Trace number 453835

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerObjective functionCPU timeWall clock time
PB-clasp 2007-03-23Wrong Cert. 1802.03 1803.73

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mds/normalized-mds_500_10_3.opb
MD5SUM31a0e10ee8ac2049545ec8eab33f6948
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark69
Best CPU time to get the best result obtained on this benchmark1800.06
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 69
Optimality of the best value was proved NO
Number of variables500
Total number of constraints500
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints500
Minimum length of a constraint11
Maximum length of a constraint23
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 500
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)6316
Sum of products size (including duplicates)12632
Number of different products6316
Sum of products size12632

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data (download as text)

1.98/2.00	o 367
3.95/4.09	o 366
6.06/6.18	o 365
8.16/8.29	o 364
10.26/10.39	o 363
12.46/12.50	o 362
14.57/14.60	o 361
16.66/16.70	o 360
18.77/18.80	o 359
20.87/20.91	o 358
22.97/23.01	o 357
24.94/25.07	o 356
27.15/27.20	o 355
29.23/29.34	o 354
31.33/31.48	o 353
33.53/33.62	o 352
35.63/35.75	o 351
37.72/37.87	o 350
39.94/40.01	o 349
42.03/42.14	o 348
44.12/44.29	o 347
46.32/46.45	o 346
48.52/48.62	o 345
50.61/50.79	o 344
52.82/52.96	o 343
55.02/55.13	o 342
57.12/57.29	o 341
59.33/59.45	o 340
61.53/61.62	o 339
63.60/63.79	o 338
65.81/65.98	o 337
68.01/68.18	o 336
70.22/70.38	o 335
72.40/72.58	o 334
74.59/74.76	o 333
76.80/76.95	o 332
79.03/79.21	o 331
81.22/81.40	o 330
83.30/83.60	o 329
85.62/85.81	o 328
87.70/87.96	o 327
89.90/90.17	o 326
92.10/92.39	o 325
94.36/94.64	o 324
96.55/96.84	o 323
98.76/99.06	o 322
100.94/101.26	o 321
103.15/103.47	o 320
105.44/105.70	o 319
107.62/107.92	o 318
109.83/110.10	o 317
112.03/112.33	o 316
114.21/114.56	o 315
116.40/116.78	o 314
118.73/119.00	o 313
120.92/121.22	o 312
123.10/123.43	o 311
125.30/125.68	o 310
127.61/127.92	o 309
129.81/130.16	o 308
132.11/132.41	o 307
134.30/134.60	o 306
136.48/136.83	o 305
138.69/139.06	o 304
140.90/141.37	o 303
143.22/143.60	o 302
145.40/145.85	o 301
147.71/148.10	o 300
149.89/150.35	o 299
152.20/152.60	o 298
154.38/154.84	o 297
156.59/157.07	o 296
158.89/159.30	o 295
161.08/161.53	o 294
163.28/163.77	o 293
165.58/166.03	o 292
167.78/168.28	o 291
170.08/170.53	o 290
172.28/172.79	o 289
174.57/175.03	o 288
176.78/177.27	o 287
179.09/179.50	o 286
181.26/181.74	o 285
183.46/183.98	o 284
185.76/186.24	o 283
187.97/188.49	o 282
190.25/190.75	o 281
192.57/193.00	o 280
194.76/195.24	o 279
196.96/197.48	o 278
199.27/199.71	o 277
201.45/201.95	o 276
203.65/204.19	o 275
205.96/206.44	o 274
208.23/208.78	o 273
210.46/211.04	o 272
212.72/213.38	o 271
214.99/215.62	o 270
217.18/217.85	o 269
219.37/220.08	o 268
221.68/222.31	o 267
223.86/224.55	o 266
226.17/226.80	o 265
228.36/229.05	o 264
230.66/231.30	o 263
232.84/233.54	o 262
235.04/235.77	o 261
237.24/237.99	o 260
239.56/240.21	o 259
241.74/242.43	o 258
243.94/244.67	o 257
246.25/246.90	o 256
248.43/249.14	o 255
250.65/251.37	o 254
252.95/253.61	o 253
255.08/255.88	o 252
257.27/258.18	o 251
259.47/260.40	o 250
261.79/262.61	o 249
263.97/264.82	o 248
266.17/267.05	o 247
268.37/269.28	o 246
270.69/271.50	o 245
272.86/273.72	o 244
275.11/276.00	o 243
277.31/278.20	o 242
279.38/280.40	o 241
281.70/282.60	o 240
283.89/284.81	o 239
286.09/287.02	o 238
288.29/289.21	o 237
290.49/291.42	o 236
292.68/293.63	o 235
294.89/295.81	o 234
296.97/297.99	o 233
299.24/300.21	o 232
301.33/302.39	o 231
303.52/304.57	o 230
305.72/306.77	o 229
307.94/308.90	o 228
310.02/311.09	o 227
312.21/313.28	o 226
314.41/315.44	o 225
316.57/317.64	o 224
318.78/319.80	o 223
320.88/321.95	o 222
323.04/324.14	o 221
325.25/326.31	o 220
327.33/328.48	o 219
329.54/330.64	o 218
331.74/332.80	o 217
333.84/334.95	o 216
335.93/337.09	o 215
338.12/339.22	o 214
340.22/341.35	o 213
342.33/343.48	o 212
344.51/345.63	o 211
346.61/347.77	o 210
348.83/349.91	o 209
350.92/352.04	o 208
353.01/354.17	o 207
355.10/356.28	o 206
357.19/358.39	o 205
359.29/360.49	o 204
361.39/362.59	o 203
363.60/364.72	o 202
365.68/366.83	o 201
367.77/368.94	o 200
369.86/371.05	o 199
371.96/373.15	o 198
374.06/375.24	o 197
376.18/377.31	o 196
378.16/379.39	o 195
380.27/381.46	o 194
382.37/383.53	o 193
384.48/385.61	o 192
386.47/387.77	o 191
388.56/389.85	o 190
390.68/391.93	o 189
392.68/393.99	o 188
394.77/396.03	o 187
396.77/398.08	o 186
398.89/400.11	o 185
400.86/402.15	o 184
402.86/404.18	o 183
404.97/406.22	o 182
406.98/408.27	o 181
408.97/410.30	o 180
411.07/412.33	o 179
413.05/414.35	o 178
415.07/416.35	o 177
417.06/418.36	o 176
419.05/420.35	o 175
421.06/422.34	o 174
423.06/424.34	o 173
425.04/426.34	o 172
427.05/428.34	o 171
429.05/430.32	o 170
431.07/432.31	o 169
432.95/434.29	o 168
434.94/436.25	o 167
436.96/438.21	o 166
438.85/440.16	o 165
440.86/442.11	o 164
442.75/444.06	o 163
444.75/446.01	o 162
446.63/447.96	o 161
448.66/449.91	o 160
450.54/451.85	o 159
452.43/453.79	o 158
454.45/455.70	o 157
456.36/457.61	o 156
458.25/459.52	o 155
460.13/461.42	o 154
462.04/463.31	o 153
463.93/465.21	o 152
465.83/467.11	o 151
467.72/469.00	o 150
469.52/470.89	o 149
471.42/472.76	o 148
473.41/474.77	o 75
484.01/485.39	o 74
869.61/871.07	o 73
1735.00/1736.60	o 72
1800.09/1801.72	c Somebody sent me a SIGTERM
1800.09/1801.72	s SATISFIABLE
1800.09/1801.72	v x1 x2 x3 x7 x8 x9 x11 x16 x17 x19 x21 x28 x30 x31 x35 x38 x40 x43 x45 x46 x48 x49 x51 x53 x55 x62 x64 x66 x67 x70 x71 x79 x84 x95 x108 x125
1800.09/1801.72	v x126 x130 x136 x144 x145 x146 x152 x160 x161 x162 x166 x168 x176 x193 x195 x213 x231 x235 x239 x244 x245 x248 x250 x251 x313 x314
1800.09/1801.72	v x319 x347 x349 x368 x424 x447 x452 x458 x465 x471 x551 x552 x554 x557 x559 x576 x585 x587 x651 x656 x688 x697 x701 x703 x707 x722
1800.09/1801.72	v x731 x739 x740 x777 x785 x786 x815 x843 x851 x860 x861 x865 x866 x874 x880 x888 x890 x892 x905 x911 x936 x961 x1001 x1011 x1013
1800.09/1801.72	v x1018 x1019 x1023 x1028 x1031 x1035 x1038 x1068 x1073 x1086 x1090 x1107 x1116 x1118 x1142 x1150 x1161 x1165 x1168 x1189 x1193
1800.09/1801.72	v x1199 x1230 x1235 x1238 x1239 x1240 x1277 x1285 x1310 x1317 x1320 x1341 x1350 x1371 x1376 x1388 x1389 x1398 x1399 x1400 x1404
1800.09/1801.72	v x1415 x1419 x1420 x1429 x1444 x1449 x1470 x1471 x1472 x1474 x1481 x1482 x1504 x1545 x1552 x1558 x1559 x1563 x1606 x1620 x1621
1800.09/1801.72	v x1624 x1632 x1646 x1648 x1659 x1660 x1662 x1667 x1674 x1685 x1689 x1696 x1699 x1718 x1719 x1720 x1721 x1725 x1740 x1746 x1747
1800.09/1801.72	v x1757 x1761 x1767 x1796 x1807 x1808 x1832 x1835 x1837 x1839 x1846 x1862 x1864 x1865 x1870 x1875 x1877 x1878 x1879 x1880 x1887
1800.09/1801.72	v x1895 x1898 x1909 x1911 x1930 x1957 x1971 x1972 x1978 x1984 x1998 x2002 x2017 x2019 x2029 x2042 x2043 x2048 x2050 x2053 x2057
1800.09/1801.72	v x2058 x2068 x2069 x2070 x2076 x2094 x2102 x2114 x2116 x2127 x2146 x2147 x2163 x2164 x2174 x2177 x2188 x2194 x2202 x2205 x2213
1800.09/1801.72	v x2223 x2239 x2250 x2254 x2255 x2257 x2266 x2269 x2278 x2280 x2286 x2292 x2293 x2302 x2311 x2325 x2341 x2344 x2354 x2394 x2396
1800.09/1801.72	v x2404 x2406 x2408 x2419 x2421 x2428 x2429 x2430 x2455 x2460 x2469 x2471 x2477 x2479 x2483 x2492 x2502 x2507 x2510 x2549 x2554
1800.09/1801.72	v x2556 x2565 x2576 x2578 x2593 x2599 x2602 x2605 x2609 x2610 x2618 x2625 x2627 x2628 x2688 x2692 x2709 x2711 x2716 x2719 x2721
1800.09/1801.72	v x2723 x2725 x2729 x2731 x2735 x2766 x2779 x2791 x2805 x2816 x2818 x2821 x2826 x2829 x2830 x2831 x2848 x2850 x2901 x2902 x2914
1800.09/1801.72	v x2919 x2928 x2929 x2940 x2958 x2986 x2987 x2991 x3001 x3012 x3013 x3035 x3038 x3039 x3051 x3054 x3056 x3074 x3078 x3098 x3107
1800.09/1801.72	v x3110 x3125 x3131 x3134 x3137 x3146 x3147 x3148 x3151 x3152 x3158 x3160 x3164 x3170 x3183 x3185 x3195 x3197 x3207 x3216 x3224
1800.09/1801.72	v x3229 x3230 x3236 x3242 x3245 x3249 x3253 x3267 x3278 x3281 x3286 x3294 x3298 x3302 x3329 x3344 x3349 x3356 x3357 x3358 x3371
1800.09/1801.72	v x3384 x3385 x3391 x3392 x3395 x3402 x3404 x3408 x3417 x3418 x3420 x3421 x3432 x3438 x3445 x3447 x3448 x3449 x3461 x3466 x3469
1800.09/1801.72	v x3474 x3475 x3482 x3488 x3489 x3491 x3497 x3502 x3506 x3511 x3528 x3535 x3540 x3550 x3552 x3553 x3554 x3581 x3583 x3594 x3609
1800.09/1801.72	v x3624 x3636 x3637 x3644 x3650 x3657 x3666 x3667 x3679 x3692 x3704 x3707 x3709 x3710 x3716 x3732 x3742 x3748 x3752 x3755 x3769
1800.09/1801.72	v x3770 x3771 x3772 x3778 x3779 x3791 x3792 x3799 x3813 x3819 x3834 x3848 x3861 x3862 x3871 x3873 x3887 x3906 x3909 x3919 x3924
1800.09/1801.72	v x3933 x3943 x3944 x3946 x3985 x3994 x4006 x4027 x4031 x4059 x4065 x4067 x4079 x4090 x4097 x4102 x4109 x4114 x4123 x4124 x4125
1800.09/1801.72	v x4129 x4135 x4145 x4148 x4152 x4161 x4171 x4172 x4173 x4183 x4191 x4204 x4216 x4217 x4238 x4247 x4255 x4267 x4269 x4270 x4271
1800.09/1801.72	v x4280 x4281 x4287 x4289 x4298 x4308 x4316 x4325 x4326 x4331 x4339 x4341 x4342 x4350 x4353 x4358 x4362 x4365 x4366 x4368 x4373
1800.09/1801.72	v x4375 x4377 x4378 x4393 x4400 x4402 x4413 x4422 x4433 x4435 x4436 x4437 x4443 x4445 x4452 x4454 x4468 x4476 x4490 x4503 x4504
1800.09/1801.72	v x4517 x4527 x4539 x4540 x4560 x4561 x4576 x4580 x4581 x4587 x4588 x4599 x4601 x4609 x4613 x4614 x4619 x4629 x4642 x4651 x4652
1800.09/1801.72	v x4653 x4665 x4669 x4676 x4678 x4694 x4695 x4698 x4699 x4708 x4710 x4711 x4712 x4713 x4718 x4720 x4723 x4724 x4725 x4726 x4734
1800.09/1801.72	v x4735 x4738 x4748 x4758 x4763 x4770 x4773 x4813 x4815 x4821 x4832 x4833 x4845 x4873 x4880 x4891 x4892 x4893 x4894 x4895 x4896
1800.09/1801.72	v x4904 x4906 x4914 x4918 x4935 x4939 x4940 x4952 x4954 x4964 x4965 x4966 x4967 x4978 x4983 x4986 x4989 x4996 x4997 x4998 x5004
1800.09/1801.72	v x5016 x5018 x5019 x5020 x5024 x5028 x5029 x5049 x5050 x5053 x5056 x5064 x5066 x5068 x5074 x5080 x5087 x5096 x5099 x5107 x5117
1800.09/1801.72	v x5129 x5141 x5152 x5161 x5165 x5167 x5192 x5207 x5208 x5223 x5224 x5231 x5236 x5241 x5251 x5252 x5262 x5263 x5264 x5268 x5274
1800.09/1801.72	v x5278 x5290 x5301 x5302 x5312 x5328 x5334 x5350 x5358 x5370 x5384 x5388 x5389 x5400 x5424 x5425 x5426 x5428 x5429 x5430 x5435
1800.09/1801.72	v x5450 x5459 x5460 x5462 x5471 x5481 x5491 x5492 x5499 x5505 x5508 x5513 x5515 x5518 x5523 x5525 x5526 x5534 x5540 x5547 x5563
1800.09/1801.72	v x5565 x5566 x5568 x5571 x5578 x5579 x5584 x5587 x5588 x5599 x5600 x5609 x5610 x5615 x5620 x5622 x5625 x5634 x5643 x5645 x5647
1800.09/1801.72	v x5649 x5650 x5657 x5670 x5682 x5687 x5688 x5689 x5697 x5699 x5707 x5708 x5713 x5719 x5732 x5733 x5734 x5743 x5753 x5761 x5765
1800.09/1801.72	v x5770 x5774 x5776 x5777 x5778 x5790 x5793 x5800 x5809 x5810 x5812 x5821 x5827 x5833 x5842 x5843 x5852 x5872 x5874 x5877 x5885
1800.09/1801.72	v x5886 x5888 x5890 x5898 x5905 x5906 x5913 x5919 x5930 x5933 x5943 x5944 x5945 x5954 x5963 x5976 x5980 x5987 x5998 x6007 x6020
1800.09/1801.72	v x6021 x6037 x6040 x6047 x6048 x6049 x6059 x6068 x6077 x6087 x6101 x6108 x6109 x6110 x6117 x6119 x6121 x6128 x6139 x6148 x6150
1800.09/1801.72	v x6153 x6160 x6169 x6170 x6174 x6175 x6179 x6187 x6189 x6190 x6198 x6202 x6205 x6206 x6213 x6224 x6226 x6236 x6250 x6253 x6255
1800.09/1801.72	v x6256 x6259 x6274 x6283 x6285 x6304 x6305 x6306 x6314 x6328 x6340 x6348 x6351 x6354 x6359 x6369 x6375 x6389 x6392 x6400 x6413
1800.09/1801.72	v x6416 x6418 x6425 x6426 x6432 x6434 x6436 x6438 x6447 x6463 x6465 x6477 x6478 x6483 x6485 x6493 x6496 x6497 x6499 x6500 x6502
1800.09/1801.72	v x6503 x6506 x6526 x6539 x6544 x6546 x6555 x6562 x6563 x6566 x6569 x6575 x6579 x6583 x6584 x6591 x6598 x6607 x6611 x6614 x6616
1800.09/1801.72	v x6621 x6624 x6625 x6627 x6635 x6646 x6654 x6665 x6682 x6686 x6687 x6700 x6706 x6716 x6726 x6729 x6732 x6738 x6745 x6746 x6749
1800.09/1801.72	v x6752 x6758 x6767 x6768 x6769 x6785 x6787 x6790 x6792 x6802 x6807 x6809
1800.09/1801.72	pb2clasp1: no process killed
1800.09/1801.73	clasp: no process killed

Verifier Data (download as text)

FAILED
ERROR: unsatisfied constraint on line 0
	0>=1

Falsified constraint is:
+1*~x4[=0]*x215[=0]+1*~x4[=0]*x137[=0]+1*~x4[=0]*x475[=0]+1*~x4[=0]*x7[=1]+1*~x4[=0]*x62[=1]+1*~x4[=0]*x416[=0]+1*~x4[=0]*x79[=1]+1*~x4[=0]*x291[=0]+1*~x4[=0]*x69[=0]+1*~x4[=0]*x195[=1]+1*~x4[=0]*x140[=0]+1*~x4[=0]*x245[=1]+1*~x4[=0]*x276[=0]+1*~x4[=0]*x281[=0]+1*~x4[=0]*x307[=0]+1*~x4[=0]*x453[=0]+1*x4[=0] >= 1 

Conversion Script Data (download as text)

Linearizing /tmp/evaluation/453835-1178158974/instance-453835-1178158974.opb

Watcher Data (download as text)

runsolver version 3.2.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node19/watcher-453835-1178158974 -o ROOT/results/node19/solver-453835-1178158974 -C 1800 -W 3600 -M 1800 --output-limit 1,15 pbclasp instance-453835-1178158974.opb /tmp/evaluation/453835-1178158974/temp 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 18114
/proc/meminfo: memFree=1596032/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12268 CPUtime=0
/proc/18114/stat : 18114 (pbclasp) R 18112 18114 13392 0 -1 4194304 350 0 0 0 0 0 0 0 18 0 1 0 263814800 12562432 317 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245466622 0 0 4224 0 0 0 0 17 1 0 0
/proc/18114/statm: 3067 317 242 3 0 167 0

[startup+0.097989 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 18114
/proc/meminfo: memFree=1596032/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12664 CPUtime=0.01
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 569 0 0 0 1 0 0 0 16 0 1 0 263814800 12967936 522 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245463650 0 0 4224 16384 18446744071563648864 0 0 17 1 0 0
/proc/18114/statm: 3166 522 324 3 0 266 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 12664

[startup+0.101987 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 18114
/proc/meminfo: memFree=1596032/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12664 CPUtime=0.01
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 569 0 0 0 1 0 0 0 16 0 1 0 263814800 12967936 522 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245463650 0 0 4224 16384 18446744071563648864 0 0 17 1 0 0
/proc/18114/statm: 3166 522 324 3 0 266 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 12664

[startup+0.302009 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 18114
/proc/meminfo: memFree=1596032/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12664 CPUtime=0.01
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 569 0 0 0 1 0 0 0 16 0 1 0 263814800 12967936 522 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245463650 0 0 4224 16384 18446744071563648864 0 0 17 1 0 0
/proc/18114/statm: 3166 522 324 3 0 266 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 12664

[startup+0.701053 s]
/proc/loadavg: 1.00 1.00 1.00 3/77 18114
/proc/meminfo: memFree=1596032/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12664 CPUtime=0.01
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 569 0 0 0 1 0 0 0 16 0 1 0 263814800 12967936 522 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245463650 0 0 4224 16384 18446744071563648864 0 0 17 1 0 0
/proc/18114/statm: 3166 522 324 3 0 266 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 12664

[startup+1.50114 s]
/proc/loadavg: 1.00 1.00 1.00 2/80 18117
/proc/meminfo: memFree=1593896/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12796 CPUtime=1.03
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 676 1591 0 0 1 0 101 1 16 0 1 0 263814800 13103104 553 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/18114/statm: 3199 553 343 3 0 299 0
Current children cumulated CPU time (s) 1.03
Current children cumulated vsize (KiB) 12796

[startup+3.10131 s]
/proc/loadavg: 1.00 1.00 1.00 2/81 18132
/proc/meminfo: memFree=1592352/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12796 CPUtime=1.99
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 829 7147 0 0 2 0 193 4 16 0 1 0 263814800 13103104 567 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/18114/statm: 3199 567 343 3 0 299 0
[pid=18130] ppid=18114 vsize=5356 CPUtime=0
/proc/18130/stat : 18130 (sh) S 18114 18114 13392 0 -1 4194304 289 122 0 0 0 0 0 0 16 0 1 0 263815002 5484544 225 18446744073709551615 4194304 4889804 548682069184 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18130/statm: 1339 225 188 169 0 50 0
[pid=18132] ppid=18130 vsize=54312 CPUtime=1.06
/proc/18132/stat : 18132 (clasp) R 18130 18114 13392 0 -1 4194304 14502 0 0 0 101 5 0 0 25 0 1 0 263815003 55615488 12697 18446744073709551615 134512640 135144128 4294956752 18446744073709551615 7949958 0 0 4096 0 0 0 0 17 1 0 0
/proc/18132/statm: 13578 12697 194 154 0 13048 0
Current children cumulated CPU time (s) 3.05
Current children cumulated vsize (KiB) 72464

[startup+6.30166 s]
/proc/loadavg: 1.00 1.00 1.00 2/80 18140
/proc/meminfo: memFree=1535592/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12796 CPUtime=6.18
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 1110 45337 0 0 6 0 587 25 16 0 1 0 263814800 13103104 573 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/18114/statm: 3199 573 343 3 0 299 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 12796

[startup+12.7014 s]
/proc/loadavg: 1.00 1.00 1.00 2/80 18164
/proc/meminfo: memFree=1531992/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12796 CPUtime=12.48
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 1499 102994 0 0 10 1 1179 58 16 0 1 0 263814800 13103104 573 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/18114/statm: 3199 573 343 3 0 299 0
Current children cumulated CPU time (s) 12.48
Current children cumulated vsize (KiB) 12796

[startup+25.5017 s]
/proc/loadavg: 1.00 1.00 1.00 2/81 18220
/proc/meminfo: memFree=1591208/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12796 CPUtime=25.04
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 2286 217894 0 0 21 1 2362 120 16 0 1 0 263814800 13103104 578 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/18114/statm: 3199 578 343 3 0 299 0
[pid=18218] ppid=18114 vsize=5356 CPUtime=0
/proc/18218/stat : 18218 (sh) S 18114 18114 13392 0 -1 4194304 288 0 0 0 0 0 0 0 18 0 1 0 263817309 5484544 225 18446744073709551615 4194304 4889804 548682069184 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18218/statm: 1339 225 188 169 0 50 0
[pid=18219] ppid=18218 vsize=2520 CPUtime=0
/proc/18219/stat : 18219 (cat) S 18218 18114 13392 0 -1 4194304 120 0 0 0 0 0 0 0 15 0 1 0 263817310 2580480 87 18446744073709551615 4194304 4211220 548682069360 18446744073709551615 255236735202 0 0 4096 0 18446744071563648864 0 0 17 1 0 0
/proc/18219/statm: 630 87 71 4 0 42 0
[pid=18220] ppid=18218 vsize=9932 CPUtime=0.4
/proc/18220/stat : 18220 (clasp) R 18218 18114 13392 0 -1 4194304 2157 0 0 0 39 1 0 0 21 0 1 0 263817310 10170368 2119 18446744073709551615 134512640 135144128 4294956752 18446744073709551615 134936710 0 0 4096 0 0 0 0 17 1 0 0
/proc/18220/statm: 2483 2119 173 154 0 1953 0
Current children cumulated CPU time (s) 25.44
Current children cumulated vsize (KiB) 30604

[startup+51.1015 s]
/proc/loadavg: 1.00 1.00 1.00 2/80 18308
/proc/meminfo: memFree=1530608/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12796 CPUtime=50.74
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 3887 450614 0 0 41 3 4786 244 16 0 1 0 263814800 13103104 578 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/18114/statm: 3199 578 343 3 0 299 0
Current children cumulated CPU time (s) 50.74
Current children cumulated vsize (KiB) 12796

[startup+102.306 s]
/proc/loadavg: 1.06 1.01 1.00 2/81 18500
/proc/meminfo: memFree=1557680/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12796 CPUtime=101.04
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 7011 931742 0 0 85 7 9503 509 16 0 1 0 263814800 13103104 578 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/18114/statm: 3199 578 343 3 0 299 0
[pid=18498] ppid=18114 vsize=5356 CPUtime=0
/proc/18498/stat : 18498 (sh) S 18114 18114 13392 0 -1 4194304 288 122 0 0 0 0 0 0 16 0 1 0 263824929 5484544 225 18446744073709551615 4194304 4889804 548682069184 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18498/statm: 1339 225 188 169 0 50 0
[pid=18500] ppid=18498 vsize=42884 CPUtime=1.01
/proc/18500/stat : 18500 (clasp) R 18498 18114 13392 0 -1 4194304 11494 0 0 0 97 4 0 0 25 0 1 0 263824929 43913216 9712 18446744073709551615 134512640 135144128 4294956752 18446744073709551615 134755009 0 0 4096 0 0 0 0 17 1 0 0
/proc/18500/statm: 10721 9712 188 154 0 10191 0
Current children cumulated CPU time (s) 102.05
Current children cumulated vsize (KiB) 61036

[startup+162.302 s]
/proc/loadavg: 1.02 1.01 1.00 2/81 18716
/proc/meminfo: memFree=1591656/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12796 CPUtime=161.15
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 10676 1516393 0 0 140 11 15132 832 16 0 1 0 263814800 13103104 578 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/18114/statm: 3199 578 343 3 0 299 0
[pid=18714] ppid=18114 vsize=5356 CPUtime=0
/proc/18714/stat : 18714 (sh) S 18114 18114 13392 0 -1 4194304 288 0 0 0 0 0 0 0 18 0 1 0 263830956 5484544 225 18446744073709551615 4194304 4889804 548682069184 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/18714/statm: 1339 225 188 169 0 50 0
[pid=18715] ppid=18714 vsize=2520 CPUtime=0
/proc/18715/stat : 18715 (cat) S 18714 18114 13392 0 -1 4194304 120 0 0 0 0 0 0 0 15 0 1 0 263830956 2580480 87 18446744073709551615 4194304 4211220 548682069360 18446744073709551615 255236735202 0 0 4096 0 18446744071563648864 0 0 17 1 0 0
/proc/18715/statm: 630 87 71 4 0 42 0
[pid=18716] ppid=18714 vsize=30328 CPUtime=0.73
/proc/18716/stat : 18716 (clasp) R 18714 18114 13392 0 -1 4194304 7316 0 0 0 71 2 0 0 23 0 1 0 263830956 31055872 7183 18446744073709551615 134512640 135144128 4294956752 18446744073709551615 134682886 0 0 4096 0 0 0 0 17 1 0 0
/proc/18716/statm: 7582 7183 184 154 0 7052 0
Current children cumulated CPU time (s) 161.88
Current children cumulated vsize (KiB) 51000

[startup+222.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/80 18924
/proc/meminfo: memFree=1522616/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12932 CPUtime=221.68
/proc/18114/stat : 18114 (pbclasp) R 18112 18114 13392 0 -1 4194304 14277 2113582 0 0 198 15 20809 1146 16 0 1 0 263814800 13242368 583 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255250599688 0 0 4224 16384 0 0 0 17 0 0 0
/proc/18114/statm: 3233 583 343 3 0 333 0
Current children cumulated CPU time (s) 221.68
Current children cumulated vsize (KiB) 12932

[startup+282.302 s]
/proc/loadavg: 1.00 1.00 1.00 2/80 19140
/proc/meminfo: memFree=1550016/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12932 CPUtime=279.52
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 17911 2695242 0 0 261 19 26215 1457 16 0 1 0 263814800 13242368 583 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/18114/statm: 3233 583 343 3 0 333 0
[pid=19138] ppid=18114 vsize=5356 CPUtime=0
/proc/19138/stat : 19138 (sh) S 18114 18114 13392 0 -1 4194304 288 122 0 0 0 0 0 0 16 0 1 0 263842842 5484544 225 18446744073709551615 4194304 4889804 548682069184 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/19138/statm: 1339 225 188 169 0 50 0
[pid=19140] ppid=19138 vsize=73368 CPUtime=1.86
/proc/19140/stat : 19140 (clasp) R 19138 18114 13392 0 -1 4194304 20829 0 0 0 177 9 0 0 25 0 1 0 263842843 75128832 17477 18446744073709551615 134512640 135144128 4294956752 18446744073709551615 134682899 0 0 4096 0 0 0 0 17 1 0 0
/proc/19140/statm: 18342 17477 196 154 0 17812 0
Current children cumulated CPU time (s) 281.38
Current children cumulated vsize (KiB) 91656

[startup+342.301 s]
/proc/loadavg: 1.00 1.00 1.00 2/81 19364
/proc/meminfo: memFree=1573824/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12932 CPUtime=340.31
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 21737 3317262 0 0 327 23 31892 1789 16 0 1 0 263814800 13242368 583 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 1 0 0
/proc/18114/statm: 3233 583 343 3 0 333 0
[pid=19362] ppid=18114 vsize=5356 CPUtime=0
/proc/19362/stat : 19362 (sh) S 18114 18114 13392 0 -1 4194304 288 0 0 0 0 0 0 0 18 0 1 0 263848938 5484544 225 18446744073709551615 4194304 4889804 548682069184 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/19362/statm: 1339 225 188 169 0 50 0
[pid=19363] ppid=19362 vsize=2520 CPUtime=0
/proc/19363/stat : 19363 (cat) S 19362 18114 13392 0 -1 4194304 120 0 0 0 0 0 0 0 15 0 1 0 263848938 2580480 87 18446744073709551615 4194304 4211220 548682069360 18446744073709551615 255236735202 0 0 4096 0 18446744071563648864 0 0 17 1 0 0
/proc/19363/statm: 630 87 71 4 0 42 0
[pid=19364] ppid=19362 vsize=38368 CPUtime=0.91
/proc/19364/stat : 19364 (clasp) R 19362 18114 13392 0 -1 4194304 9510 0 0 0 87 4 0 0 25 0 1 0 263848938 39288832 9104 18446744073709551615 134512640 135144128 4294956752 18446744073709551615 134674572 0 0 4096 0 0 0 0 17 1 0 0
/proc/19364/statm: 9592 9107 185 154 0 9062 0
Current children cumulated CPU time (s) 341.22
Current children cumulated vsize (KiB) 59176


################
# More data... #
################

Current children cumulated vsize (KiB) 295932

[startup+1722.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/80 19910
/proc/meminfo: memFree=1319016/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12932 CPUtime=869.72
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 30865 4767019 0 0 470 34 83866 2602 16 0 1 0 263814800 13242368 583 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/18114/statm: 3233 583 343 3 0 333 0
[pid=19906] ppid=18114 vsize=5356 CPUtime=0
/proc/19906/stat : 19906 (sh) S 18114 18114 13392 0 -1 4194304 288 122 0 0 0 0 0 0 16 0 1 0 263901910 5484544 225 18446744073709551615 4194304 4889804 548682069184 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/19906/statm: 1339 225 188 169 0 50 0
[pid=19908] ppid=19906 vsize=278292 CPUtime=850.97
/proc/19908/stat : 19908 (clasp) R 19906 18114 13392 0 -1 4194304 71669 0 0 0 85029 68 0 0 25 0 1 0 263901910 284971008 68053 18446744073709551615 134512640 135144128 4294956752 18446744073709551615 134741337 0 0 4096 0 0 0 0 17 1 0 0
/proc/19908/statm: 69573 68053 196 154 0 69043 0
Current children cumulated CPU time (s) 1720.69
Current children cumulated vsize (KiB) 296580

[startup+1782.3 s]
/proc/loadavg: 1.00 1.00 1.00 2/80 19918
/proc/meminfo: memFree=1545512/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12932 CPUtime=1735.03
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 30995 4840085 0 0 471 34 170320 2678 18 0 1 0 263814800 13242368 583 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/18114/statm: 3233 583 343 3 0 333 0
[pid=19916] ppid=18114 vsize=5356 CPUtime=0
/proc/19916/stat : 19916 (sh) S 18114 18114 13392 0 -1 4194304 288 122 0 0 0 0 0 0 16 0 1 0 263988463 5484544 225 18446744073709551615 4194304 4889804 548682069184 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/19916/statm: 1339 225 188 169 0 50 0
[pid=19918] ppid=19916 vsize=49516 CPUtime=45.65
/proc/19918/stat : 19918 (clasp) R 19916 18114 13392 0 -1 4194304 14406 0 0 0 4559 6 0 0 25 0 1 0 263988463 50704384 11613 18446744073709551615 134512640 135144128 4294956752 18446744073709551615 7919227 0 0 4096 0 0 0 0 17 1 0 0
/proc/19918/statm: 12379 11613 196 154 0 11849 0
Current children cumulated CPU time (s) 1780.68
Current children cumulated vsize (KiB) 67804



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1801.7 s]
/proc/loadavg: 1.00 1.00 1.00 2/80 19918
/proc/meminfo: memFree=1541224/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12932 CPUtime=1735.03
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 30995 4840085 0 0 471 34 170320 2678 18 0 1 0 263814800 13242368 583 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/18114/statm: 3233 583 343 3 0 333 0
[pid=19916] ppid=18114 vsize=5356 CPUtime=0
/proc/19916/stat : 19916 (sh) S 18114 18114 13392 0 -1 4194304 288 122 0 0 0 0 0 0 16 0 1 0 263988463 5484544 225 18446744073709551615 4194304 4889804 548682069184 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/19916/statm: 1339 225 188 169 0 50 0
[pid=19918] ppid=19916 vsize=53524 CPUtime=65.06
/proc/19918/stat : 19918 (clasp) R 19916 18114 13392 0 -1 4194304 15418 0 0 0 6499 7 0 0 25 0 1 0 263988463 54808576 12625 18446744073709551615 134512640 135144128 4294956752 18446744073709551615 134741259 0 0 4096 0 0 0 0 17 1 0 0
/proc/19918/statm: 13381 12625 196 154 0 12851 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 71812

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+1801.7 s]
/proc/loadavg: 1.00 1.00 1.00 2/80 19918
/proc/meminfo: memFree=1541224/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12932 CPUtime=1735.03
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 30995 4840085 0 0 471 34 170320 2678 18 0 1 0 263814800 13242368 583 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/18114/statm: 3233 583 343 3 0 333 0
[pid=19916] ppid=18114 vsize=5356 CPUtime=0
/proc/19916/stat : 19916 (sh) S 18114 18114 13392 0 -1 4194304 288 122 0 0 0 0 0 0 16 0 1 0 263988463 5484544 225 18446744073709551615 4194304 4889804 548682069184 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/19916/statm: 1339 225 188 169 0 50 0
[pid=19918] ppid=19916 vsize=53524 CPUtime=65.06
/proc/19918/stat : 19918 (clasp) R 19916 18114 13392 0 -1 4194304 15418 0 0 0 6499 7 0 0 25 0 1 0 263988463 54808576 12625 18446744073709551615 134512640 135144128 4294956752 18446744073709551615 134741259 0 0 4096 0 0 0 0 17 1 0 0
/proc/19918/statm: 13381 12625 196 154 0 12851 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 71812

# WARNING:
# current cumulated CPU time (1735.05 s) is less than in the last sample (1800.09 s)
# The time of a child was probably not reported to its father.
# (see the samples just above and below)
# Adding the difference (65.0399 s) to the 'lost time'.

[startup+1801.82 s]
/proc/loadavg: 1.00 1.00 1.00 2/80 19918
/proc/meminfo: memFree=1541224/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12932 CPUtime=1735.05
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 31164 4841869 0 0 471 34 170320 2680 17 0 1 0 263814800 13242368 583 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/18114/statm: 3233 583 343 3 0 333 0
Current children cumulated CPU time (s) 1735.05
Current children cumulated vsize (KiB) 12932

Sending SIGKILL to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1803 s]
/proc/loadavg: 1.00 1.00 1.00 2/81 19929
/proc/meminfo: memFree=1549920/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12932 CPUtime=1735.05
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 31164 4841869 0 0 471 34 170320 2680 17 0 1 0 263814800 13242368 583 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/18114/statm: 3233 583 343 3 0 333 0
[pid=19927] ppid=18114 vsize=5356 CPUtime=0
/proc/19927/stat : 19927 (sh) S 18114 18114 13392 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 263994975 5484544 225 18446744073709551615 4194304 4889804 548682069184 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/19927/statm: 1339 225 188 169 0 50 0
[pid=19929] ppid=19927 vsize=45280 CPUtime=1.25
/proc/19929/stat : 19929 (clasp) R 19927 18114 13392 0 -1 4194304 13181 0 0 0 119 6 0 0 25 0 1 0 263994975 46366720 10388 18446744073709551615 134512640 135144128 4294956752 18446744073709551615 134682899 0 0 4096 0 0 0 0 17 1 0 0
/proc/19929/statm: 11320 10388 196 154 0 10790 0
Current children cumulated CPU time (s) 1736.3
Current children cumulated vsize (KiB) 63568

[startup+1803.4 s]
/proc/loadavg: 1.00 1.00 1.00 2/81 19929
/proc/meminfo: memFree=1549920/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12932 CPUtime=1735.05
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 31164 4841869 0 0 471 34 170320 2680 17 0 1 0 263814800 13242368 583 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/18114/statm: 3233 583 343 3 0 333 0
[pid=19927] ppid=18114 vsize=5356 CPUtime=0
/proc/19927/stat : 19927 (sh) S 18114 18114 13392 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 263994975 5484544 225 18446744073709551615 4194304 4889804 548682069184 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/19927/statm: 1339 225 188 169 0 50 0
[pid=19929] ppid=19927 vsize=45280 CPUtime=1.64
/proc/19929/stat : 19929 (clasp) R 19927 18114 13392 0 -1 4194304 13332 0 0 0 158 6 0 0 25 0 1 0 263994975 46366720 10539 18446744073709551615 134512640 135144128 4294956752 18446744073709551615 134740801 0 0 4096 0 0 0 0 17 1 0 0
/proc/19929/statm: 11320 10539 196 154 0 10790 0
Current children cumulated CPU time (s) 1736.69
Current children cumulated vsize (KiB) 63568

[startup+1803.6 s]
/proc/loadavg: 1.00 1.00 1.00 2/81 19929
/proc/meminfo: memFree=1549920/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12932 CPUtime=1735.05
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 31164 4841869 0 0 471 34 170320 2680 17 0 1 0 263814800 13242368 583 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/18114/statm: 3233 583 343 3 0 333 0
[pid=19927] ppid=18114 vsize=5356 CPUtime=0
/proc/19927/stat : 19927 (sh) S 18114 18114 13392 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 263994975 5484544 225 18446744073709551615 4194304 4889804 548682069184 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/19927/statm: 1339 225 188 169 0 50 0
[pid=19929] ppid=19927 vsize=45280 CPUtime=1.84
/proc/19929/stat : 19929 (clasp) R 19927 18114 13392 0 -1 4194304 13334 0 0 0 178 6 0 0 25 0 1 0 263994975 46366720 10541 18446744073709551615 134512640 135144128 4294956752 18446744073709551615 134629605 0 0 4096 0 0 0 0 17 1 0 0
/proc/19929/statm: 11320 10541 196 154 0 10790 0
Current children cumulated CPU time (s) 1736.89
Current children cumulated vsize (KiB) 63568

[startup+1803.7 s]
/proc/loadavg: 1.00 1.00 1.00 2/81 19929
/proc/meminfo: memFree=1549920/2055920 swapFree=4153644/4192956
[pid=18114] ppid=18112 vsize=12932 CPUtime=1735.05
/proc/18114/stat : 18114 (pbclasp) S 18112 18114 13392 0 -1 4194304 31164 4841869 0 0 471 34 170320 2680 17 0 1 0 263814800 13242368 583 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 255245467540 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/18114/statm: 3233 583 343 3 0 333 0
[pid=19927] ppid=18114 vsize=5356 CPUtime=0
/proc/19927/stat : 19927 (sh) S 18114 18114 13392 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 263994975 5484544 225 18446744073709551615 4194304 4889804 548682069184 18446744073709551615 255236563780 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/19927/statm: 1339 225 188 169 0 50 0
[pid=19929] ppid=19927 vsize=45280 CPUtime=1.94
/proc/19929/stat : 19929 (clasp) R 19927 18114 13392 0 -1 4194304 13335 0 0 0 188 6 0 0 25 0 1 0 263994975 46366720 10542 18446744073709551615 134512640 135144128 4294956752 18446744073709551615 134629611 0 0 4096 0 0 0 0 17 1 0 0
/proc/19929/statm: 11320 10542 196 154 0 10790 0
Current children cumulated CPU time (s) 1736.99
Current children cumulated vsize (KiB) 63568

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 18114 and gives
#  childrusage.ru_utime.tv_sec=1707
#  childrusage.ru_utime.tv_usec=921356
#  childrusage.ru_stime.tv_sec=27
#  childrusage.ru_stime.tv_usec=156871
# CPU time returned by wait4() is 1735.08
# while last known CPU time is 1736.99
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...


# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 65.0399
#  lost CPU user time (s): 64.99
#  lost CPU system time (s): 0.0500011

Real time (s): 1803.73
CPU time (s): 1802.03
CPU user time (s): 1774.78
CPU system time (s): 27.25
CPU usage (%): 99.9056
Max. virtual memory (cumulated for all children) (KiB): 296724

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1707.92
system time used= 27.1569
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4873606
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 44546
involuntary context switches= 32526

runsolver used 1.58376 second user time and 5.00924 second system time

The end

Launcher Data (download as text)

Begin job on node19 on Thu May  3 02:22:54 UTC 2007

IDJOB= 453835
IDBENCH= 48157
IDSOLVER= 158
FILE ID= node19/453835-1178158974

PBS_JOBID= 4751077

Free space on /tmp= 66563 MiB

SOLVER NAME= PB-clasp 2007-03-23
BENCH NAME= HOME/pub/bench/PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mds/normalized-mds_500_10_3.opb
COMMAND LINE= pbclasp instance-453835-1178158974.opb /tmp/evaluation/453835-1178158974/temp
CONVERSION COMMAND LINE= runsolver -w ROOT/results/node19/convwatcher-453835-1178158974 -o ROOT/results/node19/conversion-453835-1178158974 -C 600 -M 1800 PBconversionToLinear /tmp/evaluation/453835-1178158974/instance-453835-1178158974.opb
CONVERSION RUNSOLVER STATUS CODE= 0
CONVERSION STATUS CODE= 0

RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node19/watcher-453835-1178158974 -o ROOT/results/node19/solver-453835-1178158974 -C 1800 -W 3600 -M 1800 --output-limit 1,15  pbclasp instance-453835-1178158974.opb /tmp/evaluation/453835-1178158974/temp

META MD5SUM SOLVER= 814f1745fa20958d8b352781cfa0403e
MD5SUM BENCH=  31a0e10ee8ac2049545ec8eab33f6948

RANDOM SEED= 49010105

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB

Linux node19.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.213
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.213
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1596504 kB
Buffers:        108992 kB
Cached:         231364 kB
SwapCached:       8416 kB
Active:         139004 kB
Inactive:       233864 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1596504 kB
SwapTotal:     4192956 kB
SwapFree:      4153644 kB
Dirty:            1628 kB
Writeback:           0 kB
Mapped:          30784 kB
Slab:            72140 kB
Committed_AS:  8870044 kB
PageTables:       1788 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66562 MiB

End job on node19 on Thu May  3 02:52:58 UTC 2007