Trace number 453889

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds, and are wall clock time (not CPU time).

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerObjective functionCPU timeWall clock time
PB-clasp 2007-04-10Wrong Cert. 1802.05 1802.73

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mds/normalized-mds_500_25_5.opb
MD5SUMb1035f5aebd5cbd90440f32e03bdad12
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark37
Best CPU time to get the best result obtained on this benchmark1800.11
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 37
Optimality of the best value was proved NO
Number of variables500
Total number of constraints500
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints500
Minimum length of a constraint26
Maximum length of a constraint48
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 500
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)15706
Sum of products size (including duplicates)31412
Number of different products15706
Sum of products size31412

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data (download as text)

3.36/3.47	o 52
4.36/4.43	o 51
4.44/5.39	o 50
6.47/6.54	o 49
7.58/7.68	o 46
10.07/10.15	o 45
16.16/16.22	o 44
31.44/31.52	o 43
68.54/68.65	o 42
1800.05/1800.72	c Somebody sent me a SIGTERM
1800.05/1800.72	s SATISFIABLE
1800.05/1800.72	v x5 x16 x64 x69 x90 x114 x138 x147 x152 x191 x195 x198 x220 x230 x232 x243 x265 x282 x307 x326 x351 x391 x393 x408 x415 x417 x421
1800.05/1800.72	v x442 x448 x451 x455 x458 x463 x467 x474 x479 x482 x488 x490 x494 x497 x499 x507 x520 x573 x587 x595 x624 x630 x635 x642 x661 x713
1800.05/1800.72	v x727 x755 x760 x766 x779 x780 x781 x782 x812 x823 x841 x864 x874 x879 x916 x922 x926 x927 x943 x947 x969 x979 x987 x995 x1005
1800.05/1800.72	v x1019 x1027 x1038 x1056 x1074 x1079 x1086 x1091 x1104 x1168 x1198 x1204 x1212 x1252 x1254 x1258 x1259 x1273 x1291 x1305 x1324
1800.05/1800.72	v x1331 x1344 x1347 x1352 x1366 x1394 x1403 x1454 x1459 x1476 x1480 x1481 x1494 x1495 x1519 x1528 x1547 x1550 x1577 x1587 x1608
1800.05/1800.72	v x1609 x1614 x1617 x1629 x1634 x1657 x1664 x1684 x1692 x1720 x1726 x1741 x1757 x1768 x1783 x1785 x1832 x1846 x1851 x1854 x1856
1800.05/1800.72	v x1876 x1878 x1881 x1903 x1921 x1922 x1937 x1942 x1970 x1982 x1993 x1995 x2000 x2030 x2040 x2055 x2066 x2106 x2116 x2126 x2135
1800.05/1800.72	v x2136 x2150 x2152 x2165 x2169 x2207 x2210 x2212 x2224 x2238 x2245 x2253 x2280 x2284 x2289 x2307 x2309 x2311 x2327 x2333 x2358
1800.05/1800.72	v x2363 x2366 x2368 x2376 x2393 x2431 x2457 x2471 x2488 x2505 x2516 x2567 x2569 x2579 x2580 x2584 x2592 x2597 x2607 x2641 x2659
1800.05/1800.72	v x2665 x2671 x2677 x2684 x2701 x2713 x2728 x2737 x2740 x2756 x2765 x2801 x2816 x2838 x2854 x2877 x2889 x2904 x2908 x2910 x2915
1800.05/1800.72	v x2968 x3001 x3009 x3026 x3028 x3035 x3037 x3045 x3051 x3057 x3058 x3065 x3067 x3082 x3088 x3174 x3179 x3188 x3205 x3206 x3252
1800.05/1800.72	v x3269 x3277 x3282 x3285 x3315 x3329 x3332 x3341 x3370 x3371 x3373 x3375 x3392 x3432 x3436 x3439 x3441 x3450 x3482 x3484 x3496
1800.05/1800.72	v x3500 x3508 x3525 x3554 x3561 x3573 x3583 x3596 x3624 x3629 x3653 x3667 x3679 x3693 x3694 x3698 x3738 x3757 x3764 x3773 x3776
1800.05/1800.72	v x3795 x3815 x3823 x3828 x3845 x3850 x3873 x3894 x3947 x3982 x3986 x3989 x4008 x4043 x4053 x4069 x4075 x4084 x4087 x4095 x4108
1800.05/1800.72	v x4111 x4112 x4147 x4153 x4173 x4177 x4185 x4189 x4192 x4214 x4217 x4218 x4234 x4236 x4241 x4247 x4253 x4259 x4260 x4282 x4298
1800.05/1800.72	v x4312 x4330 x4334 x4339 x4362 x4370 x4375 x4383 x4408 x4416 x4421 x4427 x4453 x4456 x4462 x4468 x4478 x4482 x4497 x4498 x4529
1800.05/1800.72	v x4533 x4540 x4558 x4567 x4583 x4606 x4621 x4623 x4650 x4651 x4661 x4665 x4666 x4681 x4687 x4699 x4700 x4709 x4742 x4743 x4748
1800.05/1800.72	v x4763 x4799 x4805 x4818 x4822 x4836 x4837 x4898 x4900 x4903 x4904 x4920 x4937 x4948 x4972 x4977 x4991 x5017 x5023 x5026 x5067
1800.05/1800.72	v x5085 x5126 x5132 x5148 x5158 x5169 x5187 x5195 x5200 x5204 x5205 x5212 x5215 x5243 x5260 x5301 x5323 x5334 x5345 x5376 x5379
1800.05/1800.72	v x5380 x5396 x5404 x5442 x5468 x5475 x5505 x5537 x5583 x5584 x5589 x5635 x5643 x5656 x5696 x5709 x5745 x5753 x5757 x5786 x5792
1800.05/1800.72	v x5801 x5810 x5819 x5833 x5836 x5842 x5852 x5871 x5879 x5883 x5896 x5901 x5918 x5965 x5990 x6009 x6015 x6022 x6073 x6074 x6077
1800.05/1800.72	v x6143 x6144 x6156 x6159 x6164 x6202 x6207 x6214 x6230 x6236 x6243 x6253 x6273 x6277 x6289 x6292 x6331 x6336 x6343 x6351 x6368
1800.05/1800.72	v x6373 x6409 x6420 x6424 x6433 x6442 x6450 x6451 x6471 x6472 x6477 x6493 x6510 x6517 x6522 x6549 x6552 x6583 x6592 x6594 x6595
1800.05/1800.72	v x6607 x6623 x6626 x6631 x6633 x6649 x6653 x6658 x6664 x6670 x6692 x6695 x6706 x6730 x6735 x6741 x6752 x6759 x6762 x6775 x6793
1800.05/1800.72	v x6801 x6802 x6822 x6826 x6830 x6839 x6844 x6848 x6858 x6860 x6862 x6875 x6897 x6902 x6921 x6928 x6934 x6938 x6972 x6989 x6992
1800.05/1800.72	v x7006 x7020 x7021 x7030 x7033 x7039 x7053 x7057 x7066 x7090 x7123 x7156 x7180 x7184 x7197 x7209 x7216 x7243 x7250 x7260 x7303
1800.05/1800.72	v x7316 x7365 x7382 x7391 x7394 x7454 x7460 x7472 x7475 x7480 x7497 x7516 x7521 x7525 x7576 x7577 x7581 x7620 x7656 x7668 x7669
1800.05/1800.72	v x7686 x7703 x7709 x7717 x7722 x7729 x7778 x7804 x7829 x7864 x7872 x7883 x7888 x7910 x7916 x7935 x7948 x7969 x7976 x7993 x8004
1800.05/1800.72	v x8009 x8030 x8046 x8054 x8088 x8090 x8092 x8123 x8129 x8133 x8136 x8147 x8154 x8168 x8222 x8223 x8225 x8231 x8234 x8248 x8251
1800.05/1800.72	v x8256 x8268 x8275 x8287 x8299 x8300 x8301 x8318 x8334 x8371 x8388 x8398 x8399 x8413 x8417 x8420 x8428 x8445 x8455 x8456 x8460
1800.05/1800.72	v x8481 x8504 x8542 x8551 x8564 x8585 x8590 x8602 x8610 x8614 x8617 x8627 x8635 x8647 x8653 x8654 x8724 x8762 x8795 x8804 x8810
1800.05/1800.72	v x8823 x8845 x8882 x8894 x8905 x8939 x8949 x8956 x8960 x8964 x8969 x8972 x8987 x8992 x9019 x9032 x9037 x9054 x9114 x9139 x9145
1800.05/1800.72	v x9148 x9185 x9188 x9189 x9196 x9199 x9232 x9246 x9258 x9293 x9294 x9304 x9336 x9348 x9351 x9387 x9394 x9416 x9429 x9432 x9444
1800.05/1800.72	v x9450 x9455 x9472 x9500 x9517 x9518 x9519 x9521 x9529 x9543 x9566 x9568 x9575 x9578 x9608 x9610 x9624 x9639 x9660 x9696 x9698
1800.05/1800.72	v x9699 x9709 x9723 x9724 x9725 x9792 x9795 x9804 x9810 x9834 x9841 x9853 x9878 x9883 x9922 x9950 x9968 x9995 x10002 x10003
1800.05/1800.72	v x10021 x10024 x10025 x10035 x10051 x10057 x10085 x10099 x10109 x10117 x10123 x10143 x10173 x10184 x10196 x10232 x10233
1800.05/1800.72	v x10241 x10282 x10286 x10292 x10300 x10305 x10313 x10318 x10324 x10330 x10342 x10346 x10350 x10365 x10372 x10390 x10406
1800.05/1800.72	v x10419 x10435 x10453 x10457 x10473 x10484 x10494 x10497 x10503 x10526 x10530 x10537 x10538 x10540 x10545 x10547 x10561
1800.05/1800.72	v x10593 x10605 x10619 x10627 x10643 x10661 x10687 x10698 x10703 x10713 x10715 x10723 x10734 x10740 x10745 x10752 x10762
1800.05/1800.72	v x10793 x10800 x10808 x10840 x10855 x10866 x10899 x10920 x10933 x10937 x10964 x10969 x10972 x10981 x10991 x10992 x11033
1800.05/1800.72	v x11048 x11052 x11054 x11071 x11075 x11081 x11106 x11110 x11122 x11166 x11170 x11185 x11219 x11225 x11226 x11227 x11244
1800.05/1800.72	v x11256 x11269 x11274 x11276 x11289 x11295 x11306 x11323 x11326 x11346 x11349 x11352 x11369 x11400 x11402 x11425 x11452
1800.05/1800.72	v x11463 x11483 x11499 x11506 x11507 x11508 x11509 x11511 x11527 x11535 x11575 x11586 x11591 x11600 x11616 x11636 x11643
1800.05/1800.72	v x11648 x11657 x11668 x11696 x11709 x11729 x11752 x11766 x11794 x11810 x11813 x11820 x11831 x11834 x11858 x11876 x11899
1800.05/1800.72	v x11902 x11930 x11935 x11943 x11948 x11955 x11957 x11966 x11975 x11990 x12006 x12010 x12023 x12031 x12043 x12067 x12083
1800.05/1800.72	v x12093 x12110 x12152 x12175 x12193 x12221 x12228 x12236 x12269 x12274 x12281 x12288 x12289 x12300 x12327 x12334 x12352
1800.05/1800.72	v x12358 x12370 x12401 x12422 x12439 x12459 x12471 x12485 x12494 x12506 x12509 x12522 x12537 x12541 x12546 x12554 x12557
1800.05/1800.72	v x12567 x12568 x12572 x12574 x12586 x12601 x12629 x12638 x12663 x12672 x12683 x12707 x12725 x12741 x12743 x12764 x12771
1800.05/1800.72	v x12781 x12789 x12808 x12812 x12814 x12815 x12822 x12823 x12848 x12860 x12883 x12889 x12900 x12901 x12905 x12908 x12922
1800.05/1800.72	v x12941 x12944 x12967 x12972 x12980 x12983 x13002 x13008 x13009 x13010 x13012 x13024 x13039 x13067 x13096 x13106 x13109
1800.05/1800.72	v x13122 x13147 x13148 x13150 x13151 x13168 x13177 x13182 x13191 x13204 x13205 x13215 x13230 x13231 x13234 x13236 x13260
1800.05/1800.72	v x13284 x13288 x13295 x13303 x13325 x13333 x13334 x13338 x13339 x13376 x13386 x13393 x13438 x13442 x13449 x13457 x13467
1800.05/1800.72	v x13471 x13496 x13501 x13556 x13563 x13579 x13581 x13582 x13583 x13599 x13600 x13605 x13611 x13633 x13641 x13662 x13664
1800.05/1800.72	v x13683 x13689 x13690 x13715 x13728 x13729 x13733 x13743 x13756 x13781 x13786 x13797 x13838 x13844 x13878 x13879 x13903
1800.05/1800.72	v x13904 x13905 x13910 x13930 x13956 x13957 x13964 x13985 x14035 x14039 x14041 x14077 x14085 x14117 x14148 x14177 x14183
1800.05/1800.72	v x14200 x14206 x14224 x14225 x14244 x14270 x14273 x14288 x14289 x14302 x14304 x14305 x14337 x14353 x14354 x14366 x14396
1800.05/1800.72	v x14407 x14428 x14433 x14458 x14460 x14462 x14485 x14487 x14488 x14489 x14491 x14518 x14527 x14529 x14544 x14546 x14569
1800.05/1800.72	v x14571 x14596 x14605 x14627 x14641 x14648 x14674 x14697 x14749 x14750 x14774 x14792 x14818 x14822 x14828 x14858 x14896
1800.05/1800.72	v x14898 x14907 x14909 x14910 x14930 x14963 x14988 x14996 x15003 x15014 x15015 x15016 x15032 x15077 x15083 x15118 x15150
1800.05/1800.72	v x15151 x15158 x15193 x15220 x15230 x15240 x15245 x15293 x15296 x15308 x15330 x15338 x15339 x15343 x15346 x15400 x15407
1800.05/1800.72	v x15408 x15414 x15420 x15450 x15475 x15480 x15496 x15499 x15524 x15578 x15588 x15599 x15602 x15605 x15612 x15623 x15629
1800.05/1800.72	v x15652 x15654 x15697 x15730 x15770 x15785 x15808 x15810 x15822 x15855 x15876 x15880 x15907 x15920 x15922 x15930 x15977
1800.05/1800.72	v x15979 x16003 x16016 x16030 x16073 x16095 x16145 x16148 x16153 x16156 x16184 x16200
1800.05/1800.72	pb2clasp1: no process killed
1800.05/1800.73	clasp-1.0: no process killed
70.58/1802.72	sh: line 1: 22241 Done                    cat /tmp/evaluation/453889-1178163150/temp/instance-453889-1178163150.opb.op
70.58/1802.72	     22242 Killed                  | clasp-1.0 --trans=no >/tmp/evaluation/453889-1178163150/temp/instance-453889-1178163150.opb.clasp

Verifier Data (download as text)

FAILED
ERROR: unsatisfied constraint on line 0
	0>=1

Falsified constraint is:
+1*~x1[=0]*x176[=0]+1*~x1[=0]*x266[=0]+1*~x1[=0]*x111[=0]+1*~x1[=0]*x73[=0]+1*~x1[=0]*x277[=0]+1*~x1[=0]*x133[=0]+1*~x1[=0]*x421[=1]+1*~x1[=0]*x150[=0]+1*~x1[=0]*x74[=0]+1*~x1[=0]*x382[=0]+1*~x1[=0]*x27[=0]+1*~x1[=0]*x349[=0]+1*~x1[=0]*x361[=0]+1*~x1[=0]*x199[=0]+1*~x1[=0]*x411[=0]+1*~x1[=0]*x21[=0]+1*~x1[=0]*x227[=0]+1*~x1[=0]*x329[=0]+1*~x1[=0]*x487[=0]+1*~x1[=0]*x415[=1]+1*~x1[=0]*x6[=0]+1*~x1[=0]*x180[=0]+1*~x1[=0]*x374[=0]+1*~x1[=0]*x332[=0]+1*~x1[=0]*x461[=0]+1*~x1[=0]*x17[=0]+1*~x1[=0]*x72[=0]+1*~x1[=0]*x81[=0]+1*~x1[=0]*x95[=0]+1*~x1[=0]*x98[=0]+1*~x1[=0]*x149[=0]+1*~x1[=0]*x181[=0]+1*~x1[=0]*x231[=0]+1*~x1[=0]*x239[=0]+1*~x1[=0]*x367[=0]+1*~x1[=0]*x378[=0]+1*x1[=0] >= 1

Conversion Script Data (download as text)

Linearizing /tmp/evaluation/453889-1178163150/instance-453889-1178163150.opb

Watcher Data (download as text)

runsolver version 3.2.3 (c) roussel@cril.univ-artois.fr

command line: runsolver --timestamp -w ROOT/results/node7/watcher-453889-1178163150 -o ROOT/results/node7/solver-453889-1178163150 -C 1800 -W 3600 -M 1800 --output-limit 1,15 pbclasp instance-453889-1178163150.opb /tmp/evaluation/453889-1178163150/temp 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 3600 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Solver output will be limited to a maximum of 15728640 bytes. The first 1048576 bytes and the last 14680064 bytes will be preserved
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 0.99 3/77 21949
/proc/meminfo: memFree=1607080/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=12268 CPUtime=0
/proc/21949/stat : 21949 (pbclasp) D 21947 21949 17046 0 -1 4194304 350 0 0 0 0 0 0 0 18 0 1 0 292352699 12562432 317 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244671281765 0 2147483391 4224 0 18446744072099781622 0 0 17 1 0 0
/proc/21949/statm: 3067 317 242 3 0 167 0

[startup+0.0365889 s]
/proc/loadavg: 0.92 0.98 0.99 3/77 21949
/proc/meminfo: memFree=1607080/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13060 CPUtime=0.01
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 642 0 0 0 1 0 0 0 16 0 1 0 292352699 13373440 595 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680011874 0 0 4224 16384 18446744071563648864 0 0 17 1 0 0
/proc/21949/statm: 3265 595 324 3 0 365 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 13060

[startup+0.102592 s]
/proc/loadavg: 0.92 0.98 0.99 3/77 21949
/proc/meminfo: memFree=1607080/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13060 CPUtime=0.01
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 642 0 0 0 1 0 0 0 16 0 1 0 292352699 13373440 595 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680011874 0 0 4224 16384 18446744071563648864 0 0 17 1 0 0
/proc/21949/statm: 3265 595 324 3 0 365 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 13060

[startup+0.301614 s]
/proc/loadavg: 0.92 0.98 0.99 3/77 21949
/proc/meminfo: memFree=1607080/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13060 CPUtime=0.01
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 642 0 0 0 1 0 0 0 16 0 1 0 292352699 13373440 595 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680011874 0 0 4224 16384 18446744071563648864 0 0 17 1 0 0
/proc/21949/statm: 3265 595 324 3 0 365 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 13060

[startup+0.701655 s]
/proc/loadavg: 0.92 0.98 0.99 3/77 21949
/proc/meminfo: memFree=1607080/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13060 CPUtime=0.01
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 642 0 0 0 1 0 0 0 16 0 1 0 292352699 13373440 595 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680011874 0 0 4224 16384 18446744071563648864 0 0 17 1 0 0
/proc/21949/statm: 3265 595 324 3 0 365 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 13060

[startup+1.50174 s]
/proc/loadavg: 0.92 0.98 0.99 2/80 21952
/proc/meminfo: memFree=1604624/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13060 CPUtime=0.01
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 642 0 0 0 1 0 0 0 16 0 1 0 292352699 13373440 595 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680011874 0 0 4224 16384 18446744071563648864 0 0 17 1 0 0
/proc/21949/statm: 3265 595 324 3 0 365 0
[pid=21951] ppid=21949 vsize=5356 CPUtime=0
/proc/21951/stat : 21951 (sh) S 21949 21949 17046 0 -1 4194304 278 0 0 0 0 0 0 0 18 0 1 0 292352702 5484544 231 18446744073709551615 4194304 4889804 548682069232 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/21951/statm: 1339 231 193 169 0 50 0
[pid=21952] ppid=21951 vsize=12400 CPUtime=1.46
/proc/21952/stat : 21952 (pb2clasp1) R 21951 21949 17046 0 -1 4194304 501 0 0 0 146 0 0 0 25 0 1 0 292352702 12697600 463 18446744073709551615 4194304 4206940 548682069264 18446744073709551615 244691441167 0 0 4224 0 0 0 0 17 1 0 0
/proc/21952/statm: 3100 463 340 3 0 200 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 30816

[startup+3.10191 s]
/proc/loadavg: 0.92 0.98 0.99 2/80 21952
/proc/meminfo: memFree=1604048/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13060 CPUtime=2.51
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 750 1593 0 0 2 0 247 2 17 0 1 0 292352699 13373440 626 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3265 626 343 3 0 365 0
Current children cumulated CPU time (s) 2.51
Current children cumulated vsize (KiB) 13060

[startup+6.30124 s]
/proc/loadavg: 0.93 0.98 0.99 2/79 21977
/proc/meminfo: memFree=1602264/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13060 CPUtime=5.4
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 1134 23575 0 0 6 0 515 19 17 0 1 0 292352699 13373440 643 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3265 643 343 3 0 365 0
Current children cumulated CPU time (s) 5.4
Current children cumulated vsize (KiB) 13060

[startup+12.7019 s]
/proc/loadavg: 0.93 0.98 0.99 2/80 22007
/proc/meminfo: memFree=1581392/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=10.16
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 1569 45595 0 0 10 1 969 36 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22005] ppid=21949 vsize=5356 CPUtime=0
/proc/22005/stat : 22005 (sh) S 21949 21949 17046 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 292353717 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22005/statm: 1339 225 188 169 0 50 0
[pid=22007] ppid=22005 vsize=23212 CPUtime=2.51
/proc/22007/stat : 22007 (clasp-1.0) R 22005 21949 17046 0 -1 4194304 5973 0 0 0 249 2 0 0 25 0 1 0 292353717 23769088 5365 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 134617548 0 0 4096 0 0 0 0 17 1 0 0
/proc/22007/statm: 5803 5365 249 81 0 5177 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 41764

[startup+25.5023 s]
/proc/loadavg: 0.95 0.98 0.99 2/80 22015
/proc/meminfo: memFree=1581336/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=16.22
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 1713 52936 0 0 11 1 1569 41 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22013] ppid=21949 vsize=5356 CPUtime=0
/proc/22013/stat : 22013 (sh) S 21949 21949 17046 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 292354324 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22013/statm: 1339 225 188 169 0 50 0
[pid=22015] ppid=22013 vsize=23676 CPUtime=9.22
/proc/22015/stat : 22015 (clasp-1.0) R 22013 21949 17046 0 -1 4194304 6075 0 0 0 919 3 0 0 25 0 1 0 292354324 24244224 5467 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 134616619 0 0 4096 0 0 0 0 17 1 0 0
/proc/22015/statm: 5919 5467 249 81 0 5293 0
Current children cumulated CPU time (s) 25.44
Current children cumulated vsize (KiB) 42228

[startup+51.103 s]
/proc/loadavg: 0.96 0.98 0.99 2/80 22023
/proc/meminfo: memFree=1573976/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=31.51
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 1863 61389 0 0 13 1 3089 48 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22021] ppid=21949 vsize=5356 CPUtime=0
/proc/22021/stat : 22021 (sh) S 21949 21949 17046 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 292355853 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22021/statm: 1339 225 188 169 0 50 0
[pid=22023] ppid=22021 vsize=31072 CPUtime=19.53
/proc/22023/stat : 22023 (clasp-1.0) R 22021 21949 17046 0 -1 4194304 7936 0 0 0 1949 4 0 0 25 0 1 0 292355854 31817728 7328 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 134616619 0 0 4096 0 0 0 0 17 1 0 0
/proc/22023/statm: 7768 7328 249 81 0 7142 0
Current children cumulated CPU time (s) 51.04
Current children cumulated vsize (KiB) 49624

[startup+102.305 s]
/proc/loadavg: 0.98 0.98 0.99 2/80 22031
/proc/meminfo: memFree=1568472/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.62
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2008 73224 0 0 14 1 6790 57 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22029] ppid=21949 vsize=5356 CPUtime=0
/proc/22029/stat : 22029 (sh) S 21949 21949 17046 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 292359566 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22029/statm: 1339 225 188 169 0 50 0
[pid=22031] ppid=22029 vsize=36384 CPUtime=33.6
/proc/22031/stat : 22031 (clasp-1.0) R 22029 21949 17046 0 -1 4194304 9255 0 0 0 3355 5 0 0 25 0 1 0 292359567 37257216 8647 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 134617515 0 0 4096 0 0 0 0 17 1 0 0
/proc/22031/statm: 9096 8647 249 81 0 8470 0
Current children cumulated CPU time (s) 102.22
Current children cumulated vsize (KiB) 54936

[startup+162.303 s]
/proc/loadavg: 0.99 0.98 0.99 2/80 22033
/proc/meminfo: memFree=1550616/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.62
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2008 73224 0 0 14 1 6790 57 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22029] ppid=21949 vsize=5356 CPUtime=0
/proc/22029/stat : 22029 (sh) S 21949 21949 17046 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 292359566 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22029/statm: 1339 225 188 169 0 50 0
[pid=22031] ppid=22029 vsize=54468 CPUtime=93.59
/proc/22031/stat : 22031 (clasp-1.0) R 22029 21949 17046 0 -1 4194304 13905 0 0 0 9350 9 0 0 25 0 1 0 292359567 55775232 13125 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 134616619 0 0 4096 0 0 0 0 17 1 0 0
/proc/22031/statm: 13617 13125 249 81 0 12991 0
Current children cumulated CPU time (s) 162.21
Current children cumulated vsize (KiB) 73020

[startup+222.303 s]
/proc/loadavg: 0.99 0.98 0.99 2/80 22033
/proc/meminfo: memFree=1544984/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.62
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2008 73224 0 0 14 1 6790 57 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22029] ppid=21949 vsize=5356 CPUtime=0
/proc/22029/stat : 22029 (sh) S 21949 21949 17046 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 292359566 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22029/statm: 1339 225 188 169 0 50 0
[pid=22031] ppid=22029 vsize=59996 CPUtime=153.57
/proc/22031/stat : 22031 (clasp-1.0) R 22029 21949 17046 0 -1 4194304 15271 0 0 0 15347 10 0 0 25 0 1 0 292359567 61435904 14491 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 134735814 0 0 4096 0 0 0 0 17 1 0 0
/proc/22031/statm: 14999 14491 249 81 0 14373 0
Current children cumulated CPU time (s) 222.19
Current children cumulated vsize (KiB) 78548

[startup+282.302 s]
/proc/loadavg: 0.99 0.98 0.99 2/80 22033
/proc/meminfo: memFree=1526744/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.62
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2008 73224 0 0 14 1 6790 57 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22029] ppid=21949 vsize=5356 CPUtime=0
/proc/22029/stat : 22029 (sh) S 21949 21949 17046 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 292359566 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22029/statm: 1339 225 188 169 0 50 0
[pid=22031] ppid=22029 vsize=78556 CPUtime=213.55
/proc/22031/stat : 22031 (clasp-1.0) R 22029 21949 17046 0 -1 4194304 20920 0 0 0 21340 15 0 0 25 0 1 0 292359567 80441344 19090 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 134616619 0 0 4096 0 0 0 0 17 1 0 0
/proc/22031/statm: 19639 19090 249 81 0 19013 0
Current children cumulated CPU time (s) 282.17
Current children cumulated vsize (KiB) 97108

[startup+342.303 s]
/proc/loadavg: 0.99 0.98 0.99 2/80 22033
/proc/meminfo: memFree=1522456/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.62
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2008 73224 0 0 14 1 6790 57 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0

################
# More data... #
################

/proc/22029/statm: 1339 225 188 169 0 50 0
[pid=22031] ppid=22029 vsize=125648 CPUtime=1533.18
/proc/22031/stat : 22031 (clasp-1.0) R 22029 21949 17046 0 -1 4194304 33241 0 0 0 153284 34 0 0 25 0 1 0 292359567 128663552 30489 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 134784634 0 0 4096 0 0 0 0 17 1 0 0
/proc/22031/statm: 31412 30489 249 81 0 30786 0
Current children cumulated CPU time (s) 1601.8
Current children cumulated vsize (KiB) 144200

[startup+1662.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/80 22033
/proc/meminfo: memFree=1478872/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.62
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2008 73224 0 0 14 1 6790 57 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22029] ppid=21949 vsize=5356 CPUtime=0
/proc/22029/stat : 22029 (sh) S 21949 21949 17046 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 292359566 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22029/statm: 1339 225 188 169 0 50 0
[pid=22031] ppid=22029 vsize=127560 CPUtime=1593.16
/proc/22031/stat : 22031 (clasp-1.0) R 22029 21949 17046 0 -1 4194304 33713 0 0 0 159281 35 0 0 25 0 1 0 292359567 130621440 30961 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 134784653 0 0 4096 0 0 0 0 17 1 0 0
/proc/22031/statm: 31890 30961 249 81 0 31264 0
Current children cumulated CPU time (s) 1661.78
Current children cumulated vsize (KiB) 146112

[startup+1722.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/86 22107
/proc/meminfo: memFree=1477736/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.62
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2008 73224 0 0 14 1 6790 57 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22029] ppid=21949 vsize=5356 CPUtime=0
/proc/22029/stat : 22029 (sh) S 21949 21949 17046 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 292359566 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22029/statm: 1339 225 188 169 0 50 0
[pid=22031] ppid=22029 vsize=127316 CPUtime=1653.11
/proc/22031/stat : 22031 (clasp-1.0) R 22029 21949 17046 0 -1 4194304 33713 0 0 0 165276 35 0 0 25 0 1 0 292359567 130371584 30906 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 134714356 0 0 4096 0 0 0 0 17 1 0 0
/proc/22031/statm: 31829 30906 249 81 0 31203 0
Current children cumulated CPU time (s) 1721.73
Current children cumulated vsize (KiB) 145868

[startup+1782.3 s]
/proc/loadavg: 0.99 0.98 0.99 2/80 22231
/proc/meminfo: memFree=1478872/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.62
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2008 73224 0 0 14 1 6790 57 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22029] ppid=21949 vsize=5356 CPUtime=0
/proc/22029/stat : 22029 (sh) S 21949 21949 17046 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 292359566 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22029/statm: 1339 225 188 169 0 50 0
[pid=22031] ppid=22029 vsize=127316 CPUtime=1713.03
/proc/22031/stat : 22031 (clasp-1.0) R 22029 21949 17046 0 -1 4194304 33713 0 0 0 171267 36 0 0 25 0 1 0 292359567 130371584 30906 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 134784625 0 0 4096 0 0 0 0 17 1 0 0
/proc/22031/statm: 31829 30906 249 81 0 31203 0
Current children cumulated CPU time (s) 1781.65
Current children cumulated vsize (KiB) 145868



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.71 s]
/proc/loadavg: 0.99 0.98 0.99 2/80 22231
/proc/meminfo: memFree=1478936/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.62
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2008 73224 0 0 14 1 6790 57 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22029] ppid=21949 vsize=5356 CPUtime=0
/proc/22029/stat : 22029 (sh) S 21949 21949 17046 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 292359566 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22029/statm: 1339 225 188 169 0 50 0
[pid=22031] ppid=22029 vsize=127316 CPUtime=1731.43
/proc/22031/stat : 22031 (clasp-1.0) R 22029 21949 17046 0 -1 4194304 33713 0 0 0 173107 36 0 0 25 0 1 0 292359567 130371584 30906 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 10849862 0 0 4096 0 0 0 0 17 1 0 0
/proc/22031/statm: 31829 30906 249 81 0 31203 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 145868

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+1800.71 s]
/proc/loadavg: 0.99 0.98 0.99 2/80 22231
/proc/meminfo: memFree=1478936/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.62
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2008 73224 0 0 14 1 6790 57 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22029] ppid=21949 vsize=5356 CPUtime=0
/proc/22029/stat : 22029 (sh) S 21949 21949 17046 0 -1 4194304 287 122 0 0 0 0 0 0 16 0 1 0 292359566 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22029/statm: 1339 225 188 169 0 50 0
[pid=22031] ppid=22029 vsize=127316 CPUtime=1731.43
/proc/22031/stat : 22031 (clasp-1.0) R 22029 21949 17046 0 -1 4194304 33713 0 0 0 173107 36 0 0 25 0 1 0 292359567 130371584 30906 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 10849862 0 0 4096 0 0 0 0 17 1 0 0
/proc/22031/statm: 31829 30906 249 81 0 31203 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 145868

# WARNING:
# current cumulated CPU time (68.65 s) is less than in the last sample (1800.05 s)
# The time of a child was probably not reported to its father.
# (see the samples just above and below)
# Adding the difference (1731.4 s) to the 'lost time'.

[startup+1800.82 s]
/proc/loadavg: 0.99 0.98 0.99 2/80 22231
/proc/meminfo: memFree=1478936/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.65
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2180 75012 0 0 14 1 6790 60 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
Current children cumulated CPU time (s) 68.65
Current children cumulated vsize (KiB) 13196

Sending SIGKILL to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1801.4 s]
/proc/loadavg: 0.99 0.98 0.99 2/80 22231
/proc/meminfo: memFree=1478936/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.65
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2180 75012 0 0 14 1 6790 60 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
Current children cumulated CPU time (s) 68.65
Current children cumulated vsize (KiB) 13196

[startup+1802.2 s]
/proc/loadavg: 0.99 0.98 0.99 2/81 22242
/proc/meminfo: memFree=1581072/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.65
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2180 75012 0 0 14 1 6790 60 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22240] ppid=21949 vsize=5356 CPUtime=0
/proc/22240/stat : 22240 (sh) S 21949 21949 17046 0 -1 4194304 288 122 0 0 0 0 0 0 16 0 1 0 292532775 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22240/statm: 1339 225 188 169 0 50 0
[pid=22242] ppid=22240 vsize=23212 CPUtime=1.43
/proc/22242/stat : 22242 (clasp-1.0) R 22240 21949 17046 0 -1 4194304 5973 0 0 0 141 2 0 0 25 0 1 0 292532775 23769088 5365 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 134714110 0 0 4096 0 0 0 0 17 1 0 0
/proc/22242/statm: 5803 5365 249 81 0 5177 0
Current children cumulated CPU time (s) 70.08
Current children cumulated vsize (KiB) 41764

[startup+1802.6 s]
/proc/loadavg: 0.99 0.98 0.99 2/81 22242
/proc/meminfo: memFree=1581072/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.65
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2180 75012 0 0 14 1 6790 60 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22240] ppid=21949 vsize=5356 CPUtime=0
/proc/22240/stat : 22240 (sh) S 21949 21949 17046 0 -1 4194304 288 122 0 0 0 0 0 0 16 0 1 0 292532775 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22240/statm: 1339 225 188 169 0 50 0
[pid=22242] ppid=22240 vsize=23212 CPUtime=1.83
/proc/22242/stat : 22242 (clasp-1.0) R 22240 21949 17046 0 -1 4194304 5973 0 0 0 181 2 0 0 25 0 1 0 292532775 23769088 5365 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 134714098 0 0 4096 0 0 0 0 17 1 0 0
/proc/22242/statm: 5803 5365 249 81 0 5177 0
Current children cumulated CPU time (s) 70.48
Current children cumulated vsize (KiB) 41764

[startup+1802.7 s]
/proc/loadavg: 0.99 0.98 0.99 2/81 22242
/proc/meminfo: memFree=1581072/2055920 swapFree=4157020/4192956
[pid=21949] ppid=21947 vsize=13196 CPUtime=68.65
/proc/21949/stat : 21949 (pbclasp) S 21947 21949 17046 0 -1 4194304 2180 75012 0 0 14 1 6790 60 16 0 1 0 292352699 13512704 647 18446744073709551615 4194304 4206940 548682069168 18446744073709551615 244680015764 0 0 4230 16384 18446744071563356171 0 0 17 0 0 0
/proc/21949/statm: 3299 647 343 3 0 399 0
[pid=22240] ppid=21949 vsize=5356 CPUtime=0
/proc/22240/stat : 22240 (sh) S 21949 21949 17046 0 -1 4194304 288 122 0 0 0 0 0 0 16 0 1 0 292532775 5484544 225 18446744073709551615 4194304 4889804 548682069168 18446744073709551615 244671112004 0 65536 4100 65538 18446744071563356171 0 0 17 0 0 0
/proc/22240/statm: 1339 225 188 169 0 50 0
[pid=22242] ppid=22240 vsize=23212 CPUtime=1.93
/proc/22242/stat : 22242 (clasp-1.0) R 22240 21949 17046 0 -1 4194304 5973 0 0 0 191 2 0 0 25 0 1 0 292532775 23769088 5365 18446744073709551615 134512640 134847168 4294956720 18446744073709551615 134617496 0 0 4096 0 0 0 0 17 1 0 0
/proc/22242/statm: 5803 5365 249 81 0 5177 0
Current children cumulated CPU time (s) 70.58
Current children cumulated vsize (KiB) 41764

Child status: 0

# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 1731.4
#  lost CPU user time (s): 1731.07
#  lost CPU system time (s): 0.33

Real time (s): 1802.73
CPU time (s): 1802.05
CPU user time (s): 1801.06
CPU system time (s): 0.992899
CPU usage (%): 99.9624
Max. virtual memory (cumulated for all children) (KiB): 146112

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 69.9914
system time used= 0.662899
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 83829
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4739
involuntary context switches= 2292

runsolver used 1.67175 second user time and 4.89525 second system time

The end

Launcher Data (download as text)

Begin job on node7 on Thu May  3 03:32:30 UTC 2007

IDJOB= 453889
IDBENCH= 48160
IDSOLVER= 167
FILE ID= node7/453889-1178163150

PBS_JOBID= 4751088

Free space on /tmp= 66564 MiB

SOLVER NAME= PB-clasp 2007-04-10
BENCH NAME= HOME/pub/bench/PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mds/normalized-mds_500_25_5.opb
COMMAND LINE= pbclasp instance-453889-1178163150.opb /tmp/evaluation/453889-1178163150/temp
CONVERSION COMMAND LINE= runsolver -w ROOT/results/node7/convwatcher-453889-1178163150 -o ROOT/results/node7/conversion-453889-1178163150 -C 600 -M 1800 PBconversionToLinear /tmp/evaluation/453889-1178163150/instance-453889-1178163150.opb
CONVERSION RUNSOLVER STATUS CODE= 0
CONVERSION STATUS CODE= 0

RUNSOLVER COMMAND LINE= runsolver  --timestamp  -w ROOT/results/node7/watcher-453889-1178163150 -o ROOT/results/node7/solver-453889-1178163150 -C 1800 -W 3600 -M 1800 --output-limit 1,15  pbclasp instance-453889-1178163150.opb /tmp/evaluation/453889-1178163150/temp

META MD5SUM SOLVER= 1e5f480786d97be718f2223f2ffb5f36
MD5SUM BENCH=  b1035f5aebd5cbd90440f32e03bdad12

RANDOM SEED= 740986562

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB

Linux node7.alineos.net 2.6.9-22.EL.rootsmp #1 SMP Mon Oct 3 08:59:52 CEST 2005 x86_64 x86_64 x86_64 GNU/Linux

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5914.62
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.231
cache size	: 2048 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5586.94
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2055920 kB
MemFree:       1607552 kB
Buffers:        206732 kB
Cached:         122140 kB
SwapCached:      15820 kB
Active:         205240 kB
Inactive:       147772 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2055920 kB
LowFree:       1607552 kB
SwapTotal:     4192956 kB
SwapFree:      4157020 kB
Dirty:            1672 kB
Writeback:           0 kB
Mapped:          30268 kB
Slab:            80876 kB
Committed_AS: 14488144 kB
PageTables:       1864 kB
VmallocTotal: 536870911 kB
VmallocUsed:    264952 kB
VmallocChunk: 536605679 kB
HugePages_Total:     0
HugePages_Free:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 66560 MiB

End job on node7 on Thu May  3 04:02:34 UTC 2007