Trace number 3482879

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-dec-11.04.03? (MO) 347.86 345.379

General information on the benchmark

Name/DEC-SMALLINT-LIN/lopes/
normalized-05.opb
MD5SUMcf89b9356492102125d645e5cc48c383
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark406.988
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables7351
Total number of constraints155824
Number of constraints which are clauses139567
Number of constraints which are cardinality constraints (but not clauses)563
Number of constraints which are nor clauses,nor cardinality constraints15694
Minimum length of a constraint2
Maximum length of a constraint195
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 196
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.39/0.50	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.39/0.50	c INFO: solving HOME/instance-3482879-1307578360.opb
1.49/1.60	c INFO: parsing took 1.07 s
2.98/3.51	c INFO: features took 1.90 CPU seconds
2.98/3.53	c INFO: running wbo1.4b-fixed@0 for 45 with 1796 remaining (b = 0.95)
50.29/50.32	c INFO: running pbct-0.1.2-linear@0 for 45 with 1750 remaining (b = 0.80)
107.67/107.60	c INFO: wrote minion input file to HOME/tmpBpLEqj.minion
107.67/107.60	c INFO: running minion-0.12@0 for 45 with 1704 remaining (b = 0.69)
156.55/156.44	c INFO: running clasp-1.3.7@0 for 45 with 1646 remaining (b = 0.64)
203.75/203.58	c INFO: running wbo1.4a@0 for 45 with 1599 remaining (b = 0.28)
251.16/250.83	c INFO: running clasp-1.3.7@47 for 45 with 1552 remaining (b = 0.20)
297.36/296.96	c INFO: running sat4j-pb-v20101225@0 for 45 with 1506 remaining (b = 0.17)
347.17/344.92	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1457 remaining (b = 0.16)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482879-1307578360/watcher-3482879-1307578360 -o /tmp/evaluation-result-3482879-1307578360/solver-3482879-1307578360 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482879-1307578360.opb -seed 1611258197 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.40 2.11 1.78 2/324 30420
/proc/meminfo: memFree=29839612/32951124 swapFree=53958412/67111528
[pid=30420] ppid=30418 vsize=15776 CPUtime=0 cores=1,3,5,7
/proc/30420/stat : 30420 (python) R 30418 30420 28606 0 -1 4202496 920 0 0 0 0 0 0 0 20 0 1 0 869436879 16154624 799 33554432000 4194304 5683644 140737035918544 18446744073709551615 5254192 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/30420/statm: 3944 800 350 364 0 431 0

[startup+0.0422781 s]
/proc/loadavg: 2.40 2.11 1.78 2/324 30420
/proc/meminfo: memFree=29839612/32951124 swapFree=53958412/67111528
[pid=30420] ppid=30418 vsize=23208 CPUtime=0.03 cores=1,3,5,7
/proc/30420/stat : 30420 (python) R 30418 30420 28606 0 -1 4202496 1323 0 0 0 2 1 0 0 18 0 1 0 869436879 23764992 1172 33554432000 4194304 5683644 140737035918544 18446744073709551615 222921772901 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/30420/statm: 5802 1172 432 364 0 729 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 23208

[startup+0.100268 s]
/proc/loadavg: 2.40 2.11 1.78 2/324 30420
/proc/meminfo: memFree=29839612/32951124 swapFree=53958412/67111528
[pid=30420] ppid=30418 vsize=96128 CPUtime=0.07 cores=1,3,5,7
/proc/30420/stat : 30420 (python) R 30418 30420 28606 0 -1 4202496 3169 933 1 0 5 2 0 0 18 0 1 0 869436879 98435072 2483 33554432000 4194304 5683644 140737035918544 18446744073709551615 5168667 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/30420/statm: 24032 2483 792 364 0 1627 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 96128

[startup+0.300233 s]
/proc/loadavg: 2.40 2.11 1.78 2/324 30420
/proc/meminfo: memFree=29839612/32951124 swapFree=53958412/67111528
[pid=30420] ppid=30418 vsize=171348 CPUtime=0.22 cores=1,3,5,7
/proc/30420/stat : 30420 (python) R 30418 30420 28606 0 -1 4202496 6179 933 1 0 17 5 0 0 17 0 1 0 869436879 175460352 4495 33554432000 4194304 5683644 140737035918544 18446744073709551615 222921473803 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/30420/statm: 42836 4494 1226 364 0 3535 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 171348

[startup+0.700158 s]
/proc/loadavg: 2.40 2.11 1.78 2/324 30420
/proc/meminfo: memFree=29839612/32951124 swapFree=53958412/67111528
[pid=30420] ppid=30418 vsize=295352 CPUtime=0.58 cores=1,3,5,7
/proc/30420/stat : 30420 (python) R 30418 30420 28606 0 -1 4202496 12269 933 1 0 49 9 0 0 17 0 1 0 869436879 302440448 10131 33554432000 4194304 5683644 140737035918544 18446744073709551615 47928037329547 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/30420/statm: 73838 10131 1781 364 0 8731 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 295352

[startup+1.50102 s]
/proc/loadavg: 2.40 2.11 1.78 3/325 30425
/proc/meminfo: memFree=29794964/32951124 swapFree=53958412/67111528
[pid=30420] ppid=30418 vsize=325744 CPUtime=1.39 cores=1,3,5,7
/proc/30420/stat : 30420 (python) R 30418 30420 28606 0 -1 4202496 19552 933 1 0 128 11 0 0 18 0 1 0 869436879 333561856 17414 33554432000 4194304 5683644 140737035918544 18446744073709551615 47927870927388 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/30420/statm: 81436 17414 1781 364 0 16329 0
Current children cumulated CPU time (s) 1.39
Current children cumulated vsize (KiB) 325744

[startup+3.10071 s]
/proc/loadavg: 2.40 2.11 1.78 3/325 30425
/proc/meminfo: memFree=29775496/32951124 swapFree=53958412/67111528
[pid=30420] ppid=30418 vsize=325840 CPUtime=2.98 cores=1,3,5,7
/proc/30420/stat : 30420 (python) R 30418 30420 28606 0 -1 4202496 27514 933 1 0 286 12 0 0 21 0 1 0 869436879 333660160 17807 33554432000 4194304 5683644 140737035918544 18446744073709551615 222925185717 0 0 16781312 33554434 0 0 0 17 3 0 0 0
/proc/30420/statm: 81460 17807 1816 364 0 16353 0
Current children cumulated CPU time (s) 2.98
Current children cumulated vsize (KiB) 325840

[startup+6.30113 s]
/proc/loadavg: 2.45 2.13 1.79 3/328 30428
/proc/meminfo: memFree=29753276/32951124 swapFree=53958412/67111528
[pid=30420] ppid=30418 vsize=338544 CPUtime=3.42 cores=1,3,5,7
/proc/30420/stat : 30420 (python) S 30418 30420 28606 0 -1 4202496 28408 933 1 0 330 12 0 0 24 0 2 0 869436879 346669056 18476 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/30420/statm: 84636 18476 1872 364 0 19523 0
[pid=30426] ppid=30420 vsize=328300 CPUtime=0 cores=1,3,5,7
/proc/30426/stat : 30426 (python) S 30420 30420 28606 0 -1 4202560 751 0 0 0 0 0 0 0 15 0 1 0 869437232 336179200 16951 33554432000 4194304 5683644 140737035918544 18446744073709551615 222921797135 0 0 16781312 33554946 4509517237605859591 0 0 17 7 0 0 0
/proc/30426/statm: 82075 16951 351 364 0 16962 0
[pid=30428] ppid=30426 vsize=22124 CPUtime=2.75 cores=1,3,5,7
/proc/30428/stat : 30428 (wbo1.4b-fixed) R 30426 30428 30428 0 -1 4202496 7013 0 0 0 250 25 0 0 21 0 1 0 869437233 22654976 4923 33554432000 134512640 135752315 4291095728 18446744073709551615 135270849 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/30428/statm: 5531 4923 146 303 0 5226 0
[pid=30420/tid=30427] ppid=30418 vsize=338544 CPUtime=0 cores=1,3,5,7
/proc/30420/task/30427/stat : 30427 (python) S 30418 30420 28606 0 -1 4202560 26 933 0 0 0 0 0 0 24 0 2 0 869437233 346669056 18476 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554434 18446604470055690624 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 688968

[startup+12.701 s]
/proc/loadavg: 2.41 2.12 1.79 3/328 30428
/proc/meminfo: memFree=29745048/32951124 swapFree=53958412/67111528
[pid=30420] ppid=30418 vsize=338544 CPUtime=3.42 cores=1,3,5,7
/proc/30420/stat : 30420 (python) S 30418 30420 28606 0 -1 4202496 28408 933 1 0 330 12 0 0 24 0 2 0 869436879 346669056 18476 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/30420/statm: 84636 18476 1872 364 0 19523 0
[pid=30426] ppid=30420 vsize=328300 CPUtime=0.01 cores=1,3,5,7
/proc/30426/stat : 30426 (python) S 30420 30420 28606 0 -1 4202560 891 0 0 0 0 1 0 0 15 0 1 0 869437232 336179200 16975 33554432000 4194304 5683644 140737035918544 18446744073709551615 222921797135 0 0 16781312 33554946 5623753486446373783 0 0 17 7 0 0 0
/proc/30426/statm: 82075 16975 375 364 0 16962 0
[pid=30428] ppid=30426 vsize=29712 CPUtime=9.15 cores=1,3,5,7
/proc/30428/stat : 30428 (wbo1.4b-fixed) R 30426 30428 30428 0 -1 4202496 8885 0 0 0 876 39 0 0 25 0 1 0 869437233 30425088 6795 33554432000 134512640 135752315 4291095728 18446744073709551615 134517408 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/30428/statm: 7428 6795 146 303 0 7123 0
[pid=30420/tid=30427] ppid=30418 vsize=338544 CPUtime=0 cores=1,3,5,7
/proc/30420/task/30427/stat : 30427 (python) S 30418 30420 28606 0 -1 4202560 26 933 0 0 0 0 0 0 24 0 2 0 869437233 346669056 18476 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554434 18446604470055690624 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.58
Current children cumulated vsize (KiB) 696556

[startup+25.5006 s]
/proc/loadavg: 2.32 2.12 1.79 3/328 30429
/proc/meminfo: memFree=29736240/32951124 swapFree=53958412/67111528
[pid=30420] ppid=30418 vsize=338544 CPUtime=3.42 cores=1,3,5,7
/proc/30420/stat : 30420 (python) S 30418 30420 28606 0 -1 4202496 28408 933 1 0 330 12 0 0 24 0 2 0 869436879 346669056 18476 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/30420/statm: 84636 18476 1872 364 0 19523 0
[pid=30426] ppid=30420 vsize=328300 CPUtime=0.04 cores=1,3,5,7
/proc/30426/stat : 30426 (python) S 30420 30420 28606 0 -1 4202560 894 0 0 0 1 3 0 0 15 0 1 0 869437232 336179200 16975 33554432000 4194304 5683644 140737035918544 18446744073709551615 222921797135 0 0 16781312 33554946 4294934792 0 0 17 7 0 0 0
/proc/30426/statm: 82075 16975 375 364 0 16962 0
[pid=30428] ppid=30426 vsize=39504 CPUtime=21.95 cores=1,3,5,7
/proc/30428/stat : 30428 (wbo1.4b-fixed) R 30426 30428 30428 0 -1 4202496 11280 0 0 0 2134 61 0 0 25 0 1 0 869437233 40452096 9190 33554432000 134512640 135752315 4291095728 18446744073709551615 135270849 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/30428/statm: 9876 9190 146 303 0 9571 0
[pid=30420/tid=30427] ppid=30418 vsize=338544 CPUtime=0 cores=1,3,5,7
/proc/30420/task/30427/stat : 30427 (python) S 30418 30420 28606 0 -1 4202560 26 933 0 0 0 0 0 0 24 0 2 0 869437233 346669056 18476 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554434 18446604470055690624 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.41
Current children cumulated vsize (KiB) 706348

[startup+51.1009 s]
/proc/loadavg: 2.21 2.11 1.80 3/332 30433
/proc/meminfo: memFree=29715760/32951124 swapFree=53958412/67111528
[pid=30420] ppid=30418 vsize=348800 CPUtime=3.45 cores=1,3,5,7
/proc/30420/stat : 30420 (python) S 30418 30420 28606 0 -1 4202496 29306 933 1 0 332 13 0 0 20 0 3 0 869436879 357171200 18483 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/30420/statm: 87200 18483 1875 364 0 22084 0
[pid=30426] ppid=30420 vsize=338544 CPUtime=0.11 cores=1,3,5,7
/proc/30426/stat : 30426 (python) S 30420 30420 28606 0 -1 4202560 1127 0 0 0 4 7 0 0 17 0 2 0 869437232 346669056 17016 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/30426/statm: 84636 17016 411 364 0 19523 0
[pid=30428] ppid=30426 vsize=52532 CPUtime=46.76 cores=1,3,5,7
/proc/30428/stat : 30428 (wbo1.4b-fixed) T 30426 30428 30428 0 -1 4202496 14451 0 0 0 4594 82 0 0 25 0 1 0 869437233 53792768 12361 33554432000 134512640 135752315 4291095728 18446744073709551615 134611201 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/30428/statm: 13133 12361 146 303 0 12828 0
[pid=30426/tid=30430] ppid=30420 vsize=338544 CPUtime=0 cores=1,3,5,7
/proc/30426/task/30430/stat : 30430 (python) S 30420 30420 28606 0 -1 4202560 42 0 0 0 0 0 0 0 17 0 2 0 869441909 346669056 17016 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554946 18446604466495321280 0 0 -1 7 0 0 0
[pid=30431] ppid=30420 vsize=338556 CPUtime=0 cores=1,3,5,7
/proc/30431/stat : 30431 (python) S 30420 30420 28606 0 -1 4202560 767 0 0 0 0 0 0 0 19 0 1 0 869441912 346681344 16952 33554432000 4194304 5683644 140737035918544 18446744073709551615 222921797190 0 0 16781312 33554946 12198676241355604230 0 0 17 3 0 0 0
/proc/30431/statm: 84639 16952 348 364 0 19523 0
[pid=30433] ppid=30431 vsize=11652 CPUtime=0.76 cores=1,3,5,7
/proc/30433/stat : 30433 (pbct-0.1.2-linu) R 30431 30433 30433 0 -1 4202496 2888 0 0 0 76 0 0 0 22 0 1 0 869441912 11931648 2521 33554432000 134512640 136422188 4292345696 18446744073709551615 135380721 0 0 16781312 0 0 0 0 17 5 0 0 0
/proc/30433/statm: 2913 2521 144 467 0 2444 0
[pid=30420/tid=30427] ppid=30418 vsize=348800 CPUtime=0 cores=1,3,5,7
/proc/30420/task/30427/stat : 30427 (python) S 30418 30420 28606 0 -1 4202560 26 933 0 0 0 0 0 0 24 0 3 0 869437233 357171200 18483 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554434 18446604470055690624 0 0 -1 3 0 0 0
[pid=30420/tid=30432] ppid=30418 vsize=348800 CPUtime=0 cores=1,3,5,7
/proc/30420/task/30432/stat : 30432 (python) S 30418 30420 28606 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 3 0 869441912 357171200 18483 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554434 18446604470055690624 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 1090084

[startup+102.311 s]
/proc/loadavg: 2.09 2.09 1.81 3/333 30436
/proc/meminfo: memFree=29094376/32951124 swapFree=53958412/67111528
[pid=30420] ppid=30418 vsize=348804 CPUtime=8.12 cores=1,3,5,7
/proc/30420/stat : 30420 (python) R 30418 30420 28606 0 -1 4202496 29919 933 1 0 798 14 0 0 25 0 3 0 869436879 357175296 18484 33554432000 4194304 5683644 140737035918544 18446744073709551615 4539178 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/30420/statm: 87201 18484 1875 364 0 22085 0
[pid=30426] ppid=30420 vsize=338544 CPUtime=0.11 cores=1,3,5,7
/proc/30426/stat : 30426 (python) S 30420 30420 28606 0 -1 4202560 1127 0 0 0 4 7 0 0 17 0 2 0 869437232 346669056 17016 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/30426/statm: 84636 17016 411 364 0 19523 0
[pid=30428] ppid=30426 vsize=52532 CPUtime=46.76 cores=1,3,5,7
/proc/30428/stat : 30428 (wbo1.4b-fixed) T 30426 30428 30428 0 -1 4202496 14451 0 0 0 4594 82 0 0 25 0 1 0 869437233 53792768 12361 33554432000 134512640 135752315 4291095728 18446744073709551615 134611201 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/30428/statm: 13133 12361 146 303 0 12828 0
[pid=30426/tid=30430] ppid=30420 vsize=338544 CPUtime=0 cores=1,3,5,7
/proc/30426/task/30430/stat : 30430 (python) S 30420 30420 28606 0 -1 4202560 42 0 0 0 0 0 0 0 17 0 2 0 869441909 346669056 17016 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554946 18446604466495321280 0 0 -1 7 0 0 0
[pid=30431] ppid=30420 vsize=338556 CPUtime=0.1 cores=1,3,5,7
/proc/30431/stat : 30431 (python) S 30420 30420 28606 0 -1 4202560 1092 0 0 0 5 5 0 0 16 0 2 0 869441912 346681344 17001 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/30431/statm: 84639 17001 396 364 0 19523 0
[pid=30433] ppid=30431 vsize=648828 CPUtime=47.29 cores=1,3,5,7
/proc/30433/stat : 30433 (pbct-0.1.2-linu) T 30431 30433 30433 0 -1 4202496 169672 0 0 0 4637 92 0 0 25 0 1 0 869441912 664399872 154060 33554432000 134512640 136422188 4292345696 18446744073709551615 134974310 0 0 16781312 16387 18446744071562691360 0 0 17 5 0 0 0
/proc/30433/statm: 162207 154060 215 467 0 161738 0
[pid=30431/tid=30436] ppid=30420 vsize=338556 CPUtime=0 cores=1,3,5,7
/proc/30431/task/30436/stat : 30436 (python) S 30420 30420 28606 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 869446643 346681344 17001 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554946 18446604463697273984 0 0 -1 7 0 0 0
[pid=30420/tid=30427] ppid=30418 vsize=348804 CPUtime=0 cores=1,3,5,7
/proc/30420/task/30427/stat : 30427 (python) S 30418 30420 28606 0 -1 4202560 26 933 0 0 0 0 0 0 24 0 3 0 869437233 357175296 18484 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554434 18446604470055690624 0 0 -1 3 0 0 0
[pid=30420/tid=30432] ppid=30418 vsize=348804 CPUtime=0 cores=1,3,5,7
/proc/30420/task/30432/stat : 30432 (python) S 30418 30420 28606 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 3 0 869441912 357175296 18484 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554434 18446604470055690624 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 102.38
Current children cumulated vsize (KiB) 1727264

[startup+162.302 s]
/proc/loadavg: 2.03 2.07 1.82 3/340 30444
/proc/meminfo: memFree=26873364/32951124 swapFree=53958412/67111528
[pid=30420] ppid=30418 vsize=369312 CPUtime=13.44 cores=1,3,5,7
/proc/30420/stat : 30420 (python) S 30418 30420 28606 0 -1 4202496 31149 933 1 0 1328 16 0 0 20 0 5 0 869436879 378175488 18495 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/30420/statm: 92328 18495 1879 364 0 27206 0
[pid=30426] ppid=30420 vsize=338544 CPUtime=0.11 cores=1,3,5,7
/proc/30426/stat : 30426 (python) S 30420 30420 28606 0 -1 4202560 1127 0 0 0 4 7 0 0 17 0 2 0 869437232 346669056 17016 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/30426/statm: 84636 17016 411 364 0 19523 0
[pid=30428] ppid=30426 vsize=52532 CPUtime=46.76 cores=1,3,5,7
/proc/30428/stat : 30428 (wbo1.4b-fixed) T 30426 30428 30428 0 -1 4202496 14451 0 0 0 4594 82 0 0 25 0 1 0 869437233 53792768 12361 33554432000 134512640 135752315 4291095728 18446744073709551615 134611201 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0

################
# More data... #
################




Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+345.302 s]
/proc/loadavg: 2.14 2.07 1.85 4/390 30499
/proc/meminfo: memFree=25656268/32951124 swapFree=53958412/67111528
[pid=30420] ppid=30418 vsize=400080 CPUtime=13.54 cores=1,3,5,7
/proc/30420/stat : 30420 (python) S 30418 30420 28606 0 -1 4202496 33945 933 1 0 1338 16 0 0 19 0 8 0 869436879 409681920 18513 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/30420/statm: 100020 18513 1885 364 0 34889 0
[pid=30426] ppid=30420 vsize=338544 CPUtime=0.11 cores=1,3,5,7
/proc/30426/stat : 30426 (python) S 30420 30420 28606 0 -1 4202560 1127 0 0 0 4 7 0 0 17 0 2 0 869437232 346669056 17016 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/30426/statm: 84636 17016 411 364 0 19523 0
[pid=30428] ppid=30426 vsize=52532 CPUtime=46.76 cores=1,3,5,7
/proc/30428/stat : 30428 (wbo1.4b-fixed) T 30426 30428 30428 0 -1 4202496 14451 0 0 0 4594 82 0 0 25 0 1 0 869437233 53792768 12361 33554432000 134512640 135752315 4291095728 18446744073709551615 134611201 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/30428/statm: 13133 12361 146 303 0 12828 0
[pid=30426/tid=30430] ppid=30420 vsize=338544 CPUtime=0 cores=1,3,5,7
/proc/30426/task/30430/stat : 30430 (python) S 30420 30420 28606 0 -1 4202560 42 0 0 0 0 0 0 0 17 0 2 0 869441909 346669056 17016 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554946 18446604466495321280 0 0 -1 7 0 0 0
[pid=30431] ppid=30420 vsize=338556 CPUtime=0.1 cores=1,3,5,7
/proc/30431/stat : 30431 (python) S 30420 30420 28606 0 -1 4202560 1092 0 0 0 5 5 0 0 16 0 2 0 869441912 346681344 17001 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/30431/statm: 84639 17001 396 364 0 19523 0
[pid=30433] ppid=30431 vsize=648828 CPUtime=47.29 cores=1,3,5,7
/proc/30433/stat : 30433 (pbct-0.1.2-linu) T 30431 30433 30433 0 -1 4202496 169672 0 0 0 4637 92 0 0 25 0 1 0 869441912 664399872 154060 33554432000 134512640 136422188 4292345696 18446744073709551615 134974310 0 0 16781312 16387 18446744071562691360 0 0 17 5 0 0 0
/proc/30433/statm: 162207 154060 215 467 0 161738 0
[pid=30431/tid=30436] ppid=30420 vsize=338556 CPUtime=0 cores=1,3,5,7
/proc/30431/task/30436/stat : 30436 (python) S 30420 30420 28606 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 869446643 346681344 17001 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554946 18446604463697273984 0 0 -1 7 0 0 0
[pid=30437] ppid=30420 vsize=348812 CPUtime=0.11 cores=1,3,5,7
/proc/30437/stat : 30437 (python) S 30420 30420 28606 0 -1 4202560 1079 0 0 0 6 5 0 0 17 0 2 0 869447639 357183488 17005 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0
/proc/30437/statm: 87203 17005 396 364 0 22084 0
[pid=30439] ppid=30437 vsize=2211948 CPUtime=48.79 cores=1,3,5,7
/proc/30439/stat : 30439 (minion) T 30437 30439 30439 0 -1 4202496 556658 0 0 0 4820 59 0 0 25 0 1 0 869447640 2265034752 545606 33554432000 134512640 165565024 4290699504 18446744073709551615 158624694 0 0 16781312 8396802 18446744071562691360 0 0 17 5 0 0 0
/proc/30439/statm: 552987 545606 359 7582 0 545402 0
[pid=30437/tid=30441] ppid=30420 vsize=348812 CPUtime=0 cores=1,3,5,7
/proc/30437/task/30441/stat : 30441 (python) S 30420 30420 28606 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 869452521 357183488 17005 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554946 18446604466495323072 0 0 -1 3 0 0 0
[pid=30442] ppid=30420 vsize=359068 CPUtime=0.23 cores=1,3,5,7
/proc/30442/stat : 30442 (python) S 30420 30420 28606 0 -1 4202560 1152 0 0 0 11 12 0 0 15 0 2 0 869452523 367685632 17009 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/30442/statm: 89767 17009 396 364 0 24645 0
[pid=30444] ppid=30442 vsize=50300 CPUtime=93.22 cores=1,3,5,7
/proc/30444/stat : 30444 (clasp-1.3.7-x86) T 30442 30444 30444 0 -1 4202496 13102 0 0 0 9320 2 0 0 25 0 1 0 869452524 51507200 12040 33554432000 134512640 136139019 4287593120 18446744073709551615 134883859 0 0 16781312 16386 18446744071562691360 0 0 17 5 0 0 0
/proc/30444/statm: 12575 12040 184 398 0 12175 0
[pid=30442/tid=30447] ppid=30420 vsize=359068 CPUtime=0 cores=1,3,5,7
/proc/30442/task/30447/stat : 30447 (python) S 30420 30420 28606 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 869457235 367685632 17009 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554946 18446604466495322176 0 0 -1 7 0 0 0
[pid=30448] ppid=30420 vsize=369324 CPUtime=0.11 cores=1,3,5,7
/proc/30448/stat : 30448 (python) S 30420 30420 28606 0 -1 4202560 1118 0 0 0 5 6 0 0 17 0 2 0 869457238 378187776 17013 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/30448/statm: 92331 17013 396 364 0 27206 0
[pid=30450] ppid=30448 vsize=50020 CPUtime=47.2 cores=1,3,5,7
/proc/30450/stat : 30450 (wbo1.4a) T 30448 30450 30450 0 -1 4202496 13826 0 0 0 4634 86 0 0 25 0 1 0 869457238 51220480 11729 33554432000 134512640 135751879 4291303328 18446744073709551615 134616336 0 0 16781312 3 18446744071562691360 0 0 17 1 0 0 0
/proc/30450/statm: 12505 11729 143 303 0 12200 0
[pid=30448/tid=30452] ppid=30420 vsize=369324 CPUtime=0 cores=1,3,5,7
/proc/30448/task/30452/stat : 30452 (python) S 30420 30420 28606 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 869461959 378187776 17013 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554946 18446604471126745152 0 0 -1 7 0 0 0
[pid=30457] ppid=30420 vsize=379580 CPUtime=0.12 cores=1,3,5,7
/proc/30457/stat : 30457 (python) S 30420 30420 28606 0 -1 4202560 1128 0 0 0 5 7 0 0 16 0 2 0 869466575 388689920 17017 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/30457/statm: 94895 17017 396 364 0 29767 0
[pid=30459] ppid=30457 vsize=8550364 CPUtime=49.61 cores=1,3,5,7
/proc/30459/stat : 30459 (java) T 30457 30459 30459 0 -1 4202496 262900 0 1 0 4930 31 0 0 15 0 19 0 869466576 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933579749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/30459/statm: 2137591 257547 2255 9 0 2128332 0
[pid=30459/tid=30460] ppid=30457 vsize=8550364 CPUtime=46.45 cores=1,3,5,7
/proc/30459/task/30460/stat : 30460 (java) T 30457 30459 30459 0 -1 4202560 216555 0 1 0 4621 24 0 0 25 0 19 0 869466577 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 46912505886806 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=30459/tid=30461] ppid=30457 vsize=8550364 CPUtime=0.04 cores=1,3,5,7
/proc/30459/task/30461/stat : 30461 (java) T 30457 30459 30459 0 -1 4202560 554 0 0 0 4 0 0 0 15 0 19 0 869466577 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=30459/tid=30462] ppid=30457 vsize=8550364 CPUtime=0.07 cores=1,3,5,7
/proc/30459/task/30462/stat : 30462 (java) T 30457 30459 30459 0 -1 4202560 3718 0 0 0 7 0 0 0 15 0 19 0 869466577 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=30459/tid=30463] ppid=30457 vsize=8550364 CPUtime=0.04 cores=1,3,5,7
/proc/30459/task/30463/stat : 30463 (java) T 30457 30459 30459 0 -1 4202560 1724 0 0 0 4 0 0 0 15 0 19 0 869466577 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=30459/tid=30464] ppid=30457 vsize=8550364 CPUtime=0.06 cores=1,3,5,7
/proc/30459/task/30464/stat : 30464 (java) T 30457 30459 30459 0 -1 4202560 4531 0 0 0 6 0 0 0 15 0 19 0 869466577 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30459/tid=30465] ppid=30457 vsize=8550364 CPUtime=0.04 cores=1,3,5,7
/proc/30459/task/30465/stat : 30465 (java) T 30457 30459 30459 0 -1 4202560 1021 0 0 0 4 0 0 0 15 0 19 0 869466577 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30459/tid=30466] ppid=30457 vsize=8550364 CPUtime=0.04 cores=1,3,5,7
/proc/30459/task/30466/stat : 30466 (java) T 30457 30459 30459 0 -1 4202560 1833 0 0 0 4 0 0 0 15 0 19 0 869466577 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30459/tid=30467] ppid=30457 vsize=8550364 CPUtime=0.05 cores=1,3,5,7
/proc/30459/task/30467/stat : 30467 (java) T 30457 30459 30459 0 -1 4202560 1268 0 0 0 5 0 0 0 15 0 19 0 869466577 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=30459/tid=30468] ppid=30457 vsize=8550364 CPUtime=0.08 cores=1,3,5,7
/proc/30459/task/30468/stat : 30468 (java) T 30457 30459 30459 0 -1 4202560 6526 0 0 0 8 0 0 0 15 0 19 0 869466578 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30459/tid=30469] ppid=30457 vsize=8550364 CPUtime=1.19 cores=1,3,5,7
/proc/30459/task/30469/stat : 30469 (java) T 30457 30459 30459 0 -1 4202560 13023 0 0 0 118 1 0 0 15 0 19 0 869466579 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933593600 0 0 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=30459/tid=30470] ppid=30457 vsize=8550364 CPUtime=0 cores=1,3,5,7
/proc/30459/task/30470/stat : 30470 (java) T 30457 30459 30459 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 19 0 869466579 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30459/tid=30471] ppid=30457 vsize=8550364 CPUtime=0 cores=1,3,5,7
/proc/30459/task/30471/stat : 30471 (java) T 30457 30459 30459 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 19 0 869466579 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30459/tid=30472] ppid=30457 vsize=8550364 CPUtime=0 cores=1,3,5,7
/proc/30459/task/30472/stat : 30472 (java) T 30457 30459 30459 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869466581 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933600689 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30459/tid=30473] ppid=30457 vsize=8550364 CPUtime=0.45 cores=1,3,5,7
/proc/30459/task/30473/stat : 30473 (java) T 30457 30459 30459 0 -1 4202560 1869 0 0 0 45 0 0 0 15 0 19 0 869466581 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=30459/tid=30474] ppid=30457 vsize=8550364 CPUtime=0.97 cores=1,3,5,7
/proc/30459/task/30474/stat : 30474 (java) T 30457 30459 30459 0 -1 4202560 8880 0 0 0 96 1 0 0 15 0 19 0 869466581 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=30459/tid=30475] ppid=30457 vsize=8550364 CPUtime=0 cores=1,3,5,7
/proc/30459/task/30475/stat : 30475 (java) T 30457 30459 30459 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869466581 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30459/tid=30476] ppid=30457 vsize=8550364 CPUtime=0 cores=1,3,5,7
/proc/30459/task/30476/stat : 30476 (java) T 30457 30459 30459 0 -1 4202560 7 0 0 0 0 0 0 0 15 0 19 0 869466581 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933593600 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30459/tid=30477] ppid=30457 vsize=8550364 CPUtime=0 cores=1,3,5,7
/proc/30459/task/30477/stat : 30477 (java) T 30457 30459 30459 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869466706 8755572736 257547 33554432000 1073741824 1073778376 140733599498560 18446744073709551615 222933593600 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=30457/tid=30479] ppid=30420 vsize=379580 CPUtime=0 cores=1,3,5,7
/proc/30457/task/30479/stat : 30479 (python) S 30420 30420 28606 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869471369 388689920 17017 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554946 18446604457859679552 0 0 -1 5 0 0 0
[pid=30480] ppid=30420 vsize=389836 CPUtime=0 cores=1,3,5,7
/proc/30480/stat : 30480 (python) S 30420 30420 28606 0 -1 4202560 838 0 0 0 0 0 0 0 19 0 1 0 869471371 399192064 16972 33554432000 4194304 5683644 140737035918544 18446744073709551615 222921797190 0 0 16781312 33554946 3704149009191927808 0 0 17 1 0 0 0
/proc/30480/statm: 97459 16972 348 364 0 32328 0
[pid=30482] ppid=30480 vsize=8535988 CPUtime=0.67 cores=1,3,5,7
/proc/30482/stat : 30482 (java) S 30480 30482 30482 0 -1 4202496 14289 0 1 0 65 2 0 0 20 0 18 0 869471372 8740851712 12916 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933579749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/30482/statm: 2133997 12918 2205 9 0 2124738 0
[pid=30482/tid=30483] ppid=30480 vsize=8535988 CPUtime=0.37 cores=1,3,5,7
/proc/30482/task/30483/stat : 30483 (java) R 30480 30482 30482 0 -1 4202560 9950 0 1 0 36 1 0 0 22 0 18 0 869471372 8740851712 12976 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 46912505581387 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=30482/tid=30484] ppid=30480 vsize=8535988 CPUtime=0 cores=1,3,5,7
/proc/30482/task/30484/stat : 30484 (java) S 30480 30482 30482 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 869471373 8740851712 12978 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933592985 0 4 0 16800975 18446604459138263872 0 0 -1 5 0 0 0
[pid=30482/tid=30485] ppid=30480 vsize=8535988 CPUtime=0 cores=1,3,5,7
/proc/30482/task/30485/stat : 30485 (java) S 30480 30482 30482 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 18 0 869471373 8740851712 12979 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933592985 0 4 0 16800975 18446604459138263872 0 0 -1 5 0 0 0
[pid=30482/tid=30486] ppid=30480 vsize=8535988 CPUtime=0 cores=1,3,5,7
/proc/30482/task/30486/stat : 30486 (java) S 30480 30482 30482 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 18 0 869471373 8740851712 12981 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933592985 0 4 0 16800975 18446604459138263872 0 0 -1 5 0 0 0
[pid=30482/tid=30487] ppid=30480 vsize=8535988 CPUtime=0 cores=1,3,5,7
/proc/30482/task/30487/stat : 30487 (java) S 30480 30482 30482 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869471373 8740851712 12982 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933592985 0 4 0 16800975 18446604459138263872 0 0 -1 1 0 0 0
[pid=30482/tid=30488] ppid=30480 vsize=8535988 CPUtime=0 cores=1,3,5,7
/proc/30482/task/30488/stat : 30488 (java) S 30480 30482 30482 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869471373 8740851712 12984 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933592985 0 4 0 16800975 18446604459138263872 0 0 -1 1 0 0 0
[pid=30482/tid=30489] ppid=30480 vsize=8535988 CPUtime=0 cores=1,3,5,7
/proc/30482/task/30489/stat : 30489 (java) S 30480 30482 30482 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869471373 8740851712 12986 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933592985 0 4 0 16800975 18446604459138263872 0 0 -1 1 0 0 0
[pid=30482/tid=30490] ppid=30480 vsize=8535988 CPUtime=0 cores=1,3,5,7
/proc/30482/task/30490/stat : 30490 (java) S 30480 30482 30482 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869471373 8740851712 12987 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933592985 0 4 0 16800975 18446604459138263872 0 0 -1 1 0 0 0
[pid=30482/tid=30491] ppid=30480 vsize=8535988 CPUtime=0 cores=1,3,5,7
/proc/30482/task/30491/stat : 30491 (java) S 30480 30482 30482 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869471373 8740851712 12989 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933592985 0 4 0 16800975 18446604459138263872 0 0 -1 1 0 0 0
[pid=30482/tid=30492] ppid=30480 vsize=8535988 CPUtime=0 cores=1,3,5,7
/proc/30482/task/30492/stat : 30492 (java) S 30480 30482 30482 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 18 0 869471374 8740851712 12991 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933593600 0 0 0 16800975 18446604459138263872 0 0 -1 5 0 0 0
[pid=30482/tid=30493] ppid=30480 vsize=8535988 CPUtime=0 cores=1,3,5,7
/proc/30482/task/30493/stat : 30493 (java) S 30480 30482 30482 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 18 0 869471374 8740851712 12992 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933592985 0 4 0 16800975 18446604459138263872 0 0 -1 5 0 0 0
[pid=30482/tid=30494] ppid=30480 vsize=8535988 CPUtime=0 cores=1,3,5,7
/proc/30482/task/30494/stat : 30494 (java) S 30480 30482 30482 0 -1 4202560 8 0 0 0 0 0 0 0 25 0 18 0 869471374 8740851712 12994 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933592985 0 4 0 16800975 18446604459138263872 0 0 -1 1 0 0 0
[pid=30482/tid=30495] ppid=30480 vsize=8535988 CPUtime=0 cores=1,3,5,7
/proc/30482/task/30495/stat : 30495 (java) S 30480 30482 30482 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869471376 8740851712 12996 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933600689 0 4 0 16800975 18446604459138263872 0 0 -1 5 0 0 0
[pid=30482/tid=30496] ppid=30480 vsize=8535988 CPUtime=0.13 cores=1,3,5,7
/proc/30482/task/30496/stat : 30496 (java) S 30480 30482 30482 0 -1 4202560 1611 0 0 0 13 0 0 0 17 0 18 0 869471376 8740851712 12998 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933592985 0 4 0 16800975 18446604459138263872 0 0 -1 5 0 0 0
[pid=30482/tid=30497] ppid=30480 vsize=8535988 CPUtime=0.15 cores=1,3,5,7
/proc/30482/task/30497/stat : 30497 (java) S 30480 30482 30482 0 -1 4202560 1393 0 0 0 15 0 0 0 17 0 18 0 869471376 8740851712 12999 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933592985 0 4 0 16800975 18446604459138263872 0 0 -1 5 0 0 0
[pid=30482/tid=30498] ppid=30480 vsize=8535988 CPUtime=0 cores=1,3,5,7
/proc/30482/task/30498/stat : 30498 (java) S 30480 30482 30482 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 869471376 8740851712 13001 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933592985 0 4 0 16800975 18446604459138263872 0 0 -1 7 0 0 0
[pid=30482/tid=30499] ppid=30480 vsize=8535988 CPUtime=0 cores=1,3,5,7
/proc/30482/task/30499/stat : 30499 (java) S 30480 30482 30482 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869471376 8740851712 13003 33554432000 1073741824 1073778376 140736634116320 18446744073709551615 222933593600 0 4 0 16800975 18446604459138263872 0 0 -1 5 0 0 0
[pid=30420/tid=30427] ppid=30418 vsize=400080 CPUtime=0 cores=1,3,5,7
/proc/30420/task/30427/stat : 30427 (python) S 30418 30420 28606 0 -1 4202560 26 933 0 0 0 0 0 0 24 0 8 0 869437233 409681920 18513 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554434 18446604470055690624 0 0 -1 3 0 0 0
[pid=30420/tid=30432] ppid=30418 vsize=400080 CPUtime=0 cores=1,3,5,7
/proc/30420/task/30432/stat : 30432 (python) S 30418 30420 28606 0 -1 4202560 25 933 0 0 0 0 0 0 20 0 8 0 869441912 409681920 18513 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554434 18446604470055690624 0 0 -1 3 0 0 0
[pid=30420/tid=30438] ppid=30418 vsize=400080 CPUtime=0 cores=1,3,5,7
/proc/30420/task/30438/stat : 30438 (python) S 30418 30420 28606 0 -1 4202560 29 933 0 0 0 0 0 0 25 0 8 0 869447640 409681920 18513 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554434 18446604470055690624 0 0 -1 3 0 0 0
[pid=30420/tid=30443] ppid=30418 vsize=400080 CPUtime=0 cores=1,3,5,7
/proc/30420/task/30443/stat : 30443 (python) S 30418 30420 28606 0 -1 4202560 33 933 0 0 0 0 0 0 18 0 8 0 869452523 409681920 18513 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554434 18446604470055690624 0 0 -1 7 0 0 0
[pid=30420/tid=30449] ppid=30418 vsize=400080 CPUtime=0 cores=1,3,5,7
/proc/30420/task/30449/stat : 30449 (python) S 30418 30420 28606 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 8 0 869457238 409681920 18513 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554434 18446604470055690624 0 0 -1 5 0 0 0
[pid=30420/tid=30458] ppid=30418 vsize=400080 CPUtime=0 cores=1,3,5,7
/proc/30420/task/30458/stat : 30458 (python) S 30418 30420 28606 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 8 0 869466576 409681920 18513 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554434 18446604470055690624 0 0 -1 7 0 0 0
[pid=30420/tid=30481] ppid=30418 vsize=400080 CPUtime=0 cores=1,3,5,7
/proc/30420/task/30481/stat : 30481 (python) S 30418 30420 28606 0 -1 4202560 30 933 0 0 0 0 0 0 20 0 8 0 869471371 409681920 18513 33554432000 4194304 5683644 140737035918544 18446744073709551615 222933600689 0 0 16781312 33554434 18446604470055690624 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 347.86
Current children cumulated vsize (KiB) 23023780

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 30420 and gives
#  childrusage.ru_utime.tv_sec=13
#  childrusage.ru_utime.tv_usec=388964
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=174973
# CPU time returned by wait4() is 13.5639
# while last known CPU time is 347.86
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 345.379
CPU time (s): 347.86
CPU user time (s): 343.74
CPU system time (s): 4.12
CPU usage (%): 100.718
Max. virtual memory (cumulated for all children) (KiB): 23023780

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 13.389
system time used= 0.174973
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 34883
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1020
involuntary context switches= 33

runsolver used 1.10983 second user time and 2.57761 second system time

The end

Launcher Data 

Begin job on node109 at 2011-06-09 02:12:41
IDJOB=3482879
IDBENCH=89657
IDSOLVER=1971
FILE ID=node109/3482879-1307578360
RUNJOBID= node109-1307576440-28625
PBS_JOBID= 13547696
Free space on /tmp= 74004 MiB

SOLVER NAME= borg pb-dec-11.04.03
BENCH NAME= PB11/normalized-PB11/DEC-SMALLINT-LIN/lopes/normalized-05.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482879-1307578360/watcher-3482879-1307578360 -o /tmp/evaluation-result-3482879-1307578360/solver-3482879-1307578360 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482879-1307578360.opb -seed 1611258197 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= cf89b9356492102125d645e5cc48c383
RANDOM SEED=1611258197

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29839644 kB
Buffers:        199504 kB
Cached:         540224 kB
SwapCached:       8632 kB
Active:        2624660 kB
Inactive:       212620 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29839644 kB
SwapTotal:    67111528 kB
SwapFree:     53958412 kB
Dirty:          111340 kB
Writeback:           0 kB
AnonPages:     2095352 kB
Mapped:          44204 kB
Slab:           162924 kB
PageTables:      46484 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 33856092 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73896 MiB
End job on node109 at 2011-06-09 02:18:29