Trace number 3482902

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-dec-11.04.03? (MO) 373.63 370.701

General information on the benchmark

Name/DEC-SMALLINT-LIN/lopes/
normalized-89.opb
MD5SUM5e35cfce24461785d6d1180987ae518e
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables10086
Total number of constraints226240
Number of constraints which are clauses203302
Number of constraints which are cardinality constraints (but not clauses)720
Number of constraints which are nor clauses,nor cardinality constraints22218
Minimum length of a constraint2
Maximum length of a constraint231
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 232
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.41/0.73	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.41/0.73	c INFO: solving HOME/instance-3482902-1307578709.opb
2.00/2.32	c INFO: parsing took 1.56 s
4.70/5.03	c INFO: features took 2.71 CPU seconds
4.70/5.06	c INFO: running wbo1.4b-fixed@0 for 45 with 1795 remaining (b = 0.96)
56.12/56.30	c INFO: running pbct-0.1.2-linear@0 for 45 with 1745 remaining (b = 0.96)
104.96/105.16	c INFO: running wbo1.4a@0 for 45 with 1697 remaining (b = 0.90)
169.90/169.92	c INFO: wrote minion input file to HOME/tmpBIkEQE.minion
169.90/169.93	c INFO: running minion-0.12@0 for 45 with 1648 remaining (b = 0.70)
180.61/180.65	c INFO: running clasp-1.3.7@0 for 45 with 1630 remaining (b = 0.57)
228.82/228.79	c INFO: running bsolo_pb10-l2@0 for 45 with 1582 remaining (b = 0.47)
277.21/277.04	c INFO: running clasp-1.3.7@48 for 45 with 1535 remaining (b = 0.18)
322.42/322.19	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1489 remaining (b = 0.22)
372.09/369.67	c INFO: running sat4j-pb-v20101225@0 for 45 with 1441 remaining (b = 0.16)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482902-1307578709/watcher-3482902-1307578709 -o /tmp/evaluation-result-3482902-1307578709/solver-3482902-1307578709 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482902-1307578709.opb -seed 1390992116 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.13 2.07 1.85 3/352 30529
/proc/meminfo: memFree=25756008/32951124 swapFree=53958412/67111528
[pid=30529] ppid=30527 vsize=15772 CPUtime=0 cores=1,3,5,7
/proc/30529/stat : 30529 (python) R 30527 30529 28606 0 -1 4202496 857 0 0 0 0 0 0 0 17 0 1 0 869471742 16150528 738 33554432000 4194304 5683644 140735334525584 18446744073709551615 4540219 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/30529/statm: 3943 740 335 364 0 430 0

[startup+0.0730961 s]
/proc/loadavg: 2.13 2.07 1.85 3/352 30529
/proc/meminfo: memFree=25756008/32951124 swapFree=53958412/67111528
[pid=30529] ppid=30527 vsize=34244 CPUtime=0.04 cores=1,3,5,7
/proc/30529/stat : 30529 (python) R 30527 30529 28606 0 -1 4202496 1523 0 0 0 3 1 0 0 17 0 1 0 869471742 35065856 1359 33554432000 4194304 5683644 140735334525584 18446744073709551615 47390181113968 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/30529/statm: 8561 1359 448 364 0 899 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 34244

[startup+0.101129 s]
/proc/loadavg: 2.13 2.07 1.85 3/352 30529
/proc/meminfo: memFree=25756008/32951124 swapFree=53958412/67111528
[pid=30529] ppid=30527 vsize=84568 CPUtime=0.05 cores=1,3,5,7
/proc/30529/stat : 30529 (python) S 30527 30529 28606 0 -1 4202496 2409 0 0 0 4 1 0 0 17 0 1 0 869471742 86597632 2136 33554432000 4194304 5683644 140735334525584 18446744073709551615 222921775104 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/30529/statm: 21142 2136 707 364 0 1359 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 84568

[startup+0.301102 s]
/proc/loadavg: 2.13 2.07 1.85 3/352 30529
/proc/meminfo: memFree=25756008/32951124 swapFree=53958412/67111528
[pid=30529] ppid=30527 vsize=123740 CPUtime=0.16 cores=1,3,5,7
/proc/30529/stat : 30529 (python) S 30527 30529 28606 0 -1 4202496 5358 932 1 0 11 5 0 0 16 0 1 0 869471742 126709760 3744 33554432000 4194304 5683644 140735334525584 18446744073709551615 222921773061 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/30529/statm: 30935 3744 987 364 0 2767 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 123740

[startup+0.700994 s]
/proc/loadavg: 2.13 2.07 1.85 3/352 30529
/proc/meminfo: memFree=25756008/32951124 swapFree=53958412/67111528
[pid=30529] ppid=30527 vsize=266368 CPUtime=0.41 cores=1,3,5,7
/proc/30529/stat : 30529 (python) R 30527 30529 28606 0 -1 4202496 8548 932 1 0 28 13 0 0 16 0 1 0 869471742 272760832 6609 33554432000 4194304 5683644 140735334525584 18446744073709551615 222921777024 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/30529/statm: 66591 6608 1701 364 0 5255 0
Current children cumulated CPU time (s) 0.41
Current children cumulated vsize (KiB) 266368

[startup+1.50085 s]
/proc/loadavg: 2.13 2.07 1.85 3/353 30534
/proc/meminfo: memFree=25716072/32951124 swapFree=53958412/67111528
[pid=30529] ppid=30527 vsize=317508 CPUtime=1.2 cores=1,3,5,7
/proc/30529/stat : 30529 (python) R 30527 30529 28606 0 -1 4202496 17683 932 1 0 106 14 0 0 16 0 1 0 869471742 325128192 15544 33554432000 4194304 5683644 140735334525584 18446744073709551615 4603744 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/30529/statm: 79377 15545 1781 364 0 14270 0
Current children cumulated CPU time (s) 1.2
Current children cumulated vsize (KiB) 317508

[startup+3.10056 s]
/proc/loadavg: 2.13 2.07 1.85 3/353 30534
/proc/meminfo: memFree=25679380/32951124 swapFree=53958412/67111528
[pid=30529] ppid=30527 vsize=343304 CPUtime=2.8 cores=1,3,5,7
/proc/30529/stat : 30529 (python) R 30527 30529 28606 0 -1 4202496 35211 932 1 0 264 16 0 0 18 0 1 0 869471742 351543296 22173 33554432000 4194304 5683644 140735334525584 18446744073709551615 222925185717 0 0 16781312 33554434 0 0 0 17 5 0 0 0
/proc/30529/statm: 85826 22173 1815 364 0 20719 0
Current children cumulated CPU time (s) 2.8
Current children cumulated vsize (KiB) 343304

[startup+6.30097 s]
/proc/loadavg: 2.28 2.10 1.86 3/356 30538
/proc/meminfo: memFree=25656664/32951124 swapFree=53958412/67111528
[pid=30529] ppid=30527 vsize=358876 CPUtime=4.77 cores=1,3,5,7
/proc/30529/stat : 30529 (python) S 30527 30529 28606 0 -1 4202496 36824 932 1 0 460 17 0 0 20 0 2 0 869471742 367489024 23560 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/30529/statm: 89719 23560 1872 364 0 24606 0
[pid=30536] ppid=30529 vsize=348632 CPUtime=0 cores=1,3,5,7
/proc/30536/stat : 30536 (python) S 30529 30529 28606 0 -1 4202560 756 0 0 0 0 0 0 0 15 0 1 0 869472248 356999168 22035 33554432000 4194304 5683644 140735334525584 18446744073709551615 222921797135 0 0 16781312 33554946 9842363518123213063 0 0 17 7 0 0 0
/proc/30536/statm: 87158 22035 351 364 0 22045 0
[pid=30538] ppid=30536 vsize=26644 CPUtime=1.22 cores=1,3,5,7
/proc/30538/stat : 30538 (wbo1.4b-fixed) R 30536 30538 30538 0 -1 4202496 8863 0 0 0 114 8 0 0 25 0 1 0 869472249 27283456 6054 33554432000 134512640 135752315 4287734480 18446744073709551615 135270849 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/30538/statm: 6661 6054 146 303 0 6356 0
[pid=30529/tid=30537] ppid=30527 vsize=358876 CPUtime=0 cores=1,3,5,7
/proc/30529/task/30537/stat : 30537 (python) S 30527 30529 28606 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 2 0 869472249 367489024 23560 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554434 18446604459138262080 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 5.99
Current children cumulated vsize (KiB) 734152

[startup+12.7008 s]
/proc/loadavg: 2.25 2.10 1.86 3/356 30538
/proc/meminfo: memFree=25636752/32951124 swapFree=53958412/67111528
[pid=30529] ppid=30527 vsize=358876 CPUtime=4.77 cores=1,3,5,7
/proc/30529/stat : 30529 (python) S 30527 30529 28606 0 -1 4202496 36824 932 1 0 460 17 0 0 20 0 2 0 869471742 367489024 23560 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/30529/statm: 89719 23560 1872 364 0 24606 0
[pid=30536] ppid=30529 vsize=348632 CPUtime=0.01 cores=1,3,5,7
/proc/30536/stat : 30536 (python) S 30529 30529 28606 0 -1 4202560 894 0 0 0 1 0 0 0 15 0 1 0 869472248 356999168 22059 33554432000 4194304 5683644 140735334525584 18446744073709551615 222921797135 0 0 16781312 33554946 4294934789 0 0 17 7 0 0 0
/proc/30536/statm: 87158 22059 375 364 0 22045 0
[pid=30538] ppid=30536 vsize=31348 CPUtime=7.62 cores=1,3,5,7
/proc/30538/stat : 30538 (wbo1.4b-fixed) R 30536 30538 30538 0 -1 4202496 10040 0 0 0 696 66 0 0 25 0 1 0 869472249 32100352 7231 33554432000 134512640 135752315 4287734480 18446744073709551615 135270849 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/30538/statm: 7837 7231 146 303 0 7532 0
[pid=30529/tid=30537] ppid=30527 vsize=358876 CPUtime=0 cores=1,3,5,7
/proc/30529/task/30537/stat : 30537 (python) S 30527 30529 28606 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 2 0 869472249 367489024 23560 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554434 18446604459138262080 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.4
Current children cumulated vsize (KiB) 738856

[startup+25.5005 s]
/proc/loadavg: 2.20 2.10 1.87 3/356 30538
/proc/meminfo: memFree=25623992/32951124 swapFree=53958412/67111528
[pid=30529] ppid=30527 vsize=358876 CPUtime=4.77 cores=1,3,5,7
/proc/30529/stat : 30529 (python) S 30527 30529 28606 0 -1 4202496 36824 932 1 0 460 17 0 0 20 0 2 0 869471742 367489024 23560 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/30529/statm: 89719 23560 1872 364 0 24606 0
[pid=30536] ppid=30529 vsize=348632 CPUtime=0.05 cores=1,3,5,7
/proc/30536/stat : 30536 (python) S 30529 30529 28606 0 -1 4202560 904 0 0 0 3 2 0 0 15 0 1 0 869472248 356999168 22059 33554432000 4194304 5683644 140735334525584 18446744073709551615 222921797135 0 0 16781312 33554946 5623753486446373657 0 0 17 7 0 0 0
/proc/30536/statm: 87158 22059 375 364 0 22045 0
[pid=30538] ppid=30536 vsize=42996 CPUtime=20.42 cores=1,3,5,7
/proc/30538/stat : 30538 (wbo1.4b-fixed) R 30536 30538 30538 0 -1 4202496 12943 0 0 0 1948 94 0 0 25 0 1 0 869472249 44027904 10134 33554432000 134512640 135752315 4287734480 18446744073709551615 134605105 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/30538/statm: 10749 10134 146 303 0 10444 0
[pid=30529/tid=30537] ppid=30527 vsize=358876 CPUtime=0 cores=1,3,5,7
/proc/30529/task/30537/stat : 30537 (python) S 30527 30529 28606 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 2 0 869472249 367489024 23560 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554434 18446604459138262080 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.24
Current children cumulated vsize (KiB) 750504

[startup+51.1008 s]
/proc/loadavg: 2.13 2.09 1.87 3/356 30539
/proc/meminfo: memFree=25597424/32951124 swapFree=53958412/67111528
[pid=30529] ppid=30527 vsize=358876 CPUtime=4.77 cores=1,3,5,7
/proc/30529/stat : 30529 (python) S 30527 30529 28606 0 -1 4202496 36824 932 1 0 460 17 0 0 20 0 2 0 869471742 367489024 23560 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/30529/statm: 89719 23560 1872 364 0 24606 0
[pid=30536] ppid=30529 vsize=348632 CPUtime=0.11 cores=1,3,5,7
/proc/30536/stat : 30536 (python) S 30529 30529 28606 0 -1 4202560 1001 0 0 0 6 5 0 0 15 0 1 0 869472248 356999168 22064 33554432000 4194304 5683644 140735334525584 18446744073709551615 222921797135 0 0 16781312 33554946 5623753486446373657 0 0 17 7 0 0 0
/proc/30536/statm: 87158 22064 380 364 0 22045 0
[pid=30538] ppid=30536 vsize=68940 CPUtime=46.03 cores=1,3,5,7
/proc/30538/stat : 30538 (wbo1.4b-fixed) R 30536 30538 30538 0 -1 4202496 19396 0 0 0 4452 151 0 0 25 0 1 0 869472249 70594560 16587 33554432000 134512640 135752315 4287734480 18446744073709551615 134517428 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/30538/statm: 17235 16587 146 303 0 16930 0
[pid=30529/tid=30537] ppid=30527 vsize=358876 CPUtime=0 cores=1,3,5,7
/proc/30529/task/30537/stat : 30537 (python) S 30527 30529 28606 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 2 0 869472249 367489024 23560 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554434 18446604459138262080 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.91
Current children cumulated vsize (KiB) 776448

[startup+102.311 s]
/proc/loadavg: 2.05 2.07 1.87 3/360 30544
/proc/meminfo: memFree=24710628/32951124 swapFree=53958412/67111528
[pid=30529] ppid=30527 vsize=369132 CPUtime=4.79 cores=1,3,5,7
/proc/30529/stat : 30529 (python) S 30527 30529 28606 0 -1 4202496 37737 932 1 0 462 17 0 0 19 0 3 0 869471742 377991168 23567 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/30529/statm: 92283 23567 1875 364 0 27167 0
[pid=30536] ppid=30529 vsize=358876 CPUtime=0.13 cores=1,3,5,7
/proc/30536/stat : 30536 (python) S 30529 30529 28606 0 -1 4202560 1137 0 0 0 7 6 0 0 16 0 2 0 869472248 367489024 22100 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/30536/statm: 89719 22100 411 364 0 24606 0
[pid=30538] ppid=30536 vsize=71848 CPUtime=51.2 cores=1,3,5,7
/proc/30538/stat : 30538 (wbo1.4b-fixed) T 30536 30538 30538 0 -1 4202496 20116 0 0 0 4965 155 0 0 25 0 1 0 869472249 73572352 17307 33554432000 134512640 135752315 4287734480 18446744073709551615 134517428 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/30538/statm: 17962 17307 146 303 0 17657 0
[pid=30536/tid=30540] ppid=30529 vsize=358876 CPUtime=0 cores=1,3,5,7
/proc/30536/task/30540/stat : 30540 (python) S 30529 30529 28606 0 -1 4202560 41 0 0 0 0 0 0 0 16 0 2 0 869477370 367489024 22100 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554946 18446604469852677312 0 0 -1 7 0 0 0
[pid=30541] ppid=30529 vsize=358888 CPUtime=0.1 cores=1,3,5,7
/proc/30541/stat : 30541 (python) S 30529 30529 28606 0 -1 4202560 940 0 0 0 5 5 0 0 15 0 1 0 869477372 367501312 22060 33554432000 4194304 5683644 140735334525584 18446744073709551615 222921797190 0 0 16781312 33554946 5623606151888251673 0 0 17 5 0 0 0
/proc/30541/statm: 89722 22060 372 364 0 24606 0
[pid=30543] ppid=30541 vsize=907344 CPUtime=45.95 cores=1,3,5,7
/proc/30543/stat : 30543 (pbct-0.1.2-linu) R 30541 30543 30543 0 -1 4202496 239568 0 0 0 4511 84 0 0 25 0 1 0 869477373 929120256 219182 33554432000 134512640 136422188 4287357120 18446744073709551615 135874785 0 0 16781312 16387 0 0 0 17 1 0 0 0
/proc/30543/statm: 226836 219182 215 467 0 226367 0
[pid=30529/tid=30537] ppid=30527 vsize=369132 CPUtime=0 cores=1,3,5,7
/proc/30529/task/30537/stat : 30537 (python) S 30527 30529 28606 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 3 0 869472249 377991168 23567 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554434 18446604459138262080 0 0 -1 7 0 0 0
[pid=30529/tid=30542] ppid=30527 vsize=369132 CPUtime=0 cores=1,3,5,7
/proc/30529/task/30542/stat : 30542 (python) S 30527 30529 28606 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 3 0 869477372 377991168 23567 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554434 18446604459138262080 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 102.17
Current children cumulated vsize (KiB) 2066088

[startup+162.301 s]
/proc/loadavg: 2.02 2.06 1.88 3/365 30551
/proc/meminfo: memFree=24630896/32951124 swapFree=53958412/67111528
[pid=30529] ppid=30527 vsize=379392 CPUtime=11.32 cores=1,3,5,7
/proc/30529/stat : 30529 (python) R 30527 30529 28606 0 -1 4202496 39218 932 1 0 1113 19 0 0 25 0 4 0 869471742 388497408 23574 33554432000 4194304 5683644 140735334525584 18446744073709551615 47390218683108 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/30529/statm: 94848 23574 1877 364 0 29729 0
[pid=30536] ppid=30529 vsize=358876 CPUtime=0.13 cores=1,3,5,7
/proc/30536/stat : 30536 (python) S 30529 30529 28606 0 -1 4202560 1137 0 0 0 7 6 0 0 16 0 2 0 869472248 367489024 22100 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/30536/statm: 89719 22100 411 364 0 24606 0
[pid=30538] ppid=30536 vsize=71848 CPUtime=51.2 cores=1,3,5,7
/proc/30538/stat : 30538 (wbo1.4b-fixed) T 30536 30538 30538 0 -1 4202496 20116 0 0 0 4965 155 0 0 25 0 1 0 869472249 73572352 17307 33554432000 134512640 135752315 4287734480 18446744073709551615 134517428 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/30538/statm: 17962 17307 146 303 0 17657 0
[pid=30536/tid=30540] ppid=30529 vsize=358876 CPUtime=0 cores=1,3,5,7
/proc/30536/task/30540/stat : 30540 (python) S 30529 30529 28606 0 -1 4202560 41 0 0 0 0 0 0 0 16 0 2 0 869477370 367489024 22100 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554946 18446604469852677312 0 0 -1 7 0 0 0
[pid=30541] ppid=30529 vsize=358888 CPUtime=0.12 cores=1,3,5,7
/proc/30541/stat : 30541 (python) S 30529 30529 28606 0 -1 4202560 1102 0 0 0 6 6 0 0 17 0 2 0 869477372 367501312 22085 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/30541/statm: 89722 22085 396 364 0 24606 0
[pid=30543] ppid=30541 vsize=907740 CPUtime=48.79 cores=1,3,5,7
/proc/30543/stat : 30543 (pbct-0.1.2-linu) T 30541 30543 30543 0 -1 4202496 239693 0 0 0 4792 87 0 0 25 0 1 0 869477373 929525760 219307 33554432000 134512640 136422188 4287357120 18446744073709551615 135020695 0 0 16781312 16387 18446744071562691360 0 0 17 1 0 0 0
/proc/30543/statm: 226935 219307 215 467 0 226466 0
[pid=30541/tid=30545] ppid=30529 vsize=358888 CPUtime=0 cores=1,3,5,7
/proc/30541/task/30545/stat : 30545 (python) S 30529 30529 28606 0 -1 4202560 51 0 0 0 0 0 0 0 17 0 2 0 869482256 367501312 22085 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554946 18446604453986944320 0 0 -1 5 0 0 0
[pid=30546] ppid=30529 vsize=369144 CPUtime=0.14 cores=1,3,5,7

################
# More data... #
################

Current children cumulated CPU time (s) 373.63
Current children cumulated vsize (KiB) 21411876

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+370.602 s]
/proc/loadavg: 2.33 2.44 2.09 4/416 30612
/proc/meminfo: memFree=17259320/32951124 swapFree=53958412/67111528
[pid=30529] ppid=30527 vsize=430668 CPUtime=29.79 cores=1,3,5,7
/proc/30529/stat : 30529 (python) S 30527 30529 28606 0 -1 4202496 43223 1056147 1 0 1885 23 433 638 20 0 9 0 869471742 441004032 23603 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/30529/statm: 107667 23603 1887 364 0 42533 0
[pid=30536] ppid=30529 vsize=358876 CPUtime=0.13 cores=1,3,5,7
/proc/30536/stat : 30536 (python) S 30529 30529 28606 0 -1 4202560 1137 0 0 0 7 6 0 0 16 0 2 0 869472248 367489024 22100 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/30536/statm: 89719 22100 411 364 0 24606 0
[pid=30538] ppid=30536 vsize=71848 CPUtime=51.2 cores=1,3,5,7
/proc/30538/stat : 30538 (wbo1.4b-fixed) T 30536 30538 30538 0 -1 4202496 20116 0 0 0 4965 155 0 0 25 0 1 0 869472249 73572352 17307 33554432000 134512640 135752315 4287734480 18446744073709551615 134517428 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/30538/statm: 17962 17307 146 303 0 17657 0
[pid=30536/tid=30540] ppid=30529 vsize=358876 CPUtime=0 cores=1,3,5,7
/proc/30536/task/30540/stat : 30540 (python) S 30529 30529 28606 0 -1 4202560 41 0 0 0 0 0 0 0 16 0 2 0 869477370 367489024 22100 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554946 18446604469852677312 0 0 -1 7 0 0 0
[pid=30541] ppid=30529 vsize=358888 CPUtime=0.12 cores=1,3,5,7
/proc/30541/stat : 30541 (python) S 30529 30529 28606 0 -1 4202560 1102 0 0 0 6 6 0 0 17 0 2 0 869477372 367501312 22085 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/30541/statm: 89722 22085 396 364 0 24606 0
[pid=30543] ppid=30541 vsize=907740 CPUtime=48.79 cores=1,3,5,7
/proc/30543/stat : 30543 (pbct-0.1.2-linu) T 30541 30543 30543 0 -1 4202496 239693 0 0 0 4792 87 0 0 25 0 1 0 869477373 929525760 219307 33554432000 134512640 136422188 4287357120 18446744073709551615 135020695 0 0 16781312 16387 18446744071562691360 0 0 17 1 0 0 0
/proc/30543/statm: 226935 219307 215 467 0 226466 0
[pid=30541/tid=30545] ppid=30529 vsize=358888 CPUtime=0 cores=1,3,5,7
/proc/30541/task/30545/stat : 30545 (python) S 30529 30529 28606 0 -1 4202560 51 0 0 0 0 0 0 0 17 0 2 0 869482256 367501312 22085 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554946 18446604453986944320 0 0 -1 5 0 0 0
[pid=30546] ppid=30529 vsize=369144 CPUtime=0.14 cores=1,3,5,7
/proc/30546/stat : 30546 (python) S 30529 30529 28606 0 -1 4202560 1098 0 0 0 7 7 0 0 16 0 2 0 869482259 378003456 22089 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/30546/statm: 92286 22089 396 364 0 27167 0
[pid=30548] ppid=30546 vsize=67560 CPUtime=50.61 cores=1,3,5,7
/proc/30548/stat : 30548 (wbo1.4a) T 30546 30548 30548 0 -1 4202496 19047 0 0 0 4910 151 0 0 25 0 1 0 869482259 69181440 16237 33554432000 134512640 135751879 4291605824 18446744073709551615 134641957 0 0 16781312 3 18446744071562691360 0 0 17 1 0 0 0
/proc/30548/statm: 16890 16237 143 303 0 16585 0
[pid=30546/tid=30551] ppid=30529 vsize=369144 CPUtime=0 cores=1,3,5,7
/proc/30546/task/30551/stat : 30551 (python) S 30529 30529 28606 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869487322 378003456 22089 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554946 18446604466495323072 0 0 -1 7 0 0 0
[pid=30556] ppid=30529 vsize=389656 CPUtime=0.23 cores=1,3,5,7
/proc/30556/stat : 30556 (python) S 30529 30529 28606 0 -1 4202560 1139 0 0 0 10 13 0 0 18 0 2 0 869489807 399007744 22097 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/30556/statm: 97414 22097 396 364 0 32289 0
[pid=30558] ppid=30556 vsize=53296 CPUtime=93.22 cores=1,3,5,7
/proc/30558/stat : 30558 (clasp-1.3.7-x86) T 30556 30558 30558 0 -1 4202496 14014 0 0 0 9321 1 0 0 25 0 1 0 869489807 54575104 12806 33554432000 134512640 136139019 4294283408 18446744073709551615 134883787 0 0 16781312 16386 18446744071562691360 0 0 17 1 0 0 0
/proc/30558/statm: 13324 12806 184 398 0 12924 0
[pid=30556/tid=30560] ppid=30529 vsize=389656 CPUtime=0 cores=1,3,5,7
/proc/30556/task/30560/stat : 30560 (python) S 30529 30529 28606 0 -1 4202560 45 0 0 0 0 0 0 0 18 0 2 0 869494619 399007744 22097 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554946 18446604471147869376 0 0 -1 7 0 0 0
[pid=30561] ppid=30529 vsize=399912 CPUtime=0.11 cores=1,3,5,7
/proc/30561/stat : 30561 (python) S 30529 30529 28606 0 -1 4202560 1152 0 0 0 5 6 0 0 16 0 2 0 869494622 409509888 22101 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/30561/statm: 99978 22101 396 364 0 34850 0
[pid=30563] ppid=30561 vsize=95188 CPUtime=48.21 cores=1,3,5,7
/proc/30563/stat : 30563 (bsolo_pb10) T 30561 30563 30563 0 -1 4202496 27414 0 0 0 4701 120 0 0 25 0 1 0 869494622 97472512 21331 33554432000 134512640 137138936 4291497760 18446744073709551615 134542805 0 0 16781312 16384 18446744071562691360 0 0 17 3 0 0 0
/proc/30563/statm: 23797 21331 192 642 0 23153 0
[pid=30561/tid=30568] ppid=30529 vsize=399912 CPUtime=0 cores=1,3,5,7
/proc/30561/task/30568/stat : 30568 (python) S 30529 30529 28606 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869499444 409509888 22101 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554946 18446604471142503680 0 0 -1 1 0 0 0
[pid=30570] ppid=30529 vsize=410168 CPUtime=0.12 cores=1,3,5,7
/proc/30570/stat : 30570 (python) S 30529 30529 28606 0 -1 4202560 1162 0 0 0 6 6 0 0 17 0 2 0 869503961 420012032 22105 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/30570/statm: 102542 22105 396 364 0 37411 0
[pid=30572] ppid=30570 vsize=8541184 CPUtime=49.51 cores=1,3,5,7
/proc/30572/stat : 30572 (java) T 30570 30572 30572 0 -1 4202496 701692 0 1 0 4875 76 0 0 15 0 19 0 869503962 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933579749 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/30572/statm: 2135296 692914 2260 9 0 2126037 0
[pid=30572/tid=30573] ppid=30570 vsize=8541184 CPUtime=46.77 cores=1,3,5,7
/proc/30572/task/30573/stat : 30573 (java) T 30570 30572 30572 0 -1 4202560 642352 0 1 0 4609 68 0 0 25 0 19 0 869503963 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 46912505777936 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30572/tid=30574] ppid=30570 vsize=8541184 CPUtime=0.09 cores=1,3,5,7
/proc/30572/task/30574/stat : 30574 (java) T 30570 30572 30572 0 -1 4202560 6290 0 0 0 9 0 0 0 15 0 19 0 869503963 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30572/tid=30575] ppid=30570 vsize=8541184 CPUtime=0.05 cores=1,3,5,7
/proc/30572/task/30575/stat : 30575 (java) T 30570 30572 30572 0 -1 4202560 3935 0 0 0 5 0 0 0 15 0 19 0 869503963 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=30572/tid=30576] ppid=30570 vsize=8541184 CPUtime=0.06 cores=1,3,5,7
/proc/30572/task/30576/stat : 30576 (java) T 30570 30572 30572 0 -1 4202560 3451 0 0 0 6 0 0 0 15 0 19 0 869503963 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=30572/tid=30577] ppid=30570 vsize=8541184 CPUtime=0.04 cores=1,3,5,7
/proc/30572/task/30577/stat : 30577 (java) T 30570 30572 30572 0 -1 4202560 2753 0 0 0 4 0 0 0 15 0 19 0 869503963 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=30572/tid=30578] ppid=30570 vsize=8541184 CPUtime=0.05 cores=1,3,5,7
/proc/30572/task/30578/stat : 30578 (java) T 30570 30572 30572 0 -1 4202560 3818 0 0 0 5 0 0 0 15 0 19 0 869503963 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=30572/tid=30579] ppid=30570 vsize=8541184 CPUtime=0.01 cores=1,3,5,7
/proc/30572/task/30579/stat : 30579 (java) T 30570 30572 30572 0 -1 4202560 858 0 0 0 1 0 0 0 15 0 19 0 869503963 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=30572/tid=30580] ppid=30570 vsize=8541184 CPUtime=0.11 cores=1,3,5,7
/proc/30572/task/30580/stat : 30580 (java) T 30570 30572 30572 0 -1 4202560 8144 0 0 0 10 1 0 0 15 0 19 0 869503963 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=30572/tid=30581] ppid=30570 vsize=8541184 CPUtime=0.08 cores=1,3,5,7
/proc/30572/task/30581/stat : 30581 (java) T 30570 30572 30572 0 -1 4202560 5678 0 0 0 8 0 0 0 15 0 19 0 869503963 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=30572/tid=30582] ppid=30570 vsize=8541184 CPUtime=0.44 cores=1,3,5,7
/proc/30572/task/30582/stat : 30582 (java) T 30570 30572 30572 0 -1 4202560 11138 0 0 0 44 0 0 0 15 0 19 0 869503964 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933593600 0 0 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30572/tid=30583] ppid=30570 vsize=8541184 CPUtime=0 cores=1,3,5,7
/proc/30572/task/30583/stat : 30583 (java) T 30570 30572 30572 0 -1 4202560 17 0 0 0 0 0 0 0 15 0 19 0 869503965 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=30572/tid=30584] ppid=30570 vsize=8541184 CPUtime=0 cores=1,3,5,7
/proc/30572/task/30584/stat : 30584 (java) T 30570 30572 30572 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 19 0 869503965 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30572/tid=30585] ppid=30570 vsize=8541184 CPUtime=0 cores=1,3,5,7
/proc/30572/task/30585/stat : 30585 (java) T 30570 30572 30572 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869503967 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933600689 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30572/tid=30586] ppid=30570 vsize=8541184 CPUtime=0.92 cores=1,3,5,7
/proc/30572/task/30586/stat : 30586 (java) T 30570 30572 30572 0 -1 4202560 4842 0 0 0 92 0 0 0 15 0 19 0 869503967 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=30572/tid=30587] ppid=30570 vsize=8541184 CPUtime=0.75 cores=1,3,5,7
/proc/30572/task/30587/stat : 30587 (java) T 30570 30572 30572 0 -1 4202560 7035 0 0 0 75 0 0 0 15 0 19 0 869503967 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=30572/tid=30588] ppid=30570 vsize=8541184 CPUtime=0 cores=1,3,5,7
/proc/30572/task/30588/stat : 30588 (java) T 30570 30572 30572 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869503967 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933592985 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30572/tid=30589] ppid=30570 vsize=8541184 CPUtime=0 cores=1,3,5,7
/proc/30572/task/30589/stat : 30589 (java) T 30570 30572 30572 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869503967 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933593600 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=30572/tid=30590] ppid=30570 vsize=8541184 CPUtime=0 cores=1,3,5,7
/proc/30572/task/30590/stat : 30590 (java) T 30570 30572 30572 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869504134 8746172416 692914 33554432000 1073741824 1073778376 140735464909136 18446744073709551615 222933593600 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=30570/tid=30592] ppid=30529 vsize=410168 CPUtime=0 cores=1,3,5,7
/proc/30570/task/30592/stat : 30592 (python) S 30529 30529 28606 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 869508707 420012032 22105 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554946 18446604469852678208 0 0 -1 1 0 0 0
[pid=30593] ppid=30529 vsize=420424 CPUtime=0 cores=1,3,5,7
/proc/30593/stat : 30593 (python) S 30529 30529 28606 0 -1 4202560 840 0 0 0 0 0 0 0 19 0 1 0 869508710 430514176 22060 33554432000 4194304 5683644 140735334525584 18446744073709551615 222921797190 0 0 16781312 33554946 4294934791 0 0 17 3 0 0 0
/proc/30593/statm: 105106 22060 348 364 0 39972 0
[pid=30595] ppid=30593 vsize=8537324 CPUtime=1.45 cores=1,3,5,7
/proc/30595/stat : 30595 (java) S 30593 30595 30595 0 -1 4202496 46120 0 1 0 139 6 0 0 20 0 18 0 869508710 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933579749 0 0 0 16800975 18446744073709551615 0 0 17 1 0 0 0
/proc/30595/statm: 2134331 44064 2224 9 0 2125072 0
[pid=30595/tid=30596] ppid=30593 vsize=8537324 CPUtime=0.9 cores=1,3,5,7
/proc/30595/task/30596/stat : 30596 (java) R 30593 30595 30595 0 -1 4202560 35194 0 1 0 86 4 0 0 18 0 18 0 869508711 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933603787 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=30595/tid=30597] ppid=30593 vsize=8537324 CPUtime=0.01 cores=1,3,5,7
/proc/30595/task/30597/stat : 30597 (java) S 30593 30595 30595 0 -1 4202560 1275 0 0 0 1 0 0 0 16 0 18 0 869508711 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933592985 0 4 0 16800975 18446604457455377344 0 0 -1 1 0 0 0
[pid=30595/tid=30598] ppid=30593 vsize=8537324 CPUtime=0.01 cores=1,3,5,7
/proc/30595/task/30598/stat : 30598 (java) S 30593 30595 30595 0 -1 4202560 1062 0 0 0 1 0 0 0 16 0 18 0 869508711 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933592985 0 4 0 16800975 18446604457455377344 0 0 -1 5 0 0 0
[pid=30595/tid=30599] ppid=30593 vsize=8537324 CPUtime=0 cores=1,3,5,7
/proc/30595/task/30599/stat : 30599 (java) S 30593 30595 30595 0 -1 4202560 369 0 0 0 0 0 0 0 15 0 18 0 869508711 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933592985 0 4 0 16800975 18446604457455377344 0 0 -1 3 0 0 0
[pid=30595/tid=30600] ppid=30593 vsize=8537324 CPUtime=0 cores=1,3,5,7
/proc/30595/task/30600/stat : 30600 (java) S 30593 30595 30595 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 18 0 869508711 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933592985 0 4 0 16800975 18446604457455377344 0 0 -1 3 0 0 0
[pid=30595/tid=30601] ppid=30593 vsize=8537324 CPUtime=0 cores=1,3,5,7
/proc/30595/task/30601/stat : 30601 (java) S 30593 30595 30595 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 18 0 869508711 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933592985 0 4 0 16800975 18446604457455377344 0 0 -1 3 0 0 0
[pid=30595/tid=30602] ppid=30593 vsize=8537324 CPUtime=0 cores=1,3,5,7
/proc/30595/task/30602/stat : 30602 (java) S 30593 30595 30595 0 -1 4202560 737 0 0 0 0 0 0 0 17 0 18 0 869508711 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933592985 0 4 0 16800975 18446604457455377344 0 0 -1 7 0 0 0
[pid=30595/tid=30603] ppid=30593 vsize=8537324 CPUtime=0 cores=1,3,5,7
/proc/30595/task/30603/stat : 30603 (java) S 30593 30595 30595 0 -1 4202560 218 0 0 0 0 0 0 0 17 0 18 0 869508711 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933592985 0 4 0 16800975 18446604457455377344 0 0 -1 5 0 0 0
[pid=30595/tid=30604] ppid=30593 vsize=8537324 CPUtime=0 cores=1,3,5,7
/proc/30595/task/30604/stat : 30604 (java) S 30593 30595 30595 0 -1 4202560 849 0 0 0 0 0 0 0 17 0 18 0 869508711 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933592985 0 4 0 16800975 18446604457455377344 0 0 -1 3 0 0 0
[pid=30595/tid=30605] ppid=30593 vsize=8537324 CPUtime=0 cores=1,3,5,7
/proc/30595/task/30605/stat : 30605 (java) S 30593 30595 30595 0 -1 4202560 71 0 0 0 0 0 0 0 17 0 18 0 869508712 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933593600 0 0 0 16800975 18446604457455377344 0 0 -1 7 0 0 0
[pid=30595/tid=30606] ppid=30593 vsize=8537324 CPUtime=0 cores=1,3,5,7
/proc/30595/task/30606/stat : 30606 (java) S 30593 30595 30595 0 -1 4202560 17 0 0 0 0 0 0 0 19 0 18 0 869508713 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933592985 0 4 0 16800975 18446604457455377344 0 0 -1 1 0 0 0
[pid=30595/tid=30607] ppid=30593 vsize=8537324 CPUtime=0 cores=1,3,5,7
/proc/30595/task/30607/stat : 30607 (java) S 30593 30595 30595 0 -1 4202560 10 0 0 0 0 0 0 0 19 0 18 0 869508713 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933592985 0 4 0 16800975 18446604457455377344 0 0 -1 7 0 0 0
[pid=30595/tid=30608] ppid=30593 vsize=8537324 CPUtime=0 cores=1,3,5,7
/proc/30595/task/30608/stat : 30608 (java) S 30593 30595 30595 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869508715 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933600689 0 4 0 16800975 18446604457455377344 0 0 -1 1 0 0 0
[pid=30595/tid=30609] ppid=30593 vsize=8537324 CPUtime=0.25 cores=1,3,5,7
/proc/30595/task/30609/stat : 30609 (java) S 30593 30595 30595 0 -1 4202560 2617 0 0 0 25 0 0 0 16 0 18 0 869508715 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933592985 0 4 0 16800975 18446604457455377344 0 0 -1 1 0 0 0
[pid=30595/tid=30610] ppid=30593 vsize=8537324 CPUtime=0.21 cores=1,3,5,7
/proc/30595/task/30610/stat : 30610 (java) S 30593 30595 30595 0 -1 4202560 2340 0 0 0 21 0 0 0 16 0 18 0 869508715 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933592985 0 4 0 16800975 18446604457455377344 0 0 -1 7 0 0 0
[pid=30595/tid=30611] ppid=30593 vsize=8537324 CPUtime=0 cores=1,3,5,7
/proc/30595/task/30611/stat : 30611 (java) S 30593 30595 30595 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 869508715 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933592985 0 4 0 16800975 18446604457455377344 0 0 -1 7 0 0 0
[pid=30595/tid=30612] ppid=30593 vsize=8537324 CPUtime=0 cores=1,3,5,7
/proc/30595/task/30612/stat : 30612 (java) S 30593 30595 30595 0 -1 4202560 1 0 0 0 0 0 0 0 15 0 18 0 869508715 8742219776 44064 33554432000 1073741824 1073778376 140737434945168 18446744073709551615 222933593600 0 4 0 16800975 18446604457455377344 0 0 -1 3 0 0 0
[pid=30529/tid=30537] ppid=30527 vsize=430668 CPUtime=10.71 cores=1,3,5,7
/proc/30529/task/30537/stat : 30537 (python) S 30527 30529 28606 0 -1 4202560 25 1056147 0 0 0 0 433 638 20 0 9 0 869472249 441004032 23603 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554434 18446604459138262080 0 0 -1 7 0 0 0
[pid=30529/tid=30542] ppid=30527 vsize=430668 CPUtime=10.71 cores=1,3,5,7
/proc/30529/task/30542/stat : 30542 (python) S 30527 30529 28606 0 -1 4202560 26 1056147 0 0 0 0 433 638 20 0 9 0 869477372 441004032 23603 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554434 18446604459138262080 0 0 -1 5 0 0 0
[pid=30529/tid=30547] ppid=30527 vsize=430668 CPUtime=10.71 cores=1,3,5,7
/proc/30529/task/30547/stat : 30547 (python) S 30527 30529 28606 0 -1 4202560 30 1056147 0 0 0 0 433 638 20 0 9 0 869482259 441004032 23603 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554434 18446604459138262080 0 0 -1 1 0 0 0
[pid=30529/tid=30553] ppid=30527 vsize=430668 CPUtime=10.71 cores=1,3,5,7
/proc/30529/task/30553/stat : 30553 (python) S 30527 30529 28606 0 -1 4202560 33 1056147 0 0 0 0 433 638 25 0 9 0 869488735 441004032 23603 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554434 18446604459138262080 0 0 -1 5 0 0 0
[pid=30529/tid=30557] ppid=30527 vsize=430668 CPUtime=10.71 cores=1,3,5,7
/proc/30529/task/30557/stat : 30557 (python) S 30527 30529 28606 0 -1 4202560 37 1056147 0 0 0 0 433 638 18 0 9 0 869489807 441004032 23603 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554434 18446604459138262080 0 0 -1 1 0 0 0
[pid=30529/tid=30562] ppid=30527 vsize=430668 CPUtime=10.71 cores=1,3,5,7
/proc/30529/task/30562/stat : 30562 (python) S 30527 30529 28606 0 -1 4202560 31 1056147 0 0 0 0 433 638 20 0 9 0 869494622 441004032 23603 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554434 18446604459138262080 0 0 -1 7 0 0 0
[pid=30529/tid=30571] ppid=30527 vsize=430668 CPUtime=10.71 cores=1,3,5,7
/proc/30529/task/30571/stat : 30571 (python) S 30527 30529 28606 0 -1 4202560 30 1056147 0 0 0 0 433 638 20 0 9 0 869503961 441004032 23603 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554434 18446604459138262080 0 0 -1 1 0 0 0
[pid=30529/tid=30594] ppid=30527 vsize=430668 CPUtime=10.71 cores=1,3,5,7
/proc/30529/task/30594/stat : 30594 (python) S 30527 30529 28606 0 -1 4202560 28 1056147 0 0 0 0 433 638 20 0 9 0 869508710 441004032 23603 33554432000 4194304 5683644 140735334525584 18446744073709551615 222933600689 0 0 16781312 33554434 18446604459138262080 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 373.63
Current children cumulated vsize (KiB) 21411876

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 30529 and gives
#  childrusage.ru_utime.tv_sec=23
#  childrusage.ru_utime.tv_usec=198473
#  childrusage.ru_stime.tv_sec=6
#  childrusage.ru_stime.tv_usec=616994
# CPU time returned by wait4() is 29.8155
# while last known CPU time is 373.63
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 370.701
CPU time (s): 373.63
CPU user time (s): 360.62
CPU system time (s): 13.01
CPU usage (%): 100.79
Max. virtual memory (cumulated for all children) (KiB): 21411876

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 23.1985
system time used= 6.61699
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1099376
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2923
involuntary context switches= 57

runsolver used 1.22281 second user time and 2.86756 second system time

The end

Launcher Data 

Begin job on node109 at 2011-06-09 02:18:29
IDJOB=3482902
IDBENCH=89814
IDSOLVER=1971
FILE ID=node109/3482902-1307578709
RUNJOBID= node109-1307576440-28625
PBS_JOBID= 13547696
Free space on /tmp= 73956 MiB

SOLVER NAME= borg pb-dec-11.04.03
BENCH NAME= PB11/normalized-PB11/DEC-SMALLINT-LIN/lopes/normalized-89.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482902-1307578709/watcher-3482902-1307578709 -o /tmp/evaluation-result-3482902-1307578709/solver-3482902-1307578709 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482902-1307578709.opb -seed 1390992116 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5e35cfce24461785d6d1180987ae518e
RANDOM SEED=1390992116

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25756164 kB
Buffers:        200760 kB
Cached:         589764 kB
SwapCached:       8632 kB
Active:        6699896 kB
Inactive:       213716 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25756164 kB
SwapTotal:    67111528 kB
SwapFree:     53958412 kB
Dirty:          111192 kB
Writeback:           0 kB
AnonPages:     6120524 kB
Mapped:          49232 kB
Slab:           161996 kB
PageTables:      55416 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 38500944 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 69780 MiB
End job on node109 at 2011-06-09 02:24:43