Trace number 3482903

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-dec-11.04.03? (MO) 373.12 415.375

General information on the benchmark

Name/DEC-SMALLINT-LIN/lopes/
normalized-91.opb
MD5SUM0d52a3bd95f65144c5f8bf26bef42f13
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables10086
Total number of constraints226240
Number of constraints which are clauses203302
Number of constraints which are cardinality constraints (but not clauses)720
Number of constraints which are nor clauses,nor cardinality constraints22218
Minimum length of a constraint2
Maximum length of a constraint231
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 232
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.57/14.02	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.57/14.02	c INFO: solving HOME/instance-3482903-1307578391.opb
2.18/15.61	c INFO: parsing took 1.57 s
5.18/18.70	c INFO: features took 3.08 CPU seconds
5.29/18.73	c INFO: running wbo1.4b-fixed@0 for 45 with 1795 remaining (b = 0.96)
55.72/69.09	c INFO: running pbct-0.1.2-linear@0 for 45 with 1745 remaining (b = 0.96)
104.91/118.02	c INFO: running wbo1.4a@0 for 45 with 1697 remaining (b = 0.90)
169.68/182.66	c INFO: wrote minion input file to HOME/tmpMOQweQ.minion
169.68/182.66	c INFO: running minion-0.12@0 for 45 with 1648 remaining (b = 0.70)
180.55/198.79	c INFO: running clasp-1.3.7@0 for 45 with 1629 remaining (b = 0.57)
231.43/251.08	c INFO: running bsolo_pb10-l2@0 for 45 with 1579 remaining (b = 0.47)
281.29/304.03	c INFO: running clasp-1.3.7@50 for 45 with 1530 remaining (b = 0.18)
324.66/349.26	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1487 remaining (b = 0.21)
373.01/392.62	c INFO: running sat4j-pb-v20101225@0 for 45 with 1440 remaining (b = 0.16)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482903-1307578391/watcher-3482903-1307578391 -o /tmp/evaluation-result-3482903-1307578391/solver-3482903-1307578391 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482903-1307578391.opb -seed 997748722 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.18 2.08 1.95 2/511 4473
/proc/meminfo: memFree=16858384/32951132 swapFree=65929880/67111528
[pid=4473] ppid=4471 vsize=11796 CPUtime=0 cores=1,3,5,7
/proc/4473/stat : 4473 (runsolver) R 4471 4473 3617 0 -1 4202560 46 0 0 0 0 0 0 0 23 0 1 0 869439168 12079104 53 33554432000 4194304 5432328 140733589632752 18446744073709551615 5055479 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/4473/statm: 2949 53 34 303 0 2643 0

[startup+0.0435009 s]
/proc/loadavg: 2.18 2.08 1.95 2/511 4473
/proc/meminfo: memFree=16858384/32951132 swapFree=65929880/67111528
[pid=4473] ppid=4471 vsize=11796 CPUtime=0.01 cores=1,3,5,7
/proc/4473/stat : 4473 (runsolver) R 4471 4473 3617 0 -1 4202560 46 0 0 0 0 1 0 0 23 0 1 0 869439168 12079104 53 33554432000 4194304 5432328 140733589632752 18446744073709551615 5055479 0 0 4096 24578 0 0 0 17 1 0 0 0
/proc/4473/statm: 2949 53 34 303 0 2643 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 11796

[startup+0.100488 s]
/proc/loadavg: 2.18 2.08 1.95 2/511 4473
/proc/meminfo: memFree=16858384/32951132 swapFree=65929880/67111528
[pid=4473] ppid=4471 vsize=4 CPUtime=0.04 cores=1,3,5,7
/proc/4473/stat : 4473 (python) R 4471 4473 3617 0 -1 4194304 47 0 0 0 0 4 0 0 23 0 1 0 869439168 4096 1 33554432000 0 0 0 18446744073709551615 5055479 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/4473/statm: 1 1 0 0 0 1 0
Current children cumulated CPU time (s) 0.04
Current children cumulated vsize (KiB) 4

[startup+0.300408 s]
/proc/loadavg: 2.18 2.08 1.95 2/511 4473
/proc/meminfo: memFree=16858384/32951132 swapFree=65929880/67111528
[pid=4473] ppid=4471 vsize=54636 CPUtime=0.14 cores=1,3,5,7
/proc/4473/stat : 4473 (python) R 4471 4473 3617 0 -1 4202496 2068 0 0 0 4 10 0 0 25 0 1 0 869439168 55947264 1825 33554432000 4194304 5683644 140734973132848 18446744073709551615 4539648 0 0 16781312 2 0 0 0 17 7 0 0 0
/proc/4473/statm: 13659 1825 492 364 0 1309 0
Current children cumulated CPU time (s) 0.14
Current children cumulated vsize (KiB) 54636

[startup+0.700385 s]
/proc/loadavg: 2.18 2.08 1.95 2/511 4473
/proc/meminfo: memFree=16858384/32951132 swapFree=65929880/67111528
[pid=4473] ppid=4471 vsize=85356 CPUtime=0.15 cores=1,3,5,7
/proc/4473/stat : 4473 (python) D 4471 4473 3617 0 -1 4202496 2585 0 0 0 4 11 0 0 25 0 1 0 869439168 87404544 2309 33554432000 4194304 5683644 140734973132848 18446744073709551615 274664814135 0 0 16781312 2 18446744071562154983 0 0 17 7 0 0 0
/proc/4473/statm: 21339 2309 709 364 0 1556 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 85356

[startup+1.50024 s]
/proc/loadavg: 2.32 2.12 1.96 3/512 4474
/proc/meminfo: memFree=16850192/32951132 swapFree=65929880/67111528
[pid=4473] ppid=4471 vsize=85356 CPUtime=0.15 cores=1,3,5,7
/proc/4473/stat : 4473 (python) D 4471 4473 3617 0 -1 4202496 2585 0 0 0 4 11 0 0 25 0 1 0 869439168 87404544 2309 33554432000 4194304 5683644 140734973132848 18446744073709551615 274664814135 0 0 16781312 2 18446744071562154983 0 0 17 7 0 0 0
/proc/4473/statm: 21339 2309 709 364 0 1556 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 85356

[startup+3.10097 s]
/proc/loadavg: 2.32 2.12 1.96 2/512 4474
/proc/meminfo: memFree=16849140/32951132 swapFree=65929880/67111528
[pid=4473] ppid=4471 vsize=94064 CPUtime=0.17 cores=1,3,5,7
/proc/4473/stat : 4473 (python) S 4471 4473 3617 0 -1 4202496 2795 0 1 0 5 12 0 0 18 0 1 0 869439168 96321536 2467 33554432000 4194304 5683644 140734973132848 18446744073709551615 274664808192 0 0 16781312 2 18446744071562362840 0 0 17 7 0 0 221
/proc/4473/statm: 23516 2467 788 364 0 1627 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 94064
heavy processes:

[startup+6.30041 s]
/proc/loadavg: 2.46 2.15 1.97 2/513 4475
/proc/meminfo: memFree=16847056/32951132 swapFree=65929880/67111528
[pid=4473] ppid=4471 vsize=94064 CPUtime=0.17 cores=1,3,5,7
/proc/4473/stat : 4473 (python) S 4471 4473 3617 0 -1 4202496 2795 0 1 0 5 12 0 0 18 0 1 0 869439168 96321536 2467 33554432000 4194304 5683644 140734973132848 18446744073709551615 274664808192 0 0 16781312 2 18446744071562362840 0 0 17 7 0 0 221
/proc/4473/statm: 23516 2467 788 364 0 1627 0
[pid=4475] ppid=4473 vsize=94060 CPUtime=0 cores=1,3,5,7
/proc/4475/stat : 4475 (python) D 4473 4473 3617 0 -1 4202560 24 0 0 0 0 0 0 0 18 0 1 0 869439423 96317440 1721 33554432000 4194304 5683644 140734973132848 18446744073709551615 274664629239 0 0 16781312 2 18446744071696489144 0 0 17 7 0 0 0
/proc/4475/statm: 23515 1721 42 364 0 1626 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 188124
heavy processes:

[startup+12.7003 s]
/proc/loadavg: 2.58 2.18 1.98 2/513 4476
/proc/meminfo: memFree=16845948/32951132 swapFree=65929880/67111528
[pid=4473] ppid=4471 vsize=94064 CPUtime=0.17 cores=1,3,5,7
/proc/4473/stat : 4473 (python) S 4471 4473 3617 0 -1 4202496 2795 0 1 0 5 12 0 0 18 0 1 0 869439168 96321536 2467 33554432000 4194304 5683644 140734973132848 18446744073709551615 274664808192 0 0 16781312 2 18446744071562362840 0 0 17 7 0 0 221
/proc/4473/statm: 23516 2467 788 364 0 1627 0
[pid=4475] ppid=4473 vsize=94060 CPUtime=0 cores=1,3,5,7
/proc/4475/stat : 4475 (python) D 4473 4473 3617 0 -1 4202560 24 0 0 0 0 0 0 0 18 0 1 0 869439423 96317440 1721 33554432000 4194304 5683644 140734973132848 18446744073709551615 274664629239 0 0 16781312 2 18446744071696489144 0 0 17 7 0 0 0
/proc/4475/statm: 23515 1721 42 364 0 1626 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 188124
heavy processes:

[startup+25.5011 s]
/proc/loadavg: 2.88 2.25 2.01 3/515 4482
/proc/meminfo: memFree=16733652/32951132 swapFree=65929880/67111528
[pid=4473] ppid=4471 vsize=358876 CPUtime=5.31 cores=1,3,5,7
/proc/4473/stat : 4473 (python) S 4471 4473 3617 0 -1 4202496 36821 930 1 0 496 24 0 11 25 0 2 0 869439168 367489024 23560 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676635083 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 221
/proc/4473/statm: 89719 23560 1872 364 0 24606 0
[pid=4480] ppid=4473 vsize=348632 CPUtime=0.02 cores=1,3,5,7
/proc/4480/stat : 4480 (python) S 4473 4473 3617 0 -1 4202560 882 0 0 0 1 1 0 0 15 0 1 0 869441041 356999168 22059 33554432000 4194304 5683644 140734973132848 18446744073709551615 274664828431 0 0 16781312 33554946 4294934790 0 0 17 7 0 0 0
/proc/4480/statm: 87158 22059 375 364 0 22045 0
[pid=4482] ppid=4480 vsize=33568 CPUtime=6.73 cores=1,3,5,7
/proc/4482/stat : 4482 (wbo1.4b-fixed) R 4480 4482 4482 0 -1 4202496 10592 0 0 0 630 43 0 0 25 0 1 0 869441042 34373632 7783 33554432000 134512640 135752315 4290494720 18446744073709551615 135270849 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/4482/statm: 8392 7783 146 303 0 8087 0
[pid=4473/tid=4481] ppid=4471 vsize=358876 CPUtime=0.11 cores=1,3,5,7
/proc/4473/task/4481/stat : 4481 (python) S 4471 4473 3617 0 -1 4202560 26 930 0 0 0 0 0 11 25 0 2 0 869441042 367489024 23560 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554434 18446604458710460224 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.06
Current children cumulated vsize (KiB) 741076
heavy processes:

[startup+51.1007 s]
/proc/loadavg: 2.80 2.31 2.03 4/515 4482
/proc/meminfo: memFree=16717704/32951132 swapFree=65929880/67111528
[pid=4473] ppid=4471 vsize=358876 CPUtime=5.31 cores=1,3,5,7
/proc/4473/stat : 4473 (python) S 4471 4473 3617 0 -1 4202496 36821 930 1 0 496 24 0 11 25 0 2 0 869439168 367489024 23560 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676635083 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 221
/proc/4473/statm: 89719 23560 1872 364 0 24606 0
[pid=4480] ppid=4473 vsize=348632 CPUtime=0.13 cores=1,3,5,7
/proc/4480/stat : 4480 (python) S 4473 4473 3617 0 -1 4202560 991 0 0 0 6 7 0 0 16 0 1 0 869441041 356999168 22064 33554432000 4194304 5683644 140734973132848 18446744073709551615 274664828431 0 0 16781312 33554946 5623606151888251760 0 0 17 5 0 0 0
/proc/4480/statm: 87158 22064 380 364 0 22045 0
[pid=4482] ppid=4480 vsize=52380 CPUtime=32.32 cores=1,3,5,7
/proc/4482/stat : 4482 (wbo1.4b-fixed) R 4480 4482 4482 0 -1 4202496 15213 0 0 0 3157 75 0 0 25 0 1 0 869441042 53637120 12404 33554432000 134512640 135752315 4290494720 18446744073709551615 134611201 0 0 16781312 3 0 0 0 17 3 0 0 0
/proc/4482/statm: 13095 12404 146 303 0 12790 0
[pid=4473/tid=4481] ppid=4471 vsize=358876 CPUtime=0.11 cores=1,3,5,7
/proc/4473/task/4481/stat : 4481 (python) S 4471 4473 3617 0 -1 4202560 26 930 0 0 0 0 0 11 25 0 2 0 869441042 367489024 23560 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554434 18446604458710460224 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 37.76
Current children cumulated vsize (KiB) 759888
heavy processes:

[startup+102.318 s]
/proc/loadavg: 2.46 2.29 2.04 3/522 4491
/proc/meminfo: memFree=15814344/32951132 swapFree=65929880/67111528
[pid=4473] ppid=4471 vsize=369132 CPUtime=5.34 cores=1,3,5,7
/proc/4473/stat : 4473 (python) S 4471 4473 3617 0 -1 4202496 37755 930 1 0 499 24 0 11 19 0 3 0 869439168 377991168 23567 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676635083 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 221
/proc/4473/statm: 92283 23567 1875 364 0 27167 0
[pid=4480] ppid=4473 vsize=358876 CPUtime=0.2 cores=1,3,5,7
/proc/4480/stat : 4480 (python) S 4473 4473 3617 0 -1 4202560 1131 0 0 0 9 11 0 0 16 0 2 0 869441041 367489024 22100 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676635083 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/4480/statm: 89719 22100 411 364 0 24606 0
[pid=4482] ppid=4480 vsize=65836 CPUtime=50.3 cores=1,3,5,7
/proc/4482/stat : 4482 (wbo1.4b-fixed) T 4480 4482 4482 0 -1 4202496 18524 0 0 0 4931 99 0 0 25 0 1 0 869441042 67416064 15715 33554432000 134512640 135752315 4290494720 18446744073709551615 134611201 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/4482/statm: 16459 15715 146 303 0 16154 0
[pid=4480/tid=4483] ppid=4473 vsize=358876 CPUtime=0 cores=1,3,5,7
/proc/4480/task/4483/stat : 4483 (python) S 4473 4473 3617 0 -1 4202560 40 0 0 0 0 0 0 0 16 0 2 0 869446075 367489024 22100 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554946 18446604459276952576 0 0 -1 5 0 0 0
[pid=4484] ppid=4473 vsize=358888 CPUtime=0.11 cores=1,3,5,7
/proc/4484/stat : 4484 (python) S 4473 4473 3617 0 -1 4202560 941 0 0 0 6 5 0 0 15 0 1 0 869446077 367501312 22060 33554432000 4194304 5683644 140734973132848 18446744073709551615 274664828486 0 0 16781312 33554946 5623311482772007792 0 0 17 1 0 0 0
/proc/4484/statm: 89722 22060 372 364 0 24606 0
[pid=4486] ppid=4484 vsize=902564 CPUtime=33.21 cores=1,3,5,7
/proc/4486/stat : 4486 (pbct-0.1.2-linu) R 4484 4486 4486 0 -1 4202496 238459 0 0 0 3252 69 0 0 25 0 1 0 869446078 924225536 218076 33554432000 134512640 136422188 4293496128 18446744073709551615 135874785 0 0 16781312 16387 0 0 0 17 3 0 0 0
/proc/4486/statm: 225641 218076 215 467 0 225172 0
[pid=4473/tid=4481] ppid=4471 vsize=369132 CPUtime=0.11 cores=1,3,5,7
/proc/4473/task/4481/stat : 4481 (python) S 4471 4473 3617 0 -1 4202560 26 930 0 0 0 0 0 11 25 0 3 0 869441042 377991168 23567 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554434 18446604458710460224 0 0 -1 5 0 0 0
[pid=4473/tid=4485] ppid=4471 vsize=369132 CPUtime=0.11 cores=1,3,5,7
/proc/4473/task/4485/stat : 4485 (python) S 4471 4473 3617 0 -1 4202560 31 930 0 0 0 0 0 11 20 0 3 0 869446078 377991168 23567 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554434 18446604458710460224 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 89.16
Current children cumulated vsize (KiB) 2055296

[startup+162.301 s]
/proc/loadavg: 2.22 2.25 2.04 3/530 4501
/proc/meminfo: memFree=15676840/32951132 swapFree=65929880/67111528
[pid=4473] ppid=4471 vsize=379388 CPUtime=5.37 cores=1,3,5,7
/proc/4473/stat : 4473 (python) S 4471 4473 3617 0 -1 4202496 38647 930 1 0 501 25 0 11 20 0 4 0 869439168 388493312 23573 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676635083 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 221
/proc/4473/statm: 94847 23573 1877 364 0 29728 0
[pid=4480] ppid=4473 vsize=358876 CPUtime=0.2 cores=1,3,5,7
/proc/4480/stat : 4480 (python) S 4473 4473 3617 0 -1 4202560 1131 0 0 0 9 11 0 0 16 0 2 0 869441041 367489024 22100 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676635083 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/4480/statm: 89719 22100 411 364 0 24606 0
[pid=4482] ppid=4480 vsize=65836 CPUtime=50.3 cores=1,3,5,7
/proc/4482/stat : 4482 (wbo1.4b-fixed) T 4480 4482 4482 0 -1 4202496 18524 0 0 0 4931 99 0 0 25 0 1 0 869441042 67416064 15715 33554432000 134512640 135752315 4290494720 18446744073709551615 134611201 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/4482/statm: 16459 15715 146 303 0 16154 0
[pid=4480/tid=4483] ppid=4473 vsize=358876 CPUtime=0 cores=1,3,5,7
/proc/4480/task/4483/stat : 4483 (python) S 4473 4473 3617 0 -1 4202560 40 0 0 0 0 0 0 0 16 0 2 0 869446075 367489024 22100 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554946 18446604459276952576 0 0 -1 5 0 0 0
[pid=4484] ppid=4473 vsize=358888 CPUtime=0.18 cores=1,3,5,7
/proc/4484/stat : 4484 (python) S 4473 4473 3617 0 -1 4202560 1111 0 0 0 9 9 0 0 16 0 2 0 869446077 367501312 22085 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676635083 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/4484/statm: 89722 22085 396 364 0 24606 0
[pid=4486] ppid=4484 vsize=908432 CPUtime=48.89 cores=1,3,5,7
/proc/4486/stat : 4486 (pbct-0.1.2-linu) T 4484 4486 4486 0 -1 4202496 239882 0 0 0 4805 84 0 0 25 0 1 0 869446078 930234368 219499 33554432000 134512640 136422188 4293496128 18446744073709551615 134862222 0 0 16781312 16387 18446744071562691360 0 0 17 3 0 0 0
/proc/4486/statm: 227108 219499 215 467 0 226639 0
[pid=4484/tid=4492] ppid=4473 vsize=358888 CPUtime=0 cores=1,3,5,7
/proc/4484/task/4492/stat : 4492 (python) S 4473 4473 3617 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 869450968 367501312 22085 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554946 18446604463551198464 0 0 -1 7 0 0 0
[pid=4493] ppid=4473 vsize=369144 CPUtime=0.17 cores=1,3,5,7
/proc/4493/stat : 4493 (python) S 4473 4473 3617 0 -1 4202560 938 0 0 0 8 9 0 0 15 0 1 0 869450971 378003456 22064 33554432000 4194304 5683644 140734973132848 18446744073709551615 274664828486 0 0 16781312 33554946 5623753486446373744 0 0 17 7 0 0 0
/proc/4493/statm: 92286 22064 372 364 0 27167 0
[pid=4495] ppid=4493 vsize=56252 CPUtime=44.24 cores=1,3,5,7
/proc/4495/stat : 4495 (wbo1.4a) R 4493 4495 4495 0 -1 4202496 16153 0 0 0 4344 80 0 0 25 0 1 0 869450971 57602048 13341 33554432000 134512640 135751879 4287197904 18446744073709551615 135270609 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/4495/statm: 14063 13341 143 303 0 13758 0

################
# More data... #
################

Current children cumulated CPU time (s) 373.12
Current children cumulated vsize (KiB) 21331756

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+415.302 s]
/proc/loadavg: 6.31 4.35 2.93 6/567 4609
/proc/meminfo: memFree=6871376/32951132 swapFree=65929880/67111528
[pid=4473] ppid=4471 vsize=430668 CPUtime=30.49 cores=1,3,5,7
/proc/4473/stat : 4473 (python) S 4471 4473 3617 0 -1 4202496 43278 1056146 1 0 1919 29 439 662 20 0 9 0 869439168 441004032 23603 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676635083 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 221
/proc/4473/statm: 107667 23603 1887 364 0 42533 0
[pid=4480] ppid=4473 vsize=358876 CPUtime=0.2 cores=1,3,5,7
/proc/4480/stat : 4480 (python) S 4473 4473 3617 0 -1 4202560 1131 0 0 0 9 11 0 0 16 0 2 0 869441041 367489024 22100 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676635083 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/4480/statm: 89719 22100 411 364 0 24606 0
[pid=4482] ppid=4480 vsize=65836 CPUtime=50.3 cores=1,3,5,7
/proc/4482/stat : 4482 (wbo1.4b-fixed) T 4480 4482 4482 0 -1 4202496 18524 0 0 0 4931 99 0 0 25 0 1 0 869441042 67416064 15715 33554432000 134512640 135752315 4290494720 18446744073709551615 134611201 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/4482/statm: 16459 15715 146 303 0 16154 0
[pid=4480/tid=4483] ppid=4473 vsize=358876 CPUtime=0 cores=1,3,5,7
/proc/4480/task/4483/stat : 4483 (python) S 4473 4473 3617 0 -1 4202560 40 0 0 0 0 0 0 0 16 0 2 0 869446075 367489024 22100 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554946 18446604459276952576 0 0 -1 5 0 0 0
[pid=4484] ppid=4473 vsize=358888 CPUtime=0.18 cores=1,3,5,7
/proc/4484/stat : 4484 (python) S 4473 4473 3617 0 -1 4202560 1111 0 0 0 9 9 0 0 16 0 2 0 869446077 367501312 22085 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676635083 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/4484/statm: 89722 22085 396 364 0 24606 0
[pid=4486] ppid=4484 vsize=908432 CPUtime=48.89 cores=1,3,5,7
/proc/4486/stat : 4486 (pbct-0.1.2-linu) T 4484 4486 4486 0 -1 4202496 239882 0 0 0 4805 84 0 0 25 0 1 0 869446078 930234368 219499 33554432000 134512640 136422188 4293496128 18446744073709551615 134862222 0 0 16781312 16387 18446744071562691360 0 0 17 3 0 0 0
/proc/4486/statm: 227108 219499 215 467 0 226639 0
[pid=4484/tid=4492] ppid=4473 vsize=358888 CPUtime=0 cores=1,3,5,7
/proc/4484/task/4492/stat : 4492 (python) S 4473 4473 3617 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 869450968 367501312 22085 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554946 18446604463551198464 0 0 -1 7 0 0 0
[pid=4493] ppid=4473 vsize=369144 CPUtime=0.2 cores=1,3,5,7
/proc/4493/stat : 4493 (python) S 4473 4473 3617 0 -1 4202560 1097 0 0 0 10 10 0 0 16 0 2 0 869450971 378003456 22089 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676635083 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/4493/statm: 92286 22089 396 364 0 27167 0
[pid=4495] ppid=4493 vsize=61676 CPUtime=50.51 cores=1,3,5,7
/proc/4495/stat : 4495 (wbo1.4a) T 4493 4495 4495 0 -1 4202496 17482 0 0 0 4963 88 0 0 25 0 1 0 869450971 63156224 14670 33554432000 134512640 135751879 4287197904 18446744073709551615 134616336 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/4495/statm: 15419 14670 143 303 0 15114 0
[pid=4493/tid=4502] ppid=4473 vsize=369144 CPUtime=0 cores=1,3,5,7
/proc/4493/task/4502/stat : 4502 (python) S 4473 4473 3617 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 869456026 378003456 22089 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554946 18446604470853797696 0 0 -1 7 0 0 0
[pid=4507] ppid=4473 vsize=389656 CPUtime=0.41 cores=1,3,5,7
/proc/4507/stat : 4507 (python) S 4473 4473 3617 0 -1 4202560 1136 0 0 0 19 22 0 0 18 0 2 0 869459047 399007744 22097 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676635083 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/4507/statm: 97414 22097 396 364 0 32289 0
[pid=4509] ppid=4507 vsize=57320 CPUtime=93.85 cores=1,3,5,7
/proc/4509/stat : 4509 (clasp-1.3.7-x86) T 4507 4509 4509 0 -1 4202496 15004 0 0 0 9373 12 0 0 25 0 1 0 869459048 58695680 13800 33554432000 134512640 136139019 4286720544 18446744073709551615 134608577 0 0 16781312 16386 18446744071562691360 0 0 17 5 0 0 0
/proc/4509/statm: 14330 13800 184 398 0 13930 0
[pid=4507/tid=4547] ppid=4473 vsize=389656 CPUtime=0 cores=1,3,5,7
/proc/4507/task/4547/stat : 4547 (python) S 4473 4473 3617 0 -1 4202560 47 0 0 0 0 0 0 0 18 0 2 0 869464274 399007744 22097 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554946 18446604458710461120 0 0 -1 5 0 0 0
[pid=4548] ppid=4473 vsize=399912 CPUtime=0.2 cores=1,3,5,7
/proc/4548/stat : 4548 (python) S 4473 4473 3617 0 -1 4202560 1138 0 0 0 11 9 0 0 16 0 2 0 869464276 409509888 22101 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676635083 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0
/proc/4548/statm: 99978 22101 396 364 0 34850 0
[pid=4550] ppid=4548 vsize=88348 CPUtime=49.56 cores=1,3,5,7
/proc/4550/stat : 4550 (bsolo_pb10) T 4548 4550 4550 0 -1 4202496 25698 0 0 0 4838 118 0 0 25 0 1 0 869464277 90468352 19620 33554432000 134512640 137138936 4294687472 18446744073709551615 134542770 0 0 16781312 16384 18446744071562691360 0 0 17 5 0 0 0
/proc/4550/statm: 22087 19620 192 642 0 21443 0
[pid=4548/tid=4556] ppid=4473 vsize=399912 CPUtime=0 cores=1,3,5,7
/proc/4548/task/4556/stat : 4556 (python) S 4473 4473 3617 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869469569 409509888 22101 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554946 18446604458014340352 0 0 -1 3 0 0 0
[pid=4562] ppid=4473 vsize=410168 CPUtime=0.21 cores=1,3,5,7
/proc/4562/stat : 4562 (python) S 4473 4473 3617 0 -1 4202560 1163 0 0 0 8 13 0 0 16 0 2 0 869474095 420012032 22105 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676635083 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/4562/statm: 102542 22105 396 364 0 37411 0
[pid=4564] ppid=4562 vsize=8546340 CPUtime=48.03 cores=1,3,5,7
/proc/4564/stat : 4564 (java) T 4562 4564 4564 0 -1 4202496 699776 0 1 0 4675 128 0 0 18 0 19 0 869474095 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/4564/statm: 2136585 693513 2260 9 0 2127326 0
[pid=4564/tid=4565] ppid=4562 vsize=8546340 CPUtime=38.97 cores=1,3,5,7
/proc/4564/task/4565/stat : 4565 (java) T 4562 4564 4564 0 -1 4202560 642450 0 1 0 3815 82 0 0 25 0 19 0 869474097 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 46912505887887 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=4564/tid=4566] ppid=4562 vsize=8546340 CPUtime=0.83 cores=1,3,5,7
/proc/4564/task/4566/stat : 4566 (java) T 4562 4564 4564 0 -1 4202560 2922 0 0 0 81 2 0 0 15 0 19 0 869474097 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624281 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=4564/tid=4567] ppid=4562 vsize=8546340 CPUtime=0.83 cores=1,3,5,7
/proc/4564/task/4567/stat : 4567 (java) T 4562 4564 4564 0 -1 4202560 5656 0 0 0 82 1 0 0 15 0 19 0 869474097 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624281 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=4564/tid=4568] ppid=4562 vsize=8546340 CPUtime=0.86 cores=1,3,5,7
/proc/4564/task/4568/stat : 4568 (java) T 4562 4564 4564 0 -1 4202560 4462 0 0 0 83 3 0 0 15 0 19 0 869474097 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624281 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=4564/tid=4569] ppid=4562 vsize=8546340 CPUtime=0.73 cores=1,3,5,7
/proc/4564/task/4569/stat : 4569 (java) T 4562 4564 4564 0 -1 4202560 3899 0 0 0 71 2 0 0 15 0 19 0 869474097 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624281 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=4564/tid=4570] ppid=4562 vsize=8546340 CPUtime=0.86 cores=1,3,5,7
/proc/4564/task/4570/stat : 4570 (java) T 4562 4564 4564 0 -1 4202560 2523 0 0 0 84 2 0 0 15 0 19 0 869474097 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624281 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=4564/tid=4571] ppid=4562 vsize=8546340 CPUtime=0.88 cores=1,3,5,7
/proc/4564/task/4571/stat : 4571 (java) T 4562 4564 4564 0 -1 4202560 6694 0 0 0 83 5 0 0 15 0 19 0 869474097 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624281 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=4564/tid=4572] ppid=4562 vsize=8546340 CPUtime=0.83 cores=1,3,5,7
/proc/4564/task/4572/stat : 4572 (java) T 4562 4564 4564 0 -1 4202560 3170 0 0 0 81 2 0 0 15 0 19 0 869474097 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624281 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=4564/tid=4573] ppid=4562 vsize=8546340 CPUtime=0.83 cores=1,3,5,7
/proc/4564/task/4573/stat : 4573 (java) T 4562 4564 4564 0 -1 4202560 5390 0 0 0 81 2 0 0 15 0 19 0 869474097 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624281 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=4564/tid=4574] ppid=4562 vsize=8546340 CPUtime=0.57 cores=1,3,5,7
/proc/4564/task/4574/stat : 4574 (java) T 4562 4564 4564 0 -1 4202560 10032 0 0 0 43 14 0 0 15 0 19 0 869474098 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624896 0 0 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=4564/tid=4575] ppid=4562 vsize=8546340 CPUtime=0 cores=1,3,5,7
/proc/4564/task/4575/stat : 4575 (java) T 4562 4564 4564 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869474099 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624281 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=4564/tid=4576] ppid=4562 vsize=8546340 CPUtime=0 cores=1,3,5,7
/proc/4564/task/4576/stat : 4576 (java) T 4562 4564 4564 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 869474099 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624281 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=4564/tid=4577] ppid=4562 vsize=8546340 CPUtime=0 cores=1,3,5,7
/proc/4564/task/4577/stat : 4577 (java) T 4562 4564 4564 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869474101 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676631985 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=4564/tid=4578] ppid=4562 vsize=8546340 CPUtime=0.7 cores=1,3,5,7
/proc/4564/task/4578/stat : 4578 (java) T 4562 4564 4564 0 -1 4202560 3448 0 0 0 69 1 0 0 15 0 19 0 869474101 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624281 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=4564/tid=4579] ppid=4562 vsize=8546340 CPUtime=0.95 cores=1,3,5,7
/proc/4564/task/4579/stat : 4579 (java) T 4562 4564 4564 0 -1 4202560 7734 0 0 0 94 1 0 0 15 0 19 0 869474101 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624281 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=4564/tid=4580] ppid=4562 vsize=8546340 CPUtime=0 cores=1,3,5,7
/proc/4564/task/4580/stat : 4580 (java) T 4562 4564 4564 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869474101 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624281 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=4564/tid=4581] ppid=4562 vsize=8546340 CPUtime=0.02 cores=1,3,5,7
/proc/4564/task/4581/stat : 4581 (java) T 4562 4564 4564 0 -1 4202560 1 0 0 0 1 1 0 0 15 0 19 0 869474101 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624896 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=4564/tid=4582] ppid=4562 vsize=8546340 CPUtime=0.03 cores=1,3,5,7
/proc/4564/task/4582/stat : 4582 (java) T 4562 4564 4564 0 -1 4202560 7 0 0 0 0 3 0 0 18 0 19 0 869474276 8751452160 693513 33554432000 1073741824 1073778376 140734375925536 18446744073709551615 274676624896 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=4562/tid=4589] ppid=4473 vsize=410168 CPUtime=0 cores=1,3,5,7
/proc/4562/task/4589/stat : 4589 (python) S 4473 4473 3617 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 869478428 420012032 22105 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554946 18446604454733415488 0 0 -1 7 0 0 0
[pid=4590] ppid=4473 vsize=420424 CPUtime=0 cores=1,3,5,7
/proc/4590/stat : 4590 (python) R 4473 4473 3617 0 -1 4202560 968 0 0 0 0 0 0 0 17 0 1 0 869478431 430514176 22080 33554432000 4194304 5683644 140734973132848 18446744073709551615 274664851591 0 0 16781312 33554946 0 0 0 17 5 0 0 0
/proc/4590/statm: 105107 22080 368 364 0 39973 0
[pid=4592] ppid=4590 vsize=8466068 CPUtime=0.09 cores=1,3,5,7
/proc/4592/stat : 4592 (java) S 4590 4592 4592 0 -1 4202496 4760 0 1 0 7 2 0 0 17 0 18 0 869478431 8669253632 4218 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676611045 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/4592/statm: 2116517 4218 1909 9 0 2107258 0
[pid=4592/tid=4593] ppid=4590 vsize=8466804 CPUtime=0.07 cores=1,3,5,7
/proc/4592/task/4593/stat : 4593 (java) R 4590 4592 4592 0 -1 4202560 3267 0 1 0 7 0 0 0 25 0 18 0 869480691 8670007296 4567 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676633972 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=4592/tid=4594] ppid=4590 vsize=8466804 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4594/stat : 4594 (java) S 4590 4592 4592 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869480692 8670007296 4576 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676624281 0 4 0 16800975 18446604456305987968 0 0 -1 3 0 0 0
[pid=4592/tid=4595] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4595/stat : 4595 (java) S 4590 4592 4592 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 869480692 8670150656 4585 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676624281 0 4 0 16800975 18446604456305987968 0 0 -1 3 0 0 0
[pid=4592/tid=4596] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4596/stat : 4596 (java) S 4590 4592 4592 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 869480692 8670150656 4600 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676624281 0 4 0 16800975 18446604456305987968 0 0 -1 3 0 0 0
[pid=4592/tid=4597] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4597/stat : 4597 (java) S 4590 4592 4592 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 869480692 8670150656 4604 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676624281 0 4 0 16800975 18446604456305987968 0 0 -1 3 0 0 0
[pid=4592/tid=4598] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4598/stat : 4598 (java) S 4590 4592 4592 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 869480692 8670150656 4604 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676624281 0 4 0 16800975 18446604456305987968 0 0 -1 3 0 0 0
[pid=4592/tid=4599] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4599/stat : 4599 (java) S 4590 4592 4592 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 869480692 8670150656 4605 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676624281 0 4 0 16800975 18446604456305987968 0 0 -1 3 0 0 0
[pid=4592/tid=4600] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4600/stat : 4600 (java) S 4590 4592 4592 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 869480692 8670150656 4607 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676624281 0 4 0 16800975 18446604456305987968 0 0 -1 3 0 0 0
[pid=4592/tid=4601] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4601/stat : 4601 (java) S 4590 4592 4592 0 -1 4202560 2 0 0 0 0 0 0 0 21 0 18 0 869480692 8670150656 4607 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676624281 0 4 0 16800975 18446604456305987968 0 0 -1 3 0 0 0
[pid=4592/tid=4602] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4602/stat : 4602 (java) S 4590 4592 4592 0 -1 4202560 2 0 0 0 0 0 0 0 23 0 18 0 869480693 8670150656 4622 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676624896 0 0 0 16800975 18446604456305987968 0 0 -1 7 0 0 0
[pid=4592/tid=4603] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4603/stat : 4603 (java) S 4590 4592 4592 0 -1 4202560 16 0 0 0 0 0 0 0 23 0 18 0 869480693 8670150656 4623 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676624281 0 4 0 16800975 18446604456305987968 0 0 -1 3 0 0 0
[pid=4592/tid=4604] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4604/stat : 4604 (java) S 4590 4592 4592 0 -1 4202560 7 0 0 0 0 0 0 0 24 0 18 0 869480693 8670150656 4623 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676624281 0 4 0 16800975 18446604456305987968 0 0 -1 3 0 0 0
[pid=4592/tid=4605] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4605/stat : 4605 (java) S 4590 4592 4592 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869480695 8670150656 4626 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676631985 0 4 0 16800975 18446604456305987968 0 0 -1 3 0 0 0
[pid=4592/tid=4606] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4606/stat : 4606 (java) R 4590 4592 4592 0 -1 4202560 228 0 0 0 0 0 0 0 18 0 18 0 869480695 8670150656 4629 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 47461154353151 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=4592/tid=4607] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4607/stat : 4607 (java) R 4590 4592 4592 0 -1 4202560 286 0 0 0 0 0 0 0 25 0 18 0 869480695 8670150656 4629 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274664502219 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=4592/tid=4608] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4608/stat : 4608 (java) S 4590 4592 4592 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869480695 8670150656 4632 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676624281 0 4 0 16800975 18446604456305987968 0 0 -1 3 0 0 0
[pid=4592/tid=4609] ppid=4590 vsize=8466944 CPUtime=0 cores=1,3,5,7
/proc/4592/task/4609/stat : 4609 (java) S 4590 4592 4592 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869480695 8670150656 4635 33554432000 1073741824 1073778376 140737376176880 18446744073709551615 274676624896 0 4 0 16800975 18446604456305987968 0 0 -1 7 0 0 0
[pid=4473/tid=4481] ppid=4471 vsize=430668 CPUtime=11.01 cores=1,3,5,7
/proc/4473/task/4481/stat : 4481 (python) S 4471 4473 3617 0 -1 4202560 26 1056146 0 0 0 0 439 662 25 0 9 0 869441042 441004032 23603 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554434 18446604458710460224 0 0 -1 5 0 0 0
[pid=4473/tid=4485] ppid=4471 vsize=430668 CPUtime=11.01 cores=1,3,5,7
/proc/4473/task/4485/stat : 4485 (python) S 4471 4473 3617 0 -1 4202560 31 1056146 0 0 0 0 439 662 20 0 9 0 869446078 441004032 23603 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554434 18446604458710460224 0 0 -1 5 0 0 0
[pid=4473/tid=4494] ppid=4471 vsize=430668 CPUtime=11.01 cores=1,3,5,7
/proc/4473/task/4494/stat : 4494 (python) S 4471 4473 3617 0 -1 4202560 30 1056146 0 0 0 0 439 662 20 0 9 0 869450971 441004032 23603 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554434 18446604458710460224 0 0 -1 7 0 0 0
[pid=4473/tid=4504] ppid=4471 vsize=430668 CPUtime=11.01 cores=1,3,5,7
/proc/4473/task/4504/stat : 4504 (python) S 4471 4473 3617 0 -1 4202560 31 1056146 0 0 0 0 439 662 25 0 9 0 869457435 441004032 23603 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554434 18446604458710460224 0 0 -1 5 0 0 0
[pid=4473/tid=4508] ppid=4471 vsize=430668 CPUtime=11.01 cores=1,3,5,7
/proc/4473/task/4508/stat : 4508 (python) S 4471 4473 3617 0 -1 4202560 35 1056146 0 0 0 0 439 662 18 0 9 0 869459048 441004032 23603 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554434 18446604458710460224 0 0 -1 7 0 0 0
[pid=4473/tid=4549] ppid=4471 vsize=430668 CPUtime=11.01 cores=1,3,5,7
/proc/4473/task/4549/stat : 4549 (python) S 4471 4473 3617 0 -1 4202560 27 1056146 0 0 0 0 439 662 20 0 9 0 869464277 441004032 23603 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554434 18446604458710460224 0 0 -1 7 0 0 0
[pid=4473/tid=4563] ppid=4471 vsize=430668 CPUtime=11.01 cores=1,3,5,7
/proc/4473/task/4563/stat : 4563 (python) S 4471 4473 3617 0 -1 4202560 30 1056146 0 0 0 0 439 662 20 0 9 0 869474095 441004032 23603 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554434 18446604458710460224 0 0 -1 5 0 0 0
[pid=4473/tid=4591] ppid=4471 vsize=430668 CPUtime=11.01 cores=1,3,5,7
/proc/4473/task/4591/stat : 4591 (python) S 4471 4473 3617 0 -1 4202560 25 1056146 0 0 0 0 439 662 20 0 9 0 869478431 441004032 23603 33554432000 4194304 5683644 140734973132848 18446744073709551615 274676631985 0 0 16781312 33554434 18446604458710460224 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 373.12
Current children cumulated vsize (KiB) 21331756

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 4473 and gives
#  childrusage.ru_utime.tv_sec=23
#  childrusage.ru_utime.tv_usec=601412
#  childrusage.ru_stime.tv_sec=6
#  childrusage.ru_stime.tv_usec=915948
# CPU time returned by wait4() is 30.5174
# while last known CPU time is 373.12
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 415.375
CPU time (s): 373.12
CPU user time (s): 360.16
CPU system time (s): 12.96
CPU usage (%): 89.8272
Max. virtual memory (cumulated for all children) (KiB): 21331756

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 23.6014
system time used= 6.91595
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1099801
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2941
involuntary context switches= 393

runsolver used 2.08368 second user time and 5.08423 second system time

The end

Launcher Data 

Begin job on node131 at 2011-06-09 02:13:12
IDJOB=3482903
IDBENCH=89703
IDSOLVER=1971
FILE ID=node131/3482903-1307578391
RUNJOBID= node131-1307576356-3636
PBS_JOBID= 13547668
Free space on /tmp= 73784 MiB

SOLVER NAME= borg pb-dec-11.04.03
BENCH NAME= PB11/normalized-PB11/DEC-SMALLINT-LIN/lopes/normalized-91.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482903-1307578391/watcher-3482903-1307578391 -o /tmp/evaluation-result-3482903-1307578391/solver-3482903-1307578391 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482903-1307578391.opb -seed 997748722 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0d52a3bd95f65144c5f8bf26bef42f13
RANDOM SEED=997748722

node131.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951132 kB
MemFree:      16858540 kB
Buffers:        187692 kB
Cached:         798592 kB
SwapCached:      43052 kB
Active:       13520096 kB
Inactive:      2248476 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951132 kB
LowFree:      16858540 kB
SwapTotal:    67111528 kB
SwapFree:     65929880 kB
Dirty:          110832 kB
Writeback:           0 kB
AnonPages:    14747568 kB
Mapped:          73924 kB
Slab:           190420 kB
PageTables:      65580 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587092 kB
Committed_AS: 99195092 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296000 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 69516 MiB
End job on node131 at 2011-06-09 02:20:13