Trace number 3482342

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-dec-11.04.03? (TO) 1800.03 1797.75

General information on the benchmark

Namenormalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/
manquinho/dbsg/normalized-dbsg_500_60_3_80.opb
MD5SUMd27101fec2f8e3dc322d79bbc996c69e
Bench CategoryDEC-SMALLINT-NLC (no optimisation, small integers, non linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables1000
Total number of constraints1502
Number of constraints which are clauses500
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints1001
Minimum length of a constraint2
Maximum length of a constraint1000
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 80
Number of bits of the biggest number in a constraint 7
Biggest sum of numbers in a constraint 1000
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)74920
Sum of products size (including duplicates)149840
Number of different products37460
Sum of products size74920

Solver Data 

0.36/0.73	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.36/0.73	c INFO: solving HOME/instance-3482342-1307741603.opb
1.09/1.25	c INFO: wrote linearized instance to HOME/tmp5VODSc.opb
1.43/1.94	c INFO: parsing took 0.53 s
2.73/2.84	c INFO: features took 1.04 CPU seconds
2.73/2.86	c INFO: running wbo1.4b-fixed@0 for 45 with 1798 remaining (b = 0.22)
52.77/52.80	c INFO: running scip-2.0.1-spx@0 for 45 with 1748 remaining (b = 0.04)
101.02/101.02	c INFO: running scip-2.0.1-clp@0 for 45 with 1700 remaining (b = 0.02)
148.86/148.84	c INFO: running clasp-1.3.7@0 for 45 with 1653 remaining (b = 0.02)
197.01/196.93	c INFO: running scip-2.0.1-clp@47 for 45 with 1605 remaining (b = 0.01)
243.18/243.02	c INFO: running clasp-1.3.7@48 for 45 with 1559 remaining (b = 0.01)
289.36/289.10	c INFO: running clasp-1.3.7@94 for 136 with 1513 remaining (b = 0.02)
423.63/423.29	c INFO: running scip-2.0.1-spx@47 for 45 with 1379 remaining (b = 0.01)
469.81/469.37	c INFO: running scip-2.0.1-spx@93 for 410 with 1332 remaining (b = 0.06)
884.50/883.46	c INFO: running bsolo_pb10-l1@0 for 91 with 920 remaining (b = 0.01)
978.02/976.87	c INFO: running scip-2.0.1-spx@506 for 547 with 827 remaining (b = 0.05)
1527.96/1526.00	c INFO: running wbo1.4a@0 for 45 with 282 remaining (b = 0.00)
1578.10/1576.10	c INFO: running scip-2.0.1-spx@1050 for 232 with 232 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 988)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482342-1307741603/watcher-3482342-1307741603 -o /tmp/evaluation-result-3482342-1307741603/solver-3482342-1307741603 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482342-1307741603.opb -seed 783878485 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.00 0.00 0.00 2/180 15322
/proc/meminfo: memFree=31574416/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=15080 CPUtime=0 cores=1,3,5,7
/proc/15322/stat : 15322 (python) S 15320 15322 15223 0 -1 4202496 617 0 0 0 0 0 0 0 25 0 1 0 885759057 15441920 513 33554432000 4194304 5683644 140735702160464 18446744073709551615 251814238208 0 2147483391 16781312 2 18446744071699215550 0 0 17 3 0 0 0
/proc/15322/statm: 3770 513 300 364 0 257 0

[startup+0.016058 s]
/proc/loadavg: 0.00 0.00 0.00 2/180 15322
/proc/meminfo: memFree=31574416/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=15384 CPUtime=0 cores=1,3,5,7
/proc/15322/stat : 15322 (python) S 15320 15322 15223 0 -1 4202496 811 0 0 0 0 0 0 0 25 0 1 0 885759057 15753216 696 33554432000 4194304 5683644 140735702160464 18446744073709551615 251814238208 0 2147483391 16781312 2 18446744071699215550 0 0 17 7 0 0 0
/proc/15322/statm: 3846 696 334 364 0 333 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 15384

[startup+0.101019 s]
/proc/loadavg: 0.00 0.00 0.00 2/180 15322
/proc/meminfo: memFree=31574416/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=50016 CPUtime=0.05 cores=1,3,5,7
/proc/15322/stat : 15322 (python) S 15320 15322 15223 0 -1 4202496 1949 0 0 0 4 1 0 0 25 0 1 0 885759057 51216384 1713 33554432000 4194304 5683644 140735702160464 18446744073709551615 251814238208 0 2147483391 16781312 2 18446744071699215550 0 0 17 7 0 0 0
/proc/15322/statm: 12504 1713 476 364 0 1204 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 50016

[startup+0.301139 s]
/proc/loadavg: 0.00 0.00 0.00 2/180 15322
/proc/meminfo: memFree=31574416/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=123744 CPUtime=0.15 cores=1,3,5,7
/proc/15322/stat : 15322 (python) S 15320 15322 15223 0 -1 4202496 5357 930 1 0 11 4 0 0 18 0 1 0 885759057 126713856 3744 33554432000 4194304 5683644 140735702160464 18446744073709551615 251814238208 0 2147483391 16781312 2 18446744071699215550 0 0 17 7 0 0 0
/proc/15322/statm: 30936 3744 987 364 0 2768 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 123744

[startup+0.703965 s]
/proc/loadavg: 0.00 0.00 0.00 2/180 15322
/proc/meminfo: memFree=31574416/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=266500 CPUtime=0.36 cores=1,3,5,7
/proc/15322/stat : 15322 (python) S 15320 15322 15223 0 -1 4202496 8571 930 1 0 27 9 0 0 16 0 1 0 885759057 272896000 6611 33554432000 4194304 5683644 140735702160464 18446744073709551615 251814238208 0 2147483391 16781312 2 18446744071699215550 0 0 17 7 0 0 0
/proc/15322/statm: 66625 6611 1701 364 0 5289 0
Current children cumulated CPU time (s) 0.36
Current children cumulated vsize (KiB) 266500

[startup+1.50077 s]
/proc/loadavg: 0.00 0.00 0.00 3/174 15355
/proc/meminfo: memFree=31704004/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=297484 CPUtime=1.43 cores=1,3,5,7
/proc/15322/stat : 15322 (python) R 15320 15322 15223 0 -1 4202496 14881 1589 1 0 65 28 40 10 16 0 1 0 885759057 304623616 10603 33554432000 4194304 5683644 140735702160464 18446744073709551615 251813601030 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/15322/statm: 74371 10604 1782 364 0 9264 0
Current children cumulated CPU time (s) 1.43
Current children cumulated vsize (KiB) 297484

[startup+3.1005 s]
/proc/loadavg: 0.00 0.00 0.00 3/178 15371
/proc/meminfo: memFree=31539812/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=315484 CPUtime=2.79 cores=1,3,5,7
/proc/15322/stat : 15322 (python) S 15320 15322 15223 0 -1 4202496 22408 1589 1 0 200 29 40 10 19 0 2 0 885759057 323055616 12712 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/15322/statm: 78871 12712 1873 364 0 13758 0
Current children cumulated CPU time (s) 2.79
Current children cumulated vsize (KiB) 315484

[startup+6.30096 s]
/proc/loadavg: 0.16 0.03 0.01 3/184 15377
/proc/meminfo: memFree=31489156/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=315484 CPUtime=2.79 cores=1,3,5,7
/proc/15322/stat : 15322 (python) S 15320 15322 15223 0 -1 4202496 22408 1589 1 0 200 29 40 10 19 0 2 0 885759057 323055616 12712 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/15322/statm: 78871 12712 1873 364 0 13758 0
[pid=15372] ppid=15322 vsize=305240 CPUtime=0 cores=1,3,5,7
/proc/15372/stat : 15372 (python) S 15322 15322 15223 0 -1 4202560 719 0 0 0 0 0 0 0 15 0 1 0 885759343 312565760 11153 33554432000 4194304 5683644 140735702160464 18446744073709551615 251814260239 0 0 16781312 33554946 10682883738867564808 0 0 17 7 0 0 0
/proc/15372/statm: 76310 11153 318 364 0 11197 0
[pid=15374] ppid=15372 vsize=27140 CPUtime=3.42 cores=1,3,5,7
/proc/15374/stat : 15374 (wbo1.4b-fixed) R 15372 15374 15374 0 -1 4202496 7316 0 0 0 340 2 0 0 25 0 1 0 885759344 27791360 6119 33554432000 134512640 135752315 4288846752 18446744073709551615 135270849 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/15374/statm: 6785 6119 146 303 0 6480 0
[pid=15322/tid=15373] ppid=15320 vsize=315484 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15373/stat : 15373 (python) S 15320 15322 15223 0 -1 4202560 27 1589 0 0 0 0 40 10 19 0 2 0 885759344 323055616 12712 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 6.21
Current children cumulated vsize (KiB) 647864

[startup+12.7009 s]
/proc/loadavg: 0.31 0.07 0.02 3/184 15377
/proc/meminfo: memFree=31480816/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=315484 CPUtime=2.79 cores=1,3,5,7
/proc/15322/stat : 15322 (python) S 15320 15322 15223 0 -1 4202496 22408 1589 1 0 200 29 40 10 19 0 2 0 885759057 323055616 12712 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/15322/statm: 78871 12712 1873 364 0 13758 0
[pid=15372] ppid=15322 vsize=305240 CPUtime=0 cores=1,3,5,7
/proc/15372/stat : 15372 (python) S 15322 15322 15223 0 -1 4202560 875 0 0 0 0 0 0 0 15 0 1 0 885759343 312565760 11177 33554432000 4194304 5683644 140735702160464 18446744073709551615 251814260239 0 0 16781312 33554946 4294934789 0 0 17 7 0 0 0
/proc/15372/statm: 76310 11177 342 364 0 11197 0
[pid=15374] ppid=15372 vsize=30976 CPUtime=9.82 cores=1,3,5,7
/proc/15374/stat : 15374 (wbo1.4b-fixed) R 15372 15374 15374 0 -1 4202496 8290 0 0 0 975 7 0 0 25 0 1 0 885759344 31719424 7093 33554432000 134512640 135752315 4288846752 18446744073709551615 134604892 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/15374/statm: 7744 7093 146 303 0 7439 0
[pid=15322/tid=15373] ppid=15320 vsize=315484 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15373/stat : 15373 (python) S 15320 15322 15223 0 -1 4202560 27 1589 0 0 0 0 40 10 19 0 2 0 885759344 323055616 12712 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 12.61
Current children cumulated vsize (KiB) 651700

[startup+25.5007 s]
/proc/loadavg: 0.68 0.16 0.05 3/184 15377
/proc/meminfo: memFree=31456412/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=315484 CPUtime=2.79 cores=1,3,5,7
/proc/15322/stat : 15322 (python) S 15320 15322 15223 0 -1 4202496 22408 1589 1 0 200 29 40 10 19 0 2 0 885759057 323055616 12712 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/15322/statm: 78871 12712 1873 364 0 13758 0
[pid=15372] ppid=15322 vsize=305240 CPUtime=0.02 cores=1,3,5,7
/proc/15372/stat : 15372 (python) S 15322 15322 15223 0 -1 4202560 987 0 0 0 1 1 0 0 15 0 1 0 885759343 312565760 11182 33554432000 4194304 5683644 140735702160464 18446744073709551615 251814260239 0 0 16781312 33554946 4294934789 0 0 17 7 0 0 0
/proc/15372/statm: 76310 11182 347 364 0 11197 0
[pid=15374] ppid=15372 vsize=50248 CPUtime=22.63 cores=1,3,5,7
/proc/15374/stat : 15374 (wbo1.4b-fixed) R 15372 15374 15374 0 -1 4202496 13098 0 0 0 2252 11 0 0 25 0 1 0 885759344 51453952 11901 33554432000 134512640 135752315 4288846752 18446744073709551615 135270849 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/15374/statm: 12562 11901 146 303 0 12257 0
[pid=15322/tid=15373] ppid=15320 vsize=315484 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15373/stat : 15373 (python) S 15320 15322 15223 0 -1 4202560 27 1589 0 0 0 0 40 10 19 0 2 0 885759344 323055616 12712 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 25.44
Current children cumulated vsize (KiB) 670972

[startup+51.1004 s]
/proc/loadavg: 1.13 0.31 0.10 3/184 15378
/proc/meminfo: memFree=31426236/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=315484 CPUtime=2.79 cores=1,3,5,7
/proc/15322/stat : 15322 (python) S 15320 15322 15223 0 -1 4202496 22408 1589 1 0 200 29 40 10 19 0 2 0 885759057 323055616 12712 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/15322/statm: 78871 12712 1873 364 0 13758 0
[pid=15372] ppid=15322 vsize=305240 CPUtime=0.06 cores=1,3,5,7
/proc/15372/stat : 15372 (python) S 15322 15322 15223 0 -1 4202560 998 0 0 0 3 3 0 0 15 0 1 0 885759343 312565760 11182 33554432000 4194304 5683644 140735702160464 18446744073709551615 251814260239 0 0 16781312 33554946 5623753486446373554 0 0 17 7 0 0 0
/proc/15372/statm: 76310 11182 347 364 0 11197 0
[pid=15374] ppid=15372 vsize=73284 CPUtime=48.22 cores=1,3,5,7
/proc/15374/stat : 15374 (wbo1.4b-fixed) R 15372 15374 15374 0 -1 4202496 18850 0 0 0 4804 18 0 0 25 0 1 0 885759344 75042816 17653 33554432000 134512640 135752315 4288846752 18446744073709551615 135270849 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/15374/statm: 18321 17653 146 303 0 18016 0
[pid=15322/tid=15373] ppid=15320 vsize=315484 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15373/stat : 15373 (python) S 15320 15322 15223 0 -1 4202560 27 1589 0 0 0 0 40 10 19 0 2 0 885759344 323055616 12712 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 694008

[startup+102.301 s]
/proc/loadavg: 1.69 0.58 0.20 3/196 15392
/proc/meminfo: memFree=30872744/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=335996 CPUtime=2.84 cores=1,3,5,7
/proc/15322/stat : 15322 (python) S 15320 15322 15223 0 -1 4202496 24233 1589 1 0 205 29 40 10 20 0 4 0 885759057 344059904 12725 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/15322/statm: 83999 12725 1878 364 0 18880 0
[pid=15372] ppid=15322 vsize=315484 CPUtime=0.06 cores=1,3,5,7
/proc/15372/stat : 15372 (python) S 15322 15322 15223 0 -1 4202560 1171 0 0 0 3 3 0 0 16 0 2 0 885759343 323055616 11250 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/15372/statm: 78871 11250 410 364 0 13758 0
[pid=15374] ppid=15372 vsize=74620 CPUtime=49.9 cores=1,3,5,7
/proc/15374/stat : 15374 (wbo1.4b-fixed) T 15372 15374 15374 0 -1 4202496 19209 0 0 0 4972 18 0 0 25 0 1 0 885759344 76410880 18012 33554432000 134512640 135752315 4288846752 18446744073709551615 134605105 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/15374/statm: 18655 18012 146 303 0 18350 0
[pid=15372/tid=15380] ppid=15322 vsize=315484 CPUtime=0 cores=1,3,5,7
/proc/15372/task/15380/stat : 15380 (python) S 15322 15322 15223 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 885764335 323055616 11250 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554946 18446604471146590592 0 0 -1 7 0 0 0
[pid=15381] ppid=15322 vsize=315496 CPUtime=0.06 cores=1,3,5,7
/proc/15381/stat : 15381 (python) S 15322 15322 15223 0 -1 4202560 1119 0 0 0 3 3 0 0 16 0 2 0 885764337 323067904 11230 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/15381/statm: 78874 11230 390 364 0 13758 0
[pid=15383] ppid=15381 vsize=350696 CPUtime=48.18 cores=1,3,5,7
/proc/15383/stat : 15383 (scip-2.0.1.linu) T 15381 15383 15383 0 -1 4202496 89197 0 0 0 4782 36 0 0 25 0 1 0 885764338 359112704 83777 33554432000 4194304 13684479 140734050446720 18446744073709551615 7390857 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/15383/statm: 87674 83777 768 2317 0 85352 0
[pid=15381/tid=15388] ppid=15322 vsize=315496 CPUtime=0 cores=1,3,5,7
/proc/15381/task/15388/stat : 15388 (python) S 15322 15322 15223 0 -1 4202560 53 0 0 0 0 0 0 0 16 0 2 0 885769157 323067904 11230 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554946 18446604471146591488 0 0 -1 5 0 0 0
[pid=15389] ppid=15322 vsize=325752 CPUtime=0 cores=1,3,5,7
/proc/15389/stat : 15389 (python) S 15322 15322 15223 0 -1 4202560 755 0 0 0 0 0 0 0 15 0 1 0 885769160 333570048 11162 33554432000 4194304 5683644 140735702160464 18446744073709551615 251814260294 0 0 16781312 33554946 8011606770168332550 0 0 17 1 0 0 0
/proc/15389/statm: 81438 11162 319 364 0 16319 0
[pid=15391] ppid=15389 vsize=151112 CPUtime=1.26 cores=1,3,5,7
/proc/15391/stat : 15391 (scip-2.0.1.linu) R 15389 15391 15391 0 -1 4202496 36275 0 0 0 105 21 0 0 25 0 1 0 885769160 154738688 34780 33554432000 4194304 15243407 140735905429472 18446744073709551615 5325124 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/15391/statm: 37778 34780 744 2698 0 35073 0
[pid=15322/tid=15373] ppid=15320 vsize=335996 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15373/stat : 15373 (python) S 15320 15322 15223 0 -1 4202560 27 1589 0 0 0 0 40 10 19 0 4 0 885759344 344059904 12725 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 1 0 0 0
[pid=15322/tid=15382] ppid=15320 vsize=335996 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15382/stat : 15382 (python) S 15320 15322 15223 0 -1 4202560 30 1589 0 0 0 0 40 10 20 0 4 0 885764338 344059904 12725 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 5 0 0 0
[pid=15322/tid=15390] ppid=15320 vsize=335996 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15390/stat : 15390 (python) S 15320 15322 15223 0 -1 4202560 24 1589 0 0 0 0 40 10 20 0 4 0 885769160 344059904 12725 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 102.3
Current children cumulated vsize (KiB) 1869156

[startup+162.301 s]
/proc/loadavg: 1.88 0.84 0.31 3/208 15405
/proc/meminfo: memFree=29596992/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=346252 CPUtime=2.87 cores=1,3,5,7
/proc/15322/stat : 15322 (python) S 15320 15322 15223 0 -1 4202496 25115 1589 1 0 207 30 40 10 19 0 5 0 885759057 354562048 12731 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/15322/statm: 86563 12731 1880 364 0 21441 0
[pid=15372] ppid=15322 vsize=315484 CPUtime=0.06 cores=1,3,5,7
/proc/15372/stat : 15372 (python) S 15322 15322 15223 0 -1 4202560 1171 0 0 0 3 3 0 0 16 0 2 0 885759343 323055616 11250 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/15372/statm: 78871 11250 410 364 0 13758 0
[pid=15374] ppid=15372 vsize=74620 CPUtime=49.9 cores=1,3,5,7
/proc/15374/stat : 15374 (wbo1.4b-fixed) T 15372 15374 15374 0 -1 4202496 19209 0 0 0 4972 18 0 0 25 0 1 0 885759344 76410880 18012 33554432000 134512640 135752315 4288846752 18446744073709551615 134605105 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/15374/statm: 18655 18012 146 303 0 18350 0
[pid=15372/tid=15380] ppid=15322 vsize=315484 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

/proc/15322/task/15390/stat : 15390 (python) S 15320 15322 15223 0 -1 4202560 27 1589 0 0 0 0 40 10 18 0 7 0 885769160 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 5 0 0 0
[pid=15322/tid=15400] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15400/stat : 15400 (python) S 15320 15322 15223 0 -1 4202560 26 1589 0 0 0 0 40 10 18 0 7 0 885773942 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 3 0 0 0
[pid=15322/tid=15461] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15461/stat : 15461 (python) S 15320 15322 15223 0 -1 4202560 26 1589 0 0 0 0 40 10 20 0 7 0 885847404 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 1 0 0 0
[pid=15322/tid=15481] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15481/stat : 15481 (python) S 15320 15322 15223 0 -1 4202560 28 1589 0 0 0 0 40 10 20 0 7 0 885911658 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1784.6
Current children cumulated vsize (KiB) 3877904



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1797.71 s]
/proc/loadavg: 1.00 1.02 1.00 2/196 15500
/proc/meminfo: memFree=30241084/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=366764 CPUtime=3.03 cores=1,3,5,7
/proc/15322/stat : 15322 (python) S 15320 15322 15223 0 -1 4202496 27851 1589 1 0 223 30 40 10 18 0 7 0 885759057 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/15322/statm: 91691 12743 1884 364 0 26563 0
[pid=15372] ppid=15322 vsize=315484 CPUtime=0.06 cores=1,3,5,7
/proc/15372/stat : 15372 (python) S 15322 15322 15223 0 -1 4202560 1171 0 0 0 3 3 0 0 16 0 2 0 885759343 323055616 11250 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/15372/statm: 78871 11250 410 364 0 13758 0
[pid=15374] ppid=15372 vsize=74620 CPUtime=49.9 cores=1,3,5,7
/proc/15374/stat : 15374 (wbo1.4b-fixed) T 15372 15374 15374 0 -1 4202496 19209 0 0 0 4972 18 0 0 25 0 1 0 885759344 76410880 18012 33554432000 134512640 135752315 4288846752 18446744073709551615 134605105 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/15374/statm: 18655 18012 146 303 0 18350 0
[pid=15372/tid=15380] ppid=15322 vsize=315484 CPUtime=0 cores=1,3,5,7
/proc/15372/task/15380/stat : 15380 (python) S 15322 15322 15223 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 885764335 323055616 11250 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554946 18446604471146590592 0 0 -1 7 0 0 0
[pid=15381] ppid=15322 vsize=315496 CPUtime=1.76 cores=1,3,5,7
/proc/15381/stat : 15381 (python) S 15322 15322 15223 0 -1 4202560 1204 0 0 0 85 91 0 0 15 0 2 0 885764337 323067904 11230 33554432000 4194304 5683644 140735702160464 18446744073709551615 251814260294 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/15381/statm: 78874 11230 390 364 0 13758 0
[pid=15383] ppid=15381 vsize=566760 CPUtime=1279.06 cores=1,3,5,7
/proc/15383/stat : 15383 (scip-2.0.1.linu) R 15381 15383 15383 0 -1 4202496 146365 0 0 0 127149 757 0 0 25 0 1 0 885764338 580362240 138747 33554432000 4194304 13684479 140734050446720 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/15383/statm: 141690 138747 845 2317 0 139368 0
[pid=15381/tid=15388] ppid=15322 vsize=315496 CPUtime=0 cores=1,3,5,7
/proc/15381/task/15388/stat : 15388 (python) S 15322 15322 15223 0 -1 4202560 54 0 0 0 0 0 0 0 15 0 2 0 885769157 323067904 11230 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554946 18446604471146591488 0 0 -1 5 0 0 0
[pid=15389] ppid=15322 vsize=325752 CPUtime=0.13 cores=1,3,5,7
/proc/15389/stat : 15389 (python) S 15322 15322 15223 0 -1 4202560 1153 0 0 0 6 7 0 0 15 0 2 0 885769160 333570048 11234 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/15389/statm: 81438 11234 390 364 0 16319 0
[pid=15391] ppid=15389 vsize=653108 CPUtime=93.84 cores=1,3,5,7
/proc/15391/stat : 15391 (scip-2.0.1.linu) T 15389 15391 15391 0 -1 4202496 203227 0 0 0 9306 78 0 0 25 0 1 0 885769160 668782592 146416 33554432000 4194304 15243407 140735905429472 18446744073709551615 8113576 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/15391/statm: 163277 146416 959 2698 0 160572 0
[pid=15389/tid=15398] ppid=15322 vsize=325752 CPUtime=0 cores=1,3,5,7
/proc/15389/task/15398/stat : 15398 (python) S 15322 15322 15223 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 885773939 333570048 11234 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554946 18446604461763581888 0 0 -1 1 0 0 0
[pid=15399] ppid=15322 vsize=336008 CPUtime=0.32 cores=1,3,5,7
/proc/15399/stat : 15399 (python) S 15322 15322 15223 0 -1 4202560 1217 0 0 0 17 15 0 0 18 0 2 0 885773941 344072192 11238 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0
/proc/15399/statm: 84002 11238 390 364 0 18880 0
[pid=15401] ppid=15399 vsize=118336 CPUtime=228.29 cores=1,3,5,7
/proc/15401/stat : 15401 (clasp-1.3.7-x86) T 15399 15401 15401 0 -1 4202496 29463 0 0 0 22824 5 0 0 25 0 1 0 885773942 121176064 28514 33554432000 134512640 136139019 4287890624 18446744073709551615 134599059 0 0 16781312 16386 18446744071562691360 0 0 17 5 0 0 0
/proc/15401/statm: 29584 28514 183 398 0 29184 0
[pid=15399/tid=15407] ppid=15322 vsize=336008 CPUtime=0 cores=1,3,5,7
/proc/15399/task/15407/stat : 15407 (python) S 15322 15322 15223 0 -1 4202560 56 0 0 0 0 0 0 0 18 0 2 0 885778748 344072192 11238 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554946 18446604471100422976 0 0 -1 3 0 0 0
[pid=15460] ppid=15322 vsize=346264 CPUtime=0.12 cores=1,3,5,7
/proc/15460/stat : 15460 (python) S 15322 15322 15223 0 -1 4202560 1172 0 0 0 5 7 0 0 16 0 2 0 885847404 354574336 11242 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/15460/statm: 86566 11242 390 364 0 21441 0
[pid=15462] ppid=15460 vsize=33080 CPUtime=93.38 cores=1,3,5,7
/proc/15462/stat : 15462 (bsolo_pb10) T 15460 15462 15462 0 -1 4202496 6844 0 0 0 9334 4 0 0 25 0 1 0 885847404 33873920 5724 33554432000 134512640 137138936 4293778240 18446744073709551615 136500388 0 0 16781312 16384 18446744071562691360 0 0 17 3 0 0 0
/proc/15462/statm: 8270 5724 184 642 0 7626 0
[pid=15460/tid=15465] ppid=15322 vsize=346264 CPUtime=0 cores=1,3,5,7
/proc/15460/task/15465/stat : 15465 (python) S 15322 15322 15223 0 -1 4202560 54 0 0 0 0 0 0 0 16 0 2 0 885856744 354574336 11242 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554946 18446604469017225216 0 0 -1 1 0 0 0
[pid=15480] ppid=15322 vsize=356520 CPUtime=0.07 cores=1,3,5,7
/proc/15480/stat : 15480 (python) S 15322 15322 15223 0 -1 4202560 1173 0 0 0 3 4 0 0 16 0 2 0 885911658 365076480 11246 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/15480/statm: 89130 11246 390 364 0 24002 0
[pid=15482] ppid=15480 vsize=69712 CPUtime=50.07 cores=1,3,5,7
/proc/15482/stat : 15482 (wbo1.4a) T 15480 15482 15482 0 -1 4202496 17975 0 0 0 4982 25 0 0 25 0 1 0 885911658 71385088 16772 33554432000 134512640 135751879 4288563312 18446744073709551615 134611152 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/15482/statm: 17428 16772 143 303 0 17123 0
[pid=15480/tid=15485] ppid=15322 vsize=356520 CPUtime=0 cores=1,3,5,7
/proc/15480/task/15485/stat : 15485 (python) S 15322 15322 15223 0 -1 4202560 53 0 0 0 0 0 0 0 16 0 2 0 885916667 365076480 11246 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554946 18446604471107761472 0 0 -1 1 0 0 0
[pid=15322/tid=15373] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15373/stat : 15373 (python) S 15320 15322 15223 0 -1 4202560 27 1589 0 0 0 0 40 10 19 0 7 0 885759344 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 1 0 0 0
[pid=15322/tid=15382] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15382/stat : 15382 (python) S 15320 15322 15223 0 -1 4202560 48 1589 0 0 0 0 40 10 18 0 7 0 885764338 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 5 0 0 0
[pid=15322/tid=15390] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15390/stat : 15390 (python) S 15320 15322 15223 0 -1 4202560 27 1589 0 0 0 0 40 10 18 0 7 0 885769160 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 5 0 0 0
[pid=15322/tid=15400] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15400/stat : 15400 (python) S 15320 15322 15223 0 -1 4202560 26 1589 0 0 0 0 40 10 18 0 7 0 885773942 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 3 0 0 0
[pid=15322/tid=15461] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15461/stat : 15461 (python) S 15320 15322 15223 0 -1 4202560 26 1589 0 0 0 0 40 10 20 0 7 0 885847404 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 1 0 0 0
[pid=15322/tid=15481] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15481/stat : 15481 (python) S 15320 15322 15223 0 -1 4202560 28 1589 0 0 0 0 40 10 20 0 7 0 885911658 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 3877904

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1797.71 s]
/proc/loadavg: 1.00 1.02 1.00 2/196 15500
/proc/meminfo: memFree=30241084/32950928 swapFree=67050648/67111528
[pid=15322] ppid=15320 vsize=366764 CPUtime=3.03 cores=1,3,5,7
/proc/15322/stat : 15322 (python) S 15320 15322 15223 0 -1 4202496 27851 1589 1 0 223 30 40 10 18 0 7 0 885759057 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/15322/statm: 91691 12743 1884 364 0 26563 0
[pid=15372] ppid=15322 vsize=315484 CPUtime=0.06 cores=1,3,5,7
/proc/15372/stat : 15372 (python) S 15322 15322 15223 0 -1 4202560 1171 0 0 0 3 3 0 0 16 0 2 0 885759343 323055616 11250 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/15372/statm: 78871 11250 410 364 0 13758 0
[pid=15374] ppid=15372 vsize=74620 CPUtime=49.9 cores=1,3,5,7
/proc/15374/stat : 15374 (wbo1.4b-fixed) T 15372 15374 15374 0 -1 4202496 19209 0 0 0 4972 18 0 0 25 0 1 0 885759344 76410880 18012 33554432000 134512640 135752315 4288846752 18446744073709551615 134605105 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/15374/statm: 18655 18012 146 303 0 18350 0
[pid=15372/tid=15380] ppid=15322 vsize=315484 CPUtime=0 cores=1,3,5,7
/proc/15372/task/15380/stat : 15380 (python) S 15322 15322 15223 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 885764335 323055616 11250 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554946 18446604471146590592 0 0 -1 7 0 0 0
[pid=15381] ppid=15322 vsize=315496 CPUtime=1.76 cores=1,3,5,7
/proc/15381/stat : 15381 (python) S 15322 15322 15223 0 -1 4202560 1204 0 0 0 85 91 0 0 15 0 2 0 885764337 323067904 11230 33554432000 4194304 5683644 140735702160464 18446744073709551615 251814260294 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/15381/statm: 78874 11230 390 364 0 13758 0
[pid=15383] ppid=15381 vsize=566760 CPUtime=1279.06 cores=1,3,5,7
/proc/15383/stat : 15383 (scip-2.0.1.linu) R 15381 15383 15383 0 -1 4202496 146365 0 0 0 127149 757 0 0 25 0 1 0 885764338 580362240 138747 33554432000 4194304 13684479 140734050446720 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/15383/statm: 141690 138747 845 2317 0 139368 0
[pid=15381/tid=15388] ppid=15322 vsize=315496 CPUtime=0 cores=1,3,5,7
/proc/15381/task/15388/stat : 15388 (python) S 15322 15322 15223 0 -1 4202560 54 0 0 0 0 0 0 0 15 0 2 0 885769157 323067904 11230 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554946 18446604471146591488 0 0 -1 5 0 0 0
[pid=15389] ppid=15322 vsize=325752 CPUtime=0.13 cores=1,3,5,7
/proc/15389/stat : 15389 (python) S 15322 15322 15223 0 -1 4202560 1153 0 0 0 6 7 0 0 15 0 2 0 885769160 333570048 11234 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/15389/statm: 81438 11234 390 364 0 16319 0
[pid=15391] ppid=15389 vsize=653108 CPUtime=93.84 cores=1,3,5,7
/proc/15391/stat : 15391 (scip-2.0.1.linu) T 15389 15391 15391 0 -1 4202496 203227 0 0 0 9306 78 0 0 25 0 1 0 885769160 668782592 146416 33554432000 4194304 15243407 140735905429472 18446744073709551615 8113576 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/15391/statm: 163277 146416 959 2698 0 160572 0
[pid=15389/tid=15398] ppid=15322 vsize=325752 CPUtime=0 cores=1,3,5,7
/proc/15389/task/15398/stat : 15398 (python) S 15322 15322 15223 0 -1 4202560 49 0 0 0 0 0 0 0 15 0 2 0 885773939 333570048 11234 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554946 18446604461763581888 0 0 -1 1 0 0 0
[pid=15399] ppid=15322 vsize=336008 CPUtime=0.32 cores=1,3,5,7
/proc/15399/stat : 15399 (python) S 15322 15322 15223 0 -1 4202560 1217 0 0 0 17 15 0 0 18 0 2 0 885773941 344072192 11238 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0
/proc/15399/statm: 84002 11238 390 364 0 18880 0
[pid=15401] ppid=15399 vsize=118336 CPUtime=228.29 cores=1,3,5,7
/proc/15401/stat : 15401 (clasp-1.3.7-x86) T 15399 15401 15401 0 -1 4202496 29463 0 0 0 22824 5 0 0 25 0 1 0 885773942 121176064 28514 33554432000 134512640 136139019 4287890624 18446744073709551615 134599059 0 0 16781312 16386 18446744071562691360 0 0 17 5 0 0 0
/proc/15401/statm: 29584 28514 183 398 0 29184 0
[pid=15399/tid=15407] ppid=15322 vsize=336008 CPUtime=0 cores=1,3,5,7
/proc/15399/task/15407/stat : 15407 (python) S 15322 15322 15223 0 -1 4202560 56 0 0 0 0 0 0 0 18 0 2 0 885778748 344072192 11238 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554946 18446604471100422976 0 0 -1 3 0 0 0
[pid=15460] ppid=15322 vsize=346264 CPUtime=0.12 cores=1,3,5,7
/proc/15460/stat : 15460 (python) S 15322 15322 15223 0 -1 4202560 1172 0 0 0 5 7 0 0 16 0 2 0 885847404 354574336 11242 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/15460/statm: 86566 11242 390 364 0 21441 0
[pid=15462] ppid=15460 vsize=33080 CPUtime=93.38 cores=1,3,5,7
/proc/15462/stat : 15462 (bsolo_pb10) T 15460 15462 15462 0 -1 4202496 6844 0 0 0 9334 4 0 0 25 0 1 0 885847404 33873920 5724 33554432000 134512640 137138936 4293778240 18446744073709551615 136500388 0 0 16781312 16384 18446744071562691360 0 0 17 3 0 0 0
/proc/15462/statm: 8270 5724 184 642 0 7626 0
[pid=15460/tid=15465] ppid=15322 vsize=346264 CPUtime=0 cores=1,3,5,7
/proc/15460/task/15465/stat : 15465 (python) S 15322 15322 15223 0 -1 4202560 54 0 0 0 0 0 0 0 16 0 2 0 885856744 354574336 11242 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554946 18446604469017225216 0 0 -1 1 0 0 0
[pid=15480] ppid=15322 vsize=356520 CPUtime=0.07 cores=1,3,5,7
/proc/15480/stat : 15480 (python) S 15322 15322 15223 0 -1 4202560 1173 0 0 0 3 4 0 0 16 0 2 0 885911658 365076480 11246 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826066891 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/15480/statm: 89130 11246 390 364 0 24002 0
[pid=15482] ppid=15480 vsize=69712 CPUtime=50.07 cores=1,3,5,7
/proc/15482/stat : 15482 (wbo1.4a) T 15480 15482 15482 0 -1 4202496 17975 0 0 0 4982 25 0 0 25 0 1 0 885911658 71385088 16772 33554432000 134512640 135751879 4288563312 18446744073709551615 134611152 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/15482/statm: 17428 16772 143 303 0 17123 0
[pid=15480/tid=15485] ppid=15322 vsize=356520 CPUtime=0 cores=1,3,5,7
/proc/15480/task/15485/stat : 15485 (python) S 15322 15322 15223 0 -1 4202560 53 0 0 0 0 0 0 0 16 0 2 0 885916667 365076480 11246 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554946 18446604471107761472 0 0 -1 1 0 0 0
[pid=15322/tid=15373] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15373/stat : 15373 (python) S 15320 15322 15223 0 -1 4202560 27 1589 0 0 0 0 40 10 19 0 7 0 885759344 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 1 0 0 0
[pid=15322/tid=15382] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15382/stat : 15382 (python) S 15320 15322 15223 0 -1 4202560 48 1589 0 0 0 0 40 10 18 0 7 0 885764338 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 5 0 0 0
[pid=15322/tid=15390] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15390/stat : 15390 (python) S 15320 15322 15223 0 -1 4202560 27 1589 0 0 0 0 40 10 18 0 7 0 885769160 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 5 0 0 0
[pid=15322/tid=15400] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15400/stat : 15400 (python) S 15320 15322 15223 0 -1 4202560 26 1589 0 0 0 0 40 10 18 0 7 0 885773942 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 3 0 0 0
[pid=15322/tid=15461] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15461/stat : 15461 (python) S 15320 15322 15223 0 -1 4202560 26 1589 0 0 0 0 40 10 20 0 7 0 885847404 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 1 0 0 0
[pid=15322/tid=15481] ppid=15320 vsize=366764 CPUtime=0.5 cores=1,3,5,7
/proc/15322/task/15481/stat : 15481 (python) S 15320 15322 15223 0 -1 4202560 28 1589 0 0 0 0 40 10 20 0 7 0 885911658 375566336 12743 33554432000 4194304 5683644 140735702160464 18446744073709551615 251826063793 0 0 16781312 33554434 18446604454225327296 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 3877904

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 15322 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=635599
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=414936
# CPU time returned by wait4() is 3.05053
# while last known CPU time is 1800.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1797.75
CPU time (s): 1800.03
CPU user time (s): 1789.49
CPU system time (s): 10.54
CPU usage (%): 100.127
Max. virtual memory (cumulated for all children) (KiB): 3877904

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.6356
system time used= 0.414936
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29443
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 20752
involuntary context switches= 53

runsolver used 2.87356 second user time and 7.13091 second system time

The end

Launcher Data 

Begin job on node126 at 2011-06-10 23:33:23
IDJOB=3482342
IDBENCH=48303
IDSOLVER=1971
FILE ID=node126/3482342-1307741603
RUNJOBID= node126-1307741588-15242
PBS_JOBID= 13550780
Free space on /tmp= 74068 MiB

SOLVER NAME= borg pb-dec-11.04.03
BENCH NAME= PB07/normalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/manquinho/dbsg/normalized-dbsg_500_60_3_80.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482342-1307741603/watcher-3482342-1307741603 -o /tmp/evaluation-result-3482342-1307741603/solver-3482342-1307741603 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482342-1307741603.opb -seed 783878485 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d27101fec2f8e3dc322d79bbc996c69e
RANDOM SEED=783878485

node126.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.783
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      31575696 kB
Buffers:        234740 kB
Cached:         868228 kB
SwapCached:      14856 kB
Active:         625948 kB
Inactive:       544956 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      31575696 kB
SwapTotal:    67111528 kB
SwapFree:     67050648 kB
Dirty:          208996 kB
Writeback:           0 kB
AnonPages:       65784 kB
Mapped:          15344 kB
Slab:           137612 kB
PageTables:       6056 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   308780 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74064 MiB
End job on node126 at 2011-06-11 00:03:23