Trace number 3482652

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-dec-11.04.03? (MO) 1685.22 1677.51

General information on the benchmark

Namenormalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/
liu/vdw/normalized-vdw_k3_l5_n550.opb
MD5SUMb656932a938990470d09f3771b5047c2
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved NO
Number of variables1650
Total number of constraints113164
Number of constraints which are clauses112614
Number of constraints which are cardinality constraints (but not clauses)550
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint3
Maximum length of a constraint5
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 4
Number of bits of the biggest number in a constraint 3
Biggest sum of numbers in a constraint 9
Number of bits of the biggest sum of numbers4
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.38/0.60	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.38/0.60	c INFO: solving HOME/instance-3482652-1307576489.opb
1.38/1.60	c INFO: parsing took 0.98 s
2.98/3.27	c INFO: features took 1.66 CPU seconds
2.98/3.29	c INFO: running clasp-1.3.7@0 for 45 with 1797 remaining (b = 0.33)
60.14/60.28	c INFO: wrote minion input file to HOME/tmpXY25Ie.minion
60.14/60.28	c INFO: running minion-0.12@0 for 45 with 1748 remaining (b = 0.06)
108.03/107.93	c INFO: running scip-2.0.1-spx@0 for 45 with 1692 remaining (b = 0.04)
157.14/156.94	c INFO: running scip-2.0.1-clp@0 for 45 with 1644 remaining (b = 0.02)
203.92/203.57	c INFO: running clasp-1.3.7@48 for 45 with 1598 remaining (b = 0.01)
250.30/249.78	c INFO: running wbo1.4a@0 for 45 with 1551 remaining (b = 0.01)
296.96/296.29	c INFO: running scip-2.0.1-clp@46 for 45 with 1505 remaining (b = 0.01)
346.29/345.37	c INFO: running clasp-1.3.7@94 for 136 with 1456 remaining (b = 0.03)
484.48/482.99	c INFO: running scip-2.0.1-spx@48 for 45 with 1319 remaining (b = 0.01)
530.01/528.30	c INFO: running scip-2.0.1-spx@93 for 410 with 1274 remaining (b = 0.06)
944.21/940.81	c INFO: running wbo1.4b-fixed@0 for 45 with 862 remaining (b = 0.01)
991.17/987.73	c INFO: running bsolo_pb10-l1@0 for 91 with 815 remaining (b = 0.01)
1083.64/1079.75	c INFO: running scip-2.0.1-spx@505 for 547 with 724 remaining (b = 0.06)
1634.76/1628.56	c INFO: running sat4j-pb-v20101225@0 for 45 with 176 remaining (b = 0.00)
1684.53/1677.02	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 126 remaining (b = 0.00)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482652-1307576489/watcher-3482652-1307576489 -o /tmp/evaluation-result-3482652-1307576489/solver-3482652-1307576489 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482652-1307576489.opb -seed 1360058803 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.07 0.71 0.25 2/476 5829
/proc/meminfo: memFree=23673812/32950928 swapFree=61858080/67111528
[pid=5829] ppid=5827 vsize=15764 CPUtime=0 cores=1,3,5,7
/proc/5829/stat : 5829 (python) R 5827 5829 5281 0 -1 4202496 853 0 0 0 0 0 0 0 20 0 1 0 869248675 16142336 735 33554432000 4194304 5683644 140735398699200 18446744073709551615 274473967248 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/5829/statm: 3943 738 335 364 0 430 0

[startup+0.0838371 s]
/proc/loadavg: 2.07 0.71 0.25 2/476 5829
/proc/meminfo: memFree=23673812/32950928 swapFree=61858080/67111528
[pid=5829] ppid=5827 vsize=85616 CPUtime=0.06 cores=1,3,5,7
/proc/5829/stat : 5829 (python) R 5827 5829 5281 0 -1 4202496 2665 0 0 0 5 1 0 0 17 0 1 0 869248675 87670784 2381 33554432000 4194304 5683644 140735398699200 18446744073709551615 274473965568 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/5829/statm: 21404 2381 715 364 0 1621 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85616

[startup+0.101598 s]
/proc/loadavg: 2.07 0.71 0.25 2/476 5829
/proc/meminfo: memFree=23673812/32950928 swapFree=61858080/67111528
[pid=5829] ppid=5827 vsize=96128 CPUtime=0.07 cores=1,3,5,7
/proc/5829/stat : 5829 (python) S 5827 5829 5281 0 -1 4202496 3033 463 1 0 5 2 0 0 18 0 1 0 869248675 98435072 2483 33554432000 4194304 5683644 140735398699200 18446744073709551615 274473967360 0 0 16781312 2 18446744071562362840 0 0 17 5 0 0 0
/proc/5829/statm: 24032 2483 792 364 0 1627 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 96128

[startup+0.300806 s]
/proc/loadavg: 2.07 0.71 0.25 2/476 5829
/proc/meminfo: memFree=23673812/32950928 swapFree=61858080/67111528
[pid=5829] ppid=5827 vsize=123736 CPUtime=0.15 cores=1,3,5,7
/proc/5829/stat : 5829 (python) S 5827 5829 5281 0 -1 4202496 5357 928 1 0 11 4 0 0 16 0 1 0 869248675 126705664 3743 33554432000 4194304 5683644 140735398699200 18446744073709551615 274473965568 0 2147483391 16781312 2 18446744071699215550 0 0 17 5 0 0 0
/proc/5829/statm: 30934 3743 987 364 0 2766 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 123736

[startup+0.700737 s]
/proc/loadavg: 2.07 0.71 0.25 2/476 5829
/proc/meminfo: memFree=23673812/32950928 swapFree=61858080/67111528
[pid=5829] ppid=5827 vsize=290868 CPUtime=0.47 cores=1,3,5,7
/proc/5829/stat : 5829 (python) R 5827 5829 5281 0 -1 4202496 11179 928 1 0 37 10 0 0 16 0 1 0 869248675 297848832 9041 33554432000 4194304 5683644 140735398699200 18446744073709551615 274473664704 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/5829/statm: 72717 9041 1781 364 0 7610 0
Current children cumulated CPU time (s) 0.47
Current children cumulated vsize (KiB) 290868

[startup+1.50052 s]
/proc/loadavg: 2.07 0.71 0.25 3/477 5834
/proc/meminfo: memFree=23633744/32950928 swapFree=61858080/67111528
[pid=5829] ppid=5827 vsize=319364 CPUtime=1.27 cores=1,3,5,7
/proc/5829/stat : 5829 (python) R 5827 5829 5281 0 -1 4202496 17631 928 1 0 116 11 0 0 16 0 1 0 869248675 327028736 15493 33554432000 4194304 5683644 140735398699200 18446744073709551615 47301315328709 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/5829/statm: 79841 15495 1781 364 0 14734 0
Current children cumulated CPU time (s) 1.27
Current children cumulated vsize (KiB) 319364

[startup+3.10031 s]
/proc/loadavg: 2.07 0.71 0.25 3/477 5834
/proc/meminfo: memFree=23613764/32950928 swapFree=61858080/67111528
[pid=5829] ppid=5827 vsize=319952 CPUtime=2.87 cores=1,3,5,7
/proc/5829/stat : 5829 (python) R 5827 5829 5281 0 -1 4202496 25145 928 1 0 275 12 0 0 19 0 1 0 869248675 327630848 16336 33554432000 4194304 5683644 140735398699200 18446744073709551615 47301315297581 0 0 16781312 33554434 0 0 0 17 5 0 0 0
/proc/5829/statm: 79988 16336 1816 364 0 14881 0
Current children cumulated CPU time (s) 2.87
Current children cumulated vsize (KiB) 319952

[startup+6.30074 s]
/proc/loadavg: 2.06 0.73 0.26 3/480 5837
/proc/meminfo: memFree=23593164/32950928 swapFree=61858080/67111528
[pid=5829] ppid=5827 vsize=331988 CPUtime=3.07 cores=1,3,5,7
/proc/5829/stat : 5829 (python) S 5827 5829 5281 0 -1 4202496 25875 928 1 0 295 12 0 0 21 0 2 0 869248675 339955712 16838 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/5829/statm: 82997 16838 1872 364 0 17884 0
[pid=5835] ppid=5829 vsize=321744 CPUtime=0 cores=1,3,5,7
/proc/5835/stat : 5835 (python) R 5829 5829 5281 0 -1 4202560 736 0 0 0 0 0 0 0 18 0 1 0 869249004 329465856 15315 33554432000 4194304 5683644 140735398699200 18446744073709551615 274473965568 0 0 16781312 33554946 0 0 0 17 5 0 0 0
/proc/5835/statm: 80436 15316 354 364 0 15323 0
[pid=5837] ppid=5835 vsize=19988 CPUtime=2.98 cores=1,3,5,7
/proc/5837/stat : 5837 (clasp-1.3.7-x86) R 5835 5837 5837 0 -1 4202496 5383 0 0 0 298 0 0 0 25 0 1 0 869249005 20467712 4701 33554432000 134512640 136139019 4287582080 18446744073709551615 134875783 0 0 16781312 16386 0 0 0 17 1 0 0 0
/proc/5837/statm: 4997 4701 182 398 0 4597 0
[pid=5829/tid=5836] ppid=5827 vsize=331988 CPUtime=0 cores=1,3,5,7
/proc/5829/task/5836/stat : 5836 (python) S 5827 5829 5281 0 -1 4202560 26 928 0 0 0 0 0 0 21 0 2 0 869249005 339955712 16838 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 6.05
Current children cumulated vsize (KiB) 673720

[startup+12.7005 s]
/proc/loadavg: 2.06 0.75 0.27 3/480 5837
/proc/meminfo: memFree=23574956/32950928 swapFree=61858080/67111528
[pid=5829] ppid=5827 vsize=331988 CPUtime=3.07 cores=1,3,5,7
/proc/5829/stat : 5829 (python) S 5827 5829 5281 0 -1 4202496 25875 928 1 0 295 12 0 0 21 0 2 0 869248675 339955712 16838 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/5829/statm: 82997 16838 1872 364 0 17884 0
[pid=5835] ppid=5829 vsize=321744 CPUtime=0.03 cores=1,3,5,7
/proc/5835/stat : 5835 (python) S 5829 5829 5281 0 -1 4202560 902 0 0 0 1 2 0 0 18 0 1 0 869249004 329465856 15337 33554432000 4194304 5683644 140735398699200 18446744073709551615 274473987599 0 0 16781312 33554946 5623753486446373637 0 0 17 7 0 0 0
/proc/5835/statm: 80436 15337 375 364 0 15323 0
[pid=5837] ppid=5835 vsize=36368 CPUtime=9.38 cores=1,3,5,7
/proc/5837/stat : 5837 (clasp-1.3.7-x86) R 5835 5837 5837 0 -1 4202496 9485 0 0 0 937 1 0 0 25 0 1 0 869249005 37240832 8803 33554432000 134512640 136139019 4287582080 18446744073709551615 134608160 0 0 16781312 16386 0 0 0 17 1 0 0 0
/proc/5837/statm: 9092 8803 182 398 0 8692 0
[pid=5829/tid=5836] ppid=5827 vsize=331988 CPUtime=0 cores=1,3,5,7
/proc/5829/task/5836/stat : 5836 (python) S 5827 5829 5281 0 -1 4202560 26 928 0 0 0 0 0 0 21 0 2 0 869249005 339955712 16838 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.48
Current children cumulated vsize (KiB) 690100

[startup+25.5004 s]
/proc/loadavg: 2.04 0.81 0.30 3/473 5861
/proc/meminfo: memFree=23596056/32950928 swapFree=61858080/67111528
[pid=5829] ppid=5827 vsize=331988 CPUtime=3.07 cores=1,3,5,7
/proc/5829/stat : 5829 (python) S 5827 5829 5281 0 -1 4202496 25875 928 1 0 295 12 0 0 21 0 2 0 869248675 339955712 16838 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/5829/statm: 82997 16838 1872 364 0 17884 0
[pid=5835] ppid=5829 vsize=321744 CPUtime=0.07 cores=1,3,5,7
/proc/5835/stat : 5835 (python) S 5829 5829 5281 0 -1 4202560 906 0 0 0 3 4 0 0 18 0 1 0 869249004 329465856 15337 33554432000 4194304 5683644 140735398699200 18446744073709551615 274473987599 0 0 16781312 33554946 5623606151888251653 0 0 17 5 0 0 0
/proc/5835/statm: 80436 15337 375 364 0 15323 0
[pid=5837] ppid=5835 vsize=45780 CPUtime=22.19 cores=1,3,5,7
/proc/5837/stat : 5837 (clasp-1.3.7-x86) R 5835 5837 5837 0 -1 4202496 11800 0 0 0 2217 2 0 0 25 0 1 0 869249005 46878720 11118 33554432000 134512640 136139019 4287582080 18446744073709551615 134883821 0 0 16781312 16386 0 0 0 17 1 0 0 0
/proc/5837/statm: 11445 11118 182 398 0 11045 0
[pid=5829/tid=5836] ppid=5827 vsize=331988 CPUtime=0 cores=1,3,5,7
/proc/5829/task/5836/stat : 5836 (python) S 5827 5829 5281 0 -1 4202560 26 928 0 0 0 0 0 0 21 0 2 0 869249005 339955712 16838 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.33
Current children cumulated vsize (KiB) 699512

[startup+51.1008 s]
/proc/loadavg: 2.03 0.90 0.34 3/480 6103
/proc/meminfo: memFree=23429784/32950928 swapFree=61858080/67111528
[pid=5829] ppid=5827 vsize=331988 CPUtime=3.07 cores=1,3,5,7
/proc/5829/stat : 5829 (python) S 5827 5829 5281 0 -1 4202496 25875 928 1 0 295 12 0 0 21 0 2 0 869248675 339955712 16838 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/5829/statm: 82997 16838 1872 364 0 17884 0
[pid=5835] ppid=5829 vsize=321744 CPUtime=0.16 cores=1,3,5,7
/proc/5835/stat : 5835 (python) S 5829 5829 5281 0 -1 4202560 1023 0 0 0 8 8 0 0 18 0 1 0 869249004 329465856 15351 33554432000 4194304 5683644 140735398699200 18446744073709551615 274473987599 0 0 16781312 33554946 5623753486446373637 0 0 17 7 0 0 0
/proc/5835/statm: 80436 15351 389 364 0 15323 0
[pid=5837] ppid=5835 vsize=54364 CPUtime=47.78 cores=1,3,5,7
/proc/5837/stat : 5837 (clasp-1.3.7-x86) R 5835 5837 5837 0 -1 4202496 13958 0 0 0 4776 2 0 0 25 0 1 0 869249005 55668736 13276 33554432000 134512640 136139019 4287582080 18446744073709551615 134608178 0 0 16781312 16386 0 0 0 17 1 0 0 0
/proc/5837/statm: 13591 13276 182 398 0 13191 0
[pid=5829/tid=5836] ppid=5827 vsize=331988 CPUtime=0 cores=1,3,5,7
/proc/5829/task/5836/stat : 5836 (python) S 5827 5829 5281 0 -1 4202560 26 928 0 0 0 0 0 0 21 0 2 0 869249005 339955712 16838 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 51.01
Current children cumulated vsize (KiB) 708096

[startup+102.319 s]
/proc/loadavg: 2.12 1.10 0.43 3/484 6145
/proc/meminfo: memFree=23095556/32950928 swapFree=61858080/67111528
[pid=5829] ppid=5827 vsize=342244 CPUtime=11.87 cores=1,3,5,7
/proc/5829/stat : 5829 (python) S 5827 5829 5281 0 -1 4202496 26872 928 1 0 1172 15 0 0 25 0 3 0 869248675 350457856 16845 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/5829/statm: 85561 16845 1875 364 0 20445 0
[pid=5835] ppid=5829 vsize=331988 CPUtime=0.18 cores=1,3,5,7
/proc/5835/stat : 5835 (python) S 5829 5829 5281 0 -1 4202560 1154 0 0 0 9 9 0 0 19 0 2 0 869249004 339955712 15387 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/5835/statm: 82997 15387 420 364 0 17884 0
[pid=5837] ppid=5835 vsize=54364 CPUtime=48.17 cores=1,3,5,7
/proc/5837/stat : 5837 (clasp-1.3.7-x86) T 5835 5837 5837 0 -1 4202496 13958 0 0 0 4815 2 0 0 25 0 1 0 869249005 55668736 13276 33554432000 134512640 136139019 4287582080 18446744073709551615 134883415 0 0 16781312 16386 18446744071562691360 0 0 17 1 0 0 0
/proc/5837/statm: 13591 13276 182 398 0 13191 0
[pid=5835/tid=6122] ppid=5829 vsize=331988 CPUtime=0 cores=1,3,5,7
/proc/5835/task/6122/stat : 6122 (python) S 5829 5829 5281 0 -1 4202560 40 0 0 0 0 0 0 0 19 0 2 0 869253823 339955712 15387 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554946 18446604463407802304 0 0 -1 7 0 0 0
[pid=6141] ppid=5829 vsize=332000 CPUtime=0.15 cores=1,3,5,7
/proc/6141/stat : 6141 (python) S 5829 5829 5281 0 -1 4202560 939 0 0 0 7 8 0 0 15 0 1 0 869254704 339968000 15338 33554432000 4194304 5683644 140735398699200 18446744073709551615 274473987654 0 0 16781312 33554946 5623753486446373637 0 0 17 7 0 0 0
/proc/6141/statm: 83000 15338 372 364 0 17884 0
[pid=6143] ppid=6141 vsize=370584 CPUtime=42.01 cores=1,3,5,7
/proc/6143/stat : 6143 (minion) R 6141 6143 6143 0 -1 4202496 95339 0 0 0 4189 12 0 0 25 0 1 0 869254704 379478016 85373 33554432000 134512640 165565024 4294334832 18446744073709551615 142764899 0 0 16781312 8396802 0 0 0 17 1 0 0 0
/proc/6143/statm: 92646 85373 346 7582 0 85061 0
[pid=5829/tid=5836] ppid=5827 vsize=342244 CPUtime=0 cores=1,3,5,7
/proc/5829/task/5836/stat : 5836 (python) S 5827 5829 5281 0 -1 4202560 26 928 0 0 0 0 0 0 21 0 3 0 869249005 350457856 16845 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 5 0 0 0
[pid=5829/tid=6142] ppid=5827 vsize=342244 CPUtime=0 cores=1,3,5,7
/proc/5829/task/6142/stat : 6142 (python) S 5827 5829 5281 0 -1 4202560 30 928 0 0 0 0 0 0 25 0 3 0 869254704 350457856 16845 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 102.38
Current children cumulated vsize (KiB) 1431180

[startup+162.301 s]
/proc/loadavg: 2.04 1.26 0.53 3/500 6163
/proc/meminfo: memFree=22210604/32950928 swapFree=61858080/67111528
[pid=5829] ppid=5827 vsize=362756 CPUtime=11.93 cores=1,3,5,7
/proc/5829/stat : 5829 (python) S 5827 5829 5281 0 -1 4202496 28590 928 1 0 1177 16 0 0 20 0 5 0 869248675 371462144 16857 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/5829/statm: 90689 16857 1879 364 0 25567 0
[pid=5835] ppid=5829 vsize=331988 CPUtime=0.18 cores=1,3,5,7
/proc/5835/stat : 5835 (python) S 5829 5829 5281 0 -1 4202560 1154 0 0 0 9 9 0 0 19 0 2 0 869249004 339955712 15387 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/5835/statm: 82997 15387 420 364 0 17884 0
[pid=5837] ppid=5835 vsize=54364 CPUtime=48.17 cores=1,3,5,7
/proc/5837/stat : 5837 (clasp-1.3.7-x86) T 5835 5837 5837 0 -1 4202496 13958 0 0 0 4815 2 0 0 25 0 1 0 869249005 55668736 13276 33554432000 134512640 136139019 4287582080 18446744073709551615 134883415 0 0 16781312 16386 18446744071562691360 0 0 17 1 0 0 0
/proc/5837/statm: 13591 13276 182 398 0 13191 0
[pid=5835/tid=6122] ppid=5829 vsize=331988 CPUtime=0 cores=1,3,5,7
/proc/5835/task/6122/stat : 6122 (python) S 5829 5829 5281 0 -1 4202560 40 0 0 0 0 0 0 0 19 0 2 0 869253823 339955712 15387 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554946 18446604463407802304 0 0 -1 7 0 0 0
[pid=6141] ppid=5829 vsize=332000 CPUtime=0.2 cores=1,3,5,7
/proc/6141/stat : 6141 (python) S 5829 5829 5281 0 -1 4202560 1103 0 0 0 9 11 0 0 16 0 2 0 869254704 339968000 15363 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/6141/statm: 83000 15363 396 364 0 17884 0
[pid=6143] ppid=6141 vsize=370584 CPUtime=47.61 cores=1,3,5,7
/proc/6143/stat : 6143 (minion) T 6141 6143 6143 0 -1 4202496 95339 0 0 0 4749 12 0 0 25 0 1 0 869254704 379478016 85373 33554432000 134512640 165565024 4294334832 18446744073709551615 158624697 0 0 16781312 8396802 18446744071562691360 0 0 17 1 0 0 0
/proc/6143/statm: 92646 85373 346 7582 0 85061 0
[pid=6141/tid=6150] ppid=5829 vsize=332000 CPUtime=0 cores=1,3,5,7
/proc/6141/task/6150/stat : 6150 (python) S 5829 5829 5281 0 -1 4202560 52 0 0 0 0 0 0 0 16 0 2 0 869259466 339968000 15363 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554946 18446604469381759232 0 0 -1 7 0 0 0
[pid=6151] ppid=5829 vsize=342256 CPUtime=0.19 cores=1,3,5,7

################
# More data... #
################

/proc/6141/stat : 6141 (python) S 5829 5829 5281 0 -1 4202560 1103 0 0 0 9 11 0 0 16 0 2 0 869254704 339968000 15363 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/6141/statm: 83000 15363 396 364 0 17884 0
[pid=6143] ppid=6141 vsize=370584 CPUtime=47.61 cores=1,3,5,7
/proc/6143/stat : 6143 (minion) T 6141 6143 6143 0 -1 4202496 95339 0 0 0 4749 12 0 0 25 0 1 0 869254704 379478016 85373 33554432000 134512640 165565024 4294334832 18446744073709551615 158624697 0 0 16781312 8396802 18446744071562691360 0 0 17 1 0 0 0
/proc/6143/statm: 92646 85373 346 7582 0 85061 0
[pid=6141/tid=6150] ppid=5829 vsize=332000 CPUtime=0 cores=1,3,5,7
/proc/6141/task/6150/stat : 6150 (python) S 5829 5829 5281 0 -1 4202560 52 0 0 0 0 0 0 0 16 0 2 0 869259466 339968000 15363 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554946 18446604469381759232 0 0 -1 7 0 0 0
[pid=6151] ppid=5829 vsize=342256 CPUtime=4.37 cores=1,3,5,7
/proc/6151/stat : 6151 (python) S 5829 5829 5281 0 -1 4202560 1201 0 0 0 200 237 0 0 16 0 2 0 869259469 350470144 15376 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/6151/statm: 85564 15376 405 364 0 20445 0
[pid=6154] ppid=6151 vsize=542472 CPUtime=1055.47 cores=1,3,5,7
/proc/6154/stat : 6154 (scip-2.0.1.linu) T 6151 6154 6154 0 -1 4202496 156000 0 0 0 105323 224 0 0 25 0 1 0 869259469 555491328 128355 33554432000 4194304 13684479 140735101126624 18446744073709551615 7416172 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/6154/statm: 135618 128355 1109 2317 0 133296 0
[pid=6151/tid=6160] ppid=5829 vsize=342256 CPUtime=0 cores=1,3,5,7
/proc/6151/task/6160/stat : 6160 (python) S 5829 5829 5281 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 869264367 350470144 15376 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554946 18446604459868186624 0 0 -1 1 0 0 0
[pid=6161] ppid=5829 vsize=352512 CPUtime=0.42 cores=1,3,5,7
/proc/6161/stat : 6161 (python) S 5829 5829 5281 0 -1 4202560 1175 0 0 0 19 23 0 0 15 0 2 0 869264369 360972288 15371 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/6161/statm: 88128 15371 396 364 0 23006 0
[pid=6163] ppid=6161 vsize=511392 CPUtime=95.64 cores=1,3,5,7
/proc/6163/stat : 6163 (scip-2.0.1.linu) T 6161 6163 6163 0 -1 4202496 123187 0 0 0 9500 64 0 0 25 0 1 0 869264370 523665408 115200 33554432000 4194304 15243407 140736662939376 18446744073709551615 6457242 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/6163/statm: 127848 115200 912 2698 0 125143 0
[pid=6161/tid=6166] ppid=5829 vsize=352512 CPUtime=0 cores=1,3,5,7
/proc/6161/task/6166/stat : 6166 (python) S 5829 5829 5281 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 869269030 360972288 15371 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554946 18446604463407803200 0 0 -1 7 0 0 0
[pid=6172] ppid=5829 vsize=362768 CPUtime=0.2 cores=1,3,5,7
/proc/6172/stat : 6172 (python) S 5829 5829 5281 0 -1 4202560 1154 0 0 0 9 11 0 0 17 0 2 0 869273654 371474432 15375 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/6172/statm: 90692 15375 396 364 0 25567 0
[pid=6174] ppid=6172 vsize=85292 CPUtime=46.47 cores=1,3,5,7
/proc/6174/stat : 6174 (wbo1.4a) T 6172 6174 6174 0 -1 4202496 22549 0 0 0 4617 30 0 0 25 0 1 0 869273654 87339008 20815 33554432000 134512640 135751879 4294079392 18446744073709551615 134516982 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/6174/statm: 21323 20815 143 303 0 21018 0
[pid=6172/tid=6177] ppid=5829 vsize=362768 CPUtime=0 cores=1,3,5,7
/proc/6172/task/6177/stat : 6177 (python) S 5829 5829 5281 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 869278302 371474432 15375 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554946 18446604460918908224 0 0 -1 7 0 0 0
[pid=6223] ppid=5829 vsize=373024 CPUtime=0.2 cores=1,3,5,7
/proc/6223/stat : 6223 (python) S 5829 5829 5281 0 -1 4202560 1150 0 0 0 9 11 0 0 16 0 2 0 869342757 381976576 15379 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554946 18446744073709551615 0 0 17 3 0 0 0
/proc/6223/statm: 93256 15379 396 364 0 28128 0
[pid=6225] ppid=6223 vsize=85504 CPUtime=46.88 cores=1,3,5,7
/proc/6225/stat : 6225 (wbo1.4b-fixed) T 6223 6225 6225 0 -1 4202496 22596 0 0 0 4659 29 0 0 25 0 1 0 869342757 87556096 20862 33554432000 134512640 135752315 4293255888 18446744073709551615 134611182 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/6225/statm: 21376 20862 146 303 0 21071 0
[pid=6223/tid=6228] ppid=5829 vsize=373024 CPUtime=0 cores=1,3,5,7
/proc/6223/task/6228/stat : 6228 (python) S 5829 5829 5281 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 869347447 381976576 15379 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554946 18446604462371619904 0 0 -1 3 0 0 0
[pid=6229] ppid=5829 vsize=383280 CPUtime=0.38 cores=1,3,5,7
/proc/6229/stat : 6229 (python) S 5829 5829 5281 0 -1 4202560 1172 0 0 0 18 20 0 0 16 0 2 0 869347449 392478720 15383 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/6229/statm: 95820 15383 396 364 0 30689 0
[pid=6231] ppid=6229 vsize=155456 CPUtime=92 cores=1,3,5,7
/proc/6231/stat : 6231 (bsolo_pb10) T 6229 6231 6231 0 -1 4202496 40276 0 0 0 9168 32 0 0 25 0 1 0 869347449 159186944 36420 33554432000 134512640 137138936 4289729280 18446744073709551615 134542199 0 0 16781312 16384 18446744071562691360 0 0 17 5 0 0 0
/proc/6231/statm: 38864 36420 190 642 0 38220 0
[pid=6229/tid=6238] ppid=5829 vsize=383280 CPUtime=0 cores=1,3,5,7
/proc/6229/task/6238/stat : 6238 (python) S 5829 5829 5281 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869356649 392478720 15383 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554946 18446604471164520512 0 0 -1 7 0 0 0
[pid=6353] ppid=5829 vsize=393536 CPUtime=0.22 cores=1,3,5,7
/proc/6353/stat : 6353 (python) S 5829 5829 5281 0 -1 4202560 1225 0 0 0 11 11 0 0 17 0 2 0 869411532 402980864 15393 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485794251 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/6353/statm: 98384 15393 402 364 0 33250 0
[pid=6355] ppid=6353 vsize=8537632 CPUtime=49.48 cores=1,3,5,7
/proc/6355/stat : 6355 (java) T 6353 6355 6355 0 -1 4202496 58417 0 1 0 4939 9 0 0 18 0 19 0 869411532 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485770213 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/6355/statm: 2134408 55586 2256 9 0 2125149 0
[pid=6355/tid=6356] ppid=6353 vsize=8537632 CPUtime=47.44 cores=1,3,5,7
/proc/6355/task/6356/stat : 6356 (java) T 6353 6355 6355 0 -1 4202560 41860 0 1 0 4738 6 0 0 25 0 19 0 869411534 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 46912505784704 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=6355/tid=6357] ppid=6353 vsize=8537632 CPUtime=0.04 cores=1,3,5,7
/proc/6355/task/6357/stat : 6357 (java) T 6353 6355 6355 0 -1 4202560 2344 0 0 0 4 0 0 0 15 0 19 0 869411534 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485783449 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=6355/tid=6358] ppid=6353 vsize=8537632 CPUtime=0.02 cores=1,3,5,7
/proc/6355/task/6358/stat : 6358 (java) T 6353 6355 6355 0 -1 4202560 411 0 0 0 2 0 0 0 15 0 19 0 869411534 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485783449 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=6355/tid=6359] ppid=6353 vsize=8537632 CPUtime=0.01 cores=1,3,5,7
/proc/6355/task/6359/stat : 6359 (java) T 6353 6355 6355 0 -1 4202560 5 0 0 0 1 0 0 0 15 0 19 0 869411534 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485783449 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=6355/tid=6360] ppid=6353 vsize=8537632 CPUtime=0.03 cores=1,3,5,7
/proc/6355/task/6360/stat : 6360 (java) T 6353 6355 6355 0 -1 4202560 19 0 0 0 3 0 0 0 15 0 19 0 869411534 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485783449 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=6355/tid=6361] ppid=6353 vsize=8537632 CPUtime=0.02 cores=1,3,5,7
/proc/6355/task/6361/stat : 6361 (java) T 6353 6355 6355 0 -1 4202560 869 0 0 0 2 0 0 0 15 0 19 0 869411534 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485783449 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=6355/tid=6362] ppid=6353 vsize=8537632 CPUtime=0.03 cores=1,3,5,7
/proc/6355/task/6362/stat : 6362 (java) T 6353 6355 6355 0 -1 4202560 1053 0 0 0 3 0 0 0 15 0 19 0 869411534 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485783449 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=6355/tid=6363] ppid=6353 vsize=8537632 CPUtime=0.01 cores=1,3,5,7
/proc/6355/task/6363/stat : 6363 (java) T 6353 6355 6355 0 -1 4202560 7 0 0 0 1 0 0 0 15 0 19 0 869411534 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485783449 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=6355/tid=6364] ppid=6353 vsize=8537632 CPUtime=0.03 cores=1,3,5,7
/proc/6355/task/6364/stat : 6364 (java) T 6353 6355 6355 0 -1 4202560 1025 0 0 0 3 0 0 0 15 0 19 0 869411534 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485783449 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=6355/tid=6365] ppid=6353 vsize=8537632 CPUtime=0.83 cores=1,3,5,7
/proc/6355/task/6365/stat : 6365 (java) T 6353 6355 6355 0 -1 4202560 4296 0 0 0 83 0 0 0 15 0 19 0 869411535 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485784064 0 0 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=6355/tid=6366] ppid=6353 vsize=8537632 CPUtime=0 cores=1,3,5,7
/proc/6355/task/6366/stat : 6366 (java) T 6353 6355 6355 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869411536 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485783449 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=6355/tid=6367] ppid=6353 vsize=8537632 CPUtime=0 cores=1,3,5,7
/proc/6355/task/6367/stat : 6367 (java) T 6353 6355 6355 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 869411536 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485783449 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=6355/tid=6368] ppid=6353 vsize=8537632 CPUtime=0 cores=1,3,5,7
/proc/6355/task/6368/stat : 6368 (java) T 6353 6355 6355 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869411538 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485791153 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=6355/tid=6369] ppid=6353 vsize=8537632 CPUtime=0.42 cores=1,3,5,7
/proc/6355/task/6369/stat : 6369 (java) T 6353 6355 6355 0 -1 4202560 2099 0 0 0 42 0 0 0 15 0 19 0 869411538 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485783449 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=6355/tid=6370] ppid=6353 vsize=8537632 CPUtime=0.5 cores=1,3,5,7
/proc/6355/task/6370/stat : 6370 (java) T 6353 6355 6355 0 -1 4202560 3039 0 0 0 50 0 0 0 15 0 19 0 869411538 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485783449 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=6355/tid=6371] ppid=6353 vsize=8537632 CPUtime=0 cores=1,3,5,7
/proc/6355/task/6371/stat : 6371 (java) T 6353 6355 6355 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869411538 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485783449 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=6355/tid=6372] ppid=6353 vsize=8537632 CPUtime=0 cores=1,3,5,7
/proc/6355/task/6372/stat : 6372 (java) T 6353 6355 6355 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 869411538 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485784064 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=6355/tid=6373] ppid=6353 vsize=8537632 CPUtime=0 cores=1,3,5,7
/proc/6355/task/6373/stat : 6373 (java) T 6353 6355 6355 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869411655 8742535168 55586 33554432000 1073741824 1073778376 140736909182848 18446744073709551615 274485784064 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=6353/tid=6377] ppid=5829 vsize=393536 CPUtime=0 cores=1,3,5,7
/proc/6353/task/6377/stat : 6377 (python) S 5829 5829 5281 0 -1 4202560 43 0 0 0 0 0 0 0 17 0 2 0 869416376 402980864 15393 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554946 18446604466789847488 0 0 -1 7 0 0 0
[pid=6378] ppid=5829 vsize=403792 CPUtime=0 cores=1,3,5,7
/proc/6378/stat : 6378 (python) S 5829 5829 5281 0 -1 4202560 881 0 0 0 0 0 0 0 18 0 1 0 869416377 413483008 15349 33554432000 4194304 5683644 140735398699200 18446744073709551615 274473987654 0 0 16781312 33554946 3426685149683646464 0 0 17 1 0 0 0
/proc/6378/statm: 100948 15349 355 364 0 35811 0
[pid=6380] ppid=6378 vsize=8535216 CPUtime=0.67 cores=1,3,5,7
/proc/6380/stat : 6380 (java) S 6378 6380 6380 0 -1 4202496 15687 0 1 0 64 3 0 0 20 0 18 0 869416378 8740061184 14612 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485770213 0 0 0 16800975 18446744073709551615 0 0 17 3 0 0 0
/proc/6380/statm: 2133804 14613 2204 9 0 2124545 0
[pid=6380/tid=6381] ppid=6378 vsize=8535216 CPUtime=0.38 cores=1,3,5,7
/proc/6380/task/6381/stat : 6381 (java) R 6378 6380 6380 0 -1 4202560 11802 0 1 0 36 2 0 0 23 0 18 0 869416379 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485783449 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=6380/tid=6382] ppid=6378 vsize=8535216 CPUtime=0 cores=1,3,5,7
/proc/6380/task/6382/stat : 6382 (java) S 6378 6380 6380 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 869416379 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485783449 0 4 0 16800975 18446604467449154624 0 0 -1 3 0 0 0
[pid=6380/tid=6383] ppid=6378 vsize=8535216 CPUtime=0 cores=1,3,5,7
/proc/6380/task/6383/stat : 6383 (java) S 6378 6380 6380 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 18 0 869416379 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485783449 0 4 0 16800975 18446604467449154624 0 0 -1 3 0 0 0
[pid=6380/tid=6384] ppid=6378 vsize=8535216 CPUtime=0 cores=1,3,5,7
/proc/6380/task/6384/stat : 6384 (java) S 6378 6380 6380 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 18 0 869416379 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485783449 0 4 0 16800975 18446604467449154624 0 0 -1 3 0 0 0
[pid=6380/tid=6385] ppid=6378 vsize=8535216 CPUtime=0 cores=1,3,5,7
/proc/6380/task/6385/stat : 6385 (java) S 6378 6380 6380 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416379 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485783449 0 4 0 16800975 18446604467449154624 0 0 -1 3 0 0 0
[pid=6380/tid=6386] ppid=6378 vsize=8535216 CPUtime=0 cores=1,3,5,7
/proc/6380/task/6386/stat : 6386 (java) S 6378 6380 6380 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416379 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485783449 0 4 0 16800975 18446604467449154624 0 0 -1 3 0 0 0
[pid=6380/tid=6387] ppid=6378 vsize=8535216 CPUtime=0 cores=1,3,5,7
/proc/6380/task/6387/stat : 6387 (java) S 6378 6380 6380 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416379 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485783449 0 4 0 16800975 18446604467449154624 0 0 -1 3 0 0 0
[pid=6380/tid=6388] ppid=6378 vsize=8535216 CPUtime=0 cores=1,3,5,7
/proc/6380/task/6388/stat : 6388 (java) S 6378 6380 6380 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416379 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485783449 0 4 0 16800975 18446604467449154624 0 0 -1 3 0 0 0
[pid=6380/tid=6389] ppid=6378 vsize=8535216 CPUtime=0 cores=1,3,5,7
/proc/6380/task/6389/stat : 6389 (java) S 6378 6380 6380 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869416379 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485783449 0 4 0 16800975 18446604467449154624 0 0 -1 3 0 0 0
[pid=6380/tid=6390] ppid=6378 vsize=8535216 CPUtime=0 cores=1,3,5,7
/proc/6380/task/6390/stat : 6390 (java) S 6378 6380 6380 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 18 0 869416380 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485784064 0 0 0 16800975 18446604467449154624 0 0 -1 3 0 0 0
[pid=6380/tid=6391] ppid=6378 vsize=8535216 CPUtime=0 cores=1,3,5,7
/proc/6380/task/6391/stat : 6391 (java) S 6378 6380 6380 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 18 0 869416381 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485783449 0 4 0 16800975 18446604467449154624 0 0 -1 3 0 0 0
[pid=6380/tid=6392] ppid=6378 vsize=8535216 CPUtime=0 cores=1,3,5,7
/proc/6380/task/6392/stat : 6392 (java) S 6378 6380 6380 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 18 0 869416381 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485783449 0 4 0 16800975 18446604467449154624 0 0 -1 3 0 0 0
[pid=6380/tid=6393] ppid=6378 vsize=8535216 CPUtime=0 cores=1,3,5,7
/proc/6380/task/6393/stat : 6393 (java) S 6378 6380 6380 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869416383 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485791153 0 4 0 16800975 18446604467449154624 0 0 -1 3 0 0 0
[pid=6380/tid=6394] ppid=6378 vsize=8535216 CPUtime=0.13 cores=1,3,5,7
/proc/6380/task/6394/stat : 6394 (java) R 6378 6380 6380 0 -1 4202560 815 0 0 0 13 0 0 0 19 0 18 0 869416383 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 47161069877405 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=6380/tid=6395] ppid=6378 vsize=8535216 CPUtime=0.14 cores=1,3,5,7
/proc/6380/task/6395/stat : 6395 (java) S 6378 6380 6380 0 -1 4202560 1966 0 0 0 14 0 0 0 19 0 18 0 869416383 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485783449 0 4 0 16800975 18446604467449154624 0 0 -1 3 0 0 0
[pid=6380/tid=6396] ppid=6378 vsize=8535216 CPUtime=0 cores=1,3,5,7
/proc/6380/task/6396/stat : 6396 (java) S 6378 6380 6380 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 869416383 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485783449 0 4 0 16800975 18446604467449154624 0 0 -1 3 0 0 0
[pid=6380/tid=6397] ppid=6378 vsize=8535216 CPUtime=0 cores=1,3,5,7
/proc/6380/task/6397/stat : 6397 (java) S 6378 6380 6380 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869416383 8740061184 14895 33554432000 1073741824 1073778376 140736657371024 18446744073709551615 274485784064 0 4 0 16800975 18446604467449154624 0 0 -1 5 0 0 0
[pid=5829/tid=5836] ppid=5827 vsize=414036 CPUtime=0 cores=1,3,5,7
/proc/5829/task/5836/stat : 5836 (python) S 5827 5829 5281 0 -1 4202560 34 928 0 0 0 0 0 0 18 0 10 0 869249005 423972864 16887 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 5 0 0 0
[pid=5829/tid=6142] ppid=5827 vsize=414036 CPUtime=0 cores=1,3,5,7
/proc/5829/task/6142/stat : 6142 (python) S 5827 5829 5281 0 -1 4202560 30 928 0 0 0 0 0 0 25 0 10 0 869254704 423972864 16887 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 5 0 0 0
[pid=5829/tid=6152] ppid=5827 vsize=414036 CPUtime=0 cores=1,3,5,7
/proc/5829/task/6152/stat : 6152 (python) S 5827 5829 5281 0 -1 4202560 37 928 0 0 0 0 0 0 18 0 10 0 869259469 423972864 16887 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 1 0 0 0
[pid=5829/tid=6162] ppid=5827 vsize=414036 CPUtime=0 cores=1,3,5,7
/proc/5829/task/6162/stat : 6162 (python) S 5827 5829 5281 0 -1 4202560 30 928 0 0 0 0 0 0 18 0 10 0 869264370 423972864 16887 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 1 0 0 0
[pid=5829/tid=6173] ppid=5827 vsize=414036 CPUtime=0 cores=1,3,5,7
/proc/5829/task/6173/stat : 6173 (python) S 5827 5829 5281 0 -1 4202560 28 928 0 0 0 0 0 0 20 0 10 0 869273654 423972864 16887 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 7 0 0 0
[pid=5829/tid=6224] ppid=5827 vsize=414036 CPUtime=0 cores=1,3,5,7
/proc/5829/task/6224/stat : 6224 (python) S 5827 5829 5281 0 -1 4202560 30 928 0 0 0 0 0 0 20 0 10 0 869342757 423972864 16887 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 3 0 0 0
[pid=5829/tid=6230] ppid=5827 vsize=414036 CPUtime=0 cores=1,3,5,7
/proc/5829/task/6230/stat : 6230 (python) S 5827 5829 5281 0 -1 4202560 30 928 0 0 0 0 0 0 20 0 10 0 869347449 423972864 16887 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 7 0 0 0
[pid=5829/tid=6354] ppid=5827 vsize=414036 CPUtime=0 cores=1,3,5,7
/proc/5829/task/6354/stat : 6354 (python) S 5827 5829 5281 0 -1 4202560 29 928 0 0 0 0 0 0 20 0 10 0 869411532 423972864 16887 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 3 0 0 0
[pid=5829/tid=6379] ppid=5827 vsize=414036 CPUtime=0 cores=1,3,5,7
/proc/5829/task/6379/stat : 6379 (python) S 5827 5829 5281 0 -1 4202560 26 928 0 0 0 0 0 0 20 0 10 0 869416378 423972864 16887 33554432000 4194304 5683644 140735398699200 18446744073709551615 274485791153 0 0 16781312 33554434 18446604469381761920 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1685.22
Current children cumulated vsize (KiB) 22613688

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 5829 and gives
#  childrusage.ru_utime.tv_sec=11
#  childrusage.ru_utime.tv_usec=956182
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=185971
# CPU time returned by wait4() is 12.1422
# while last known CPU time is 1685.22
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1677.51
CPU time (s): 1685.22
CPU user time (s): 1677.23
CPU system time (s): 7.99
CPU usage (%): 100.46
Max. virtual memory (cumulated for all children) (KiB): 22613688

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 11.9562
system time used= 0.185971
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 34324
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1193
involuntary context switches= 37

runsolver used 10.5614 second user time and 21.2328 second system time

The end

Launcher Data 

Begin job on node125 at 2011-06-09 01:41:29
IDJOB=3482652
IDBENCH=1370
IDSOLVER=1971
FILE ID=node125/3482652-1307576489
RUNJOBID= node125-1307576358-5301
PBS_JOBID= 13547674
Free space on /tmp= 73752 MiB

SOLVER NAME= borg pb-dec-11.04.03
BENCH NAME= PB06//final/normalized-PB06/SATUNSAT-SMALLINT/submitted-PB06/liu/vdw/normalized-vdw_k3_l5_n550.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482652-1307576489/watcher-3482652-1307576489 -o /tmp/evaluation-result-3482652-1307576489/solver-3482652-1307576489 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482652-1307576489.opb -seed 1360058803 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b656932a938990470d09f3771b5047c2
RANDOM SEED=1360058803

node125.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5266.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      23673976 kB
Buffers:        155688 kB
Cached:         453172 kB
SwapCached:       3408 kB
Active:        8852324 kB
Inactive:       152416 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      23673976 kB
SwapTotal:    67111528 kB
SwapFree:     61858080 kB
Dirty:          209240 kB
Writeback:           0 kB
AnonPages:     8394036 kB
Mapped:          40244 kB
Slab:           141156 kB
PageTables:      62852 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 130087224 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73640 MiB
End job on node125 at 2011-06-09 02:09:30