Trace number 3482901

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-dec-11.04.03? (MO) 471.52 467.507

General information on the benchmark

Name/DEC-SMALLINT-LIN/lopes/
normalized-60.opb
MD5SUM3a065af206abae16cc2624cb89dfd6ff
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables12587
Total number of constraints283937
Number of constraints which are clauses255125
Number of constraints which are cardinality constraints (but not clauses)903
Number of constraints which are nor clauses,nor cardinality constraints27909
Minimum length of a constraint2
Maximum length of a constraint270
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 3
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 271
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.35/0.68	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.35/0.68	c INFO: solving HOME/instance-3482901-1307578668.opb
2.33/2.66	c INFO: parsing took 1.93 s
6.03/6.33	c INFO: features took 3.66 CPU seconds
6.03/6.36	c INFO: running wbo1.4b-fixed@0 for 45 with 1794 remaining (b = 0.96)
57.65/57.74	c INFO: running pbct-0.1.2-linear@0 for 45 with 1743 remaining (b = 0.96)
106.41/106.31	c INFO: running wbo1.4a@0 for 45 with 1695 remaining (b = 0.95)
156.31/156.00	c INFO: running scip-2.0.1-clp@0 for 45 with 1647 remaining (b = 0.83)
203.07/202.68	c INFO: running scip-2.0.1-spx@0 for 45 with 1600 remaining (b = 0.68)
271.36/270.80	c INFO: wrote minion input file to HOME/tmpWVrPRL.minion
271.36/270.80	c INFO: running minion-0.12@0 for 45 with 1554 remaining (b = 0.55)
283.30/282.69	c INFO: running bsolo_pb10-l2@0 for 45 with 1528 remaining (b = 0.29)
331.17/330.32	c INFO: running clasp-1.3.7@0 for 45 with 1481 remaining (b = 0.18)
379.52/378.54	c INFO: running clasp-1.3.7@48 for 45 with 1432 remaining (b = 0.02)
422.90/421.78	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1389 remaining (b = 0.05)
470.53/466.93	c INFO: running sat4j-pb-v20101225@0 for 45 with 1343 remaining (b = 0.02)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482901-1307578668/watcher-3482901-1307578668 -o /tmp/evaluation-result-3482901-1307578668/solver-3482901-1307578668 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482901-1307578668.opb -seed 1104002183 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.01 2.06 1.85 2/493 16337
/proc/meminfo: memFree=16336580/32951124 swapFree=50923800/67111528
[pid=16337] ppid=16335 vsize=15908 CPUtime=0 cores=0,2,4,6
/proc/16337/stat : 16337 (python) S 16335 16337 15040 0 -1 4202496 944 0 0 0 0 0 0 0 20 0 1 0 850282564 16289792 821 33554432000 4194304 5683644 140734069530912 18446744073709551615 270338381824 0 2147483391 16781312 2 18446744071699199166 0 0 17 2 0 0 0
/proc/16337/statm: 3977 821 357 364 0 464 0

[startup+0.0274471 s]
/proc/loadavg: 2.01 2.06 1.85 2/493 16337
/proc/meminfo: memFree=16336580/32951124 swapFree=50923800/67111528
[pid=16337] ppid=16335 vsize=16396 CPUtime=0 cores=0,2,4,6
/proc/16337/stat : 16337 (python) R 16335 16337 15040 0 -1 4202496 1117 0 0 0 0 0 0 0 20 0 1 0 850282564 16789504 985 33554432000 4194304 5683644 140734069530912 18446744073709551615 270338379621 0 2147483391 16781312 2 0 0 0 17 6 0 0 0
/proc/16337/statm: 4099 985 409 364 0 586 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 16396

[startup+0.100437 s]
/proc/loadavg: 2.01 2.06 1.85 2/493 16337
/proc/meminfo: memFree=16336580/32951124 swapFree=50923800/67111528
[pid=16337] ppid=16335 vsize=85620 CPUtime=0.06 cores=0,2,4,6
/proc/16337/stat : 16337 (python) S 16335 16337 15040 0 -1 4202496 2665 0 0 0 4 2 0 0 20 0 1 0 850282564 87674880 2382 33554432000 4194304 5683644 140734069530912 18446744073709551615 270338381824 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/16337/statm: 21405 2382 715 364 0 1622 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 85620

[startup+0.3014 s]
/proc/loadavg: 2.01 2.06 1.85 2/493 16337
/proc/meminfo: memFree=16336580/32951124 swapFree=50923800/67111528
[pid=16337] ppid=16335 vsize=123740 CPUtime=0.17 cores=0,2,4,6
/proc/16337/stat : 16337 (python) S 16335 16337 15040 0 -1 4202496 5357 933 1 0 12 5 0 0 17 0 1 0 850282564 126709760 3744 33554432000 4194304 5683644 140734069530912 18446744073709551615 270338379781 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/16337/statm: 30935 3744 987 364 0 2767 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 123740

[startup+0.700292 s]
/proc/loadavg: 2.01 2.06 1.85 2/493 16337
/proc/meminfo: memFree=16336580/32951124 swapFree=50923800/67111528
[pid=16337] ppid=16335 vsize=294640 CPUtime=0.44 cores=0,2,4,6
/proc/16337/stat : 16337 (python) R 16335 16337 15040 0 -1 4202496 12114 933 1 0 31 13 0 0 16 0 1 0 850282564 301711360 9977 33554432000 4194304 5683644 140734069530912 18446744073709551615 4570176 0 0 16781312 2 0 0 0 17 6 0 0 0
/proc/16337/statm: 73660 9977 1781 364 0 8553 0
Current children cumulated CPU time (s) 0.44
Current children cumulated vsize (KiB) 294640

[startup+1.50019 s]
/proc/loadavg: 2.01 2.06 1.85 3/494 16342
/proc/meminfo: memFree=16291448/32951124 swapFree=50923800/67111528
[pid=16337] ppid=16335 vsize=322716 CPUtime=1.24 cores=0,2,4,6
/proc/16337/stat : 16337 (python) R 16335 16337 15040 0 -1 4202496 18941 933 1 0 110 14 0 0 16 0 1 0 850282564 330461184 16705 33554432000 4194304 5683644 140734069530912 18446744073709551615 270338044613 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/16337/statm: 80679 16705 1781 364 0 15572 0
Current children cumulated CPU time (s) 1.24
Current children cumulated vsize (KiB) 322716

[startup+3.10081 s]
/proc/loadavg: 2.01 2.06 1.85 3/494 16342
/proc/meminfo: memFree=16252016/32951124 swapFree=50923800/67111528
[pid=16337] ppid=16335 vsize=359012 CPUtime=2.84 cores=0,2,4,6
/proc/16337/stat : 16337 (python) R 16335 16337 15040 0 -1 4202496 42073 933 1 0 266 18 0 0 19 0 1 0 850282564 367628288 26100 33554432000 4194304 5683644 140734069530912 18446744073709551615 270338051039 0 0 16781312 33554434 0 0 0 17 6 0 0 0
/proc/16337/statm: 89753 26100 1815 364 0 24646 0
Current children cumulated CPU time (s) 2.84
Current children cumulated vsize (KiB) 359012

[startup+6.30024 s]
/proc/loadavg: 2.01 2.06 1.85 3/497 16346
/proc/meminfo: memFree=16220184/32951124 swapFree=50923800/67111528
[pid=16337] ppid=16335 vsize=363448 CPUtime=6.03 cores=0,2,4,6
/proc/16337/stat : 16337 (python) R 16335 16337 15040 0 -1 4202496 42887 933 1 0 585 18 0 0 25 0 1 0 850282564 372170752 26914 33554432000 4194304 5683644 140734069530912 18446744073709551615 270338077789 0 0 16781312 33554434 0 0 0 17 2 0 0 0
/proc/16337/statm: 90862 26937 1816 364 0 25755 0
Current children cumulated CPU time (s) 6.03
Current children cumulated vsize (KiB) 363448

[startup+12.701 s]
/proc/loadavg: 2.01 2.05 1.85 3/500 16349
/proc/meminfo: memFree=16174200/32951124 swapFree=50923800/67111528
[pid=16337] ppid=16335 vsize=375932 CPUtime=6.09 cores=0,2,4,6
/proc/16337/stat : 16337 (python) S 16335 16337 15040 0 -1 4202496 44027 933 1 0 591 18 0 0 25 0 2 0 850282564 384954368 27824 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/16337/statm: 93983 27824 1872 364 0 28870 0
[pid=16347] ppid=16337 vsize=365688 CPUtime=0.02 cores=0,2,4,6
/proc/16347/stat : 16347 (python) S 16337 16337 15040 0 -1 4202560 903 0 0 0 1 1 0 0 15 0 1 0 850283200 374464512 26323 33554432000 4194304 5683644 140734069530912 18446744073709551615 270338403855 0 0 16781312 33554946 45863919939485696 0 0 17 6 0 0 0
/proc/16347/statm: 91422 26323 375 364 0 26309 0
[pid=16349] ppid=16347 vsize=34884 CPUtime=6.32 cores=0,2,4,6
/proc/16349/stat : 16349 (wbo1.4b-fixed) R 16347 16349 16349 0 -1 4202496 11705 0 0 0 603 29 0 0 25 0 1 0 850283201 35721216 7993 33554432000 134512640 135752315 4293977152 18446744073709551615 135270849 0 0 16781312 3 0 0 0 17 0 0 0 0
/proc/16349/statm: 8721 7993 146 303 0 8416 0
[pid=16337/tid=16348] ppid=16335 vsize=375932 CPUtime=0 cores=0,2,4,6
/proc/16337/task/16348/stat : 16348 (python) S 16335 16337 15040 0 -1 4202560 27 933 0 0 0 0 0 0 25 0 2 0 850283201 384954368 27824 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12.43
Current children cumulated vsize (KiB) 776504

[startup+25.5005 s]
/proc/loadavg: 2.00 2.05 1.85 3/500 16349
/proc/meminfo: memFree=16154036/32951124 swapFree=50923800/67111528
[pid=16337] ppid=16335 vsize=375932 CPUtime=6.09 cores=0,2,4,6
/proc/16337/stat : 16337 (python) S 16335 16337 15040 0 -1 4202496 44027 933 1 0 591 18 0 0 25 0 2 0 850282564 384954368 27824 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/16337/statm: 93983 27824 1872 364 0 28870 0
[pid=16347] ppid=16337 vsize=365688 CPUtime=0.07 cores=0,2,4,6
/proc/16347/stat : 16347 (python) S 16337 16337 15040 0 -1 4202560 909 0 0 0 4 3 0 0 15 0 1 0 850283200 374464512 26323 33554432000 4194304 5683644 140734069530912 18446744073709551615 270338403855 0 0 16781312 33554946 72556772316949167 0 0 17 6 0 0 0
/proc/16347/statm: 91422 26323 375 364 0 26309 0
[pid=16349] ppid=16347 vsize=43068 CPUtime=19.13 cores=0,2,4,6
/proc/16349/stat : 16349 (wbo1.4b-fixed) R 16347 16349 16349 0 -1 4202496 13739 0 0 0 1846 67 0 0 25 0 1 0 850283201 44101632 10027 33554432000 134512640 135752315 4293977152 18446744073709551615 134611384 0 0 16781312 3 0 0 0 17 0 0 0 0
/proc/16349/statm: 10767 10027 146 303 0 10462 0
[pid=16337/tid=16348] ppid=16335 vsize=375932 CPUtime=0 cores=0,2,4,6
/proc/16337/task/16348/stat : 16348 (python) S 16335 16337 15040 0 -1 4202560 27 933 0 0 0 0 0 0 25 0 2 0 850283201 384954368 27824 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 25.29
Current children cumulated vsize (KiB) 784688

[startup+51.1004 s]
/proc/loadavg: 2.00 2.05 1.86 3/500 16350
/proc/meminfo: memFree=16110312/32951124 swapFree=50923800/67111528
[pid=16337] ppid=16335 vsize=375932 CPUtime=6.09 cores=0,2,4,6
/proc/16337/stat : 16337 (python) S 16335 16337 15040 0 -1 4202496 44027 933 1 0 591 18 0 0 25 0 2 0 850282564 384954368 27824 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/16337/statm: 93983 27824 1872 364 0 28870 0
[pid=16347] ppid=16337 vsize=365688 CPUtime=0.17 cores=0,2,4,6
/proc/16347/stat : 16347 (python) S 16337 16337 15040 0 -1 4202560 1009 0 0 0 9 8 0 0 15 0 1 0 850283200 374464512 26328 33554432000 4194304 5683644 140734069530912 18446744073709551615 270338403855 0 0 16781312 33554946 72556772316949167 0 0 17 6 0 0 0
/proc/16347/statm: 91422 26328 380 364 0 26309 0
[pid=16349] ppid=16347 vsize=64676 CPUtime=44.73 cores=0,2,4,6
/proc/16349/stat : 16349 (wbo1.4b-fixed) R 16347 16349 16349 0 -1 4202496 19093 0 0 0 4372 101 0 0 25 0 1 0 850283201 66228224 15381 33554432000 134512640 135752315 4293977152 18446744073709551615 135270849 0 0 16781312 3 0 0 0 17 0 0 0 0
/proc/16349/statm: 16169 15381 146 303 0 15864 0
[pid=16337/tid=16348] ppid=16335 vsize=375932 CPUtime=0 cores=0,2,4,6
/proc/16337/task/16348/stat : 16348 (python) S 16335 16337 15040 0 -1 4202560 27 933 0 0 0 0 0 0 25 0 2 0 850283201 384954368 27824 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 50.99
Current children cumulated vsize (KiB) 806296

[startup+102.318 s]
/proc/loadavg: 2.00 2.04 1.86 3/505 16356
/proc/meminfo: memFree=14924776/32951124 swapFree=50923800/67111528
[pid=16337] ppid=16335 vsize=386188 CPUtime=6.13 cores=0,2,4,6
/proc/16337/stat : 16337 (python) S 16335 16337 15040 0 -1 4202496 44929 933 1 0 594 19 0 0 20 0 3 0 850282564 395456512 27831 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/16337/statm: 96547 27831 1875 364 0 31431 0
[pid=16347] ppid=16337 vsize=375932 CPUtime=0.21 cores=0,2,4,6
/proc/16347/stat : 16347 (python) S 16337 16337 15040 0 -1 4202560 1144 0 0 0 11 10 0 0 16 0 2 0 850283200 384954368 26364 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/16347/statm: 93983 26364 411 364 0 28870 0
[pid=16349] ppid=16347 vsize=67336 CPUtime=51.35 cores=0,2,4,6
/proc/16349/stat : 16349 (wbo1.4b-fixed) T 16347 16349 16349 0 -1 4202496 19724 0 0 0 5033 102 0 0 25 0 1 0 850283201 68952064 16012 33554432000 134512640 135752315 4293977152 18446744073709551615 134611201 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/16349/statm: 16834 16012 146 303 0 16529 0
[pid=16347/tid=16352] ppid=16337 vsize=375932 CPUtime=0 cores=0,2,4,6
/proc/16347/task/16352/stat : 16352 (python) S 16337 16337 15040 0 -1 4202560 41 0 0 0 0 0 0 0 16 0 2 0 850288336 384954368 26364 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554946 18446604448964049024 0 0 -1 6 0 0 0
[pid=16353] ppid=16337 vsize=375944 CPUtime=0.16 cores=0,2,4,6
/proc/16353/stat : 16353 (python) S 16337 16337 15040 0 -1 4202560 953 0 0 0 7 9 0 0 15 0 1 0 850288338 384966656 26324 33554432000 4194304 5683644 140734069530912 18446744073709551615 270338403910 0 0 16781312 33554946 72556772316949167 0 0 17 6 0 0 0
/proc/16353/statm: 93986 26324 372 364 0 28870 0
[pid=16355] ppid=16353 vsize=1139320 CPUtime=44.56 cores=0,2,4,6
/proc/16355/stat : 16355 (pbct-0.1.2-linu) R 16353 16355 16355 0 -1 4202496 300796 0 0 0 4395 61 0 0 25 0 1 0 850288339 1166663680 270636 33554432000 134512640 136422188 4294612816 18446744073709551615 134870643 0 0 16781312 16387 0 0 0 17 0 0 0 0
/proc/16355/statm: 284830 270636 215 467 0 284361 0
[pid=16337/tid=16348] ppid=16335 vsize=386188 CPUtime=0 cores=0,2,4,6
/proc/16337/task/16348/stat : 16348 (python) S 16335 16337 15040 0 -1 4202560 27 933 0 0 0 0 0 0 25 0 3 0 850283201 395456512 27831 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 2 0 0 0
[pid=16337/tid=16354] ppid=16335 vsize=386188 CPUtime=0 cores=0,2,4,6
/proc/16337/task/16354/stat : 16354 (python) S 16335 16337 15040 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 3 0 850288338 395456512 27831 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 102.41
Current children cumulated vsize (KiB) 2344720

[startup+162.301 s]
/proc/loadavg: 2.00 2.03 1.87 3/513 16366
/proc/meminfo: memFree=14405932/32951124 swapFree=50923800/67111528
[pid=16337] ppid=16335 vsize=406700 CPUtime=6.18 cores=0,2,4,6
/proc/16337/stat : 16337 (python) S 16335 16337 15040 0 -1 4202496 46699 933 1 0 599 19 0 0 20 0 5 0 850282564 416460800 27843 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/16337/statm: 101675 27843 1879 364 0 36553 0
[pid=16347] ppid=16337 vsize=375932 CPUtime=0.21 cores=0,2,4,6
/proc/16347/stat : 16347 (python) S 16337 16337 15040 0 -1 4202560 1144 0 0 0 11 10 0 0 16 0 2 0 850283200 384954368 26364 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/16347/statm: 93983 26364 411 364 0 28870 0
[pid=16349] ppid=16347 vsize=67336 CPUtime=51.35 cores=0,2,4,6
/proc/16349/stat : 16349 (wbo1.4b-fixed) T 16347 16349 16349 0 -1 4202496 19724 0 0 0 5033 102 0 0 25 0 1 0 850283201 68952064 16012 33554432000 134512640 135752315 4293977152 18446744073709551615 134611201 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/16349/statm: 16834 16012 146 303 0 16529 0
[pid=16347/tid=16352] ppid=16337 vsize=375932 CPUtime=0 cores=0,2,4,6
/proc/16347/task/16352/stat : 16352 (python) S 16337 16337 15040 0 -1 4202560 41 0 0 0 0 0 0 0 16 0 2 0 850288336 384954368 26364 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554946 18446604448964049024 0 0 -1 6 0 0 0
[pid=16353] ppid=16337 vsize=375944 CPUtime=0.19 cores=0,2,4,6
/proc/16353/stat : 16353 (python) S 16337 16337 15040 0 -1 4202560 1114 0 0 0 8 11 0 0 16 0 2 0 850288338 384966656 26349 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/16353/statm: 93986 26349 396 364 0 28870 0
[pid=16355] ppid=16353 vsize=1139980 CPUtime=48.53 cores=0,2,4,6
/proc/16355/stat : 16355 (pbct-0.1.2-linu) T 16353 16355 16355 0 -1 4202496 300944 0 0 0 4789 64 0 0 25 0 1 0 850288339 1167339520 270784 33554432000 134512640 136422188 4294612816 18446744073709551615 135006609 0 0 16781312 16387 18446744071562691360 0 0 17 0 0 0 0
/proc/16355/statm: 284995 270784 215 467 0 284526 0
[pid=16353/tid=16357] ppid=16337 vsize=375944 CPUtime=0 cores=0,2,4,6
/proc/16353/task/16357/stat : 16357 (python) S 16337 16337 15040 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 850293193 384966656 26349 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554946 18446604451331863616 0 0 -1 6 0 0 0
[pid=16358] ppid=16337 vsize=386200 CPUtime=0.22 cores=0,2,4,6
/proc/16358/stat : 16358 (python) S 16337 16337 15040 0 -1 4202560 1105 0 0 0 11 11 0 0 17 0 2 0 850293196 395468800 26353 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/16358/statm: 96550 26353 396 364 0 31431 0
[pid=16360] ppid=16358 vsize=63292 CPUtime=49.64 cores=0,2,4,6
/proc/16360/stat : 16360 (wbo1.4a) T 16358 16360 16360 0 -1 4202496 18722 0 0 0 4873 91 0 0 25 0 1 0 850293196 64811008 15001 33554432000 134512640 135751879 4293382960 18446744073709551615 134616336 0 0 16781312 3 18446744071562691360 0 0 17 2 0 0 0
/proc/16360/statm: 15823 15001 143 303 0 15518 0
[pid=16358/tid=16363] ppid=16337 vsize=386200 CPUtime=0 cores=0,2,4,6
/proc/16358/task/16363/stat : 16363 (python) S 16337 16337 15040 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 850298162 395468800 26353 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554946 18446604453948810560 0 0 -1 6 0 0 0
[pid=16364] ppid=16337 vsize=396456 CPUtime=0.02 cores=0,2,4,6

################
# More data... #
################

[pid=16355] ppid=16353 vsize=1139980 CPUtime=48.53 cores=0,2,4,6
/proc/16355/stat : 16355 (pbct-0.1.2-linu) T 16353 16355 16355 0 -1 4202496 300944 0 0 0 4789 64 0 0 25 0 1 0 850288339 1167339520 270784 33554432000 134512640 136422188 4294612816 18446744073709551615 135006609 0 0 16781312 16387 18446744071562691360 0 0 17 0 0 0 0
/proc/16355/statm: 284995 270784 215 467 0 284526 0
[pid=16353/tid=16357] ppid=16337 vsize=375944 CPUtime=0 cores=0,2,4,6
/proc/16353/task/16357/stat : 16357 (python) S 16337 16337 15040 0 -1 4202560 49 0 0 0 0 0 0 0 16 0 2 0 850293193 384966656 26349 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554946 18446604451331863616 0 0 -1 6 0 0 0
[pid=16358] ppid=16337 vsize=386200 CPUtime=0.22 cores=0,2,4,6
/proc/16358/stat : 16358 (python) S 16337 16337 15040 0 -1 4202560 1105 0 0 0 11 11 0 0 17 0 2 0 850293196 395468800 26353 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/16358/statm: 96550 26353 396 364 0 31431 0
[pid=16360] ppid=16358 vsize=63292 CPUtime=49.64 cores=0,2,4,6
/proc/16360/stat : 16360 (wbo1.4a) T 16358 16360 16360 0 -1 4202496 18722 0 0 0 4873 91 0 0 25 0 1 0 850293196 64811008 15001 33554432000 134512640 135751879 4293382960 18446744073709551615 134616336 0 0 16781312 3 18446744071562691360 0 0 17 2 0 0 0
/proc/16360/statm: 15823 15001 143 303 0 15518 0
[pid=16358/tid=16363] ppid=16337 vsize=386200 CPUtime=0 cores=0,2,4,6
/proc/16358/task/16363/stat : 16363 (python) S 16337 16337 15040 0 -1 4202560 45 0 0 0 0 0 0 0 17 0 2 0 850298162 395468800 26353 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554946 18446604453948810560 0 0 -1 6 0 0 0
[pid=16364] ppid=16337 vsize=396456 CPUtime=0.19 cores=0,2,4,6
/proc/16364/stat : 16364 (python) S 16337 16337 15040 0 -1 4202560 1128 0 0 0 10 9 0 0 16 0 2 0 850298165 405970944 26357 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/16364/statm: 99114 26357 396 364 0 33992 0
[pid=16366] ppid=16364 vsize=819772 CPUtime=46.63 cores=0,2,4,6
/proc/16366/stat : 16366 (scip-2.0.1.linu) T 16364 16366 16366 0 -1 4202496 181551 0 0 0 4613 50 0 0 25 0 1 0 850298166 839446528 173034 33554432000 4194304 15243407 140736459767264 18446744073709551615 6457236 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/16366/statm: 204943 173034 936 2698 0 202238 0
[pid=16364/tid=16368] ppid=16337 vsize=396456 CPUtime=0 cores=0,2,4,6
/proc/16364/task/16368/stat : 16368 (python) S 16337 16337 15040 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 850302830 405970944 26357 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554946 18446604447211727552 0 0 -1 6 0 0 0
[pid=16369] ppid=16337 vsize=406712 CPUtime=0.19 cores=0,2,4,6
/proc/16369/stat : 16369 (python) S 16337 16337 15040 0 -1 4202560 1115 0 0 0 10 9 0 0 16 0 2 0 850302832 416473088 26361 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/16369/statm: 101678 26361 396 364 0 36553 0
[pid=16371] ppid=16369 vsize=906548 CPUtime=47.43 cores=0,2,4,6
/proc/16371/stat : 16371 (scip-2.0.1.linu) T 16369 16371 16371 0 -1 4202496 229096 0 0 0 4688 55 0 0 25 0 1 0 850302832 928305152 211991 33554432000 4194304 13684479 140735683717904 18446744073709551615 7416130 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/16371/statm: 226637 211991 1238 2317 0 224315 0
[pid=16369/tid=16373] ppid=16337 vsize=406712 CPUtime=0 cores=0,2,4,6
/proc/16369/task/16373/stat : 16373 (python) S 16337 16337 15040 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 850307577 416473088 26361 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554946 18446604444015477760 0 0 -1 6 0 0 0
[pid=16379] ppid=16337 vsize=427224 CPUtime=0.19 cores=0,2,4,6
/proc/16379/stat : 16379 (python) S 16337 16337 15040 0 -1 4202560 1146 0 0 0 11 8 0 0 17 0 2 0 850310833 437477376 26369 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/16379/statm: 106806 26369 396 364 0 41675 0
[pid=16381] ppid=16379 vsize=84052 CPUtime=47.59 cores=0,2,4,6
/proc/16381/stat : 16381 (bsolo_pb10) T 16379 16381 16381 0 -1 4202496 26189 0 0 0 4697 62 0 0 25 0 1 0 850310834 86069248 18558 33554432000 134512640 137138936 4289193744 18446744073709551615 134542187 0 0 16781312 16384 18446744071562691360 0 0 17 0 0 0 0
/proc/16381/statm: 21013 18558 192 642 0 20369 0
[pid=16379/tid=16383] ppid=16337 vsize=427224 CPUtime=0 cores=0,2,4,6
/proc/16379/task/16383/stat : 16383 (python) S 16337 16337 15040 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 850315594 437477376 26369 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554946 18446604453322031552 0 0 -1 6 0 0 0
[pid=16384] ppid=16337 vsize=437480 CPUtime=0.37 cores=0,2,4,6
/proc/16384/stat : 16384 (python) S 16337 16337 15040 0 -1 4202560 1250 0 0 0 19 18 0 0 18 0 2 0 850315596 447979520 26379 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/16384/statm: 109370 26379 402 364 0 44236 0
[pid=16386] ppid=16384 vsize=61924 CPUtime=91.39 cores=0,2,4,6
/proc/16386/stat : 16386 (clasp-1.3.7-x86) T 16384 16386 16386 0 -1 4202496 16873 0 0 0 9136 3 0 0 25 0 1 0 850315597 63410176 14899 33554432000 134512640 136139019 4287667600 18446744073709551615 134883787 0 0 16781312 16386 18446744071562691360 0 0 17 0 0 0 0
/proc/16386/statm: 15481 14899 184 398 0 15081 0
[pid=16384/tid=16391] ppid=16337 vsize=437480 CPUtime=0 cores=0,2,4,6
/proc/16384/task/16391/stat : 16391 (python) S 16337 16337 15040 0 -1 4202560 42 0 0 0 0 0 0 0 18 0 2 0 850320416 447979520 26379 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554946 18446604448437675264 0 0 -1 0 0 0 0
[pid=16393] ppid=16337 vsize=447736 CPUtime=0.2 cores=0,2,4,6
/proc/16393/stat : 16393 (python) S 16337 16337 15040 0 -1 4202560 1227 0 0 0 10 10 0 0 16 0 2 0 850324742 458481664 26383 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350210507 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/16393/statm: 111934 26383 402 364 0 46797 0
[pid=16395] ppid=16393 vsize=8542452 CPUtime=47.33 cores=0,2,4,6
/proc/16395/stat : 16395 (java) T 16393 16395 16395 0 -1 4202496 703248 0 1 0 4650 83 0 0 18 0 19 0 850324743 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350186469 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/16395/statm: 2135613 694120 2259 9 0 2126354 0
[pid=16395/tid=16396] ppid=16393 vsize=8542452 CPUtime=44.2 cores=0,2,4,6
/proc/16395/task/16396/stat : 16396 (java) T 16393 16395 16395 0 -1 4202560 639080 0 1 0 4347 73 0 0 25 0 19 0 850324744 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 46912506022838 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=16395/tid=16397] ppid=16393 vsize=8542452 CPUtime=0.08 cores=0,2,4,6
/proc/16395/task/16397/stat : 16397 (java) T 16393 16395 16395 0 -1 4202560 6197 0 0 0 8 0 0 0 15 0 19 0 850324745 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350199705 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=16395/tid=16398] ppid=16393 vsize=8542452 CPUtime=0.06 cores=0,2,4,6
/proc/16395/task/16398/stat : 16398 (java) T 16393 16395 16395 0 -1 4202560 3991 0 0 0 6 0 0 0 15 0 19 0 850324745 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350199705 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=16395/tid=16399] ppid=16393 vsize=8542452 CPUtime=0.05 cores=0,2,4,6
/proc/16395/task/16399/stat : 16399 (java) T 16393 16395 16395 0 -1 4202560 4249 0 0 0 5 0 0 0 15 0 19 0 850324745 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350199705 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=16395/tid=16400] ppid=16393 vsize=8542452 CPUtime=0.08 cores=0,2,4,6
/proc/16395/task/16400/stat : 16400 (java) T 16393 16395 16395 0 -1 4202560 5029 0 0 0 8 0 0 0 15 0 19 0 850324745 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350199705 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=16395/tid=16401] ppid=16393 vsize=8542452 CPUtime=0.09 cores=0,2,4,6
/proc/16395/task/16401/stat : 16401 (java) T 16393 16395 16395 0 -1 4202560 5464 0 0 0 9 0 0 0 15 0 19 0 850324745 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350199705 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=16395/tid=16402] ppid=16393 vsize=8542452 CPUtime=0.05 cores=0,2,4,6
/proc/16395/task/16402/stat : 16402 (java) T 16393 16395 16395 0 -1 4202560 2592 0 0 0 5 0 0 0 15 0 19 0 850324745 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350199705 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=16395/tid=16403] ppid=16393 vsize=8542452 CPUtime=0.06 cores=0,2,4,6
/proc/16395/task/16403/stat : 16403 (java) T 16393 16395 16395 0 -1 4202560 3491 0 0 0 6 0 0 0 15 0 19 0 850324745 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350199705 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=16395/tid=16404] ppid=16393 vsize=8542452 CPUtime=0.08 cores=0,2,4,6
/proc/16395/task/16404/stat : 16404 (java) T 16393 16395 16395 0 -1 4202560 5272 0 0 0 8 0 0 0 15 0 19 0 850324745 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350199705 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=16395/tid=16405] ppid=16393 vsize=8542452 CPUtime=0.67 cores=0,2,4,6
/proc/16395/task/16405/stat : 16405 (java) T 16393 16395 16395 0 -1 4202560 15316 0 0 0 66 1 0 0 15 0 19 0 850324746 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350200320 0 0 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=16395/tid=16406] ppid=16393 vsize=8542452 CPUtime=0 cores=0,2,4,6
/proc/16395/task/16406/stat : 16406 (java) T 16393 16395 16395 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 850324746 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350199705 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=16395/tid=16407] ppid=16393 vsize=8542452 CPUtime=0 cores=0,2,4,6
/proc/16395/task/16407/stat : 16407 (java) T 16393 16395 16395 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 850324746 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350199705 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=16395/tid=16408] ppid=16393 vsize=8542452 CPUtime=0 cores=0,2,4,6
/proc/16395/task/16408/stat : 16408 (java) T 16393 16395 16395 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850324748 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350207409 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=16395/tid=16409] ppid=16393 vsize=8542452 CPUtime=0.96 cores=0,2,4,6
/proc/16395/task/16409/stat : 16409 (java) T 16393 16395 16395 0 -1 4202560 4420 0 0 0 96 0 0 0 15 0 19 0 850324748 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350199705 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=16395/tid=16410] ppid=16393 vsize=8542452 CPUtime=0.8 cores=0,2,4,6
/proc/16395/task/16410/stat : 16410 (java) T 16393 16395 16395 0 -1 4202560 6745 0 0 0 80 0 0 0 15 0 19 0 850324748 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350199705 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=16395/tid=16411] ppid=16393 vsize=8542452 CPUtime=0 cores=0,2,4,6
/proc/16395/task/16411/stat : 16411 (java) T 16393 16395 16395 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850324748 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350199705 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=16395/tid=16412] ppid=16393 vsize=8542452 CPUtime=0 cores=0,2,4,6
/proc/16395/task/16412/stat : 16412 (java) T 16393 16395 16395 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 850324748 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350200320 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=16395/tid=16413] ppid=16393 vsize=8542452 CPUtime=0 cores=0,2,4,6
/proc/16395/task/16413/stat : 16413 (java) T 16393 16395 16395 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 850324948 8747470848 694120 33554432000 1073741824 1073778376 140734991633120 18446744073709551615 270350200320 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=16393/tid=16418] ppid=16337 vsize=447736 CPUtime=0 cores=0,2,4,6
/proc/16393/task/16418/stat : 16418 (python) S 16337 16337 15040 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 850329255 458481664 26383 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554946 18446604442946440064 0 0 -1 6 0 0 0
[pid=16419] ppid=16337 vsize=457992 CPUtime=0 cores=0,2,4,6
/proc/16419/stat : 16419 (python) S 16337 16337 15040 0 -1 4202560 861 0 0 0 0 0 0 0 19 0 1 0 850329258 468983808 26332 33554432000 4194304 5683644 140734069530912 18446744073709551615 270338403910 0 0 16781312 33554946 206724640041598976 0 0 17 0 0 0 0
/proc/16419/statm: 114498 26332 348 364 0 49358 0
[pid=16421] ppid=16419 vsize=8537016 CPUtime=0.96 cores=0,2,4,6
/proc/16421/stat : 16421 (java) S 16419 16421 16421 0 -1 4202496 25964 0 1 0 91 5 0 0 20 0 18 0 850329258 8741904384 23945 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350186469 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/16421/statm: 2134254 23947 2207 9 0 2124995 0
[pid=16421/tid=16422] ppid=16419 vsize=8537016 CPUtime=0.47 cores=0,2,4,6
/proc/16421/task/16422/stat : 16422 (java) R 16419 16421 16421 0 -1 4202560 20602 0 1 0 44 3 0 0 18 0 18 0 850329259 8741904384 24539 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 46912505610168 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=16421/tid=16423] ppid=16419 vsize=8537016 CPUtime=0 cores=0,2,4,6
/proc/16421/task/16423/stat : 16423 (java) S 16419 16421 16421 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 18 0 850329260 8741904384 24542 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350199705 0 4 0 16800975 18446604436070853312 0 0 -1 2 0 0 0
[pid=16421/tid=16424] ppid=16419 vsize=8537016 CPUtime=0 cores=0,2,4,6
/proc/16421/task/16424/stat : 16424 (java) S 16419 16421 16421 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 18 0 850329260 8741904384 24545 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350199705 0 4 0 16800975 18446604436070853312 0 0 -1 2 0 0 0
[pid=16421/tid=16425] ppid=16419 vsize=8537016 CPUtime=0 cores=0,2,4,6
/proc/16421/task/16425/stat : 16425 (java) S 16419 16421 16421 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 850329260 8741904384 24547 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350199705 0 4 0 16800975 18446604436070853312 0 0 -1 4 0 0 0
[pid=16421/tid=16426] ppid=16419 vsize=8537016 CPUtime=0 cores=0,2,4,6
/proc/16421/task/16426/stat : 16426 (java) S 16419 16421 16421 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 850329260 8741904384 24550 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350199705 0 4 0 16800975 18446604436070853312 0 0 -1 4 0 0 0
[pid=16421/tid=16427] ppid=16419 vsize=8537016 CPUtime=0 cores=0,2,4,6
/proc/16421/task/16427/stat : 16427 (java) S 16419 16421 16421 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 850329260 8741904384 24553 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350199705 0 4 0 16800975 18446604436070853312 0 0 -1 4 0 0 0
[pid=16421/tid=16428] ppid=16419 vsize=8537016 CPUtime=0 cores=0,2,4,6
/proc/16421/task/16428/stat : 16428 (java) S 16419 16421 16421 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 850329260 8741904384 24556 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350199705 0 4 0 16800975 18446604436070853312 0 0 -1 4 0 0 0
[pid=16421/tid=16429] ppid=16419 vsize=8537016 CPUtime=0 cores=0,2,4,6
/proc/16421/task/16429/stat : 16429 (java) S 16419 16421 16421 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 850329260 8741904384 24559 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350199705 0 4 0 16800975 18446604436070853312 0 0 -1 4 0 0 0
[pid=16421/tid=16430] ppid=16419 vsize=8537016 CPUtime=0 cores=0,2,4,6
/proc/16421/task/16430/stat : 16430 (java) S 16419 16421 16421 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 850329260 8741904384 24561 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350199705 0 4 0 16800975 18446604436070853312 0 0 -1 2 0 0 0
[pid=16421/tid=16431] ppid=16419 vsize=8537016 CPUtime=0 cores=0,2,4,6
/proc/16421/task/16431/stat : 16431 (java) S 16419 16421 16421 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 18 0 850329261 8741904384 24564 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350200320 0 0 0 16800975 18446604436070853312 0 0 -1 2 0 0 0
[pid=16421/tid=16432] ppid=16419 vsize=8537016 CPUtime=0 cores=0,2,4,6
/proc/16421/task/16432/stat : 16432 (java) S 16419 16421 16421 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 18 0 850329261 8741904384 24567 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350199705 0 4 0 16800975 18446604436070853312 0 0 -1 2 0 0 0
[pid=16421/tid=16433] ppid=16419 vsize=8537016 CPUtime=0 cores=0,2,4,6
/proc/16421/task/16433/stat : 16433 (java) S 16419 16421 16421 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 18 0 850329261 8741904384 24570 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350199705 0 4 0 16800975 18446604436070853312 0 0 -1 2 0 0 0
[pid=16421/tid=16434] ppid=16419 vsize=8537016 CPUtime=0 cores=0,2,4,6
/proc/16421/task/16434/stat : 16434 (java) S 16419 16421 16421 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 850329263 8741904384 24573 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350207409 0 4 0 16800975 18446604436070853312 0 0 -1 2 0 0 0
[pid=16421/tid=16435] ppid=16419 vsize=8537016 CPUtime=0.24 cores=0,2,4,6
/proc/16421/task/16435/stat : 16435 (java) S 16419 16421 16421 0 -1 4202560 1695 0 0 0 24 0 0 0 18 0 18 0 850329263 8741904384 24575 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350199705 0 4 0 16800975 18446604436070853312 0 0 -1 4 0 0 0
[pid=16421/tid=16436] ppid=16419 vsize=8537016 CPUtime=0.22 cores=0,2,4,6
/proc/16421/task/16436/stat : 16436 (java) S 16419 16421 16421 0 -1 4202560 2866 0 0 0 21 1 0 0 25 0 18 0 850329263 8741904384 24575 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350199705 0 4 0 16800975 18446604436070853312 0 0 -1 0 0 0 0
[pid=16421/tid=16437] ppid=16419 vsize=8537016 CPUtime=0 cores=0,2,4,6
/proc/16421/task/16437/stat : 16437 (java) S 16419 16421 16421 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 850329263 8741904384 24577 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350199705 0 4 0 16800975 18446604436070853312 0 0 -1 2 0 0 0
[pid=16421/tid=16438] ppid=16419 vsize=8537016 CPUtime=0 cores=0,2,4,6
/proc/16421/task/16438/stat : 16438 (java) S 16419 16421 16421 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 850329263 8741904384 24580 33554432000 1073741824 1073778376 140737191673024 18446744073709551615 270350200320 0 4 0 16800975 18446604436070853312 0 0 -1 0 0 0 0
[pid=16337/tid=16348] ppid=16335 vsize=468236 CPUtime=11.89 cores=0,2,4,6
/proc/16337/task/16348/stat : 16348 (python) S 16335 16337 15040 0 -1 4202560 27 1062984 0 0 0 0 531 658 25 0 11 0 850283201 479473664 27879 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 2 0 0 0
[pid=16337/tid=16354] ppid=16335 vsize=468236 CPUtime=11.89 cores=0,2,4,6
/proc/16337/task/16354/stat : 16354 (python) S 16335 16337 15040 0 -1 4202560 26 1062984 0 0 0 0 531 658 20 0 11 0 850288338 479473664 27879 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 0 0 0 0
[pid=16337/tid=16359] ppid=16335 vsize=468236 CPUtime=11.89 cores=0,2,4,6
/proc/16337/task/16359/stat : 16359 (python) S 16335 16337 15040 0 -1 4202560 28 1062984 0 0 0 0 531 658 20 0 11 0 850293196 479473664 27879 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 6 0 0 0
[pid=16337/tid=16365] ppid=16335 vsize=468236 CPUtime=11.89 cores=0,2,4,6
/proc/16337/task/16365/stat : 16365 (python) S 16335 16337 15040 0 -1 4202560 32 1062984 0 0 0 0 531 658 20 0 11 0 850298165 479473664 27879 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 2 0 0 0
[pid=16337/tid=16370] ppid=16335 vsize=468236 CPUtime=11.89 cores=0,2,4,6
/proc/16337/task/16370/stat : 16370 (python) S 16335 16337 15040 0 -1 4202560 32 1062984 0 0 0 0 531 658 20 0 11 0 850302832 479473664 27879 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 6 0 0 0
[pid=16337/tid=16376] ppid=16335 vsize=468236 CPUtime=11.89 cores=0,2,4,6
/proc/16337/task/16376/stat : 16376 (python) S 16335 16337 15040 0 -1 4202560 30 1062984 0 0 0 0 531 658 25 0 11 0 850309645 479473664 27879 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 0 0 0 0
[pid=16337/tid=16380] ppid=16335 vsize=468236 CPUtime=11.89 cores=0,2,4,6
/proc/16337/task/16380/stat : 16380 (python) S 16335 16337 15040 0 -1 4202560 29 1062984 0 0 0 0 531 658 20 0 11 0 850310834 479473664 27879 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 6 0 0 0
[pid=16337/tid=16385] ppid=16335 vsize=468236 CPUtime=11.89 cores=0,2,4,6
/proc/16337/task/16385/stat : 16385 (python) S 16335 16337 15040 0 -1 4202560 29 1062984 0 0 0 0 531 658 18 0 11 0 850315597 479473664 27879 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 6 0 0 0
[pid=16337/tid=16394] ppid=16335 vsize=468236 CPUtime=11.89 cores=0,2,4,6
/proc/16337/task/16394/stat : 16394 (python) S 16335 16337 15040 0 -1 4202560 29 1062984 0 0 0 0 531 658 20 0 11 0 850324742 479473664 27879 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 0 0 0 0
[pid=16337/tid=16420] ppid=16335 vsize=468236 CPUtime=11.89 cores=0,2,4,6
/proc/16337/task/16420/stat : 16420 (python) S 16335 16337 15040 0 -1 4202560 30 1062984 0 0 0 0 531 658 20 0 11 0 850329258 479473664 27879 33554432000 4194304 5683644 140734069530912 18446744073709551615 270350207409 0 0 16781312 33554434 18446604444015478656 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 471.52
Current children cumulated vsize (KiB) 24402284

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16337 and gives
#  childrusage.ru_utime.tv_sec=32
#  childrusage.ru_utime.tv_usec=86122
#  childrusage.ru_stime.tv_sec=6
#  childrusage.ru_stime.tv_usec=853958
# CPU time returned by wait4() is 38.9401
# while last known CPU time is 471.52
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 467.507
CPU time (s): 471.52
CPU user time (s): 458.67
CPU system time (s): 12.85
CPU usage (%): 100.858
Max. virtual memory (cumulated for all children) (KiB): 24402284

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 32.0861
system time used= 6.85396
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1115374
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2929
involuntary context switches= 145

runsolver used 2.85757 second user time and 5.8861 second system time

The end

Launcher Data 

Begin job on node143 at 2011-06-09 02:17:49
IDJOB=3482901
IDBENCH=89783
IDSOLVER=1971
FILE ID=node143/3482901-1307578668
RUNJOBID= node143-1307576354-15058
PBS_JOBID= 13547656
Free space on /tmp= 73728 MiB

SOLVER NAME= borg pb-dec-11.04.03
BENCH NAME= PB11/normalized-PB11/DEC-SMALLINT-LIN/lopes/normalized-60.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482901-1307578668/watcher-3482901-1307578668 -o /tmp/evaluation-result-3482901-1307578668/solver-3482901-1307578668 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482901-1307578668.opb -seed 1104002183 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 3a065af206abae16cc2624cb89dfd6ff
RANDOM SEED=1104002183

node143.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.846
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      16336612 kB
Buffers:        177356 kB
Cached:         715200 kB
SwapCached:       8640 kB
Active:       16070128 kB
Inactive:       232760 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      16336612 kB
SwapTotal:    67111528 kB
SwapFree:     50923800 kB
Dirty:          113800 kB
Writeback:           0 kB
AnonPages:    15408736 kB
Mapped:          63096 kB
Slab:           143480 kB
PageTables:     100604 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 124613596 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 69544 MiB
End job on node143 at 2011-06-09 02:25:39