Trace number 3482772

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-dec-11.04.03? (MO) 526.07 522.196

General information on the benchmark

Namenormalized-PB06/SATUNSAT-SMALLINT/web/www.ps.uni-sb.de/~walser/
benchmarks/ppp-problems/normalized-ppp:1-11,19,21.opb
MD5SUMd484bc8efed557f17788965b19feafe5
Bench CategoryDEC-SMALLINT-LIN (no optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved NO
Number of variables4602
Total number of constraints30179
Number of constraints which are clauses29160
Number of constraints which are cardinality constraints (but not clauses)941
Number of constraints which are nor clauses,nor cardinality constraints78
Minimum length of a constraint3
Maximum length of a constraint29
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 10
Number of bits of the biggest number in a constraint 4
Biggest sum of numbers in a constraint 103
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.39/0.51	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.39/0.51	c INFO: solving HOME/instance-3482772-1307576532.opb
0.49/0.69	c INFO: parsing took 0.17 s
0.90/1.01	c INFO: features took 0.32 CPU seconds
0.90/1.04	c INFO: running clasp-1.3.7@0 for 45 with 1799 remaining (b = 0.79)
50.80/50.86	c INFO: wrote minion input file to HOME/tmp9vB9ME.minion
50.80/50.86	c INFO: running minion-0.12@0 for 45 with 1751 remaining (b = 0.24)
98.64/98.55	c INFO: running wbo1.4b-fixed@0 for 45 with 1701 remaining (b = 0.06)
149.63/149.39	c INFO: running scip-2.0.1-spx@0 for 45 with 1651 remaining (b = 0.03)
197.37/196.97	c INFO: running clasp-1.3.7@48 for 45 with 1604 remaining (b = 0.03)
243.72/243.16	c INFO: running wbo1.4a@0 for 45 with 1557 remaining (b = 0.04)
290.50/289.74	c INFO: running sat4j-pb-v20101225@0 for 45 with 1511 remaining (b = 0.02)
338.70/336.76	c INFO: running scip-2.0.1-clp@0 for 45 with 1463 remaining (b = 0.02)
385.69/383.59	c INFO: running clasp-1.3.7@94 for 136 with 1417 remaining (b = 0.05)
523.81/521.17	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1279 remaining (b = 0.02)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482772-1307576532/watcher-3482772-1307576532 -o /tmp/evaluation-result-3482772-1307576532/solver-3482772-1307576532 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482772-1307576532.opb -seed 271738601 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.68 0.55 0.19 2/424 16748
/proc/meminfo: memFree=29557364/32951124 swapFree=43324008/67111528
[pid=16748] ppid=16746 vsize=16244 CPUtime=0 cores=1,3,5,7
/proc/16748/stat : 16748 (python) R 16746 16748 16182 0 -1 4202496 1051 0 0 0 0 0 0 0 20 0 1 0 869253875 16633856 922 33554432000 4194304 5683644 140735012283872 18446744073709551615 5293775 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/16748/statm: 4061 922 381 364 0 548 0

[startup+0.083576 s]
/proc/loadavg: 1.68 0.55 0.19 2/424 16748
/proc/meminfo: memFree=29557364/32951124 swapFree=43324008/67111528
[pid=16748] ppid=16746 vsize=85624 CPUtime=0.05 cores=1,3,5,7
/proc/16748/stat : 16748 (python) S 16746 16748 16182 0 -1 4202496 2665 0 0 0 4 1 0 0 18 0 1 0 869253875 87678976 2382 33554432000 4194304 5683644 140735012283872 18446744073709551615 244446943232 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/16748/statm: 21406 2382 715 364 0 1623 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85624

[startup+0.117066 s]
/proc/loadavg: 1.68 0.55 0.19 2/424 16748
/proc/meminfo: memFree=29557364/32951124 swapFree=43324008/67111528
[pid=16748] ppid=16746 vsize=96128 CPUtime=0.08 cores=1,3,5,7
/proc/16748/stat : 16748 (python) S 16746 16748 16182 0 -1 4202496 3247 932 1 0 7 1 0 0 18 0 1 0 869253875 98435072 2483 33554432000 4194304 5683644 140735012283872 18446744073709551615 244446943232 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/16748/statm: 24032 2483 792 364 0 1627 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 96128

[startup+0.301554 s]
/proc/loadavg: 1.68 0.55 0.19 2/424 16748
/proc/meminfo: memFree=29557364/32951124 swapFree=43324008/67111528
[pid=16748] ppid=16746 vsize=168444 CPUtime=0.23 cores=1,3,5,7
/proc/16748/stat : 16748 (python) S 16746 16748 16182 0 -1 4202496 6012 932 1 0 16 7 0 0 17 0 1 0 869253875 172486656 4327 33554432000 4194304 5683644 140735012283872 18446744073709551615 244446943232 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/16748/statm: 42111 4327 1222 364 0 3328 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 168444

[startup+0.700248 s]
/proc/loadavg: 1.68 0.55 0.19 2/424 16748
/proc/meminfo: memFree=29557364/32951124 swapFree=43324008/67111528
[pid=16748] ppid=16746 vsize=289432 CPUtime=0.58 cores=1,3,5,7
/proc/16748/stat : 16748 (python) R 16746 16748 16182 0 -1 4202496 11774 932 1 0 46 12 0 0 17 0 1 0 869253875 296378368 8494 33554432000 4194304 5683644 140735012283872 18446744073709551615 47170639116956 0 0 16781312 33554434 0 0 0 17 7 0 0 0
/proc/16748/statm: 72358 8494 1796 364 0 7251 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 289432

[startup+1.5001 s]
/proc/loadavg: 1.68 0.55 0.19 3/433 16765
/proc/meminfo: memFree=29474960/32951124 swapFree=43324008/67111528
[pid=16748] ppid=16746 vsize=300408 CPUtime=0.92 cores=1,3,5,7
/proc/16748/stat : 16748 (python) S 16746 16748 16182 0 -1 4202496 12447 932 1 0 80 12 0 0 20 0 2 0 869253875 307617792 8940 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/16748/statm: 75102 8940 1870 364 0 9989 0
Current children cumulated CPU time (s) 0.92
Current children cumulated vsize (KiB) 300408

[startup+3.10083 s]
/proc/loadavg: 1.68 0.55 0.19 2/433 16800
/proc/meminfo: memFree=29506088/32951124 swapFree=43324008/67111528
[pid=16748] ppid=16746 vsize=300408 CPUtime=0.92 cores=1,3,5,7
/proc/16748/stat : 16748 (python) S 16746 16748 16182 0 -1 4202496 12447 932 1 0 80 12 0 0 20 0 2 0 869253875 307617792 8940 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/16748/statm: 75102 8940 1870 364 0 9989 0
[pid=16767] ppid=16748 vsize=290164 CPUtime=0 cores=1,3,5,7
/proc/16767/stat : 16767 (python) S 16748 16748 16182 0 -1 4202560 729 0 0 0 0 0 0 0 18 0 1 0 869253979 297127936 7417 33554432000 4194304 5683644 140735012283872 18446744073709551615 244446965263 0 0 16781312 33554946 16738310713059016967 0 0 17 5 0 0 0
/proc/16767/statm: 72541 7417 351 364 0 7428 0
[pid=16770] ppid=16767 vsize=5828 CPUtime=2.05 cores=1,3,5,7
/proc/16770/stat : 16770 (clasp-1.3.7-x86) R 16767 16770 16770 0 -1 4202496 1589 0 0 0 204 1 0 0 25 0 1 0 869253979 5967872 1199 33554432000 134512640 136139019 4292180704 18446744073709551615 134599059 0 0 16781312 16386 0 0 0 17 5 0 0 0
/proc/16770/statm: 1457 1199 183 398 0 1057 0
[pid=16748/tid=16768] ppid=16746 vsize=300408 CPUtime=0 cores=1,3,5,7
/proc/16748/task/16768/stat : 16768 (python) S 16746 16748 16182 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 2 0 869253979 307617792 8940 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 596400

[startup+6.31624 s]
/proc/loadavg: 1.78 0.59 0.21 2/429 16820
/proc/meminfo: memFree=29611044/32951124 swapFree=43324008/67111528
[pid=16748] ppid=16746 vsize=300408 CPUtime=0.92 cores=1,3,5,7
/proc/16748/stat : 16748 (python) S 16746 16748 16182 0 -1 4202496 12447 932 1 0 80 12 0 0 20 0 2 0 869253875 307617792 8940 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/16748/statm: 75102 8940 1870 364 0 9989 0
[pid=16767] ppid=16748 vsize=290164 CPUtime=0.01 cores=1,3,5,7
/proc/16767/stat : 16767 (python) S 16748 16748 16182 0 -1 4202560 886 0 0 0 1 0 0 0 18 0 1 0 869253979 297127936 7440 33554432000 4194304 5683644 140735012283872 18446744073709551615 244446965263 0 0 16781312 33554946 16738297106602623239 0 0 17 5 0 0 0
/proc/16767/statm: 72541 7440 374 364 0 7428 0
[pid=16770] ppid=16767 vsize=6752 CPUtime=5.26 cores=1,3,5,7
/proc/16770/stat : 16770 (clasp-1.3.7-x86) R 16767 16770 16770 0 -1 4202496 1834 0 0 0 525 1 0 0 25 0 1 0 869253979 6914048 1444 33554432000 134512640 136139019 4292180704 18446744073709551615 134883360 0 0 16781312 16386 0 0 0 17 5 0 0 0
/proc/16770/statm: 1688 1444 183 398 0 1288 0
[pid=16748/tid=16768] ppid=16746 vsize=300408 CPUtime=0 cores=1,3,5,7
/proc/16748/task/16768/stat : 16768 (python) S 16746 16748 16182 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 2 0 869253979 307617792 8940 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 6.19
Current children cumulated vsize (KiB) 597324

[startup+12.7011 s]
/proc/loadavg: 1.80 0.61 0.22 4/434 16908
/proc/meminfo: memFree=29491556/32951124 swapFree=43324008/67111528
[pid=16748] ppid=16746 vsize=300408 CPUtime=0.92 cores=1,3,5,7
/proc/16748/stat : 16748 (python) S 16746 16748 16182 0 -1 4202496 12447 932 1 0 80 12 0 0 20 0 2 0 869253875 307617792 8940 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/16748/statm: 75102 8940 1870 364 0 9989 0
[pid=16767] ppid=16748 vsize=290164 CPUtime=0.03 cores=1,3,5,7
/proc/16767/stat : 16767 (python) S 16748 16748 16182 0 -1 4202560 903 0 0 0 2 1 0 0 18 0 1 0 869253979 297127936 7449 33554432000 4194304 5683644 140735012283872 18446744073709551615 244446965263 0 0 16781312 33554946 5623606151888251622 0 0 17 5 0 0 0
/proc/16767/statm: 72541 7449 383 364 0 7428 0
[pid=16770] ppid=16767 vsize=8472 CPUtime=11.64 cores=1,3,5,7
/proc/16770/stat : 16770 (clasp-1.3.7-x86) R 16767 16770 16770 0 -1 4202496 2238 0 0 0 1162 2 0 0 25 0 1 0 869253979 8675328 1848 33554432000 134512640 136139019 4292180704 18446744073709551615 134608320 0 0 16781312 16386 0 0 0 17 5 0 0 0
/proc/16770/statm: 2118 1848 183 398 0 1718 0
[pid=16748/tid=16768] ppid=16746 vsize=300408 CPUtime=0 cores=1,3,5,7
/proc/16748/task/16768/stat : 16768 (python) S 16746 16748 16182 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 2 0 869253979 307617792 8940 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.59
Current children cumulated vsize (KiB) 599044

[startup+25.5007 s]
/proc/loadavg: 1.84 0.68 0.24 3/436 16912
/proc/meminfo: memFree=29485732/32951124 swapFree=43324008/67111528
[pid=16748] ppid=16746 vsize=300408 CPUtime=0.92 cores=1,3,5,7
/proc/16748/stat : 16748 (python) S 16746 16748 16182 0 -1 4202496 12447 932 1 0 80 12 0 0 20 0 2 0 869253875 307617792 8940 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/16748/statm: 75102 8940 1870 364 0 9989 0
[pid=16767] ppid=16748 vsize=290164 CPUtime=0.08 cores=1,3,5,7
/proc/16767/stat : 16767 (python) S 16748 16748 16182 0 -1 4202560 910 0 0 0 4 4 0 0 18 0 1 0 869253979 297127936 7450 33554432000 4194304 5683644 140735012283872 18446744073709551615 244446965263 0 0 16781312 33554946 5623606151888251622 0 0 17 5 0 0 0
/proc/16767/statm: 72541 7450 384 364 0 7428 0
[pid=16770] ppid=16767 vsize=11132 CPUtime=24.43 cores=1,3,5,7
/proc/16770/stat : 16770 (clasp-1.3.7-x86) R 16767 16770 16770 0 -1 4202496 2898 0 0 0 2438 5 0 0 25 0 1 0 869253979 11399168 2508 33554432000 134512640 136139019 4292180704 18446744073709551615 134832230 0 0 16781312 16386 0 0 0 17 1 0 0 0
/proc/16770/statm: 2783 2508 183 398 0 2383 0
[pid=16748/tid=16768] ppid=16746 vsize=300408 CPUtime=0 cores=1,3,5,7
/proc/16748/task/16768/stat : 16768 (python) S 16746 16748 16182 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 2 0 869253979 307617792 8940 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.43
Current children cumulated vsize (KiB) 601704

[startup+51.1009 s]
/proc/loadavg: 1.95 0.80 0.29 3/455 16967
/proc/meminfo: memFree=29041068/32951124 swapFree=43324008/67111528
[pid=16748] ppid=16746 vsize=310664 CPUtime=2.58 cores=1,3,5,7
/proc/16748/stat : 16748 (python) S 16746 16748 16182 0 -1 4202496 13486 932 1 0 245 13 0 0 22 0 3 0 869253875 318119936 8947 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/16748/statm: 77666 8947 1873 364 0 12550 0
[pid=16767] ppid=16748 vsize=300408 CPUtime=0.16 cores=1,3,5,7
/proc/16767/stat : 16767 (python) S 16748 16748 16182 0 -1 4202560 1148 0 0 0 8 8 0 0 19 0 2 0 869253979 307617792 7491 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/16767/statm: 75102 7491 420 364 0 9989 0
[pid=16770] ppid=16767 vsize=13008 CPUtime=48.13 cores=1,3,5,7
/proc/16770/stat : 16770 (clasp-1.3.7-x86) T 16767 16770 16770 0 -1 4202496 3361 0 0 0 4807 6 0 0 25 0 1 0 869253979 13320192 2971 33554432000 134512640 136139019 4292180704 18446744073709551615 134876586 0 0 16781312 16386 18446744071562691360 0 0 17 1 0 0 0
/proc/16770/statm: 3252 2971 183 398 0 2852 0
[pid=16767/tid=16967] ppid=16748 vsize=300408 CPUtime=0 cores=1,3,5,7
/proc/16767/task/16967/stat : 16967 (python) S 16748 16748 16182 0 -1 4202560 43 0 0 0 0 0 0 0 19 0 2 0 869258796 307617792 7491 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554946 18446604467550088064 0 0 -1 1 0 0 0
[pid=16748/tid=16768] ppid=16746 vsize=310664 CPUtime=0 cores=1,3,5,7
/proc/16748/task/16768/stat : 16768 (python) S 16746 16748 16182 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 3 0 869253979 318119936 8947 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 50.87
Current children cumulated vsize (KiB) 624080

[startup+102.3 s]
/proc/loadavg: 1.98 0.98 0.38 3/466 16980
/proc/meminfo: memFree=28287540/32951124 swapFree=43324008/67111528
[pid=16748] ppid=16746 vsize=320920 CPUtime=2.61 cores=1,3,5,7
/proc/16748/stat : 16748 (python) S 16746 16748 16182 0 -1 4202496 14381 932 1 0 247 14 0 0 19 0 4 0 869253875 328622080 8953 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/16748/statm: 80230 8953 1875 364 0 15111 0
[pid=16767] ppid=16748 vsize=300408 CPUtime=0.16 cores=1,3,5,7
/proc/16767/stat : 16767 (python) S 16748 16748 16182 0 -1 4202560 1148 0 0 0 8 8 0 0 19 0 2 0 869253979 307617792 7491 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/16767/statm: 75102 7491 420 364 0 9989 0
[pid=16770] ppid=16767 vsize=13008 CPUtime=48.13 cores=1,3,5,7
/proc/16770/stat : 16770 (clasp-1.3.7-x86) T 16767 16770 16770 0 -1 4202496 3361 0 0 0 4807 6 0 0 25 0 1 0 869253979 13320192 2971 33554432000 134512640 136139019 4292180704 18446744073709551615 134876586 0 0 16781312 16386 18446744071562691360 0 0 17 1 0 0 0
/proc/16770/statm: 3252 2971 183 398 0 2852 0
[pid=16767/tid=16967] ppid=16748 vsize=300408 CPUtime=0 cores=1,3,5,7
/proc/16767/task/16967/stat : 16967 (python) S 16748 16748 16182 0 -1 4202560 43 0 0 0 0 0 0 0 19 0 2 0 869258796 307617792 7491 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554946 18446604467550088064 0 0 -1 1 0 0 0
[pid=16968] ppid=16748 vsize=300420 CPUtime=0.17 cores=1,3,5,7
/proc/16968/stat : 16968 (python) S 16748 16748 16182 0 -1 4202560 1103 0 0 0 8 9 0 0 16 0 2 0 869258961 307630080 7467 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/16968/statm: 75105 7467 396 364 0 9989 0
[pid=16970] ppid=16968 vsize=439524 CPUtime=47.65 cores=1,3,5,7
/proc/16970/stat : 16970 (minion) T 16968 16970 16970 0 -1 4202496 104360 0 0 0 4755 10 0 0 25 0 1 0 869258961 450072576 102584 33554432000 134512640 165565024 4289188880 18446744073709551615 159737071 0 0 16781312 8396802 18446744071562691360 0 0 17 1 0 0 0
/proc/16970/statm: 109881 102584 355 7582 0 102296 0
[pid=16968/tid=16976] ppid=16748 vsize=300420 CPUtime=0 cores=1,3,5,7
/proc/16968/task/16976/stat : 16976 (python) S 16748 16748 16182 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 869263728 307630080 7467 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554946 18446604470255420352 0 0 -1 7 0 0 0
[pid=16977] ppid=16748 vsize=310676 CPUtime=0.01 cores=1,3,5,7
/proc/16977/stat : 16977 (python) S 16748 16748 16182 0 -1 4202560 933 0 0 0 1 0 0 0 15 0 1 0 869263731 318132224 7446 33554432000 4194304 5683644 140735012283872 18446744073709551615 244446965318 0 0 16781312 33554946 5304883608173904135 0 0 17 1 0 0 0
/proc/16977/statm: 77669 7446 372 364 0 12550 0
[pid=16979] ppid=16977 vsize=21956 CPUtime=3.73 cores=1,3,5,7
/proc/16979/stat : 16979 (wbo1.4b-fixed) R 16977 16979 16979 0 -1 4202496 5541 0 0 0 367 6 0 0 25 0 1 0 869263731 22482944 5017 33554432000 134512640 135752315 4291857264 18446744073709551615 135270849 0 0 16781312 3 0 0 0 17 3 0 0 0
/proc/16979/statm: 5489 5017 147 303 0 5184 0
[pid=16748/tid=16768] ppid=16746 vsize=320920 CPUtime=0 cores=1,3,5,7
/proc/16748/task/16768/stat : 16768 (python) S 16746 16748 16182 0 -1 4202560 25 932 0 0 0 0 0 0 20 0 4 0 869253979 328622080 8953 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 7 0 0 0
[pid=16748/tid=16969] ppid=16746 vsize=320920 CPUtime=0 cores=1,3,5,7
/proc/16748/task/16969/stat : 16969 (python) S 16746 16748 16182 0 -1 4202560 24 932 0 0 0 0 0 0 22 0 4 0 869258961 328622080 8953 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 1 0 0 0
[pid=16748/tid=16978] ppid=16746 vsize=320920 CPUtime=0 cores=1,3,5,7
/proc/16748/task/16978/stat : 16978 (python) S 16746 16748 16182 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 4 0 869263731 328622080 8953 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 102.46
Current children cumulated vsize (KiB) 1706912

[startup+162.301 s]
/proc/loadavg: 1.99 1.16 0.48 3/474 16989
/proc/meminfo: memFree=27884388/32951124 swapFree=43324008/67111528

################
# More data... #
################

/proc/meminfo: memFree=26864656/32951124 swapFree=43324008/67111528
[pid=16748] ppid=16746 vsize=372200 CPUtime=2.78 cores=1,3,5,7
/proc/16748/stat : 16748 (python) S 16746 16748 16182 0 -1 4202496 19154 932 1 0 263 15 0 0 20 0 9 0 869253875 381132800 8983 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/16748/statm: 93050 8983 1885 364 0 27916 0
[pid=16767] ppid=16748 vsize=300408 CPUtime=0.85 cores=1,3,5,7
/proc/16767/stat : 16767 (python) S 16748 16748 16182 0 -1 4202560 1214 0 0 0 41 44 0 0 18 0 2 0 869253979 307617792 7492 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/16767/statm: 75102 7492 421 364 0 9989 0
[pid=16770] ppid=16767 vsize=24648 CPUtime=231.81 cores=1,3,5,7
/proc/16770/stat : 16770 (clasp-1.3.7-x86) T 16767 16770 16770 0 -1 4202496 6256 0 0 0 23174 7 0 0 25 0 1 0 869253979 25239552 5866 33554432000 134512640 136139019 4292180704 18446744073709551615 134883787 0 0 16781312 16386 18446744071562691360 0 0 17 1 0 0 0
/proc/16770/statm: 6162 5866 183 398 0 5762 0
[pid=16767/tid=16967] ppid=16748 vsize=300408 CPUtime=0 cores=1,3,5,7
/proc/16767/task/16967/stat : 16967 (python) S 16748 16748 16182 0 -1 4202560 44 0 0 0 0 0 0 0 18 0 2 0 869258796 307617792 7492 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554946 18446604467550088064 0 0 -1 1 0 0 0
[pid=16968] ppid=16748 vsize=300420 CPUtime=0.17 cores=1,3,5,7
/proc/16968/stat : 16968 (python) S 16748 16748 16182 0 -1 4202560 1103 0 0 0 8 9 0 0 16 0 2 0 869258961 307630080 7467 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/16968/statm: 75105 7467 396 364 0 9989 0
[pid=16970] ppid=16968 vsize=439524 CPUtime=47.65 cores=1,3,5,7
/proc/16970/stat : 16970 (minion) T 16968 16970 16970 0 -1 4202496 104360 0 0 0 4755 10 0 0 25 0 1 0 869258961 450072576 102584 33554432000 134512640 165565024 4289188880 18446744073709551615 159737071 0 0 16781312 8396802 18446744071562691360 0 0 17 1 0 0 0
/proc/16970/statm: 109881 102584 355 7582 0 102296 0
[pid=16968/tid=16976] ppid=16748 vsize=300420 CPUtime=0 cores=1,3,5,7
/proc/16968/task/16976/stat : 16976 (python) S 16748 16748 16182 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 869263728 307630080 7467 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554946 18446604470255420352 0 0 -1 7 0 0 0
[pid=16977] ppid=16748 vsize=310676 CPUtime=0.18 cores=1,3,5,7
/proc/16977/stat : 16977 (python) S 16748 16748 16182 0 -1 4202560 1109 0 0 0 9 9 0 0 16 0 2 0 869263731 318132224 7471 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/16977/statm: 77669 7471 396 364 0 12550 0
[pid=16979] ppid=16977 vsize=151284 CPUtime=50.8 cores=1,3,5,7
/proc/16979/stat : 16979 (wbo1.4b-fixed) T 16977 16979 16979 0 -1 4202496 37812 0 0 0 5048 32 0 0 25 0 1 0 869263731 154914816 37288 33554432000 134512640 135752315 4291857264 18446744073709551615 134517408 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/16979/statm: 37821 37288 147 303 0 37516 0
[pid=16977/tid=16986] ppid=16748 vsize=310676 CPUtime=0 cores=1,3,5,7
/proc/16977/task/16986/stat : 16986 (python) S 16748 16748 16182 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869268811 318132224 7471 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554946 18446604467748333440 0 0 -1 7 0 0 0
[pid=16987] ppid=16748 vsize=320932 CPUtime=0.18 cores=1,3,5,7
/proc/16987/stat : 16987 (python) S 16748 16748 16182 0 -1 4202560 1125 0 0 0 7 11 0 0 16 0 2 0 869268814 328634368 7475 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/16987/statm: 80233 7475 396 364 0 15111 0
[pid=16989] ppid=16987 vsize=121640 CPUtime=47.55 cores=1,3,5,7
/proc/16989/stat : 16989 (scip-2.0.1.linu) T 16987 16989 16989 0 -1 4202496 30163 0 0 0 4733 22 0 0 25 0 1 0 869268814 124559360 27906 33554432000 4194304 13684479 140733932681184 18446744073709551615 7315929 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/16989/statm: 30410 27906 768 2317 0 28088 0
[pid=16987/tid=16995] ppid=16748 vsize=320932 CPUtime=0 cores=1,3,5,7
/proc/16987/task/16995/stat : 16995 (python) S 16748 16748 16182 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 869273570 328634368 7475 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554946 18446604468939715584 0 0 -1 7 0 0 0
[pid=16998] ppid=16748 vsize=331188 CPUtime=0.17 cores=1,3,5,7
/proc/16998/stat : 16998 (python) S 16748 16748 16182 0 -1 4202560 1150 0 0 0 8 9 0 0 16 0 2 0 869278191 339136512 7479 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/16998/statm: 82797 7479 396 364 0 17672 0
[pid=17000] ppid=16998 vsize=143400 CPUtime=46.54 cores=1,3,5,7
/proc/17000/stat : 17000 (wbo1.4a) T 16998 17000 17000 0 -1 4202496 35862 0 0 0 4623 31 0 0 25 0 1 0 869278191 146841600 35331 33554432000 134512640 135751879 4292052336 18446744073709551615 134616866 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/17000/statm: 35850 35331 143 303 0 35545 0
[pid=16998/tid=17002] ppid=16748 vsize=331188 CPUtime=0 cores=1,3,5,7
/proc/16998/task/17002/stat : 17002 (python) S 16748 16748 16182 0 -1 4202560 51 0 0 0 0 0 0 0 16 0 2 0 869282846 339136512 7479 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554946 18446604455786403776 0 0 -1 7 0 0 0
[pid=17003] ppid=16748 vsize=341444 CPUtime=0.19 cores=1,3,5,7
/proc/17003/stat : 17003 (python) S 16748 16748 16182 0 -1 4202560 1153 0 0 0 9 10 0 0 16 0 2 0 869282849 349638656 7483 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/17003/statm: 85361 7483 396 364 0 20233 0
[pid=17005] ppid=17003 vsize=8537772 CPUtime=48.05 cores=1,3,5,7
/proc/17005/stat : 17005 (java) T 17003 17005 17005 0 -1 4202496 50730 0 1 0 4799 6 0 0 15 0 19 0 869282849 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/17005/statm: 2134443 47935 2254 9 0 2125184 0
[pid=17005/tid=17006] ppid=17003 vsize=8537772 CPUtime=46.23 cores=1,3,5,7
/proc/17005/task/17006/stat : 17006 (java) T 17003 17005 17005 0 -1 4202560 31196 0 1 0 4620 3 0 0 25 0 19 0 869282850 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761113 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=17005/tid=17007] ppid=17003 vsize=8537772 CPUtime=0.05 cores=1,3,5,7
/proc/17005/task/17007/stat : 17007 (java) T 17003 17005 17005 0 -1 4202560 1717 0 0 0 5 0 0 0 15 0 19 0 869282851 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761113 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17005/tid=17008] ppid=17003 vsize=8537772 CPUtime=0.02 cores=1,3,5,7
/proc/17005/task/17008/stat : 17008 (java) T 17003 17005 17005 0 -1 4202560 1470 0 0 0 2 0 0 0 15 0 19 0 869282851 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761113 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17005/tid=17009] ppid=17003 vsize=8537772 CPUtime=0.02 cores=1,3,5,7
/proc/17005/task/17009/stat : 17009 (java) T 17003 17005 17005 0 -1 4202560 222 0 0 0 2 0 0 0 15 0 19 0 869282851 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761113 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17005/tid=17010] ppid=17003 vsize=8537772 CPUtime=0.04 cores=1,3,5,7
/proc/17005/task/17010/stat : 17010 (java) T 17003 17005 17005 0 -1 4202560 1076 0 0 0 4 0 0 0 15 0 19 0 869282851 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761113 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17005/tid=17011] ppid=17003 vsize=8537772 CPUtime=0.03 cores=1,3,5,7
/proc/17005/task/17011/stat : 17011 (java) T 17003 17005 17005 0 -1 4202560 1197 0 0 0 3 0 0 0 15 0 19 0 869282851 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761113 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17005/tid=17012] ppid=17003 vsize=8537772 CPUtime=0.03 cores=1,3,5,7
/proc/17005/task/17012/stat : 17012 (java) T 17003 17005 17005 0 -1 4202560 606 0 0 0 3 0 0 0 15 0 19 0 869282851 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761113 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17005/tid=17013] ppid=17003 vsize=8537772 CPUtime=0.03 cores=1,3,5,7
/proc/17005/task/17013/stat : 17013 (java) T 17003 17005 17005 0 -1 4202560 570 0 0 0 3 0 0 0 15 0 19 0 869282851 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761113 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=17005/tid=17014] ppid=17003 vsize=8537772 CPUtime=0.02 cores=1,3,5,7
/proc/17005/task/17014/stat : 17014 (java) T 17003 17005 17005 0 -1 4202560 976 0 0 0 2 0 0 0 15 0 19 0 869282851 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761113 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17005/tid=17015] ppid=17003 vsize=8537772 CPUtime=0.58 cores=1,3,5,7
/proc/17005/task/17015/stat : 17015 (java) T 17003 17005 17005 0 -1 4202560 5157 0 0 0 58 0 0 0 15 0 19 0 869282852 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 47322099686512 0 0 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=17005/tid=17016] ppid=17003 vsize=8537772 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17016/stat : 17016 (java) T 17003 17005 17005 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869282852 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761113 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17005/tid=17017] ppid=17003 vsize=8537772 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17017/stat : 17017 (java) T 17003 17005 17005 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 869282852 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761113 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17005/tid=17018] ppid=17003 vsize=8537772 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17018/stat : 17018 (java) T 17003 17005 17005 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869282854 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458768817 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17005/tid=17019] ppid=17003 vsize=8537772 CPUtime=0.54 cores=1,3,5,7
/proc/17005/task/17019/stat : 17019 (java) T 17003 17005 17005 0 -1 4202560 3159 0 0 0 54 0 0 0 15 0 19 0 869282854 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761113 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=17005/tid=17020] ppid=17003 vsize=8537772 CPUtime=0.38 cores=1,3,5,7
/proc/17005/task/17020/stat : 17020 (java) T 17003 17005 17005 0 -1 4202560 1991 0 0 0 38 0 0 0 15 0 19 0 869282854 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761113 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17005/tid=17021] ppid=17003 vsize=8537772 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17021/stat : 17021 (java) T 17003 17005 17005 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869282854 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761113 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17005/tid=17022] ppid=17003 vsize=8537772 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17022/stat : 17022 (java) T 17003 17005 17005 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869282854 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761728 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=17005/tid=17023] ppid=17003 vsize=8537772 CPUtime=0 cores=1,3,5,7
/proc/17005/task/17023/stat : 17023 (java) T 17003 17005 17005 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869282907 8742678528 47935 33554432000 1073741824 1073778376 140733826538032 18446744073709551615 244458761728 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=17003/tid=17026] ppid=16748 vsize=341444 CPUtime=0 cores=1,3,5,7
/proc/17003/task/17026/stat : 17026 (python) S 16748 16748 16182 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869287549 349638656 7483 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554946 18446604468939717376 0 0 -1 5 0 0 0
[pid=17027] ppid=16748 vsize=351700 CPUtime=0.17 cores=1,3,5,7
/proc/17027/stat : 17027 (python) S 16748 16748 16182 0 -1 4202560 1165 0 0 0 8 9 0 0 17 0 2 0 869287551 360140800 7487 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458771915 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/17027/statm: 87925 7487 396 364 0 22794 0
[pid=17029] ppid=17027 vsize=155448 CPUtime=46.79 cores=1,3,5,7
/proc/17029/stat : 17029 (scip-2.0.1.linu) T 17027 17029 17029 0 -1 4202496 52856 0 0 0 4660 19 0 0 25 0 1 0 869287552 159178752 33750 33554432000 4194304 15243407 140734314227888 18446744073709551615 6953042 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/17029/statm: 38862 33750 909 2698 0 36157 0
[pid=17027/tid=17031] ppid=16748 vsize=351700 CPUtime=0 cores=1,3,5,7
/proc/17027/task/17031/stat : 17031 (python) S 16748 16748 16182 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 869292232 360140800 7487 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554946 18446604467940163776 0 0 -1 7 0 0 0
[pid=17039] ppid=16748 vsize=361956 CPUtime=0 cores=1,3,5,7
/proc/17039/stat : 17039 (python) S 16748 16748 16182 0 -1 4202560 933 0 0 0 0 0 0 0 15 0 1 0 869305992 370642944 7449 33554432000 4194304 5683644 140735012283872 18446744073709551615 244446965318 0 0 16781312 33554946 2402372596759789568 0 0 17 1 0 0 0
/proc/17039/statm: 90489 7449 355 364 0 25355 0
[pid=17041] ppid=17039 vsize=8549256 CPUtime=2.19 cores=1,3,5,7
/proc/17041/stat : 17041 (java) S 17039 17041 17041 0 -1 4202496 46250 0 1 0 213 6 0 0 17 0 19 0 869305993 8754438144 41198 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458747877 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/17041/statm: 2137314 41198 2230 9 0 2128055 0
[pid=17041/tid=17042] ppid=17039 vsize=8549256 CPUtime=0.93 cores=1,3,5,7
/proc/17041/task/17042/stat : 17042 (java) R 17039 17041 17041 0 -1 4202560 32774 0 1 0 89 4 0 0 25 0 19 0 869305994 8754438144 41234 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 46912505820983 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=17041/tid=17043] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17043/stat : 17043 (java) S 17039 17041 17041 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 19 0 869305994 8754438144 41234 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458761113 0 4 0 16800975 18446604470874405824 0 0 -1 5 0 0 0
[pid=17041/tid=17044] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17044/stat : 17044 (java) S 17039 17041 17041 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 869305994 8754438144 41234 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458761113 0 4 0 16800975 18446604470874405824 0 0 -1 1 0 0 0
[pid=17041/tid=17045] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17045/stat : 17045 (java) S 17039 17041 17041 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 869305994 8754438144 41235 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458761113 0 4 0 16800975 18446604470874405824 0 0 -1 1 0 0 0
[pid=17041/tid=17046] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17046/stat : 17046 (java) S 17039 17041 17041 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869305994 8754438144 41235 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458761113 0 4 0 16800975 18446604470874405824 0 0 -1 1 0 0 0
[pid=17041/tid=17047] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17047/stat : 17047 (java) S 17039 17041 17041 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869305994 8754438144 41235 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458761113 0 4 0 16800975 18446604470874405824 0 0 -1 1 0 0 0
[pid=17041/tid=17048] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17048/stat : 17048 (java) S 17039 17041 17041 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869305994 8754438144 41235 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458761113 0 4 0 16800975 18446604470874405824 0 0 -1 1 0 0 0
[pid=17041/tid=17049] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17049/stat : 17049 (java) S 17039 17041 17041 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869305994 8754438144 41235 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458761113 0 4 0 16800975 18446604470874405824 0 0 -1 1 0 0 0
[pid=17041/tid=17050] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17050/stat : 17050 (java) S 17039 17041 17041 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 19 0 869305994 8754438144 41236 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458761113 0 4 0 16800975 18446604470874405824 0 0 -1 1 0 0 0
[pid=17041/tid=17051] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17051/stat : 17051 (java) S 17039 17041 17041 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 869305995 8754438144 41238 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458761728 0 0 0 16800975 18446604470874405824 0 0 -1 7 0 0 0
[pid=17041/tid=17052] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17052/stat : 17052 (java) S 17039 17041 17041 0 -1 4202560 16 0 0 0 0 0 0 0 23 0 19 0 869305996 8754438144 41239 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458761113 0 4 0 16800975 18446604470874405824 0 0 -1 5 0 0 0
[pid=17041/tid=17053] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17053/stat : 17053 (java) S 17039 17041 17041 0 -1 4202560 7 0 0 0 0 0 0 0 24 0 19 0 869305996 8754438144 41239 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458761113 0 4 0 16800975 18446604470874405824 0 0 -1 5 0 0 0
[pid=17041/tid=17054] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17054/stat : 17054 (java) S 17039 17041 17041 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869305998 8754438144 41240 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458768817 0 4 0 16800975 18446604470874405824 0 0 -1 5 0 0 0
[pid=17041/tid=17055] ppid=17039 vsize=8549256 CPUtime=0.62 cores=1,3,5,7
/proc/17041/task/17055/stat : 17055 (java) R 17039 17041 17041 0 -1 4202560 6113 0 0 0 62 0 0 0 25 0 19 0 869305998 8754438144 41241 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 47772521274427 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=17041/tid=17056] ppid=17039 vsize=8549256 CPUtime=0.61 cores=1,3,5,7
/proc/17041/task/17056/stat : 17056 (java) R 17039 17041 17041 0 -1 4202560 5997 0 0 0 61 0 0 0 25 0 19 0 869305998 8754438144 41243 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 47772523995777 0 4 0 16800975 0 0 0 -1 7 0 0 0
[pid=17041/tid=17057] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17057/stat : 17057 (java) S 17039 17041 17041 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 19 0 869305998 8754438144 41246 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458761113 0 4 0 16800975 18446604470874405824 0 0 -1 5 0 0 0
[pid=17041/tid=17058] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17058/stat : 17058 (java) S 17039 17041 17041 0 -1 4202560 1 0 0 0 0 0 0 0 17 0 19 0 869305998 8754438144 41247 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458761728 0 4 0 16800975 18446604470874405824 0 0 -1 1 0 0 0
[pid=17041/tid=17059] ppid=17039 vsize=8549256 CPUtime=0 cores=1,3,5,7
/proc/17041/task/17059/stat : 17059 (java) S 17039 17041 17041 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 19 0 869306045 8754438144 41248 33554432000 1073741824 1073778376 140734379037536 18446744073709551615 244458761728 0 4 0 16800975 18446604470874405824 0 0 -1 7 0 0 0
[pid=16748/tid=16768] ppid=16746 vsize=372200 CPUtime=0 cores=1,3,5,7
/proc/16748/task/16768/stat : 16768 (python) S 16746 16748 16182 0 -1 4202560 35 932 0 0 0 0 0 0 18 0 9 0 869253979 381132800 8983 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 7 0 0 0
[pid=16748/tid=16969] ppid=16746 vsize=372200 CPUtime=0 cores=1,3,5,7
/proc/16748/task/16969/stat : 16969 (python) S 16746 16748 16182 0 -1 4202560 24 932 0 0 0 0 0 0 22 0 9 0 869258961 381132800 8983 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 1 0 0 0
[pid=16748/tid=16978] ppid=16746 vsize=372200 CPUtime=0 cores=1,3,5,7
/proc/16748/task/16978/stat : 16978 (python) S 16746 16748 16182 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 9 0 869263731 381132800 8983 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 1 0 0 0
[pid=16748/tid=16988] ppid=16746 vsize=372200 CPUtime=0 cores=1,3,5,7
/proc/16748/task/16988/stat : 16988 (python) S 16746 16748 16182 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 9 0 869268814 381132800 8983 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 7 0 0 0
[pid=16748/tid=16999] ppid=16746 vsize=372200 CPUtime=0 cores=1,3,5,7
/proc/16748/task/16999/stat : 16999 (python) S 16746 16748 16182 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 9 0 869278191 381132800 8983 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 3 0 0 0
[pid=16748/tid=17004] ppid=16746 vsize=372200 CPUtime=0 cores=1,3,5,7
/proc/16748/task/17004/stat : 17004 (python) S 16746 16748 16182 0 -1 4202560 31 932 0 0 0 0 0 0 20 0 9 0 869282849 381132800 8983 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 7 0 0 0
[pid=16748/tid=17028] ppid=16746 vsize=372200 CPUtime=0 cores=1,3,5,7
/proc/16748/task/17028/stat : 17028 (python) S 16746 16748 16182 0 -1 4202560 29 932 0 0 0 0 0 0 20 0 9 0 869287552 381132800 8983 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 7 0 0 0
[pid=16748/tid=17040] ppid=16746 vsize=372200 CPUtime=0 cores=1,3,5,7
/proc/16748/task/17040/stat : 17040 (python) S 16746 16748 16182 0 -1 4202560 26 932 0 0 0 0 0 0 20 0 9 0 869305993 381132800 8983 33554432000 4194304 5683644 140735012283872 18446744073709551615 244458768817 0 0 16781312 33554434 18446604466626183616 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 526.07
Current children cumulated vsize (KiB) 21113896

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 16748 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=633599
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=158975
# CPU time returned by wait4() is 2.79257
# while last known CPU time is 526.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 522.196
CPU time (s): 526.07
CPU user time (s): 523.58
CPU system time (s): 2.49
CPU usage (%): 100.742
Max. virtual memory (cumulated for all children) (KiB): 21113896

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.6336
system time used= 0.158975
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 20092
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3330
involuntary context switches= 42

runsolver used 3.02354 second user time and 6.82096 second system time

The end

Launcher Data 

Begin job on node105 at 2011-06-09 01:42:14
IDJOB=3482772
IDBENCH=1500
IDSOLVER=1971
FILE ID=node105/3482772-1307576532
RUNJOBID= node105-1307576440-16201
PBS_JOBID= 13547700
Free space on /tmp= 74000 MiB

SOLVER NAME= borg pb-dec-11.04.03
BENCH NAME= PB06//final/normalized-PB06/SATUNSAT-SMALLINT/web/www.ps.uni-sb.de/~walser/benchmarks/ppp-problems/normalized-ppp:1-11,19,21.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482772-1307576532/watcher-3482772-1307576532 -o /tmp/evaluation-result-3482772-1307576532/solver-3482772-1307576532 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482772-1307576532.opb -seed 271738601 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d484bc8efed557f17788965b19feafe5
RANDOM SEED=271738601

node105.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5410.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.825
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      29557396 kB
Buffers:        174352 kB
Cached:         493168 kB
SwapCached:      20580 kB
Active:        2810696 kB
Inactive:       263840 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      29557396 kB
SwapTotal:    67111528 kB
SwapFree:     43324008 kB
Dirty:          209276 kB
Writeback:           0 kB
AnonPages:     2404720 kB
Mapped:          18736 kB
Slab:           169708 kB
PageTables:      81164 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 114856260 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73796 MiB
End job on node105 at 2011-06-09 01:50:59