Trace number 3481671

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 616.82 611.594

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-LIN/submittedPB07/
aksoy/decomp/normalized-matrix_5x3_10.opb
MD5SUM904168892843efef74e3394360b8d762
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark27
Best CPU time to get the best result obtained on this benchmark1800.55
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 26
Optimality of the best value was proved NO
Number of variables40363
Total number of constraints154319
Number of constraints which are clauses154296
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints22
Minimum length of a constraint1
Maximum length of a constraint1952
Number of terms in the objective function 1952
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1952
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 36
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 1988
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.37/0.65	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.37/0.65	c INFO: solving HOME/instance-3481671-1307577697.opb
1.27/1.52	c INFO: parsing took 0.85 s
3.09/3.38	c INFO: features took 1.86 CPU seconds
3.17/3.41	c INFO: running scip-2.0.1-spx@0 for 45 with 1796 remaining (b = 0.09)
51.58/51.62	c INFO: running wbo1.4a@0 for 45 with 1749 remaining (b = 0.02)
101.19/101.08	c INFO: running scip-2.0.1-clp@0 for 45 with 1700 remaining (b = 0.01)
149.67/149.35	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1652 remaining (b = 0.01)
201.01/198.26	c INFO: running clasp-1.3.7@0 for 91 with 1601 remaining (b = 0.01)
294.91/291.74	c INFO: running scip-2.0.1-spx@47 for 273 with 1508 remaining (b = 0.02)
568.92/564.50	c INFO: running scip-2.0.1-clp@47 for 45 with 1235 remaining (b = 0.01)
615.43/610.77	c INFO: running sat4j-pb-v20101225@0 for 91 with 1189 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481671-1307577697/watcher-3481671-1307577697 -o /tmp/evaluation-result-3481671-1307577697/solver-3481671-1307577697 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481671-1307577697.opb -seed 2071424781 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.21 2.12 1.59 2/689 8787
/proc/meminfo: memFree=19284844/32951124 swapFree=64303752/67111528
[pid=8787] ppid=8785 vsize=15380 CPUtime=0 cores=0,2,4,6
/proc/8787/stat : 8787 (python) R 8785 8787 7805 0 -1 4202496 808 0 0 0 0 0 0 0 25 0 1 0 850185665 15749120 693 33554432000 4194304 5683644 140733632573872 18446744073709551615 233510297232 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/8787/statm: 3845 693 332 364 0 332 0

[startup+0.0247741 s]
/proc/loadavg: 2.21 2.12 1.59 2/689 8787
/proc/meminfo: memFree=19284844/32951124 swapFree=64303752/67111528
[pid=8787] ppid=8785 vsize=16396 CPUtime=0.01 cores=0,2,4,6
/proc/8787/stat : 8787 (python) S 8785 8787 7805 0 -1 4202496 1111 0 0 0 1 0 0 0 25 0 1 0 850185665 16789504 979 33554432000 4194304 5683644 140733632573872 18446744073709551615 233510293349 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/8787/statm: 4099 979 407 364 0 586 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16396

[startup+0.101701 s]
/proc/loadavg: 2.21 2.12 1.59 2/689 8787
/proc/meminfo: memFree=19284844/32951124 swapFree=64303752/67111528
[pid=8787] ppid=8785 vsize=87824 CPUtime=0.05 cores=0,2,4,6
/proc/8787/stat : 8787 (python) S 8785 8787 7805 0 -1 4202496 2691 0 0 0 4 1 0 0 25 0 1 0 850185665 89931776 2406 33554432000 4194304 5683644 140733632573872 18446744073709551615 233510295552 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/8787/statm: 21956 2406 735 364 0 1621 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 87824

[startup+0.300541 s]
/proc/loadavg: 2.21 2.12 1.59 2/689 8787
/proc/meminfo: memFree=19284844/32951124 swapFree=64303752/67111528
[pid=8787] ppid=8785 vsize=123736 CPUtime=0.17 cores=0,2,4,6
/proc/8787/stat : 8787 (python) S 8785 8787 7805 0 -1 4202496 5357 930 1 0 13 4 0 0 18 0 1 0 850185665 126705664 3743 33554432000 4194304 5683644 140733632573872 18446744073709551615 233510293509 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/8787/statm: 30934 3743 987 364 0 2766 0
Current children cumulated CPU time (s) 0.17
Current children cumulated vsize (KiB) 123736

[startup+0.705469 s]
/proc/loadavg: 2.21 2.12 1.59 2/689 8787
/proc/meminfo: memFree=19284844/32951124 swapFree=64303752/67111528
[pid=8787] ppid=8785 vsize=288856 CPUtime=0.48 cores=0,2,4,6
/proc/8787/stat : 8787 (python) R 8785 8787 7805 0 -1 4202496 10668 930 1 0 37 11 0 0 17 0 1 0 850185665 295788544 8530 33554432000 4194304 5683644 140733632573872 18446744073709551615 4602311 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/8787/statm: 72214 8531 1781 364 0 7107 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 288856

[startup+1.50037 s]
/proc/loadavg: 2.21 2.12 1.59 3/690 8792
/proc/meminfo: memFree=19246392/32951124 swapFree=64303752/67111528
[pid=8787] ppid=8785 vsize=316620 CPUtime=1.27 cores=0,2,4,6
/proc/8787/stat : 8787 (python) R 8785 8787 7805 0 -1 4202496 19226 930 1 0 115 12 0 0 18 0 1 0 850185665 324218880 15266 33554432000 4194304 5683644 140733632573872 18446744073709551615 47126948427214 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/8787/statm: 79155 15266 1784 364 0 14048 0
Current children cumulated CPU time (s) 1.27
Current children cumulated vsize (KiB) 316620

[startup+3.10106 s]
/proc/loadavg: 2.21 2.12 1.59 3/690 8792
/proc/meminfo: memFree=19229156/32951124 swapFree=64303752/67111528
[pid=8787] ppid=8785 vsize=314384 CPUtime=2.87 cores=0,2,4,6
/proc/8787/stat : 8787 (python) R 8785 8787 7805 0 -1 4202496 22484 930 1 0 275 12 0 0 21 0 1 0 850185665 321929216 14944 33554432000 4194304 5683644 140733632573872 18446744073709551615 4620230 0 0 16781312 33554434 0 0 0 17 0 0 0 0
/proc/8787/statm: 78596 14944 1816 364 0 13489 0
Current children cumulated CPU time (s) 2.87
Current children cumulated vsize (KiB) 314384

[startup+6.30049 s]
/proc/loadavg: 2.19 2.12 1.59 3/693 8796
/proc/meminfo: memFree=18959348/32951124 swapFree=64303752/67111528
[pid=8787] ppid=8785 vsize=327064 CPUtime=3.19 cores=0,2,4,6
/proc/8787/stat : 8787 (python) S 8785 8787 7805 0 -1 4202496 23365 930 1 0 306 13 0 0 24 0 2 0 850185665 334913536 15597 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/8787/statm: 81766 15597 1862 364 0 16653 0
[pid=8794] ppid=8787 vsize=316820 CPUtime=0 cores=0,2,4,6
/proc/8794/stat : 8794 (python) S 8787 8787 7805 0 -1 4202560 745 0 0 0 0 0 0 0 15 0 1 0 850186006 324423680 14082 33554432000 4194304 5683644 140733632573872 18446744073709551615 233510317583 0 0 16781312 33554946 4482498663498612995 0 0 17 6 0 0 0
/proc/8794/statm: 79205 14082 351 364 0 14092 0
[pid=8796] ppid=8794 vsize=337252 CPUtime=2.87 cores=0,2,4,6
/proc/8796/stat : 8796 (scip-2.0.1.linu) R 8794 8796 8796 0 -1 4202496 84551 0 0 0 262 25 0 0 25 0 1 0 850186006 345346048 80526 33554432000 4194304 13684479 140736565697072 18446744073709551615 4508550 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/8796/statm: 84313 80526 641 2317 0 81991 0
[pid=8787/tid=8795] ppid=8785 vsize=327064 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8795/stat : 8795 (python) S 8785 8787 7805 0 -1 4202560 26 930 0 0 0 0 0 0 24 0 2 0 850186006 334913536 15597 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 6.06
Current children cumulated vsize (KiB) 981136

[startup+12.7003 s]
/proc/loadavg: 2.18 2.12 1.59 3/693 8796
/proc/meminfo: memFree=18883944/32951124 swapFree=64303752/67111528
[pid=8787] ppid=8785 vsize=327064 CPUtime=3.19 cores=0,2,4,6
/proc/8787/stat : 8787 (python) S 8785 8787 7805 0 -1 4202496 23365 930 1 0 306 13 0 0 24 0 2 0 850185665 334913536 15597 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/8787/statm: 81766 15597 1862 364 0 16653 0
[pid=8794] ppid=8787 vsize=316820 CPUtime=0.04 cores=0,2,4,6
/proc/8794/stat : 8794 (python) S 8787 8787 7805 0 -1 4202560 910 0 0 0 2 2 0 0 15 0 1 0 850186006 324423680 14106 33554432000 4194304 5683644 140733632573872 18446744073709551615 233510317583 0 0 16781312 33554946 72556772316949212 0 0 17 6 0 0 0
/proc/8794/statm: 79205 14106 375 364 0 14092 0
[pid=8796] ppid=8794 vsize=347848 CPUtime=9.28 cores=0,2,4,6
/proc/8796/stat : 8796 (scip-2.0.1.linu) R 8794 8796 8796 0 -1 4202496 87508 0 0 0 897 31 0 0 25 0 1 0 850186006 356196352 83401 33554432000 4194304 13684479 140736565697072 18446744073709551615 5688976 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/8796/statm: 86962 83401 660 2317 0 84640 0
[pid=8787/tid=8795] ppid=8785 vsize=327064 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8795/stat : 8795 (python) S 8785 8787 7805 0 -1 4202560 26 930 0 0 0 0 0 0 24 0 2 0 850186006 334913536 15597 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 12.51
Current children cumulated vsize (KiB) 991732

[startup+25.501 s]
/proc/loadavg: 2.14 2.11 1.60 3/697 8800
/proc/meminfo: memFree=18646088/32951124 swapFree=64303752/67111528
[pid=8787] ppid=8785 vsize=327064 CPUtime=3.19 cores=0,2,4,6
/proc/8787/stat : 8787 (python) S 8785 8787 7805 0 -1 4202496 23365 930 1 0 306 13 0 0 24 0 2 0 850185665 334913536 15597 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/8787/statm: 81766 15597 1862 364 0 16653 0
[pid=8794] ppid=8787 vsize=316820 CPUtime=0.09 cores=0,2,4,6
/proc/8794/stat : 8794 (python) S 8787 8787 7805 0 -1 4202560 916 0 0 0 5 4 0 0 15 0 1 0 850186006 324423680 14106 33554432000 4194304 5683644 140733632573872 18446744073709551615 233510317583 0 0 16781312 33554946 72556772316949212 0 0 17 6 0 0 0
/proc/8794/statm: 79205 14106 375 364 0 14092 0
[pid=8796] ppid=8794 vsize=600936 CPUtime=22.08 cores=0,2,4,6
/proc/8796/stat : 8796 (scip-2.0.1.linu) R 8794 8796 8796 0 -1 4202496 147422 0 0 0 2168 40 0 0 25 0 1 0 850186006 615358464 139777 33554432000 4194304 13684479 140736565697072 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/8796/statm: 150234 139777 845 2317 0 147912 0
[pid=8787/tid=8795] ppid=8785 vsize=327064 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8795/stat : 8795 (python) S 8785 8787 7805 0 -1 4202560 26 930 0 0 0 0 0 0 24 0 2 0 850186006 334913536 15597 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 25.36
Current children cumulated vsize (KiB) 1244820

[startup+51.1005 s]
/proc/loadavg: 2.32 2.15 1.62 3/697 8801
/proc/meminfo: memFree=18580372/32951124 swapFree=64303752/67111528
[pid=8787] ppid=8785 vsize=327064 CPUtime=3.19 cores=0,2,4,6
/proc/8787/stat : 8787 (python) S 8785 8787 7805 0 -1 4202496 23365 930 1 0 306 13 0 0 24 0 2 0 850185665 334913536 15597 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/8787/statm: 81766 15597 1862 364 0 16653 0
[pid=8794] ppid=8787 vsize=316820 CPUtime=0.2 cores=0,2,4,6
/proc/8794/stat : 8794 (python) S 8787 8787 7805 0 -1 4202560 925 0 0 0 10 10 0 0 15 0 1 0 850186006 324423680 14106 33554432000 4194304 5683644 140733632573872 18446744073709551615 233510317583 0 0 16781312 33554946 72556772316949212 0 0 17 6 0 0 0
/proc/8794/statm: 79205 14106 375 364 0 14092 0
[pid=8796] ppid=8794 vsize=656216 CPUtime=47.67 cores=0,2,4,6
/proc/8796/stat : 8796 (scip-2.0.1.linu) R 8794 8796 8796 0 -1 4202496 174529 0 0 0 4723 44 0 0 25 0 1 0 850186006 671965184 155013 33554432000 4194304 13684479 140736565697072 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/8796/statm: 164054 155013 786 2317 0 161732 0
[pid=8787/tid=8795] ppid=8785 vsize=327064 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8795/stat : 8795 (python) S 8785 8787 7805 0 -1 4202560 26 930 0 0 0 0 0 0 24 0 2 0 850186006 334913536 15597 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 1300100

[startup+102.321 s]
/proc/loadavg: 2.19 2.14 1.65 3/705 8810
/proc/meminfo: memFree=18264944/32951124 swapFree=64303752/67111528
[pid=8787] ppid=8785 vsize=347576 CPUtime=3.24 cores=0,2,4,6
/proc/8787/stat : 8787 (python) S 8785 8787 7805 0 -1 4202496 25186 930 1 0 310 14 0 0 20 0 4 0 850185665 355917824 15618 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/8787/statm: 86894 15618 1875 364 0 21775 0
[pid=8794] ppid=8787 vsize=327064 CPUtime=0.22 cores=0,2,4,6
/proc/8794/stat : 8794 (python) S 8787 8787 7805 0 -1 4202560 1082 0 0 0 10 12 0 0 17 0 2 0 850186006 334913536 14142 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/8794/statm: 81766 14142 406 364 0 16653 0
[pid=8796] ppid=8794 vsize=656216 CPUtime=48.17 cores=0,2,4,6
/proc/8796/stat : 8796 (scip-2.0.1.linu) T 8794 8796 8796 0 -1 4202496 174529 0 0 0 4773 44 0 0 25 0 1 0 850186006 671965184 155013 33554432000 4194304 13684479 140736565697072 18446744073709551615 7391338 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/8796/statm: 164054 155013 786 2317 0 161732 0
[pid=8794/tid=8802] ppid=8787 vsize=327064 CPUtime=0 cores=0,2,4,6
/proc/8794/task/8802/stat : 8802 (python) S 8787 8787 7805 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 850190825 334913536 14142 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554946 18446604452741321984 0 0 -1 6 0 0 0
[pid=8803] ppid=8787 vsize=327076 CPUtime=0.25 cores=0,2,4,6
/proc/8803/stat : 8803 (python) S 8787 8787 7805 0 -1 4202560 1170 0 0 0 13 12 0 0 16 0 2 0 850190827 334925824 14138 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/8803/statm: 81769 14138 402 364 0 16653 0
[pid=8805] ppid=8803 vsize=180208 CPUtime=49.42 cores=0,2,4,6
/proc/8805/stat : 8805 (wbo1.4a) T 8803 8805 8805 0 -1 4202496 55281 0 0 0 4920 22 0 0 25 0 1 0 850190828 184532992 44346 33554432000 134512640 135751879 4294445152 18446744073709551615 134616336 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/8805/statm: 45052 44346 146 303 0 44747 0
[pid=8803/tid=8807] ppid=8787 vsize=327076 CPUtime=0 cores=0,2,4,6
/proc/8803/task/8807/stat : 8807 (python) S 8787 8787 7805 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 850195771 334925824 14138 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554946 18446604444126835968 0 0 -1 6 0 0 0
[pid=8808] ppid=8787 vsize=337332 CPUtime=0 cores=0,2,4,6
/proc/8808/stat : 8808 (python) S 8787 8787 7805 0 -1 4202560 868 0 0 0 0 0 0 0 17 0 1 0 850195773 345427968 14094 33554432000 4194304 5683644 140733632573872 18446744073709551615 233510317638 0 0 16781312 33554946 3265392579209854976 0 0 17 0 0 0 0
/proc/8808/statm: 84333 14094 355 364 0 19214 0
[pid=8810] ppid=8808 vsize=202872 CPUtime=1.22 cores=0,2,4,6
/proc/8810/stat : 8810 (scip-2.0.1.linu) R 8808 8810 8810 0 -1 4202496 48711 0 0 0 117 5 0 0 25 0 1 0 850195774 207740928 48090 33554432000 4194304 15243407 140735626900640 18446744073709551615 6707872 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/8810/statm: 50718 48100 589 2698 0 48013 0
[pid=8787/tid=8795] ppid=8785 vsize=347576 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8795/stat : 8795 (python) S 8785 8787 7805 0 -1 4202560 26 930 0 0 0 0 0 0 24 0 4 0 850186006 355917824 15618 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 0 0 0 0
[pid=8787/tid=8804] ppid=8785 vsize=347576 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8804/stat : 8804 (python) S 8785 8787 7805 0 -1 4202560 31 930 0 0 0 0 0 0 20 0 4 0 850190827 355917824 15618 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 0 0 0 0
[pid=8787/tid=8809] ppid=8785 vsize=347576 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8809/stat : 8809 (python) S 8785 8787 7805 0 -1 4202560 94 930 0 0 0 0 0 0 20 0 4 0 850195774 355917824 15618 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 102.52
Current children cumulated vsize (KiB) 2378344

[startup+162.301 s]
/proc/loadavg: 2.37 2.18 1.69 3/728 8835
/proc/meminfo: memFree=16392324/32951124 swapFree=64303752/67111528
[pid=8787] ppid=8785 vsize=357832 CPUtime=3.27 cores=0,2,4,6
/proc/8787/stat : 8787 (python) S 8785 8787 7805 0 -1 4202496 26072 930 1 0 313 14 0 0 20 0 5 0 850185665 366419968 15624 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/8787/statm: 89458 15624 1877 364 0 24336 0
[pid=8794] ppid=8787 vsize=327064 CPUtime=0.22 cores=0,2,4,6
/proc/8794/stat : 8794 (python) S 8787 8787 7805 0 -1 4202560 1082 0 0 0 10 12 0 0 17 0 2 0 850186006 334913536 14142 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/8794/statm: 81766 14142 406 364 0 16653 0
[pid=8796] ppid=8794 vsize=656216 CPUtime=48.17 cores=0,2,4,6
/proc/8796/stat : 8796 (scip-2.0.1.linu) T 8794 8796 8796 0 -1 4202496 174529 0 0 0 4773 44 0 0 25 0 1 0 850186006 671965184 155013 33554432000 4194304 13684479 140736565697072 18446744073709551615 7391338 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/8796/statm: 164054 155013 786 2317 0 161732 0
[pid=8794/tid=8802] ppid=8787 vsize=327064 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

[pid=8787/tid=8795] ppid=8785 vsize=378344 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8795/stat : 8795 (python) S 8785 8787 7805 0 -1 4202560 32 930 0 0 0 0 0 0 18 0 7 0 850186006 387424256 15636 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 0 0 0 0
[pid=8787/tid=8804] ppid=8785 vsize=378344 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8804/stat : 8804 (python) S 8785 8787 7805 0 -1 4202560 31 930 0 0 0 0 0 0 20 0 7 0 850190827 387424256 15636 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 0 0 0 0
[pid=8787/tid=8809] ppid=8785 vsize=378344 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8809/stat : 8809 (python) S 8785 8787 7805 0 -1 4202560 101 930 0 0 0 0 0 0 18 0 7 0 850195774 387424256 15636 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 6 0 0 0
[pid=8787/tid=8814] ppid=8785 vsize=378344 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8814/stat : 8814 (python) S 8785 8787 7805 0 -1 4202560 30 930 0 0 0 0 0 0 20 0 7 0 850200600 387424256 15636 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 6 0 0 0
[pid=8787/tid=8839] ppid=8785 vsize=378344 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8839/stat : 8839 (python) S 8785 8787 7805 0 -1 4202560 29 930 0 0 0 0 0 0 20 0 7 0 850205491 387424256 15636 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 6 0 0 0
[pid=8787/tid=9066] ppid=8785 vsize=378344 CPUtime=0 cores=0,2,4,6
/proc/8787/task/9066/stat : 9066 (python) S 8785 8787 7805 0 -1 4202560 28 930 0 0 0 0 0 0 20 0 7 0 850246742 387424256 15636 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 616.82
Current children cumulated vsize (KiB) 20981552

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+611.502 s]
/proc/loadavg: 2.17 2.13 1.84 4/790 9084
/proc/meminfo: memFree=12411776/32951124 swapFree=64303752/67111528
[pid=8787] ppid=8785 vsize=378344 CPUtime=3.37 cores=0,2,4,6
/proc/8787/stat : 8787 (python) S 8785 8787 7805 0 -1 4202496 27962 930 1 0 322 15 0 0 20 0 7 0 850185665 387424256 15636 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/8787/statm: 94586 15636 1881 364 0 29458 0
[pid=8794] ppid=8787 vsize=327064 CPUtime=1.53 cores=0,2,4,6
/proc/8794/stat : 8794 (python) S 8787 8787 7805 0 -1 4202560 1155 0 0 0 81 72 0 0 15 0 2 0 850186006 334913536 14143 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/8794/statm: 81766 14143 407 364 0 16653 0
[pid=8796] ppid=8794 vsize=622812 CPUtime=320.91 cores=0,2,4,6
/proc/8796/stat : 8796 (scip-2.0.1.linu) T 8794 8796 8796 0 -1 4202496 181924 0 0 0 32032 59 0 0 25 0 1 0 850186006 637759488 147759 33554432000 4194304 13684479 140736565697072 18446744073709551615 7388139 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/8796/statm: 155703 147759 1381 2317 0 153381 0
[pid=8794/tid=8802] ppid=8787 vsize=327064 CPUtime=0 cores=0,2,4,6
/proc/8794/task/8802/stat : 8802 (python) S 8787 8787 7805 0 -1 4202560 44 0 0 0 0 0 0 0 15 0 2 0 850190825 334913536 14143 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554946 18446604452741321984 0 0 -1 6 0 0 0
[pid=8803] ppid=8787 vsize=327076 CPUtime=0.25 cores=0,2,4,6
/proc/8803/stat : 8803 (python) S 8787 8787 7805 0 -1 4202560 1170 0 0 0 13 12 0 0 16 0 2 0 850190827 334925824 14138 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/8803/statm: 81769 14138 402 364 0 16653 0
[pid=8805] ppid=8803 vsize=180208 CPUtime=49.42 cores=0,2,4,6
/proc/8805/stat : 8805 (wbo1.4a) T 8803 8805 8805 0 -1 4202496 55281 0 0 0 4920 22 0 0 25 0 1 0 850190828 184532992 44346 33554432000 134512640 135751879 4294445152 18446744073709551615 134616336 0 0 16781312 3 18446744071562691360 0 0 17 0 0 0 0
/proc/8805/statm: 45052 44346 146 303 0 44747 0
[pid=8803/tid=8807] ppid=8787 vsize=327076 CPUtime=0 cores=0,2,4,6
/proc/8803/task/8807/stat : 8807 (python) S 8787 8787 7805 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 850195771 334925824 14138 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554946 18446604444126835968 0 0 -1 6 0 0 0
[pid=8808] ppid=8787 vsize=337332 CPUtime=0.51 cores=0,2,4,6
/proc/8808/stat : 8808 (python) S 8787 8787 7805 0 -1 4202560 1208 0 0 0 26 25 0 0 16 0 2 0 850195773 345427968 14142 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0
/proc/8808/statm: 84333 14142 402 364 0 19214 0
[pid=8810] ppid=8808 vsize=620972 CPUtime=94.37 cores=0,2,4,6
/proc/8810/stat : 8810 (scip-2.0.1.linu) T 8808 8810 8810 0 -1 4202496 181067 0 0 0 9388 49 0 0 25 0 1 0 850195774 635875328 135963 33554432000 4194304 15243407 140735626900640 18446744073709551615 7060979 0 0 16781312 2 18446744071562691360 0 0 17 6 0 0 0
/proc/8810/statm: 155243 135963 903 2698 0 152538 0
[pid=8808/tid=8812] ppid=8787 vsize=337332 CPUtime=0 cores=0,2,4,6
/proc/8808/task/8812/stat : 8812 (python) S 8787 8787 7805 0 -1 4202560 45 0 0 0 0 0 0 0 15 0 2 0 850200598 345427968 14142 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554946 18446604445762986176 0 0 -1 0 0 0 0
[pid=8813] ppid=8787 vsize=347588 CPUtime=0.23 cores=0,2,4,6
/proc/8813/stat : 8813 (python) S 8787 8787 7805 0 -1 4202560 1139 0 0 0 13 10 0 0 17 0 2 0 850200600 355930112 14140 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/8813/statm: 86897 14140 396 364 0 21775 0
[pid=8815] ppid=8813 vsize=8546228 CPUtime=51.1 cores=0,2,4,6
/proc/8815/stat : 8815 (java) T 8813 8815 8815 0 -1 4202496 702265 0 1 0 5033 77 0 0 18 0 19 0 850200601 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522100197 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/8815/statm: 2136557 683763 2250 9 0 2127298 0
[pid=8815/tid=8816] ppid=8813 vsize=8546228 CPUtime=48.62 cores=0,2,4,6
/proc/8815/task/8816/stat : 8816 (java) T 8813 8815 8815 0 -1 4202560 643813 0 1 0 4792 70 0 0 25 0 19 0 850200602 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 46912505929306 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=8815/tid=8817] ppid=8813 vsize=8546228 CPUtime=0.1 cores=0,2,4,6
/proc/8815/task/8817/stat : 8817 (java) T 8813 8815 8815 0 -1 4202560 8401 0 0 0 10 0 0 0 15 0 19 0 850200602 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522113433 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=8815/tid=8818] ppid=8813 vsize=8546228 CPUtime=0.04 cores=0,2,4,6
/proc/8815/task/8818/stat : 8818 (java) T 8813 8815 8815 0 -1 4202560 3707 0 0 0 4 0 0 0 15 0 19 0 850200602 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522113433 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=8815/tid=8819] ppid=8813 vsize=8546228 CPUtime=0.08 cores=0,2,4,6
/proc/8815/task/8819/stat : 8819 (java) T 8813 8815 8815 0 -1 4202560 7723 0 0 0 7 1 0 0 15 0 19 0 850200602 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522113433 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=8815/tid=8820] ppid=8813 vsize=8546228 CPUtime=0.07 cores=0,2,4,6
/proc/8815/task/8820/stat : 8820 (java) T 8813 8815 8815 0 -1 4202560 5642 0 0 0 7 0 0 0 15 0 19 0 850200602 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522113433 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=8815/tid=8821] ppid=8813 vsize=8546228 CPUtime=0.03 cores=0,2,4,6
/proc/8815/task/8821/stat : 8821 (java) T 8813 8815 8815 0 -1 4202560 3334 0 0 0 3 0 0 0 15 0 19 0 850200602 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522113433 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=8815/tid=8822] ppid=8813 vsize=8546228 CPUtime=0.05 cores=0,2,4,6
/proc/8815/task/8822/stat : 8822 (java) T 8813 8815 8815 0 -1 4202560 4607 0 0 0 5 0 0 0 15 0 19 0 850200602 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522113433 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=8815/tid=8823] ppid=8813 vsize=8546228 CPUtime=0.04 cores=0,2,4,6
/proc/8815/task/8823/stat : 8823 (java) T 8813 8815 8815 0 -1 4202560 3323 0 0 0 4 0 0 0 15 0 19 0 850200602 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522113433 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=8815/tid=8824] ppid=8813 vsize=8546228 CPUtime=0.04 cores=0,2,4,6
/proc/8815/task/8824/stat : 8824 (java) T 8813 8815 8815 0 -1 4202560 3694 0 0 0 4 0 0 0 15 0 19 0 850200602 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522113433 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=8815/tid=8825] ppid=8813 vsize=8546228 CPUtime=0 cores=0,2,4,6
/proc/8815/task/8825/stat : 8825 (java) T 8813 8815 8815 0 -1 4202560 1269 0 0 0 0 0 0 0 15 0 19 0 850200603 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522114048 0 0 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=8815/tid=8826] ppid=8813 vsize=8546228 CPUtime=0 cores=0,2,4,6
/proc/8815/task/8826/stat : 8826 (java) T 8813 8815 8815 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 850200604 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522113433 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=8815/tid=8827] ppid=8813 vsize=8546228 CPUtime=0 cores=0,2,4,6
/proc/8815/task/8827/stat : 8827 (java) T 8813 8815 8815 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 850200604 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522113433 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=8815/tid=8828] ppid=8813 vsize=8546228 CPUtime=0 cores=0,2,4,6
/proc/8815/task/8828/stat : 8828 (java) T 8813 8815 8815 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850200606 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522121137 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=8815/tid=8829] ppid=8813 vsize=8546228 CPUtime=0.88 cores=0,2,4,6
/proc/8815/task/8829/stat : 8829 (java) T 8813 8815 8815 0 -1 4202560 8351 0 0 0 87 1 0 0 15 0 19 0 850200606 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522113433 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=8815/tid=8830] ppid=8813 vsize=8546228 CPUtime=1.04 cores=0,2,4,6
/proc/8815/task/8830/stat : 8830 (java) T 8813 8815 8815 0 -1 4202560 7004 0 0 0 104 0 0 0 15 0 19 0 850200606 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522113433 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=8815/tid=8831] ppid=8813 vsize=8546228 CPUtime=0 cores=0,2,4,6
/proc/8815/task/8831/stat : 8831 (java) T 8813 8815 8815 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 850200606 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522113433 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=8815/tid=8832] ppid=8813 vsize=8546228 CPUtime=0 cores=0,2,4,6
/proc/8815/task/8832/stat : 8832 (java) T 8813 8815 8815 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 850200606 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522114048 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=8815/tid=8833] ppid=8813 vsize=8546228 CPUtime=0 cores=0,2,4,6
/proc/8815/task/8833/stat : 8833 (java) T 8813 8815 8815 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 850200720 8751337472 683763 33554432000 1073741824 1073778376 140733797676560 18446744073709551615 233522114048 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=8813/tid=8837] ppid=8787 vsize=347588 CPUtime=0 cores=0,2,4,6
/proc/8813/task/8837/stat : 8837 (python) S 8787 8787 7805 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 850205488 355930112 14140 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554946 18446604445321156544 0 0 -1 6 0 0 0
[pid=8838] ppid=8787 vsize=357844 CPUtime=0.43 cores=0,2,4,6
/proc/8838/stat : 8838 (python) S 8787 8787 7805 0 -1 4202560 1166 0 0 0 21 22 0 0 19 0 2 0 850205491 366432256 14144 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522124235 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/8838/statm: 89461 14144 396 364 0 24336 0
[pid=8840] ppid=8838 vsize=28640 CPUtime=93.41 cores=0,2,4,6
/proc/8840/stat : 8840 (clasp-1.3.7-x86) T 8838 8840 8840 0 -1 4202496 8521 0 0 0 9341 0 0 0 25 0 1 0 850205491 29327360 6856 33554432000 134512640 136139019 4288764720 18446744073709551615 134883497 0 0 16781312 16386 18446744071562691360 0 0 17 0 0 0 0
/proc/8840/statm: 7160 6856 187 398 0 6760 0
[pid=8838/tid=8938] ppid=8787 vsize=357844 CPUtime=0 cores=0,2,4,6
/proc/8838/task/8938/stat : 8938 (python) S 8787 8787 7805 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 850214836 366432256 14144 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554946 18446604443694018688 0 0 -1 6 0 0 0
[pid=9065] ppid=8787 vsize=368100 CPUtime=0 cores=0,2,4,6
/proc/9065/stat : 9065 (python) S 8787 8787 7805 0 -1 4202560 809 0 0 0 0 0 0 0 20 0 1 0 850246742 376934400 14099 33554432000 4194304 5683644 140733632573872 18446744073709551615 233510317638 0 0 16781312 33554946 2035317119616286720 0 0 17 0 0 0 0
/proc/9065/statm: 92025 14099 348 364 0 26897 0
[pid=9067] ppid=9065 vsize=8539344 CPUtime=1.29 cores=0,2,4,6
/proc/9067/stat : 9067 (java) S 9065 9067 9067 0 -1 4202496 44508 0 1 0 123 6 0 0 22 0 18 0 850246742 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522100197 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0
/proc/9067/statm: 2134836 41595 2221 9 0 2125577 0
[pid=9067/tid=9068] ppid=9065 vsize=8539344 CPUtime=0.72 cores=0,2,4,6
/proc/9067/task/9068/stat : 9068 (java) R 9065 9067 9067 0 -1 4202560 35211 0 1 0 68 4 0 0 18 0 18 0 850246743 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 46912505366496 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=9067/tid=9069] ppid=9065 vsize=8539344 CPUtime=0 cores=0,2,4,6
/proc/9067/task/9069/stat : 9069 (java) S 9065 9067 9067 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 850246743 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522113433 0 4 0 16800975 18446604448735703424 0 0 -1 0 0 0 0
[pid=9067/tid=9070] ppid=9065 vsize=8539344 CPUtime=0 cores=0,2,4,6
/proc/9067/task/9070/stat : 9070 (java) S 9065 9067 9067 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 850246743 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522113433 0 4 0 16800975 18446604448735703424 0 0 -1 0 0 0 0
[pid=9067/tid=9071] ppid=9065 vsize=8539344 CPUtime=0 cores=0,2,4,6
/proc/9067/task/9071/stat : 9071 (java) S 9065 9067 9067 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 850246743 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522113433 0 4 0 16800975 18446604448735703424 0 0 -1 6 0 0 0
[pid=9067/tid=9072] ppid=9065 vsize=8539344 CPUtime=0 cores=0,2,4,6
/proc/9067/task/9072/stat : 9072 (java) S 9065 9067 9067 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 850246743 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522113433 0 4 0 16800975 18446604448735703424 0 0 -1 6 0 0 0
[pid=9067/tid=9073] ppid=9065 vsize=8539344 CPUtime=0 cores=0,2,4,6
/proc/9067/task/9073/stat : 9073 (java) S 9065 9067 9067 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 850246743 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522113433 0 4 0 16800975 18446604448735703424 0 0 -1 6 0 0 0
[pid=9067/tid=9074] ppid=9065 vsize=8539344 CPUtime=0 cores=0,2,4,6
/proc/9067/task/9074/stat : 9074 (java) S 9065 9067 9067 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 850246743 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522113433 0 4 0 16800975 18446604448735703424 0 0 -1 0 0 0 0
[pid=9067/tid=9075] ppid=9065 vsize=8539344 CPUtime=0.01 cores=0,2,4,6
/proc/9067/task/9075/stat : 9075 (java) S 9065 9067 9067 0 -1 4202560 984 0 0 0 1 0 0 0 19 0 18 0 850246743 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522113433 0 4 0 16800975 18446604448735703424 0 0 -1 6 0 0 0
[pid=9067/tid=9076] ppid=9065 vsize=8539344 CPUtime=0.01 cores=0,2,4,6
/proc/9067/task/9076/stat : 9076 (java) S 9065 9067 9067 0 -1 4202560 1120 0 0 0 1 0 0 0 19 0 18 0 850246743 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522113433 0 4 0 16800975 18446604448735703424 0 0 -1 0 0 0 0
[pid=9067/tid=9077] ppid=9065 vsize=8539344 CPUtime=0 cores=0,2,4,6
/proc/9067/task/9077/stat : 9077 (java) S 9065 9067 9067 0 -1 4202560 71 0 0 0 0 0 0 0 19 0 18 0 850246744 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522114048 0 0 0 16800975 18446604448735703424 0 0 -1 2 0 0 0
[pid=9067/tid=9078] ppid=9065 vsize=8539344 CPUtime=0 cores=0,2,4,6
/proc/9067/task/9078/stat : 9078 (java) S 9065 9067 9067 0 -1 4202560 18 0 0 0 0 0 0 0 19 0 18 0 850246745 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522113433 0 4 0 16800975 18446604448735703424 0 0 -1 6 0 0 0
[pid=9067/tid=9079] ppid=9065 vsize=8539344 CPUtime=0 cores=0,2,4,6
/proc/9067/task/9079/stat : 9079 (java) S 9065 9067 9067 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 18 0 850246745 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522113433 0 4 0 16800975 18446604448735703424 0 0 -1 2 0 0 0
[pid=9067/tid=9080] ppid=9065 vsize=8539344 CPUtime=0 cores=0,2,4,6
/proc/9067/task/9080/stat : 9080 (java) S 9065 9067 9067 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 850246747 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522121137 0 4 0 16800975 18446604448735703424 0 0 -1 2 0 0 0
[pid=9067/tid=9081] ppid=9065 vsize=8539344 CPUtime=0.21 cores=0,2,4,6
/proc/9067/task/9081/stat : 9081 (java) S 9065 9067 9067 0 -1 4202560 2152 0 0 0 21 0 0 0 20 0 18 0 850246747 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522113433 0 4 0 16800975 18446604448735703424 0 0 -1 6 0 0 0
[pid=9067/tid=9082] ppid=9065 vsize=8539344 CPUtime=0.3 cores=0,2,4,6
/proc/9067/task/9082/stat : 9082 (java) S 9065 9067 9067 0 -1 4202560 3586 0 0 0 30 0 0 0 16 0 18 0 850246747 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522113433 0 4 0 16800975 18446604448735703424 0 0 -1 2 0 0 0
[pid=9067/tid=9083] ppid=9065 vsize=8539344 CPUtime=0 cores=0,2,4,6
/proc/9067/task/9083/stat : 9083 (java) S 9065 9067 9067 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 850246747 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522113433 0 4 0 16800975 18446604448735703424 0 0 -1 2 0 0 0
[pid=9067/tid=9084] ppid=9065 vsize=8539344 CPUtime=0 cores=0,2,4,6
/proc/9067/task/9084/stat : 9084 (java) S 9065 9067 9067 0 -1 4202560 1 0 0 0 0 0 0 0 16 0 18 0 850246747 8744288256 41595 33554432000 1073741824 1073778376 140736505363424 18446744073709551615 233522114048 0 4 0 16800975 18446604448735703424 0 0 -1 4 0 0 0
[pid=8787/tid=8795] ppid=8785 vsize=378344 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8795/stat : 8795 (python) S 8785 8787 7805 0 -1 4202560 32 930 0 0 0 0 0 0 18 0 7 0 850186006 387424256 15636 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 0 0 0 0
[pid=8787/tid=8804] ppid=8785 vsize=378344 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8804/stat : 8804 (python) S 8785 8787 7805 0 -1 4202560 31 930 0 0 0 0 0 0 20 0 7 0 850190827 387424256 15636 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 0 0 0 0
[pid=8787/tid=8809] ppid=8785 vsize=378344 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8809/stat : 8809 (python) S 8785 8787 7805 0 -1 4202560 101 930 0 0 0 0 0 0 18 0 7 0 850195774 387424256 15636 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 6 0 0 0
[pid=8787/tid=8814] ppid=8785 vsize=378344 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8814/stat : 8814 (python) S 8785 8787 7805 0 -1 4202560 30 930 0 0 0 0 0 0 20 0 7 0 850200600 387424256 15636 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 6 0 0 0
[pid=8787/tid=8839] ppid=8785 vsize=378344 CPUtime=0 cores=0,2,4,6
/proc/8787/task/8839/stat : 8839 (python) S 8785 8787 7805 0 -1 4202560 29 930 0 0 0 0 0 0 20 0 7 0 850205491 387424256 15636 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 6 0 0 0
[pid=8787/tid=9066] ppid=8785 vsize=378344 CPUtime=0 cores=0,2,4,6
/proc/8787/task/9066/stat : 9066 (python) S 8785 8787 7805 0 -1 4202560 28 930 0 0 0 0 0 0 20 0 7 0 850246742 387424256 15636 33554432000 4194304 5683644 140733632573872 18446744073709551615 233522121137 0 0 16781312 33554434 18446604450781817536 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 616.82
Current children cumulated vsize (KiB) 20981552

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 8787 and gives
#  childrusage.ru_utime.tv_sec=3
#  childrusage.ru_utime.tv_usec=227509
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=155976
# CPU time returned by wait4() is 3.38349
# while last known CPU time is 616.82
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 611.594
CPU time (s): 616.82
CPU user time (s): 613.13
CPU system time (s): 3.69
CPU usage (%): 100.855
Max. virtual memory (cumulated for all children) (KiB): 20981552

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3.22751
system time used= 0.155976
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 28896
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2567
involuntary context switches= 35

runsolver used 5.21221 second user time and 10.5614 second system time

The end

Launcher Data 

Begin job on node145 at 2011-06-09 02:01:37
IDJOB=3481671
IDBENCH=25020
IDSOLVER=1970
FILE ID=node145/3481671-1307577697
RUNJOBID= node145-1307576354-7823
PBS_JOBID= 13547654
Free space on /tmp= 73816 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-LIN/submittedPB07/aksoy/decomp/normalized-matrix_5x3_10.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481671-1307577697/watcher-3481671-1307577697 -o /tmp/evaluation-result-3481671-1307577697/solver-3481671-1307577697 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481671-1307577697.opb -seed 2071424781 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 904168892843efef74e3394360b8d762
RANDOM SEED=2071424781

node145.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.786
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      19285140 kB
Buffers:        157516 kB
Cached:         606860 kB
SwapCached:       1064 kB
Active:       13184824 kB
Inactive:       190788 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      19285140 kB
SwapTotal:    67111528 kB
SwapFree:     64303752 kB
Dirty:          108484 kB
Writeback:           0 kB
AnonPages:    12610208 kB
Mapped:          75648 kB
Slab:           139552 kB
PageTables:      78700 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 160595896 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73624 MiB
End job on node145 at 2011-06-09 02:11:52