Trace number 3481510

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 704.82 698.295

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mis/normalized-mis_1000_25_4.opb
MD5SUMd847cf1d914db0ec942abd195c5092c7
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-123
Best CPU time to get the best result obtained on this benchmark1800.3
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -124
Optimality of the best value was proved NO
Number of variables1000
Total number of constraints1000
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1000
Minimum length of a constraint25
Maximum length of a constraint50
Number of terms in the objective function 1000
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1000
Number of bits of the sum of numbers in the objective function 10
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1000
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)31592
Sum of products size (including duplicates)63184
Number of different products15796
Sum of products size31592

Solver Data 

0.33/0.48	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.33/0.48	c INFO: solving HOME/instance-3481510-1307577981.opb
0.40/0.72	c INFO: wrote linearized instance to HOME/tmpLyO644.opb
0.81/0.95	c INFO: parsing took 0.23 s
1.33/1.69	c INFO: features took 0.43 CPU seconds
1.33/1.69	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.12)
48.27/48.19	c INFO: running scip-2.0.1-clp@0 for 45 with 1752 remaining (b = 0.02)
95.67/95.38	c INFO: running wbo1.4a@0 for 45 with 1705 remaining (b = 0.02)
144.41/143.90	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1657 remaining (b = 0.01)
194.56/190.84	c INFO: running scip-2.0.1-spx@46 for 45 with 1608 remaining (b = 0.01)
244.22/240.29	c INFO: running clasp-1.3.7@0 for 91 with 1558 remaining (b = 0.02)
338.19/333.73	c INFO: running scip-2.0.1-clp@46 for 45 with 1465 remaining (b = 0.01)
387.37/382.68	c INFO: running scip-2.0.1-spx@95 for 228 with 1416 remaining (b = 0.04)
615.68/609.78	c INFO: running scip-2.0.1-clp@95 for 91 with 1190 remaining (b = 0.02)
704.39/697.98	c INFO: running sat4j-pb-v20101225@0 for 91 with 1102 remaining (b = 0.02)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481510-1307577981/watcher-3481510-1307577981 -o /tmp/evaluation-result-3481510-1307577981/solver-3481510-1307577981 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481510-1307577981.opb -seed 1722682389 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.34 2.15 1.74 2/804 21040
/proc/meminfo: memFree=17914064/32950928 swapFree=26914392/67111528
[pid=21040] ppid=21038 vsize=16244 CPUtime=0 cores=0,2,4,6
/proc/21040/stat : 21040 (python) R 21038 21040 19061 0 -1 4202496 1052 0 0 0 0 0 0 0 25 0 1 0 869394813 16633856 923 33554432000 4194304 5683644 140735649394432 18446744073709551615 254500691712 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/21040/statm: 4061 923 381 364 0 548 0

[startup+0.118568 s]
/proc/loadavg: 2.34 2.15 1.74 2/804 21040
/proc/meminfo: memFree=17914064/32950928 swapFree=26914392/67111528
[pid=21040] ppid=21038 vsize=98188 CPUtime=0.08 cores=0,2,4,6
/proc/21040/stat : 21040 (python) S 21038 21040 19061 0 -1 4202496 3383 930 1 0 7 1 0 0 18 0 1 0 869394813 100544512 2487 33554432000 4194304 5683644 140735649394432 18446744073709551615 254500689920 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/21040/statm: 24547 2487 794 364 0 1627 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 98188

[startup+0.200781 s]
/proc/loadavg: 2.34 2.15 1.74 2/804 21040
/proc/meminfo: memFree=17914064/32950928 swapFree=26914392/67111528
[pid=21040] ppid=21038 vsize=123744 CPUtime=0.16 cores=0,2,4,6
/proc/21040/stat : 21040 (python) S 21038 21040 19061 0 -1 4202496 5358 930 1 0 12 4 0 0 17 0 1 0 869394813 126713856 3745 33554432000 4194304 5683644 140735649394432 18446744073709551615 254500689920 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/21040/statm: 30936 3745 987 364 0 2768 0
Current children cumulated CPU time (s) 0.16
Current children cumulated vsize (KiB) 123744

[startup+0.301758 s]
/proc/loadavg: 2.34 2.15 1.74 2/804 21040
/proc/meminfo: memFree=17914064/32950928 swapFree=26914392/67111528
[pid=21040] ppid=21038 vsize=200780 CPUtime=0.24 cores=0,2,4,6
/proc/21040/stat : 21040 (python) S 21038 21040 19061 0 -1 4202496 6649 930 1 0 18 6 0 0 17 0 1 0 869394813 205598720 4937 33554432000 4194304 5683644 140735649394432 18446744073709551615 254500689920 0 2147483391 16781312 2 18446744071699199166 0 0 17 6 0 0 0
/proc/21040/statm: 50195 4937 1465 364 0 3677 0
Current children cumulated CPU time (s) 0.24
Current children cumulated vsize (KiB) 200780

[startup+0.700366 s]
/proc/loadavg: 2.34 2.15 1.74 2/804 21040
/proc/meminfo: memFree=17914064/32950928 swapFree=26914392/67111528
[pid=21040] ppid=21038 vsize=284896 CPUtime=0.4 cores=0,2,4,6
/proc/21040/stat : 21040 (python) S 21038 21040 19061 0 -1 4202496 9800 930 1 0 30 10 0 0 18 0 1 0 869394813 291733504 7530 33554432000 4194304 5683644 140735649394432 18446744073709551615 254500711951 0 0 16781312 2 4294934787 0 0 17 6 0 0 0
/proc/21040/statm: 71224 7530 1777 364 0 6117 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 284896

[startup+1.50027 s]
/proc/loadavg: 2.39 2.17 1.74 3/805 21046
/proc/meminfo: memFree=17876140/32950928 swapFree=26914392/67111528
[pid=21040] ppid=21038 vsize=302292 CPUtime=1.33 cores=0,2,4,6
/proc/21040/stat : 21040 (python) S 21038 21040 19061 0 -1 4202496 15260 1458 1 0 99 11 20 3 20 0 2 0 869394813 309547008 9413 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/21040/statm: 75573 9413 1871 364 0 10460 0
Current children cumulated CPU time (s) 1.33
Current children cumulated vsize (KiB) 302292

[startup+3.12194 s]
/proc/loadavg: 2.39 2.17 1.74 3/808 21049
/proc/meminfo: memFree=17782628/32950928 swapFree=26914392/67111528
[pid=21040] ppid=21038 vsize=302292 CPUtime=1.33 cores=0,2,4,6
/proc/21040/stat : 21040 (python) S 21038 21040 19061 0 -1 4202496 15260 1458 1 0 99 11 20 3 20 0 2 0 869394813 309547008 9413 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/21040/statm: 75573 9413 1871 364 0 10460 0
[pid=21047] ppid=21040 vsize=292048 CPUtime=0 cores=0,2,4,6
/proc/21047/stat : 21047 (python) S 21040 21040 19061 0 -1 4202560 737 0 0 0 0 0 0 0 15 0 1 0 869394954 299057152 7856 33554432000 4194304 5683644 140735649394432 18446744073709551615 254500711951 0 0 16781312 33554946 3176909715972030464 0 0 17 6 0 0 0
/proc/21047/statm: 73012 7856 318 364 0 7899 0
[pid=21049] ppid=21047 vsize=100796 CPUtime=1.69 cores=0,2,4,6
/proc/21049/stat : 21049 (scip-2.0.1.linu) R 21047 21049 21049 0 -1 4202496 24653 0 0 0 161 8 0 0 19 0 1 0 869394954 103215104 22099 33554432000 4194304 13684479 140733534113632 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/21049/statm: 25199 22099 768 2317 0 22877 0
[pid=21040/tid=21048] ppid=21038 vsize=302292 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21048/stat : 21048 (python) S 21038 21040 19061 0 -1 4202560 29 1458 0 0 0 0 20 3 20 0 2 0 869394954 309547008 9413 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 3.02
Current children cumulated vsize (KiB) 695136

[startup+6.30131 s]
/proc/loadavg: 2.36 2.16 1.74 3/808 21049
/proc/meminfo: memFree=17766144/32950928 swapFree=26914392/67111528
[pid=21040] ppid=21038 vsize=302292 CPUtime=1.33 cores=0,2,4,6
/proc/21040/stat : 21040 (python) S 21038 21040 19061 0 -1 4202496 15260 1458 1 0 99 11 20 3 20 0 2 0 869394813 309547008 9413 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/21040/statm: 75573 9413 1871 364 0 10460 0
[pid=21047] ppid=21040 vsize=292048 CPUtime=0.02 cores=0,2,4,6
/proc/21047/stat : 21047 (python) S 21040 21040 19061 0 -1 4202560 884 0 0 0 1 1 0 0 15 0 1 0 869394954 299057152 7880 33554432000 4194304 5683644 140735649394432 18446744073709551615 254500711951 0 0 16781312 33554946 2607513566395236352 0 0 17 4 0 0 0
/proc/21047/statm: 73012 7880 342 364 0 7899 0
[pid=21049] ppid=21047 vsize=107644 CPUtime=4.89 cores=0,2,4,6
/proc/21049/stat : 21049 (scip-2.0.1.linu) R 21047 21049 21049 0 -1 4202496 26610 0 0 0 478 11 0 0 25 0 1 0 869394954 110227456 23981 33554432000 4194304 13684479 140733534113632 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/21049/statm: 26911 23981 757 2317 0 24589 0
[pid=21040/tid=21048] ppid=21038 vsize=302292 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21048/stat : 21048 (python) S 21038 21040 19061 0 -1 4202560 29 1458 0 0 0 0 20 3 20 0 2 0 869394954 309547008 9413 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 6.24
Current children cumulated vsize (KiB) 701984

[startup+12.701 s]
/proc/loadavg: 2.33 2.16 1.75 3/808 21049
/proc/meminfo: memFree=17745608/32950928 swapFree=26914392/67111528
[pid=21040] ppid=21038 vsize=302292 CPUtime=1.33 cores=0,2,4,6
/proc/21040/stat : 21040 (python) S 21038 21040 19061 0 -1 4202496 15260 1458 1 0 99 11 20 3 20 0 2 0 869394813 309547008 9413 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/21040/statm: 75573 9413 1871 364 0 10460 0
[pid=21047] ppid=21040 vsize=292048 CPUtime=0.04 cores=0,2,4,6
/proc/21047/stat : 21047 (python) S 21040 21040 19061 0 -1 4202560 891 0 0 0 2 2 0 0 15 0 1 0 869394954 299057152 7880 33554432000 4194304 5683644 140735649394432 18446744073709551615 254500711951 0 0 16781312 33554946 901040927034834944 0 0 17 4 0 0 0
/proc/21047/statm: 73012 7880 342 364 0 7899 0
[pid=21049] ppid=21047 vsize=128864 CPUtime=11.28 cores=0,2,4,6
/proc/21049/stat : 21049 (scip-2.0.1.linu) R 21047 21049 21049 0 -1 4202496 32255 0 0 0 1111 17 0 0 20 0 1 0 869394954 131956736 29499 33554432000 4194304 13684479 140733534113632 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/21049/statm: 32216 29499 763 2317 0 29894 0
[pid=21040/tid=21048] ppid=21038 vsize=302292 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21048/stat : 21048 (python) S 21038 21040 19061 0 -1 4202560 29 1458 0 0 0 0 20 3 20 0 2 0 869394954 309547008 9413 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 12.65
Current children cumulated vsize (KiB) 723204

[startup+25.5005 s]
/proc/loadavg: 2.28 2.15 1.75 3/808 21049
/proc/meminfo: memFree=17720204/32950928 swapFree=26914392/67111528
[pid=21040] ppid=21038 vsize=302292 CPUtime=1.33 cores=0,2,4,6
/proc/21040/stat : 21040 (python) S 21038 21040 19061 0 -1 4202496 15260 1458 1 0 99 11 20 3 20 0 2 0 869394813 309547008 9413 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/21040/statm: 75573 9413 1871 364 0 10460 0
[pid=21047] ppid=21040 vsize=292048 CPUtime=0.12 cores=0,2,4,6
/proc/21047/stat : 21047 (python) S 21040 21040 19061 0 -1 4202560 902 0 0 0 6 6 0 0 15 0 1 0 869394954 299057152 7880 33554432000 4194304 5683644 140735649394432 18446744073709551615 254500711951 0 0 16781312 33554946 1138946535724154880 0 0 17 6 0 0 0
/proc/21047/statm: 73012 7880 342 364 0 7899 0
[pid=21049] ppid=21047 vsize=154124 CPUtime=24.07 cores=0,2,4,6
/proc/21049/stat : 21049 (scip-2.0.1.linu) R 21047 21049 21049 0 -1 4202496 38530 0 0 0 2384 23 0 0 18 0 1 0 869394954 157822976 35524 33554432000 4194304 13684479 140733534113632 18446744073709551615 4316687 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/21049/statm: 38531 35524 798 2317 0 36209 0
[pid=21040/tid=21048] ppid=21038 vsize=302292 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21048/stat : 21048 (python) S 21038 21040 19061 0 -1 4202560 29 1458 0 0 0 0 20 3 20 0 2 0 869394954 309547008 9413 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 25.52
Current children cumulated vsize (KiB) 748464

[startup+51.1014 s]
/proc/loadavg: 2.18 2.14 1.75 4/834 21077
/proc/meminfo: memFree=17452796/32950928 swapFree=26914392/67111528
[pid=21040] ppid=21038 vsize=312548 CPUtime=1.35 cores=0,2,4,6
/proc/21040/stat : 21040 (python) S 21038 21040 19061 0 -1 4202496 16128 1458 1 0 101 11 20 3 20 0 3 0 869394813 320049152 9420 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/21040/statm: 78137 9420 1874 364 0 13021 0
[pid=21047] ppid=21040 vsize=302292 CPUtime=0.26 cores=0,2,4,6
/proc/21047/stat : 21047 (python) S 21040 21040 19061 0 -1 4202560 1109 0 0 0 11 15 0 0 16 0 2 0 869394954 309547008 7948 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/21047/statm: 75573 7948 405 364 0 10460 0
[pid=21049] ppid=21047 vsize=188800 CPUtime=46.75 cores=0,2,4,6
/proc/21049/stat : 21049 (scip-2.0.1.linu) T 21047 21049 21049 0 -1 4202496 47104 0 0 0 4638 37 0 0 25 0 1 0 869394954 193331200 43878 33554432000 4194304 13684479 140733534113632 18446744073709551615 7454306 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/21049/statm: 47200 43878 818 2317 0 44878 0
[pid=21047/tid=21074] ppid=21040 vsize=302292 CPUtime=0 cores=0,2,4,6
/proc/21047/task/21074/stat : 21074 (python) S 21040 21040 19061 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869399630 309547008 7948 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554946 18446604441335278272 0 0 -1 6 0 0 0
[pid=21075] ppid=21040 vsize=302304 CPUtime=0 cores=0,2,4,6
/proc/21075/stat : 21075 (python) S 21040 21040 19061 0 -1 4202560 760 0 0 0 0 0 0 0 15 0 1 0 869399632 309559296 7861 33554432000 4194304 5683644 140735649394432 18446744073709551615 254500712006 0 0 16781312 33554946 1864673997317210112 0 0 17 0 0 0 0
/proc/21075/statm: 75576 7861 319 364 0 10460 0
[pid=21077] ppid=21075 vsize=109324 CPUtime=2.88 cores=0,2,4,6
/proc/21077/stat : 21077 (scip-2.0.1.linu) R 21075 21077 21077 0 -1 4202496 24947 0 0 0 280 8 0 0 19 0 1 0 869399632 111947776 23333 33554432000 4194304 15243407 140737433502096 18446744073709551615 8113576 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/21077/statm: 27331 23333 853 2698 0 24626 0
[pid=21040/tid=21048] ppid=21038 vsize=312548 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21048/stat : 21048 (python) S 21038 21040 19061 0 -1 4202560 29 1458 0 0 0 0 20 3 20 0 3 0 869394954 320049152 9420 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 4 0 0 0
[pid=21040/tid=21076] ppid=21038 vsize=312548 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21076/stat : 21076 (python) S 21038 21040 19061 0 -1 4202560 27 1458 0 0 0 0 20 3 20 0 3 0 869399632 320049152 9420 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 51.24
Current children cumulated vsize (KiB) 1215268

[startup+102.301 s]
/proc/loadavg: 2.16 2.14 1.77 3/842 21086
/proc/meminfo: memFree=17176184/32950928 swapFree=26914392/67111528
[pid=21040] ppid=21038 vsize=322804 CPUtime=1.38 cores=0,2,4,6
/proc/21040/stat : 21040 (python) S 21038 21040 19061 0 -1 4202496 16988 1458 1 0 104 11 20 3 20 0 4 0 869394813 330551296 9426 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/21040/statm: 80701 9426 1876 364 0 15582 0
[pid=21047] ppid=21040 vsize=302292 CPUtime=0.26 cores=0,2,4,6
/proc/21047/stat : 21047 (python) S 21040 21040 19061 0 -1 4202560 1109 0 0 0 11 15 0 0 16 0 2 0 869394954 309547008 7948 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/21047/statm: 75573 7948 405 364 0 10460 0
[pid=21049] ppid=21047 vsize=188800 CPUtime=46.75 cores=0,2,4,6
/proc/21049/stat : 21049 (scip-2.0.1.linu) T 21047 21049 21049 0 -1 4202496 47104 0 0 0 4638 37 0 0 25 0 1 0 869394954 193331200 43878 33554432000 4194304 13684479 140733534113632 18446744073709551615 7454306 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/21049/statm: 47200 43878 818 2317 0 44878 0
[pid=21047/tid=21074] ppid=21040 vsize=302292 CPUtime=0 cores=0,2,4,6
/proc/21047/task/21074/stat : 21074 (python) S 21040 21040 19061 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869399630 309547008 7948 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554946 18446604441335278272 0 0 -1 6 0 0 0
[pid=21075] ppid=21040 vsize=302304 CPUtime=0.28 cores=0,2,4,6
/proc/21075/stat : 21075 (python) S 21040 21040 19061 0 -1 4202560 1132 0 0 0 14 14 0 0 16 0 2 0 869399632 309559296 7933 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/21075/statm: 75576 7933 390 364 0 10460 0
[pid=21077] ppid=21075 vsize=155620 CPUtime=47.11 cores=0,2,4,6
/proc/21077/stat : 21077 (scip-2.0.1.linu) T 21075 21077 21077 0 -1 4202496 51286 0 0 0 4688 23 0 0 25 0 1 0 869399632 159354880 34703 33554432000 4194304 15243407 140737433502096 18446744073709551615 8121945 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/21077/statm: 38905 34703 866 2698 0 36200 0
[pid=21075/tid=21079] ppid=21040 vsize=302304 CPUtime=0 cores=0,2,4,6
/proc/21075/task/21079/stat : 21079 (python) S 21040 21040 19061 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869404348 309559296 7933 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554946 18446604452340167744 0 0 -1 6 0 0 0
[pid=21080] ppid=21040 vsize=312560 CPUtime=0.02 cores=0,2,4,6
/proc/21080/stat : 21080 (python) S 21040 21040 19061 0 -1 4202560 924 0 0 0 1 1 0 0 18 0 1 0 869404351 320061440 7888 33554432000 4194304 5683644 140735649394432 18446744073709551615 254500712006 0 0 16781312 33554946 10841319722297819394 0 0 17 2 0 0 0
/proc/21080/statm: 78140 7888 342 364 0 13021 0
[pid=21082] ppid=21080 vsize=133344 CPUtime=6.9 cores=0,2,4,6
/proc/21082/stat : 21082 (wbo1.4a) R 21080 21082 21082 0 -1 4202496 33869 0 0 0 687 3 0 0 25 0 1 0 869404351 136544256 32713 33554432000 134512640 135751879 4294187888 18446744073709551615 135221360 0 0 16781312 3 0 0 0 17 2 0 0 0
/proc/21082/statm: 33336 32713 143 303 0 33031 0
[pid=21040/tid=21048] ppid=21038 vsize=322804 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21048/stat : 21048 (python) S 21038 21040 19061 0 -1 4202560 29 1458 0 0 0 0 20 3 20 0 4 0 869394954 330551296 9426 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 4 0 0 0
[pid=21040/tid=21076] ppid=21038 vsize=322804 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21076/stat : 21076 (python) S 21038 21040 19061 0 -1 4202560 27 1458 0 0 0 0 20 3 20 0 4 0 869399632 330551296 9426 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 0 0 0 0

################
# More data... #
################

[pid=21040/tid=21048] ppid=21038 vsize=353572 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21048/stat : 21048 (python) S 21038 21040 19061 0 -1 4202560 40 1458 0 0 0 0 20 3 18 0 7 0 869394954 362057728 9444 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 2 0 0 0
[pid=21040/tid=21076] ppid=21038 vsize=353572 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21076/stat : 21076 (python) S 21038 21040 19061 0 -1 4202560 34 1458 0 0 0 0 20 3 18 0 7 0 869399632 362057728 9444 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 0 0 0 0
[pid=21040/tid=21081] ppid=21038 vsize=353572 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21081/stat : 21081 (python) S 21038 21040 19061 0 -1 4202560 31 1458 0 0 0 0 20 3 20 0 7 0 869404351 362057728 9444 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 2 0 0 0
[pid=21040/tid=21091] ppid=21038 vsize=353572 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21091/stat : 21091 (python) S 21038 21040 19061 0 -1 4202560 27 1458 0 0 0 0 20 3 20 0 7 0 869409203 362057728 9444 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 4 0 0 0
[pid=21040/tid=21222] ppid=21038 vsize=353572 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21222/stat : 21222 (python) S 21038 21040 19061 0 -1 4202560 31 1458 0 0 0 0 20 3 20 0 7 0 869418842 362057728 9444 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 6 0 0 0
[pid=21040/tid=21271] ppid=21038 vsize=353572 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21271/stat : 21271 (python) S 21038 21040 19061 0 -1 4202560 28 1458 0 0 0 0 20 3 20 0 7 0 869464611 362057728 9444 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 704.82
Current children cumulated vsize (KiB) 20177528

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+698.202 s]
/proc/loadavg: 2.03 2.10 1.91 6/919 21291
/proc/meminfo: memFree=12779480/32950928 swapFree=26914392/67111528
[pid=21040] ppid=21038 vsize=353572 CPUtime=1.54 cores=0,2,4,6
/proc/21040/stat : 21040 (python) S 21038 21040 19061 0 -1 4202496 19901 1458 1 0 119 12 20 3 20 0 7 0 869394813 362057728 9444 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/21040/statm: 88393 9444 1882 364 0 23265 0
[pid=21047] ppid=21040 vsize=302292 CPUtime=1.78 cores=0,2,4,6
/proc/21047/stat : 21047 (python) S 21040 21040 19061 0 -1 4202560 1204 0 0 0 85 93 0 0 15 0 2 0 869394954 309547008 7950 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/21047/statm: 75573 7950 407 364 0 10460 0
[pid=21049] ppid=21047 vsize=206492 CPUtime=323.27 cores=0,2,4,6
/proc/21049/stat : 21049 (scip-2.0.1.linu) T 21047 21049 21049 0 -1 4202496 51778 0 0 0 32206 121 0 0 25 0 1 0 869394954 211447808 48335 33554432000 4194304 13684479 140733534113632 18446744073709551615 4412880 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/21049/statm: 51623 48335 768 2317 0 49301 0
[pid=21047/tid=21074] ppid=21040 vsize=302292 CPUtime=0 cores=0,2,4,6
/proc/21047/task/21074/stat : 21074 (python) S 21040 21040 19061 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 869399630 309547008 7950 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554946 18446604441335278272 0 0 -1 6 0 0 0
[pid=21075] ppid=21040 vsize=302304 CPUtime=1.06 cores=0,2,4,6
/proc/21075/stat : 21075 (python) S 21040 21040 19061 0 -1 4202560 1217 0 0 0 56 50 0 0 15 0 2 0 869399632 309559296 7933 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/21075/statm: 75576 7933 390 364 0 10460 0
[pid=21077] ppid=21075 vsize=190244 CPUtime=184.22 cores=0,2,4,6
/proc/21077/stat : 21077 (scip-2.0.1.linu) T 21075 21077 21077 0 -1 4202496 75187 0 0 0 18371 51 0 0 25 0 1 0 869399632 194809856 43621 33554432000 4194304 15243407 140737433502096 18446744073709551615 7323043 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/21077/statm: 47561 43621 866 2698 0 44856 0
[pid=21075/tid=21079] ppid=21040 vsize=302304 CPUtime=0 cores=0,2,4,6
/proc/21075/task/21079/stat : 21079 (python) S 21040 21040 19061 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 869404348 309559296 7933 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554946 18446604452340167744 0 0 -1 6 0 0 0
[pid=21080] ppid=21040 vsize=312560 CPUtime=0.28 cores=0,2,4,6
/proc/21080/stat : 21080 (python) S 21040 21040 19061 0 -1 4202560 1142 0 0 0 15 13 0 0 17 0 2 0 869404351 320061440 7937 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/21080/statm: 78140 7937 390 364 0 13021 0
[pid=21082] ppid=21080 vsize=408744 CPUtime=48.43 cores=0,2,4,6
/proc/21082/stat : 21082 (wbo1.4a) T 21080 21082 21082 0 -1 4202496 103204 0 0 0 4812 31 0 0 25 0 1 0 869404351 418553856 101680 33554432000 134512640 135751879 4294187888 18446744073709551615 134616336 0 0 16781312 3 18446744071562691360 0 0 17 4 0 0 0
/proc/21082/statm: 102186 101680 146 303 0 101881 0
[pid=21080/tid=21089] ppid=21040 vsize=312560 CPUtime=0 cores=0,2,4,6
/proc/21080/task/21089/stat : 21089 (python) S 21040 21040 19061 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 869409201 320061440 7937 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554946 18446604448240147520 0 0 -1 6 0 0 0
[pid=21090] ppid=21040 vsize=322816 CPUtime=0.25 cores=0,2,4,6
/proc/21090/stat : 21090 (python) S 21040 21040 19061 0 -1 4202560 1142 0 0 0 13 12 0 0 17 0 2 0 869409203 330563584 7941 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0
/proc/21090/statm: 80704 7941 390 364 0 15582 0
[pid=21093] ppid=21090 vsize=8544156 CPUtime=49.81 cores=0,2,4,6
/proc/21093/stat : 21093 (java) T 21090 21093 21093 0 -1 4202496 334944 0 1 0 4941 40 0 0 18 0 19 0 869409204 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512494565 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/21093/statm: 2136039 327550 2252 9 0 2126780 0
[pid=21093/tid=21094] ppid=21090 vsize=8544156 CPUtime=46.55 cores=0,2,4,6
/proc/21093/task/21094/stat : 21094 (java) T 21090 21093 21093 0 -1 4202560 232335 0 1 0 4631 24 0 0 25 0 19 0 869409205 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 46912506051376 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=21093/tid=21095] ppid=21090 vsize=8544156 CPUtime=0.07 cores=0,2,4,6
/proc/21093/task/21095/stat : 21095 (java) T 21090 21093 21093 0 -1 4202560 6528 0 0 0 7 0 0 0 15 0 19 0 869409205 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512507801 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=21093/tid=21096] ppid=21090 vsize=8544156 CPUtime=0.13 cores=0,2,4,6
/proc/21093/task/21096/stat : 21096 (java) T 21090 21093 21093 0 -1 4202560 10737 0 0 0 12 1 0 0 15 0 19 0 869409205 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512507801 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=21093/tid=21097] ppid=21090 vsize=8544156 CPUtime=0.09 cores=0,2,4,6
/proc/21093/task/21097/stat : 21097 (java) T 21090 21093 21093 0 -1 4202560 8678 0 0 0 9 0 0 0 15 0 19 0 869409205 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512507801 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=21093/tid=21098] ppid=21090 vsize=8544156 CPUtime=0.1 cores=0,2,4,6
/proc/21093/task/21098/stat : 21098 (java) T 21090 21093 21093 0 -1 4202560 9168 0 0 0 9 1 0 0 15 0 19 0 869409205 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512507801 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=21093/tid=21099] ppid=21090 vsize=8544156 CPUtime=0.21 cores=0,2,4,6
/proc/21093/task/21099/stat : 21099 (java) T 21090 21093 21093 0 -1 4202560 15213 0 0 0 20 1 0 0 15 0 19 0 869409205 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512507801 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=21093/tid=21100] ppid=21090 vsize=8544156 CPUtime=0.14 cores=0,2,4,6
/proc/21093/task/21100/stat : 21100 (java) T 21090 21093 21093 0 -1 4202560 11559 0 0 0 13 1 0 0 15 0 19 0 869409205 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512507801 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=21093/tid=21101] ppid=21090 vsize=8544156 CPUtime=0.1 cores=0,2,4,6
/proc/21093/task/21101/stat : 21101 (java) T 21090 21093 21093 0 -1 4202560 8191 0 0 0 9 1 0 0 15 0 19 0 869409205 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512507801 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=21093/tid=21102] ppid=21090 vsize=8544156 CPUtime=0.19 cores=0,2,4,6
/proc/21093/task/21102/stat : 21102 (java) T 21090 21093 21093 0 -1 4202560 17004 0 0 0 17 2 0 0 15 0 19 0 869409205 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512507801 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=21093/tid=21103] ppid=21090 vsize=8544156 CPUtime=0 cores=0,2,4,6
/proc/21093/task/21103/stat : 21103 (java) T 21090 21093 21093 0 -1 4202560 992 0 0 0 0 0 0 0 15 0 19 0 869409206 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512508416 0 0 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=21093/tid=21104] ppid=21090 vsize=8544156 CPUtime=0 cores=0,2,4,6
/proc/21093/task/21104/stat : 21104 (java) T 21090 21093 21093 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869409207 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512507801 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=21093/tid=21105] ppid=21090 vsize=8544156 CPUtime=0 cores=0,2,4,6
/proc/21093/task/21105/stat : 21105 (java) T 21090 21093 21093 0 -1 4202560 9 0 0 0 0 0 0 0 18 0 19 0 869409207 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512507801 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=21093/tid=21106] ppid=21090 vsize=8544156 CPUtime=0 cores=0,2,4,6
/proc/21093/task/21106/stat : 21106 (java) T 21090 21093 21093 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869409209 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512515505 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=21093/tid=21107] ppid=21090 vsize=8544156 CPUtime=1.03 cores=0,2,4,6
/proc/21093/task/21107/stat : 21107 (java) T 21090 21093 21093 0 -1 4202560 9696 0 0 0 101 2 0 0 15 0 19 0 869409209 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512507801 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=21093/tid=21108] ppid=21090 vsize=8544156 CPUtime=1.08 cores=0,2,4,6
/proc/21093/task/21108/stat : 21108 (java) T 21090 21093 21093 0 -1 4202560 3445 0 0 0 108 0 0 0 15 0 19 0 869409209 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512507801 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=21093/tid=21109] ppid=21090 vsize=8544156 CPUtime=0 cores=0,2,4,6
/proc/21093/task/21109/stat : 21109 (java) T 21090 21093 21093 0 -1 4202560 2 0 0 0 0 0 0 0 18 0 19 0 869409209 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512507801 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=21093/tid=21110] ppid=21090 vsize=8544156 CPUtime=0 cores=0,2,4,6
/proc/21093/task/21110/stat : 21110 (java) T 21090 21093 21093 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869409209 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512508416 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=21093/tid=21111] ppid=21090 vsize=8544156 CPUtime=0 cores=0,2,4,6
/proc/21093/task/21111/stat : 21111 (java) T 21090 21093 21093 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869409277 8749215744 327550 33554432000 1073741824 1073778376 140734491760048 18446744073709551615 254512508416 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=21090/tid=21215] ppid=21040 vsize=322816 CPUtime=0 cores=0,2,4,6
/proc/21090/task/21215/stat : 21215 (python) S 21040 21040 19061 0 -1 4202560 50 0 0 0 0 0 0 0 17 0 2 0 869413894 330563584 7941 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554946 18446604452924897472 0 0 -1 2 0 0 0
[pid=21221] ppid=21040 vsize=333072 CPUtime=0.45 cores=0,2,4,6
/proc/21221/stat : 21221 (python) S 21040 21040 19061 0 -1 4202560 1243 0 0 0 21 24 0 0 16 0 2 0 869418842 341065728 7951 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512518603 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/21221/statm: 83268 7951 396 364 0 18143 0
[pid=21223] ppid=21221 vsize=23808 CPUtime=93.4 cores=0,2,4,6
/proc/21223/stat : 21223 (clasp-1.3.7-x86) T 21221 21223 21223 0 -1 4202496 6376 0 0 0 9339 1 0 0 25 0 1 0 869418842 24379392 5717 33554432000 134512640 136139019 4290574192 18446744073709551615 134599797 0 0 16781312 16386 18446744071562691360 0 0 17 0 0 0 0
/proc/21223/statm: 5952 5717 187 398 0 5552 0
[pid=21221/tid=21255] ppid=21040 vsize=333072 CPUtime=0 cores=0,2,4,6
/proc/21221/task/21255/stat : 21255 (python) S 21040 21040 19061 0 -1 4202560 46 0 0 0 0 0 0 0 16 0 2 0 869428183 341065728 7951 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554946 18446604446753414208 0 0 -1 0 0 0 0
[pid=21270] ppid=21040 vsize=343328 CPUtime=0 cores=0,2,4,6
/proc/21270/stat : 21270 (python) S 21040 21040 19061 0 -1 4202560 825 0 0 0 0 0 0 0 18 0 1 0 869464611 351567872 7877 33554432000 4194304 5683644 140735649394432 18446744073709551615 254500712006 0 0 16781312 33554946 3834969095938244608 0 0 17 6 0 0 0
/proc/21270/statm: 85832 7877 319 364 0 20704 0
[pid=21273] ppid=21270 vsize=8534140 CPUtime=0.33 cores=0,2,4,6
/proc/21273/stat : 21273 (java) S 21270 21273 21273 0 -1 4202496 6896 0 1 0 32 1 0 0 20 0 18 0 869464611 8738959360 6301 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512494565 0 0 0 16800975 18446744073709551615 0 0 17 6 0 0 0
/proc/21273/statm: 2133535 6301 2181 9 0 2124276 0
[pid=21273/tid=21274] ppid=21270 vsize=8534276 CPUtime=0.22 cores=0,2,4,6
/proc/21273/task/21274/stat : 21274 (java) R 21270 21273 21273 0 -1 4202560 4303 0 1 0 22 0 0 0 23 0 18 0 869464612 8739098624 6395 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 47655408028468 0 4 0 16800975 0 0 0 -1 0 0 0 0
[pid=21273/tid=21275] ppid=21270 vsize=8534276 CPUtime=0 cores=0,2,4,6
/proc/21273/task/21275/stat : 21275 (java) S 21270 21273 21273 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 869464613 8739098624 6395 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512507801 0 4 0 16800975 18446604445047220352 0 0 -1 2 0 0 0
[pid=21273/tid=21276] ppid=21270 vsize=8534276 CPUtime=0 cores=0,2,4,6
/proc/21273/task/21276/stat : 21276 (java) S 21270 21273 21273 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 18 0 869464613 8739098624 6395 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512507801 0 4 0 16800975 18446604445047220352 0 0 -1 2 0 0 0
[pid=21273/tid=21277] ppid=21270 vsize=8534276 CPUtime=0 cores=0,2,4,6
/proc/21273/task/21277/stat : 21277 (java) S 21270 21273 21273 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 18 0 869464613 8739098624 6396 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512507801 0 4 0 16800975 18446604445047220352 0 0 -1 2 0 0 0
[pid=21273/tid=21278] ppid=21270 vsize=8534276 CPUtime=0 cores=0,2,4,6
/proc/21273/task/21278/stat : 21278 (java) S 21270 21273 21273 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 18 0 869464613 8739098624 6396 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512507801 0 4 0 16800975 18446604445047220352 0 0 -1 2 0 0 0
[pid=21273/tid=21279] ppid=21270 vsize=8534276 CPUtime=0 cores=0,2,4,6
/proc/21273/task/21279/stat : 21279 (java) S 21270 21273 21273 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 18 0 869464613 8739098624 6396 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512507801 0 4 0 16800975 18446604445047220352 0 0 -1 2 0 0 0
[pid=21273/tid=21281] ppid=21270 vsize=8534276 CPUtime=0 cores=0,2,4,6
/proc/21273/task/21281/stat : 21281 (java) S 21270 21273 21273 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869464613 8739098624 6396 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512507801 0 4 0 16800975 18446604445047220352 0 0 -1 2 0 0 0
[pid=21273/tid=21282] ppid=21270 vsize=8534276 CPUtime=0 cores=0,2,4,6
/proc/21273/task/21282/stat : 21282 (java) S 21270 21273 21273 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869464613 8739098624 6396 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512507801 0 4 0 16800975 18446604445047220352 0 0 -1 2 0 0 0
[pid=21273/tid=21283] ppid=21270 vsize=8534276 CPUtime=0 cores=0,2,4,6
/proc/21273/task/21283/stat : 21283 (java) S 21270 21273 21273 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869464613 8739098624 6396 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512507801 0 4 0 16800975 18446604445047220352 0 0 -1 2 0 0 0
[pid=21273/tid=21284] ppid=21270 vsize=8534276 CPUtime=0 cores=0,2,4,6
/proc/21273/task/21284/stat : 21284 (java) S 21270 21273 21273 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 18 0 869464614 8739098624 6397 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512508416 0 0 0 16800975 18446604445047220352 0 0 -1 2 0 0 0
[pid=21273/tid=21285] ppid=21270 vsize=8534276 CPUtime=0 cores=0,2,4,6
/proc/21273/task/21285/stat : 21285 (java) S 21270 21273 21273 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 18 0 869464614 8739098624 6397 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512507801 0 4 0 16800975 18446604445047220352 0 0 -1 2 0 0 0
[pid=21273/tid=21286] ppid=21270 vsize=8534276 CPUtime=0 cores=0,2,4,6
/proc/21273/task/21286/stat : 21286 (java) S 21270 21273 21273 0 -1 4202560 8 0 0 0 0 0 0 0 25 0 18 0 869464614 8739098624 6397 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512507801 0 4 0 16800975 18446604445047220352 0 0 -1 6 0 0 0
[pid=21273/tid=21287] ppid=21270 vsize=8534276 CPUtime=0 cores=0,2,4,6
/proc/21273/task/21287/stat : 21287 (java) S 21270 21273 21273 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 869464617 8739098624 6397 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512515505 0 4 0 16800975 18446604445047220352 0 0 -1 2 0 0 0
[pid=21273/tid=21288] ppid=21270 vsize=8534276 CPUtime=0.06 cores=0,2,4,6
/proc/21273/task/21288/stat : 21288 (java) R 21270 21273 21273 0 -1 4202560 686 0 0 0 6 0 0 0 17 0 18 0 869464617 8739098624 6397 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 47655404380624 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=21273/tid=21289] ppid=21270 vsize=8534276 CPUtime=0.03 cores=0,2,4,6
/proc/21273/task/21289/stat : 21289 (java) R 21270 21273 21273 0 -1 4202560 602 0 0 0 3 0 0 0 20 0 18 0 869464617 8739098624 6398 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 47655403283231 0 4 0 16800975 0 0 0 -1 2 0 0 0
[pid=21273/tid=21290] ppid=21270 vsize=8534276 CPUtime=0 cores=0,2,4,6
/proc/21273/task/21290/stat : 21290 (java) S 21270 21273 21273 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 869464617 8739098624 6398 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512507801 0 4 0 16800975 18446604445047220352 0 0 -1 6 0 0 0
[pid=21273/tid=21291] ppid=21270 vsize=8534276 CPUtime=0 cores=0,2,4,6
/proc/21273/task/21291/stat : 21291 (java) S 21270 21273 21273 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 869464617 8739098624 6398 33554432000 1073741824 1073778376 140736580329280 18446744073709551615 254512508416 0 4 0 16800975 18446604445047220352 0 0 -1 2 0 0 0
[pid=21040/tid=21048] ppid=21038 vsize=353572 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21048/stat : 21048 (python) S 21038 21040 19061 0 -1 4202560 40 1458 0 0 0 0 20 3 18 0 7 0 869394954 362057728 9444 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 2 0 0 0
[pid=21040/tid=21076] ppid=21038 vsize=353572 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21076/stat : 21076 (python) S 21038 21040 19061 0 -1 4202560 34 1458 0 0 0 0 20 3 18 0 7 0 869399632 362057728 9444 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 0 0 0 0
[pid=21040/tid=21081] ppid=21038 vsize=353572 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21081/stat : 21081 (python) S 21038 21040 19061 0 -1 4202560 31 1458 0 0 0 0 20 3 20 0 7 0 869404351 362057728 9444 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 2 0 0 0
[pid=21040/tid=21091] ppid=21038 vsize=353572 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21091/stat : 21091 (python) S 21038 21040 19061 0 -1 4202560 27 1458 0 0 0 0 20 3 20 0 7 0 869409203 362057728 9444 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 4 0 0 0
[pid=21040/tid=21222] ppid=21038 vsize=353572 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21222/stat : 21222 (python) S 21038 21040 19061 0 -1 4202560 31 1458 0 0 0 0 20 3 20 0 7 0 869418842 362057728 9444 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 6 0 0 0
[pid=21040/tid=21271] ppid=21038 vsize=353572 CPUtime=0.23 cores=0,2,4,6
/proc/21040/task/21271/stat : 21271 (python) S 21038 21040 19061 0 -1 4202560 28 1458 0 0 0 0 20 3 20 0 7 0 869464611 362057728 9444 33554432000 4194304 5683644 140735649394432 18446744073709551615 254512515505 0 0 16781312 33554434 18446604442743992576 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 704.82
Current children cumulated vsize (KiB) 20177528

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21040 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=406786
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=158975
# CPU time returned by wait4() is 1.56576
# while last known CPU time is 704.82
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 698.295
CPU time (s): 704.82
CPU user time (s): 700.3
CPU system time (s): 4.52
CPU usage (%): 100.934
Max. virtual memory (cumulated for all children) (KiB): 20177528

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.40679
system time used= 0.158975
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 21814
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14031
involuntary context switches= 32

runsolver used 6.13407 second user time and 12.6821 second system time

The end

Launcher Data 

Begin job on node149 at 2011-06-09 02:06:21
IDJOB=3481510
IDBENCH=48177
IDSOLVER=1970
FILE ID=node149/3481510-1307577981
RUNJOBID= node149-1307576353-19079
PBS_JOBID= 13547650
Free space on /tmp= 73276 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mis/normalized-mis_1000_25_4.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481510-1307577981/watcher-3481510-1307577981 -o /tmp/evaluation-result-3481510-1307577981/solver-3481510-1307577981 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481510-1307577981.opb -seed 1722682389 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d847cf1d914db0ec942abd195c5092c7
RANDOM SEED=1722682389

node149.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      17914220 kB
Buffers:        177908 kB
Cached:         960716 kB
SwapCached:      27136 kB
Active:       14419752 kB
Inactive:       251236 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      17914220 kB
SwapTotal:    67111528 kB
SwapFree:     26914392 kB
Dirty:          204364 kB
Writeback:         204 kB
AnonPages:    13529196 kB
Mapped:          96288 kB
Slab:           141048 kB
PageTables:     149624 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 192276728 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73136 MiB
End job on node149 at 2011-06-09 02:18:02