Trace number 3481517

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 1363.66 1354

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mis/normalized-mis_500_60_3.opb
MD5SUM2917e00f55986a046b103b08aa2aecc1
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-37
Best CPU time to get the best result obtained on this benchmark1800.04
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -36
Optimality of the best value was proved NO
Number of variables500
Total number of constraints500
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints500
Minimum length of a constraint60
Maximum length of a constraint110
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 500
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)37460
Sum of products size (including duplicates)74920
Number of different products18730
Sum of products size37460

Solver Data 

0.32/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.32/0.47	c INFO: solving HOME/instance-3481517-1307577995.opb
0.48/0.73	c INFO: wrote linearized instance to HOME/tmpeYn_DF.opb
1.04/1.02	c INFO: parsing took 0.27 s
1.52/1.57	c INFO: features took 0.56 CPU seconds
1.52/1.59	c INFO: running scip-2.0.1-spx@0 for 45 with 1798 remaining (b = 0.10)
48.46/48.26	c INFO: running scip-2.0.1-clp@0 for 45 with 1752 remaining (b = 0.02)
96.51/96.03	c INFO: running wbo1.4a@0 for 45 with 1705 remaining (b = 0.01)
144.63/144.00	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1658 remaining (b = 0.01)
195.27/191.60	c INFO: running scip-2.0.1-spx@45 for 45 with 1608 remaining (b = 0.01)
243.53/239.66	c INFO: running scip-2.0.1-spx@93 for 228 with 1560 remaining (b = 0.04)
481.05/476.13	c INFO: running scip-2.0.1-clp@47 for 45 with 1331 remaining (b = 0.01)
526.52/521.28	c INFO: running scip-2.0.1-clp@92 for 91 with 1286 remaining (b = 0.02)
620.88/615.15	c INFO: running clasp-1.3.7@0 for 91 with 1193 remaining (b = 0.02)
714.62/708.40	c INFO: running scip-2.0.1-clp@185 for 593 with 1099 remaining (b = 0.06)
1315.23/1305.92	c INFO: running bsolo_pb10-l3@0 for 45 with 508 remaining (b = 0.01)
1363.13/1353.62	c INFO: running sat4j-pb-v20101225@0 for 91 with 460 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481517-1307577995/watcher-3481517-1307577995 -o /tmp/evaluation-result-3481517-1307577995/solver-3481517-1307577995 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481517-1307577995.opb -seed 1793437729 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.08 2.08 1.69 2/794 20116
/proc/meminfo: memFree=12508564/32950928 swapFree=38525204/67111528
[pid=20116] ppid=20114 vsize=16244 CPUtime=0 cores=1,3,5,7
/proc/20116/stat : 20116 (python) R 20114 20116 17436 0 -1 4202496 1051 0 0 0 0 0 0 0 25 0 1 0 869399249 16633856 923 33554432000 4194304 5683644 140736149677584 18446744073709551615 208080232192 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20116/statm: 4061 923 381 364 0 548 0

[startup+0.0779131 s]
/proc/loadavg: 2.08 2.08 1.69 2/794 20116
/proc/meminfo: memFree=12508564/32950928 swapFree=38525204/67111528
[pid=20116] ppid=20114 vsize=85356 CPUtime=0.05 cores=1,3,5,7
/proc/20116/stat : 20116 (python) R 20114 20116 17436 0 -1 4202496 2581 0 0 0 4 1 0 0 17 0 1 0 869399249 87404544 2307 33554432000 4194304 5683644 140736149677584 18446744073709551615 208080232080 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20116/statm: 21339 2307 707 364 0 1556 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85356

[startup+0.100907 s]
/proc/loadavg: 2.08 2.08 1.69 2/794 20116
/proc/meminfo: memFree=12508564/32950928 swapFree=38525204/67111528
[pid=20116] ppid=20114 vsize=96124 CPUtime=0.08 cores=1,3,5,7
/proc/20116/stat : 20116 (python) R 20114 20116 17436 0 -1 4202496 3168 928 1 0 6 2 0 0 18 0 1 0 869399249 98430976 2483 33554432000 4194304 5683644 140736149677584 18446744073709551615 5177571 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20116/statm: 24031 2483 792 364 0 1626 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 96124

[startup+0.300873 s]
/proc/loadavg: 2.08 2.08 1.69 2/794 20116
/proc/meminfo: memFree=12508564/32950928 swapFree=38525204/67111528
[pid=20116] ppid=20114 vsize=202996 CPUtime=0.22 cores=1,3,5,7
/proc/20116/stat : 20116 (python) R 20114 20116 17436 0 -1 4202496 6663 928 1 0 17 5 0 0 17 0 1 0 869399249 207867904 4950 33554432000 4194304 5683644 140736149677584 18446744073709551615 4620076 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20116/statm: 50749 4950 1472 364 0 3711 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 202996

[startup+0.700793 s]
/proc/loadavg: 2.08 2.08 1.69 2/794 20116
/proc/meminfo: memFree=12508564/32950928 swapFree=38525204/67111528
[pid=20116] ppid=20114 vsize=285044 CPUtime=0.48 cores=1,3,5,7
/proc/20116/stat : 20116 (python) S 20114 20116 17436 0 -1 4202496 9852 928 1 0 34 14 0 0 17 0 1 0 869399249 291885056 7582 33554432000 4194304 5683644 140736149677584 18446744073709551615 208080252431 0 0 16781312 2 4294934790 0 0 17 3 0 0 0
/proc/20116/statm: 71261 7582 1777 364 0 6154 0
Current children cumulated CPU time (s) 0.48
Current children cumulated vsize (KiB) 285044

[startup+1.50064 s]
/proc/loadavg: 2.08 2.08 1.69 3/795 20122
/proc/meminfo: memFree=12470180/32950928 swapFree=38525204/67111528
[pid=20116] ppid=20114 vsize=292620 CPUtime=1.52 cores=1,3,5,7
/proc/20116/stat : 20116 (python) R 20114 20116 17436 0 -1 4202496 15272 1451 1 0 111 16 21 4 17 0 1 0 869399249 299642880 9504 33554432000 4194304 5683644 140736149677584 18446744073709551615 47377397145216 0 0 16781312 33554434 0 0 0 17 3 0 0 0
/proc/20116/statm: 73155 9504 1817 364 0 8048 0
Current children cumulated CPU time (s) 1.52
Current children cumulated vsize (KiB) 292620

[startup+3.10034 s]
/proc/loadavg: 2.08 2.08 1.69 3/798 20125
/proc/meminfo: memFree=12397612/32950928 swapFree=38525204/67111528
[pid=20116] ppid=20114 vsize=303480 CPUtime=1.62 cores=1,3,5,7
/proc/20116/stat : 20116 (python) S 20114 20116 17436 0 -1 4202496 16065 1451 1 0 121 16 21 4 20 0 2 0 869399249 310763520 9702 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/20116/statm: 75870 9702 1863 364 0 10757 0
[pid=20123] ppid=20116 vsize=293236 CPUtime=0 cores=1,3,5,7
/proc/20123/stat : 20123 (python) S 20116 20116 17436 0 -1 4202560 739 0 0 0 0 0 0 0 15 0 1 0 869399409 300273664 8153 33554432000 4194304 5683644 140736149677584 18446744073709551615 208080252431 0 0 16781312 33554946 1684223845478694912 0 0 17 3 0 0 0
/proc/20123/statm: 73309 8153 318 364 0 8196 0
[pid=20125] ppid=20123 vsize=113100 CPUtime=1.49 cores=1,3,5,7
/proc/20125/stat : 20125 (scip-2.0.1.linu) R 20123 20125 20125 0 -1 4202496 27010 0 0 0 133 16 0 0 25 0 1 0 869399409 115814400 25267 33554432000 4194304 13684479 140734119336416 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20125/statm: 28275 25267 993 2317 0 25953 0
[pid=20116/tid=20124] ppid=20114 vsize=303480 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20124/stat : 20124 (python) S 20114 20116 17436 0 -1 4202560 27 1451 0 0 0 0 21 4 20 0 2 0 869399409 310763520 9702 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 3.11
Current children cumulated vsize (KiB) 709816

[startup+6.30073 s]
/proc/loadavg: 2.16 2.09 1.70 3/798 20125
/proc/meminfo: memFree=12366900/32950928 swapFree=38525204/67111528
[pid=20116] ppid=20114 vsize=303480 CPUtime=1.62 cores=1,3,5,7
/proc/20116/stat : 20116 (python) S 20114 20116 17436 0 -1 4202496 16065 1451 1 0 121 16 21 4 20 0 2 0 869399249 310763520 9702 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/20116/statm: 75870 9702 1863 364 0 10757 0
[pid=20123] ppid=20116 vsize=293236 CPUtime=0.02 cores=1,3,5,7
/proc/20123/stat : 20123 (python) S 20116 20116 17436 0 -1 4202560 883 0 0 0 1 1 0 0 15 0 1 0 869399409 300273664 8177 33554432000 4194304 5683644 140736149677584 18446744073709551615 208080252431 0 0 16781312 33554946 724171480841060352 0 0 17 7 0 0 0
/proc/20123/statm: 73309 8177 342 364 0 8196 0
[pid=20125] ppid=20123 vsize=119936 CPUtime=4.68 cores=1,3,5,7
/proc/20125/stat : 20125 (scip-2.0.1.linu) R 20123 20125 20125 0 -1 4202496 29209 0 0 0 449 19 0 0 25 0 1 0 869399409 122814464 27259 33554432000 4194304 13684479 140734119336416 18446744073709551615 7390248 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20125/statm: 29984 27259 819 2317 0 27662 0
[pid=20116/tid=20124] ppid=20114 vsize=303480 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20124/stat : 20124 (python) S 20114 20116 17436 0 -1 4202560 27 1451 0 0 0 0 21 4 20 0 2 0 869399409 310763520 9702 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 6.32
Current children cumulated vsize (KiB) 716652

[startup+12.7006 s]
/proc/loadavg: 2.14 2.09 1.70 3/798 20125
/proc/meminfo: memFree=12352552/32950928 swapFree=38525204/67111528
[pid=20116] ppid=20114 vsize=303480 CPUtime=1.62 cores=1,3,5,7
/proc/20116/stat : 20116 (python) S 20114 20116 17436 0 -1 4202496 16065 1451 1 0 121 16 21 4 20 0 2 0 869399249 310763520 9702 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/20116/statm: 75870 9702 1863 364 0 10757 0
[pid=20123] ppid=20116 vsize=293236 CPUtime=0.04 cores=1,3,5,7
/proc/20123/stat : 20123 (python) S 20116 20116 17436 0 -1 4202560 893 0 0 0 2 2 0 0 15 0 1 0 869399409 300273664 8177 33554432000 4194304 5683644 140736149677584 18446744073709551615 208080252431 0 0 16781312 33554946 3484688274994233344 0 0 17 7 0 0 0
/proc/20123/statm: 73309 8177 342 364 0 8196 0
[pid=20125] ppid=20123 vsize=132768 CPUtime=11.09 cores=1,3,5,7
/proc/20125/stat : 20125 (scip-2.0.1.linu) R 20123 20125 20125 0 -1 4202496 32574 0 0 0 1079 30 0 0 18 0 1 0 869399409 135954432 30454 33554432000 4194304 13684479 140734119336416 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20125/statm: 33192 30454 839 2317 0 30870 0
[pid=20116/tid=20124] ppid=20114 vsize=303480 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20124/stat : 20124 (python) S 20114 20116 17436 0 -1 4202560 27 1451 0 0 0 0 21 4 20 0 2 0 869399409 310763520 9702 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.75
Current children cumulated vsize (KiB) 729484

[startup+25.5011 s]
/proc/loadavg: 2.11 2.08 1.70 3/798 20125
/proc/meminfo: memFree=12340040/32950928 swapFree=38525204/67111528
[pid=20116] ppid=20114 vsize=303480 CPUtime=1.62 cores=1,3,5,7
/proc/20116/stat : 20116 (python) S 20114 20116 17436 0 -1 4202496 16065 1451 1 0 121 16 21 4 20 0 2 0 869399249 310763520 9702 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/20116/statm: 75870 9702 1863 364 0 10757 0
[pid=20123] ppid=20116 vsize=293236 CPUtime=0.12 cores=1,3,5,7
/proc/20123/stat : 20123 (python) S 20116 20116 17436 0 -1 4202560 908 0 0 0 6 6 0 0 15 0 1 0 869399409 300273664 8177 33554432000 4194304 5683644 140736149677584 18446744073709551615 208080252431 0 0 16781312 33554946 2958742101937881088 0 0 17 5 0 0 0
/proc/20123/statm: 73309 8177 342 364 0 8196 0
[pid=20125] ppid=20123 vsize=146136 CPUtime=23.89 cores=1,3,5,7
/proc/20125/stat : 20125 (scip-2.0.1.linu) R 20123 20125 20125 0 -1 4202496 35936 0 0 0 2341 48 0 0 18 0 1 0 869399409 149643264 33701 33554432000 4194304 13684479 140734119336416 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/20125/statm: 36534 33701 792 2317 0 34212 0
[pid=20116/tid=20124] ppid=20114 vsize=303480 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20124/stat : 20124 (python) S 20114 20116 17436 0 -1 4202560 27 1451 0 0 0 0 21 4 20 0 2 0 869399409 310763520 9702 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.63
Current children cumulated vsize (KiB) 742852

[startup+51.1012 s]
/proc/loadavg: 2.07 2.08 1.71 3/802 20130
/proc/meminfo: memFree=12236288/32950928 swapFree=38525204/67111528
[pid=20116] ppid=20114 vsize=313736 CPUtime=1.65 cores=1,3,5,7
/proc/20116/stat : 20116 (python) S 20114 20116 17436 0 -1 4202496 16991 1451 1 0 124 16 21 4 19 0 3 0 869399249 321265664 9717 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/20116/statm: 78434 9717 1874 364 0 13318 0
[pid=20123] ppid=20116 vsize=303480 CPUtime=0.26 cores=1,3,5,7
/proc/20123/stat : 20123 (python) S 20116 20116 17436 0 -1 4202560 1127 0 0 0 14 12 0 0 16 0 2 0 869399409 310763520 8245 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/20123/statm: 75870 8245 405 364 0 10757 0
[pid=20125] ppid=20123 vsize=146136 CPUtime=46.63 cores=1,3,5,7
/proc/20125/stat : 20125 (scip-2.0.1.linu) T 20123 20125 20125 0 -1 4202496 35950 0 0 0 4593 70 0 0 18 0 1 0 869399409 149643264 33701 33554432000 4194304 13684479 140734119336416 18446744073709551615 4963328 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/20125/statm: 36534 33701 778 2317 0 34212 0
[pid=20123/tid=20127] ppid=20116 vsize=303480 CPUtime=0 cores=1,3,5,7
/proc/20123/task/20127/stat : 20127 (python) S 20116 20116 17436 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869404074 310763520 8245 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554946 18446604466026027840 0 0 -1 7 0 0 0
[pid=20128] ppid=20116 vsize=303492 CPUtime=0 cores=1,3,5,7
/proc/20128/stat : 20128 (python) S 20116 20116 17436 0 -1 4202560 758 0 0 0 0 0 0 0 15 0 1 0 869404076 310775808 8158 33554432000 4194304 5683644 140736149677584 18446744073709551615 208080252486 0 0 16781312 33554946 1387257797904695296 0 0 17 3 0 0 0
/proc/20128/statm: 75873 8158 319 364 0 10757 0
[pid=20130] ppid=20128 vsize=118692 CPUtime=2.81 cores=1,3,5,7
/proc/20130/stat : 20130 (scip-2.0.1.linu) R 20128 20130 20130 0 -1 4202496 27339 0 0 0 263 18 0 0 25 0 1 0 869404076 121540608 25798 33554432000 4194304 15243407 140735231674384 18446744073709551615 13277498 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/20130/statm: 29673 25798 851 2698 0 26968 0
[pid=20116/tid=20124] ppid=20114 vsize=313736 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20124/stat : 20124 (python) S 20114 20116 17436 0 -1 4202560 27 1451 0 0 0 0 21 4 20 0 3 0 869399409 321265664 9717 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 7 0 0 0
[pid=20116/tid=20129] ppid=20114 vsize=313736 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20129/stat : 20129 (python) S 20114 20116 17436 0 -1 4202560 28 1451 0 0 0 0 21 4 20 0 3 0 869404076 321265664 9717 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 51.35
Current children cumulated vsize (KiB) 1185536

[startup+102.301 s]
/proc/loadavg: 2.07 2.08 1.73 3/810 20139
/proc/meminfo: memFree=11741296/32950928 swapFree=38525204/67111528
[pid=20116] ppid=20114 vsize=323992 CPUtime=1.67 cores=1,3,5,7
/proc/20116/stat : 20116 (python) S 20114 20116 17436 0 -1 4202496 17876 1451 1 0 126 16 21 4 20 0 4 0 869399249 331767808 9723 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/20116/statm: 80998 9723 1876 364 0 15879 0
[pid=20123] ppid=20116 vsize=303480 CPUtime=0.26 cores=1,3,5,7
/proc/20123/stat : 20123 (python) S 20116 20116 17436 0 -1 4202560 1127 0 0 0 14 12 0 0 16 0 2 0 869399409 310763520 8245 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/20123/statm: 75870 8245 405 364 0 10757 0
[pid=20125] ppid=20123 vsize=146136 CPUtime=46.63 cores=1,3,5,7
/proc/20125/stat : 20125 (scip-2.0.1.linu) T 20123 20125 20125 0 -1 4202496 35950 0 0 0 4593 70 0 0 18 0 1 0 869399409 149643264 33701 33554432000 4194304 13684479 140734119336416 18446744073709551615 4963328 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/20125/statm: 36534 33701 778 2317 0 34212 0
[pid=20123/tid=20127] ppid=20116 vsize=303480 CPUtime=0 cores=1,3,5,7
/proc/20123/task/20127/stat : 20127 (python) S 20116 20116 17436 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869404074 310763520 8245 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554946 18446604466026027840 0 0 -1 7 0 0 0
[pid=20128] ppid=20116 vsize=303492 CPUtime=0.25 cores=1,3,5,7
/proc/20128/stat : 20128 (python) S 20116 20116 17436 0 -1 4202560 1183 0 0 0 13 12 0 0 16 0 2 0 869404076 310775808 8236 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/20128/statm: 75873 8236 396 364 0 10757 0
[pid=20130] ppid=20128 vsize=143804 CPUtime=47.72 cores=1,3,5,7
/proc/20130/stat : 20130 (scip-2.0.1.linu) T 20128 20130 20130 0 -1 4202496 33952 0 0 0 4735 37 0 0 25 0 1 0 869404076 147255296 32411 33554432000 4194304 15243407 140735231674384 18446744073709551615 4412880 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/20130/statm: 35951 32411 865 2698 0 33246 0
[pid=20128/tid=20136] ppid=20116 vsize=303492 CPUtime=0 cores=1,3,5,7
/proc/20128/task/20136/stat : 20136 (python) S 20116 20116 17436 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 869408850 310775808 8236 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554946 18446604469749727616 0 0 -1 7 0 0 0
[pid=20137] ppid=20116 vsize=313748 CPUtime=0.01 cores=1,3,5,7
/proc/20137/stat : 20137 (python) S 20116 20116 17436 0 -1 4202560 1016 0 0 0 0 1 0 0 18 0 1 0 869408853 321277952 8191 33554432000 4194304 5683644 140736149677584 18446744073709551615 208080252486 0 0 16781312 33554946 4488740109973160199 0 0 17 3 0 0 0
/proc/20137/statm: 78437 8191 348 364 0 13318 0
[pid=20139] ppid=20137 vsize=131620 CPUtime=6.26 cores=1,3,5,7
/proc/20139/stat : 20139 (wbo1.4a) R 20137 20139 20139 0 -1 4202496 33660 0 0 0 621 5 0 0 25 0 1 0 869408853 134778880 32367 33554432000 134512640 135751879 4288732208 18446744073709551615 135200702 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/20139/statm: 32905 32367 143 303 0 32600 0
[pid=20116/tid=20124] ppid=20114 vsize=323992 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20124/stat : 20124 (python) S 20114 20116 17436 0 -1 4202560 27 1451 0 0 0 0 21 4 20 0 4 0 869399409 331767808 9723 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 7 0 0 0
[pid=20116/tid=20129] ppid=20114 vsize=323992 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20129/stat : 20129 (python) S 20114 20116 17436 0 -1 4202560 28 1451 0 0 0 0 21 4 20 0 4 0 869404076 331767808 9723 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 3 0 0 0

################
# More data... #
################

[pid=20116/tid=20902] ppid=20114 vsize=365016 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20902/stat : 20902 (python) S 20114 20116 17436 0 -1 4202560 25 1451 0 0 0 0 21 4 20 0 8 0 869534612 373776384 9747 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1363.66
Current children cumulated vsize (KiB) 20508460

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1353.9 s]
/proc/loadavg: 1.06 1.64 1.81 5/929 20920
/proc/meminfo: memFree=805596/32950928 swapFree=38525204/67111528
[pid=20116] ppid=20114 vsize=365016 CPUtime=1.84 cores=1,3,5,7
/proc/20116/stat : 20116 (python) S 20114 20116 17436 0 -1 4202496 21643 1451 1 0 142 17 21 4 20 0 8 0 869399249 373776384 9747 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/20116/statm: 91254 9747 1884 364 0 26123 0
[pid=20123] ppid=20116 vsize=303480 CPUtime=1.65 cores=1,3,5,7
/proc/20123/stat : 20123 (python) S 20116 20116 17436 0 -1 4202560 1207 0 0 0 81 84 0 0 15 0 2 0 869399409 310763520 8246 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/20123/statm: 75870 8246 406 364 0 10757 0
[pid=20125] ppid=20123 vsize=150836 CPUtime=331.13 cores=1,3,5,7
/proc/20125/stat : 20125 (scip-2.0.1.linu) T 20123 20125 20125 0 -1 4202496 42177 0 0 0 32278 835 0 0 25 0 1 0 869399409 154456064 34958 33554432000 4194304 13684479 140734119336416 18446744073709551615 5565221 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/20125/statm: 37709 34958 821 2317 0 35387 0
[pid=20123/tid=20127] ppid=20116 vsize=303480 CPUtime=0 cores=1,3,5,7
/proc/20123/task/20127/stat : 20127 (python) S 20116 20116 17436 0 -1 4202560 48 0 0 0 0 0 0 0 15 0 2 0 869404074 310763520 8246 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554946 18446604466026027840 0 0 -1 3 0 0 0
[pid=20128] ppid=20116 vsize=303492 CPUtime=4.11 cores=1,3,5,7
/proc/20128/stat : 20128 (python) S 20116 20116 17436 0 -1 4202560 1314 0 0 0 198 213 0 0 15 0 2 0 869404076 310775808 8246 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/20128/statm: 75873 8246 406 364 0 10757 0
[pid=20130] ppid=20128 vsize=200972 CPUtime=784.19 cores=1,3,5,7
/proc/20130/stat : 20130 (scip-2.0.1.linu) T 20128 20130 20130 0 -1 4202496 168216 0 0 0 77722 697 0 0 25 0 1 0 869404076 205795328 46935 33554432000 4194304 15243407 140735231674384 18446744073709551615 6975488 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/20130/statm: 50243 46935 946 2698 0 47538 0
[pid=20128/tid=20136] ppid=20116 vsize=303492 CPUtime=0 cores=1,3,5,7
/proc/20128/task/20136/stat : 20136 (python) S 20116 20116 17436 0 -1 4202560 52 0 0 0 0 0 0 0 15 0 2 0 869408850 310775808 8246 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554946 18446604469749727616 0 0 -1 1 0 0 0
[pid=20137] ppid=20116 vsize=313748 CPUtime=0.26 cores=1,3,5,7
/proc/20137/stat : 20137 (python) S 20116 20116 17436 0 -1 4202560 1223 0 0 0 12 14 0 0 17 0 2 0 869408853 321277952 8240 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/20137/statm: 78437 8240 396 364 0 13318 0
[pid=20139] ppid=20137 vsize=326840 CPUtime=47.93 cores=1,3,5,7
/proc/20139/stat : 20139 (wbo1.4a) T 20137 20139 20139 0 -1 4202496 87918 0 0 0 4728 65 0 0 25 0 1 0 869408853 334684160 81175 33554432000 134512640 135751879 4288732208 18446744073709551615 134616532 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/20139/statm: 81710 81175 146 303 0 81405 0
[pid=20137/tid=20142] ppid=20116 vsize=313748 CPUtime=0 cores=1,3,5,7
/proc/20137/task/20142/stat : 20142 (python) S 20116 20116 17436 0 -1 4202560 47 0 0 0 0 0 0 0 17 0 2 0 869413647 321277952 8240 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554946 18446604466026025152 0 0 -1 7 0 0 0
[pid=20143] ppid=20116 vsize=324004 CPUtime=0.22 cores=1,3,5,7
/proc/20143/stat : 20143 (python) S 20116 20116 17436 0 -1 4202560 1148 0 0 0 9 13 0 0 17 0 2 0 869413649 331780096 8238 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/20143/statm: 81001 8238 390 364 0 15879 0
[pid=20145] ppid=20143 vsize=8543220 CPUtime=50.27 cores=1,3,5,7
/proc/20145/stat : 20145 (java) T 20143 20145 20145 0 -1 4202496 572611 0 1 0 4965 62 0 0 18 0 19 0 869413650 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092035045 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/20145/statm: 2135805 567577 2249 9 0 2126546 0
[pid=20145/tid=20146] ppid=20143 vsize=8543220 CPUtime=47.17 cores=1,3,5,7
/proc/20145/task/20146/stat : 20146 (java) T 20143 20145 20145 0 -1 4202560 473067 0 1 0 4669 48 0 0 25 0 19 0 869413651 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 46912506049232 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=20145/tid=20147] ppid=20143 vsize=8543220 CPUtime=0.16 cores=1,3,5,7
/proc/20145/task/20147/stat : 20147 (java) T 20143 20145 20145 0 -1 4202560 12214 0 0 0 15 1 0 0 15 0 19 0 869413651 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=20145/tid=20148] ppid=20143 vsize=8543220 CPUtime=0.17 cores=1,3,5,7
/proc/20145/task/20148/stat : 20148 (java) T 20143 20145 20145 0 -1 4202560 11298 0 0 0 16 1 0 0 15 0 19 0 869413651 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=20145/tid=20149] ppid=20143 vsize=8543220 CPUtime=0.07 cores=1,3,5,7
/proc/20145/task/20149/stat : 20149 (java) T 20143 20145 20145 0 -1 4202560 5816 0 0 0 7 0 0 0 15 0 19 0 869413651 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=20145/tid=20150] ppid=20143 vsize=8543220 CPUtime=0.02 cores=1,3,5,7
/proc/20145/task/20150/stat : 20150 (java) T 20143 20145 20145 0 -1 4202560 2117 0 0 0 2 0 0 0 15 0 19 0 869413651 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=20145/tid=20151] ppid=20143 vsize=8543220 CPUtime=0.18 cores=1,3,5,7
/proc/20145/task/20151/stat : 20151 (java) T 20143 20145 20145 0 -1 4202560 13835 0 0 0 17 1 0 0 15 0 19 0 869413651 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=20145/tid=20152] ppid=20143 vsize=8543220 CPUtime=0.21 cores=1,3,5,7
/proc/20145/task/20152/stat : 20152 (java) T 20143 20145 20145 0 -1 4202560 14256 0 0 0 20 1 0 0 15 0 19 0 869413651 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=20145/tid=20153] ppid=20143 vsize=8543220 CPUtime=0.18 cores=1,3,5,7
/proc/20145/task/20153/stat : 20153 (java) T 20143 20145 20145 0 -1 4202560 14187 0 0 0 17 1 0 0 15 0 19 0 869413651 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=20145/tid=20154] ppid=20143 vsize=8543220 CPUtime=0.17 cores=1,3,5,7
/proc/20145/task/20154/stat : 20154 (java) T 20143 20145 20145 0 -1 4202560 13016 0 0 0 15 2 0 0 15 0 19 0 869413651 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=20145/tid=20155] ppid=20143 vsize=8543220 CPUtime=0 cores=1,3,5,7
/proc/20145/task/20155/stat : 20155 (java) T 20143 20145 20145 0 -1 4202560 1270 0 0 0 0 0 0 0 15 0 19 0 869413652 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048896 0 0 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=20145/tid=20156] ppid=20143 vsize=8543220 CPUtime=0 cores=1,3,5,7
/proc/20145/task/20156/stat : 20156 (java) T 20143 20145 20145 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869413653 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=20145/tid=20157] ppid=20143 vsize=8543220 CPUtime=0 cores=1,3,5,7
/proc/20145/task/20157/stat : 20157 (java) T 20143 20145 20145 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869413653 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=20145/tid=20158] ppid=20143 vsize=8543220 CPUtime=0 cores=1,3,5,7
/proc/20145/task/20158/stat : 20158 (java) T 20143 20145 20145 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869413655 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092055985 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=20145/tid=20159] ppid=20143 vsize=8543220 CPUtime=0.92 cores=1,3,5,7
/proc/20145/task/20159/stat : 20159 (java) T 20143 20145 20145 0 -1 4202560 6731 0 0 0 92 0 0 0 15 0 19 0 869413655 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=20145/tid=20160] ppid=20143 vsize=8543220 CPUtime=0.88 cores=1,3,5,7
/proc/20145/task/20160/stat : 20160 (java) T 20143 20145 20145 0 -1 4202560 3408 0 0 0 88 0 0 0 15 0 19 0 869413655 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=20145/tid=20161] ppid=20143 vsize=8543220 CPUtime=0 cores=1,3,5,7
/proc/20145/task/20161/stat : 20161 (java) T 20143 20145 20145 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869413655 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048281 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=20145/tid=20162] ppid=20143 vsize=8543220 CPUtime=0 cores=1,3,5,7
/proc/20145/task/20162/stat : 20162 (java) T 20143 20145 20145 0 -1 4202560 3 0 0 0 0 0 0 0 15 0 19 0 869413655 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048896 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=20145/tid=20163] ppid=20143 vsize=8543220 CPUtime=0 cores=1,3,5,7
/proc/20145/task/20163/stat : 20163 (java) T 20143 20145 20145 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869413724 8748257280 567577 33554432000 1073741824 1073778376 140734252900704 18446744073709551615 208092048896 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=20143/tid=20260] ppid=20116 vsize=324004 CPUtime=0 cores=1,3,5,7
/proc/20143/task/20260/stat : 20260 (python) S 20116 20116 17436 0 -1 4202560 53 0 0 0 0 0 0 0 17 0 2 0 869418407 331780096 8238 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554946 18446604459560578112 0 0 -1 7 0 0 0
[pid=20392] ppid=20116 vsize=334260 CPUtime=0.43 cores=1,3,5,7
/proc/20392/stat : 20392 (python) S 20116 20116 17436 0 -1 4202560 1186 0 0 0 20 23 0 0 17 0 2 0 869460765 342282240 8242 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/20392/statm: 83565 8242 390 364 0 18440 0
[pid=20394] ppid=20392 vsize=17392 CPUtime=93.22 cores=1,3,5,7
/proc/20394/stat : 20394 (clasp-1.3.7-x86) T 20392 20394 20394 0 -1 4202496 4725 0 0 0 9322 0 0 0 25 0 1 0 869460765 17809408 4084 33554432000 134512640 136139019 4290051504 18446744073709551615 134634749 0 0 16781312 16386 18446744071562691360 0 0 17 5 0 0 0
/proc/20394/statm: 4348 4084 187 398 0 3948 0
[pid=20392/tid=20451] ppid=20116 vsize=334260 CPUtime=0 cores=1,3,5,7
/proc/20392/task/20451/stat : 20451 (python) S 20116 20116 17436 0 -1 4202560 53 0 0 0 0 0 0 0 17 0 2 0 869470088 342282240 8242 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554946 18446604467882837184 0 0 -1 7 0 0 0
[pid=20895] ppid=20116 vsize=344516 CPUtime=0.23 cores=1,3,5,7
/proc/20895/stat : 20895 (python) S 20116 20116 17436 0 -1 4202560 1162 0 0 0 11 12 0 0 17 0 2 0 869529842 352784384 8246 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092059083 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/20895/statm: 86129 8246 390 364 0 21001 0
[pid=20897] ppid=20895 vsize=90368 CPUtime=47.67 cores=1,3,5,7
/proc/20897/stat : 20897 (bsolo_pb10) T 20895 20897 20897 0 -1 4202496 20784 0 0 0 4761 6 0 0 25 0 1 0 869529843 92536832 20083 33554432000 134512640 137138936 4293720992 18446744073709551615 136511176 0 0 16781312 16384 18446744071562691360 0 0 17 3 0 0 0
/proc/20897/statm: 22592 20083 192 642 0 21948 0
[pid=20895/tid=20900] ppid=20116 vsize=344516 CPUtime=0 cores=1,3,5,7
/proc/20895/task/20900/stat : 20900 (python) S 20116 20116 17436 0 -1 4202560 52 0 0 0 0 0 0 0 17 0 2 0 869534611 352784384 8246 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554946 18446604456555603776 0 0 -1 1 0 0 0
[pid=20901] ppid=20116 vsize=354772 CPUtime=0 cores=1,3,5,7
/proc/20901/stat : 20901 (python) S 20116 20116 17436 0 -1 4202560 824 0 0 0 0 0 0 0 19 0 1 0 869534612 363286528 8178 33554432000 4194304 5683644 140736149677584 18446744073709551615 208080252486 0 0 16781312 33554946 380183048978694144 0 0 17 5 0 0 0
/proc/20901/statm: 88693 8178 319 364 0 23562 0
[pid=20903] ppid=20901 vsize=8535544 CPUtime=0.51 cores=1,3,5,7
/proc/20903/stat : 20903 (java) S 20901 20903 20903 0 -1 4202496 8796 0 1 0 50 1 0 0 17 0 18 0 869534612 8740397056 7943 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092035045 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/20903/statm: 2133886 7946 2212 9 0 2124627 0
[pid=20903/tid=20904] ppid=20901 vsize=8536324 CPUtime=0.29 cores=1,3,5,7
/proc/20903/task/20904/stat : 20904 (java) R 20901 20903 20903 0 -1 4202560 5337 0 1 0 28 1 0 0 25 0 18 0 869534613 8741195776 8285 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 46912505606943 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=20903/tid=20905] ppid=20901 vsize=8536324 CPUtime=0 cores=1,3,5,7
/proc/20903/task/20905/stat : 20905 (java) S 20901 20903 20903 0 -1 4202560 1 0 0 0 0 0 0 0 19 0 18 0 869534614 8741195776 8285 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092048281 0 4 0 16800975 18446604454370409152 0 0 -1 5 0 0 0
[pid=20903/tid=20906] ppid=20901 vsize=8536324 CPUtime=0 cores=1,3,5,7
/proc/20903/task/20906/stat : 20906 (java) S 20901 20903 20903 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 869534614 8741195776 8286 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092048281 0 4 0 16800975 18446604454370409152 0 0 -1 3 0 0 0
[pid=20903/tid=20907] ppid=20901 vsize=8536864 CPUtime=0 cores=1,3,5,7
/proc/20903/task/20907/stat : 20907 (java) S 20901 20903 20903 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 869534614 8741748736 8315 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092048281 0 4 0 16800975 18446604454370409152 0 0 -1 3 0 0 0
[pid=20903/tid=20908] ppid=20901 vsize=8536864 CPUtime=0 cores=1,3,5,7
/proc/20903/task/20908/stat : 20908 (java) S 20901 20903 20903 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 869534614 8741748736 8343 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092048281 0 4 0 16800975 18446604454370409152 0 0 -1 3 0 0 0
[pid=20903/tid=20909] ppid=20901 vsize=8536864 CPUtime=0 cores=1,3,5,7
/proc/20903/task/20909/stat : 20909 (java) S 20901 20903 20903 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 869534614 8741748736 8362 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092048281 0 4 0 16800975 18446604454370409152 0 0 -1 3 0 0 0
[pid=20903/tid=20910] ppid=20901 vsize=8536864 CPUtime=0 cores=1,3,5,7
/proc/20903/task/20910/stat : 20910 (java) S 20901 20903 20903 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 18 0 869534614 8741748736 8383 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092048281 0 4 0 16800975 18446604454370409152 0 0 -1 3 0 0 0
[pid=20903/tid=20911] ppid=20901 vsize=8536864 CPUtime=0 cores=1,3,5,7
/proc/20903/task/20911/stat : 20911 (java) S 20901 20903 20903 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 869534614 8741748736 8404 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092048281 0 4 0 16800975 18446604454370409152 0 0 -1 3 0 0 0
[pid=20903/tid=20912] ppid=20901 vsize=8536864 CPUtime=0 cores=1,3,5,7
/proc/20903/task/20912/stat : 20912 (java) S 20901 20903 20903 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 869534614 8741748736 8425 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092048281 0 4 0 16800975 18446604454370409152 0 0 -1 3 0 0 0
[pid=20903/tid=20913] ppid=20901 vsize=8536864 CPUtime=0 cores=1,3,5,7
/proc/20903/task/20913/stat : 20913 (java) S 20901 20903 20903 0 -1 4202560 2 0 0 0 0 0 0 0 23 0 18 0 869534615 8741748736 8425 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092048896 0 0 0 16800975 18446604454370409152 0 0 -1 1 0 0 0
[pid=20903/tid=20914] ppid=20901 vsize=8536864 CPUtime=0 cores=1,3,5,7
/proc/20903/task/20914/stat : 20914 (java) S 20901 20903 20903 0 -1 4202560 16 0 0 0 0 0 0 0 23 0 18 0 869534615 8741748736 8425 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092048281 0 4 0 16800975 18446604454370409152 0 0 -1 5 0 0 0
[pid=20903/tid=20915] ppid=20901 vsize=8536864 CPUtime=0 cores=1,3,5,7
/proc/20903/task/20915/stat : 20915 (java) S 20901 20903 20903 0 -1 4202560 8 0 0 0 0 0 0 0 24 0 18 0 869534615 8741748736 8426 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092048281 0 4 0 16800975 18446604454370409152 0 0 -1 3 0 0 0
[pid=20903/tid=20916] ppid=20901 vsize=8536864 CPUtime=0 cores=1,3,5,7
/proc/20903/task/20916/stat : 20916 (java) S 20901 20903 20903 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869534617 8741748736 8426 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092055985 0 4 0 16800975 18446604454370409152 0 0 -1 5 0 0 0
[pid=20903/tid=20917] ppid=20901 vsize=8536864 CPUtime=0.09 cores=1,3,5,7
/proc/20903/task/20917/stat : 20917 (java) R 20901 20903 20903 0 -1 4202560 1387 0 0 0 9 0 0 0 25 0 18 0 869534617 8741748736 8426 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208079924944 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=20903/tid=20918] ppid=20901 vsize=8536864 CPUtime=0.13 cores=1,3,5,7
/proc/20903/task/20918/stat : 20918 (java) R 20901 20903 20903 0 -1 4202560 1291 0 0 0 13 0 0 0 17 0 18 0 869534617 8741748736 8427 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208079893537 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=20903/tid=20919] ppid=20901 vsize=8536864 CPUtime=0 cores=1,3,5,7
/proc/20903/task/20919/stat : 20919 (java) S 20901 20903 20903 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869534617 8741748736 8427 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092048281 0 4 0 16800975 18446604454370409152 0 0 -1 5 0 0 0
[pid=20903/tid=20920] ppid=20901 vsize=8536864 CPUtime=0 cores=1,3,5,7
/proc/20903/task/20920/stat : 20920 (java) S 20901 20903 20903 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 18 0 869534617 8741748736 8429 33554432000 1073741824 1073778376 140735193578384 18446744073709551615 208092048896 0 4 0 16800975 18446604454370409152 0 0 -1 5 0 0 0
[pid=20116/tid=20124] ppid=20114 vsize=365016 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20124/stat : 20124 (python) S 20114 20116 17436 0 -1 4202560 33 1451 0 0 0 0 21 4 18 0 8 0 869399409 373776384 9747 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 7 0 0 0
[pid=20116/tid=20129] ppid=20114 vsize=365016 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20129/stat : 20129 (python) S 20114 20116 17436 0 -1 4202560 38 1451 0 0 0 0 21 4 18 0 8 0 869404076 373776384 9747 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 3 0 0 0
[pid=20116/tid=20138] ppid=20114 vsize=365016 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20138/stat : 20138 (python) S 20114 20116 17436 0 -1 4202560 32 1451 0 0 0 0 21 4 20 0 8 0 869408853 373776384 9747 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 5 0 0 0
[pid=20116/tid=20144] ppid=20114 vsize=365016 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20144/stat : 20144 (python) S 20114 20116 17436 0 -1 4202560 30 1451 0 0 0 0 21 4 20 0 8 0 869413650 373776384 9747 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 3 0 0 0
[pid=20116/tid=20393] ppid=20114 vsize=365016 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20393/stat : 20393 (python) S 20114 20116 17436 0 -1 4202560 30 1451 0 0 0 0 21 4 20 0 8 0 869460765 373776384 9747 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 7 0 0 0
[pid=20116/tid=20896] ppid=20114 vsize=365016 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20896/stat : 20896 (python) S 20114 20116 17436 0 -1 4202560 31 1451 0 0 0 0 21 4 20 0 8 0 869529842 373776384 9747 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 1 0 0 0
[pid=20116/tid=20902] ppid=20114 vsize=365016 CPUtime=0.25 cores=1,3,5,7
/proc/20116/task/20902/stat : 20902 (python) S 20114 20116 17436 0 -1 4202560 25 1451 0 0 0 0 21 4 20 0 8 0 869534612 373776384 9747 33554432000 4194304 5683644 140736149677584 18446744073709551615 208092055985 0 0 16781312 33554434 18446604468552377408 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1363.66
Current children cumulated vsize (KiB) 20508460

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20116 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=638750
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=222966
# CPU time returned by wait4() is 1.86172
# while last known CPU time is 1363.66
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1354
CPU time (s): 1363.66
CPU user time (s): 1343.2
CPU system time (s): 20.46
CPU usage (%): 100.714
Max. virtual memory (cumulated for all children) (KiB): 20508460

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.63875
system time used= 0.222966
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 23098
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15162
involuntary context switches= 43

runsolver used 10.7774 second user time and 25.0092 second system time

The end

Launcher Data 

Begin job on node127 at 2011-06-09 02:06:35
IDJOB=3481517
IDBENCH=48184
IDSOLVER=1970
FILE ID=node127/3481517-1307577995
RUNJOBID= node127-1307576357-17455
PBS_JOBID= 13547672
Free space on /tmp= 73596 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mis/normalized-mis_500_60_3.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481517-1307577995/watcher-3481517-1307577995 -o /tmp/evaluation-result-3481517-1307577995/solver-3481517-1307577995 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481517-1307577995.opb -seed 1793437729 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2917e00f55986a046b103b08aa2aecc1
RANDOM SEED=1793437729

node127.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.64
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.60
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.823
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12508844 kB
Buffers:        182960 kB
Cached:         796384 kB
SwapCached:       9392 kB
Active:       19945784 kB
Inactive:       147708 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12508844 kB
SwapTotal:    67111528 kB
SwapFree:     38525204 kB
Dirty:          103508 kB
Writeback:          36 kB
AnonPages:    19111896 kB
Mapped:         101228 kB
Slab:           139464 kB
PageTables:     134512 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 142037232 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73404 MiB
End job on node127 at 2011-06-09 02:29:12