Trace number 3481698

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
borg pb-opt-11.04.03? (MO) 195.03 192.78

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB05/
manquinho/primes-dimacs-cnf/normalized-par32-4.opb
MD5SUM172d8bfe30610a29dfe3bb9d98ed3f4c
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables6352
Total number of constraints13489
Number of constraints which are clauses13489
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint3
Number of terms in the objective function 6352
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 6352
Number of bits of the sum of numbers in the objective function 13
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 6352
Number of bits of the biggest sum of numbers13
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.37/0.55	c INFO: loaded portfolio from HOME/etc/borg-mix+class.opt.pickle
0.37/0.55	c INFO: solving HOME/instance-3481698-1307576700.opb
0.48/0.63	c INFO: parsing took 0.07 s
0.57/0.77	c INFO: features took 0.14 CPU seconds
0.57/0.79	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.32)
51.97/52.00	c INFO: running sat4j-pb-v20101225@0 for 45 with 1749 remaining (b = 0.13)
98.51/97.23	c INFO: running scip-2.0.1-clp@0 for 45 with 1703 remaining (b = 0.03)
145.81/144.39	c INFO: running wbo1.4a@0 for 45 with 1656 remaining (b = 0.01)
193.83/192.17	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1609 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3481698-1307576700/watcher-3481698-1307576700 -o /tmp/evaluation-result-3481698-1307576700/solver-3481698-1307576700 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481698-1307576700.opb -seed 852816353 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 1.40 0.62 2/495 2632
/proc/meminfo: memFree=29993268/32950928 swapFree=34366004/67111528
[pid=2632] ppid=2630 vsize=15184 CPUtime=0 cores=1,3,5,7
/proc/2632/stat : 2632 (python) R 2630 2632 2236 0 -1 4202496 712 0 0 0 0 0 0 0 22 0 1 0 869268796 15548416 603 33554432000 4194304 5683644 140735101712176 18446744073709551615 235594864640 0 2147483391 16781312 2 0 0 0 17 5 0 0 0
/proc/2632/statm: 3796 603 319 364 0 283 0

[startup+0.084045 s]
/proc/loadavg: 2.02 1.40 0.62 2/495 2632
/proc/meminfo: memFree=29993268/32950928 swapFree=34366004/67111528
[pid=2632] ppid=2630 vsize=54504 CPUtime=0.06 cores=1,3,5,7
/proc/2632/stat : 2632 (python) S 2630 2632 2236 0 -1 4202496 2058 0 0 0 4 2 0 0 17 0 1 0 869268796 55812096 1815 33554432000 4194304 5683644 140735101712176 18446744073709551615 235594864640 0 2147483391 16781312 2 18446744071699215550 0 0 17 5 0 0 0
/proc/2632/statm: 13626 1815 492 364 0 1276 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 54504

[startup+0.101039 s]
/proc/loadavg: 2.02 1.40 0.62 2/495 2632
/proc/meminfo: memFree=29993268/32950928 swapFree=34366004/67111528
[pid=2632] ppid=2630 vsize=87828 CPUtime=0.07 cores=1,3,5,7
/proc/2632/stat : 2632 (python) R 2630 2632 2236 0 -1 4202496 2693 0 0 0 4 3 0 0 17 0 1 0 869268796 89935872 2407 33554432000 4194304 5683644 140735101712176 18446744073709551615 4651233 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/2632/statm: 21957 2407 735 364 0 1622 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 87828

[startup+0.301065 s]
/proc/loadavg: 2.02 1.40 0.62 2/495 2632
/proc/meminfo: memFree=29993268/32950928 swapFree=34366004/67111528
[pid=2632] ppid=2630 vsize=161712 CPUtime=0.22 cores=1,3,5,7
/proc/2632/stat : 2632 (python) S 2630 2632 2236 0 -1 4202496 5859 933 1 0 14 8 0 0 17 0 1 0 869268796 165593088 4185 33554432000 4194304 5683644 140735101712176 18446744073709551615 235589942919 0 2147483391 16781312 2 18446744071699215550 0 0 17 7 0 0 0
/proc/2632/statm: 40428 4185 1159 364 0 3261 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 161712

[startup+0.700993 s]
/proc/loadavg: 2.02 1.40 0.62 2/495 2632
/proc/meminfo: memFree=29993268/32950928 swapFree=34366004/67111528
[pid=2632] ppid=2630 vsize=285844 CPUtime=0.57 cores=1,3,5,7
/proc/2632/stat : 2632 (python) R 2630 2632 2236 0 -1 4202496 10233 933 1 0 43 14 0 0 16 0 1 0 869268796 292704256 7780 33554432000 4194304 5683644 140735101712176 18446744073709551615 4539699 0 0 16781312 33554434 0 0 0 17 5 0 0 0
/proc/2632/statm: 71461 7780 1816 364 0 6354 0
Current children cumulated CPU time (s) 0.57
Current children cumulated vsize (KiB) 285844

[startup+1.50079 s]
/proc/loadavg: 2.02 1.40 0.62 3/499 2640
/proc/meminfo: memFree=29928392/32950928 swapFree=34366004/67111528
[pid=2632] ppid=2630 vsize=296324 CPUtime=0.67 cores=1,3,5,7
/proc/2632/stat : 2632 (python) S 2630 2632 2236 0 -1 4202496 10730 933 1 0 52 15 0 0 18 0 2 0 869268796 303435776 7920 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/2632/statm: 74081 7920 1870 364 0 8968 0
[pid=2638] ppid=2632 vsize=286080 CPUtime=0 cores=1,3,5,7
/proc/2638/stat : 2638 (python) S 2632 2632 2236 0 -1 4202560 865 0 0 0 0 0 0 0 15 0 1 0 869268876 292945920 6404 33554432000 4194304 5683644 140735101712176 18446744073709551615 235594886671 0 0 16781312 33554946 4294934790 0 0 17 5 0 0 0
/proc/2638/statm: 71520 6404 358 364 0 6407 0
[pid=2640] ppid=2638 vsize=52668 CPUtime=0.69 cores=1,3,5,7
/proc/2640/stat : 2640 (scip-2.0.1.linu) R 2638 2640 2640 0 -1 4202496 11324 0 0 0 44 25 0 0 21 0 1 0 869268876 53932032 10701 33554432000 4194304 13684479 140737360708464 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/2640/statm: 13167 10701 643 2317 0 10845 0
[pid=2632/tid=2639] ppid=2630 vsize=296324 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2639/stat : 2639 (python) S 2630 2632 2236 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 2 0 869268876 303435776 7920 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1.36
Current children cumulated vsize (KiB) 635072

[startup+3.10051 s]
/proc/loadavg: 2.02 1.40 0.62 3/499 2640
/proc/meminfo: memFree=29911404/32950928 swapFree=34366004/67111528
[pid=2632] ppid=2630 vsize=296324 CPUtime=0.67 cores=1,3,5,7
/proc/2632/stat : 2632 (python) S 2630 2632 2236 0 -1 4202496 10730 933 1 0 52 15 0 0 18 0 2 0 869268796 303435776 7920 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/2632/statm: 74081 7920 1870 364 0 8968 0
[pid=2638] ppid=2632 vsize=286080 CPUtime=0 cores=1,3,5,7
/proc/2638/stat : 2638 (python) S 2632 2632 2236 0 -1 4202560 865 0 0 0 0 0 0 0 15 0 1 0 869268876 292945920 6404 33554432000 4194304 5683644 140735101712176 18446744073709551615 235594886671 0 0 16781312 33554946 2879423474844041216 0 0 17 5 0 0 0
/proc/2638/statm: 71520 6404 358 364 0 6407 0
[pid=2640] ppid=2638 vsize=70216 CPUtime=2.29 cores=1,3,5,7
/proc/2640/stat : 2640 (scip-2.0.1.linu) R 2638 2640 2640 0 -1 4202496 15915 0 0 0 197 32 0 0 25 0 1 0 869268876 71901184 15006 33554432000 4194304 13684479 140737360708464 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/2640/statm: 17554 15006 840 2317 0 15232 0
[pid=2632/tid=2639] ppid=2630 vsize=296324 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2639/stat : 2639 (python) S 2630 2632 2236 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 2 0 869268876 303435776 7920 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 2.96
Current children cumulated vsize (KiB) 652620

[startup+6.301 s]
/proc/loadavg: 2.02 1.41 0.63 3/499 2640
/proc/meminfo: memFree=29896504/32950928 swapFree=34366004/67111528
[pid=2632] ppid=2630 vsize=296324 CPUtime=0.67 cores=1,3,5,7
/proc/2632/stat : 2632 (python) S 2630 2632 2236 0 -1 4202496 10730 933 1 0 52 15 0 0 18 0 2 0 869268796 303435776 7920 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/2632/statm: 74081 7920 1870 364 0 8968 0
[pid=2638] ppid=2632 vsize=286080 CPUtime=0.02 cores=1,3,5,7
/proc/2638/stat : 2638 (python) S 2632 2632 2236 0 -1 4202560 1002 0 0 0 1 1 0 0 15 0 1 0 869268876 292945920 6427 33554432000 4194304 5683644 140735101712176 18446744073709551615 235594886671 0 0 16781312 33554946 3022397412799938560 0 0 17 5 0 0 0
/proc/2638/statm: 71520 6427 381 364 0 6407 0
[pid=2640] ppid=2638 vsize=85692 CPUtime=5.49 cores=1,3,5,7
/proc/2640/stat : 2640 (scip-2.0.1.linu) R 2638 2640 2640 0 -1 4202496 20862 0 0 0 510 39 0 0 25 0 1 0 869268876 87748608 18979 33554432000 4194304 13684479 140737360708464 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/2640/statm: 21423 18979 841 2317 0 19101 0
[pid=2632/tid=2639] ppid=2630 vsize=296324 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2639/stat : 2639 (python) S 2630 2632 2236 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 2 0 869268876 303435776 7920 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 6.18
Current children cumulated vsize (KiB) 668096

[startup+12.7009 s]
/proc/loadavg: 2.01 1.42 0.64 3/499 2640
/proc/meminfo: memFree=29862924/32950928 swapFree=34366004/67111528
[pid=2632] ppid=2630 vsize=296324 CPUtime=0.67 cores=1,3,5,7
/proc/2632/stat : 2632 (python) S 2630 2632 2236 0 -1 4202496 10730 933 1 0 52 15 0 0 18 0 2 0 869268796 303435776 7920 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/2632/statm: 74081 7920 1870 364 0 8968 0
[pid=2638] ppid=2632 vsize=286080 CPUtime=0.04 cores=1,3,5,7
/proc/2638/stat : 2638 (python) S 2632 2632 2236 0 -1 4202560 1012 0 0 0 2 2 0 0 15 0 1 0 869268876 292945920 6427 33554432000 4194304 5683644 140735101712176 18446744073709551615 235594886671 0 0 16781312 33554946 3756457729422524416 0 0 17 5 0 0 0
/proc/2638/statm: 71520 6427 381 364 0 6407 0
[pid=2640] ppid=2638 vsize=117804 CPUtime=11.89 cores=1,3,5,7
/proc/2640/stat : 2640 (scip-2.0.1.linu) R 2638 2640 2640 0 -1 4202496 31775 0 0 0 1137 52 0 0 25 0 1 0 869268876 120631296 26182 33554432000 4194304 13684479 140737360708464 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/2640/statm: 29451 26182 804 2317 0 27129 0
[pid=2632/tid=2639] ppid=2630 vsize=296324 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2639/stat : 2639 (python) S 2630 2632 2236 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 2 0 869268876 303435776 7920 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 12.6
Current children cumulated vsize (KiB) 700208

[startup+25.5006 s]
/proc/loadavg: 2.08 1.46 0.66 3/499 2641
/proc/meminfo: memFree=29850972/32950928 swapFree=34366004/67111528
[pid=2632] ppid=2630 vsize=296324 CPUtime=0.67 cores=1,3,5,7
/proc/2632/stat : 2632 (python) S 2630 2632 2236 0 -1 4202496 10730 933 1 0 52 15 0 0 18 0 2 0 869268796 303435776 7920 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/2632/statm: 74081 7920 1870 364 0 8968 0
[pid=2638] ppid=2632 vsize=286080 CPUtime=0.09 cores=1,3,5,7
/proc/2638/stat : 2638 (python) S 2632 2632 2236 0 -1 4202560 1019 0 0 0 4 5 0 0 15 0 1 0 869268876 292945920 6427 33554432000 4194304 5683644 140735101712176 18446744073709551615 235594886671 0 0 16781312 33554946 4163151193452838912 0 0 17 7 0 0 0
/proc/2638/statm: 71520 6427 381 364 0 6407 0
[pid=2640] ppid=2638 vsize=129880 CPUtime=24.69 cores=1,3,5,7
/proc/2640/stat : 2640 (scip-2.0.1.linu) R 2638 2640 2640 0 -1 4202496 41449 0 0 0 2396 73 0 0 25 0 1 0 869268876 132997120 29372 33554432000 4194304 13684479 140737360708464 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/2640/statm: 32470 29372 816 2317 0 30148 0
[pid=2632/tid=2639] ppid=2630 vsize=296324 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2639/stat : 2639 (python) S 2630 2632 2236 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 2 0 869268876 303435776 7920 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 25.45
Current children cumulated vsize (KiB) 712284

[startup+51.1011 s]
/proc/loadavg: 2.25 1.55 0.71 3/521 2664
/proc/meminfo: memFree=29735188/32950928 swapFree=34366004/67111528
[pid=2632] ppid=2630 vsize=296324 CPUtime=0.67 cores=1,3,5,7
/proc/2632/stat : 2632 (python) S 2630 2632 2236 0 -1 4202496 10730 933 1 0 52 15 0 0 18 0 2 0 869268796 303435776 7920 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/2632/statm: 74081 7920 1870 364 0 8968 0
[pid=2638] ppid=2632 vsize=286080 CPUtime=0.21 cores=1,3,5,7
/proc/2638/stat : 2638 (python) S 2632 2632 2236 0 -1 4202560 1029 0 0 0 10 11 0 0 15 0 1 0 869268876 292945920 6427 33554432000 4194304 5683644 140735101712176 18446744073709551615 235594886671 0 0 16781312 33554946 3572331472125689856 0 0 17 7 0 0 0
/proc/2638/statm: 71520 6427 381 364 0 6407 0
[pid=2640] ppid=2638 vsize=143496 CPUtime=50.29 cores=1,3,5,7
/proc/2640/stat : 2640 (scip-2.0.1.linu) R 2638 2640 2640 0 -1 4202496 48691 0 0 0 4913 116 0 0 24 0 1 0 869268876 146939904 32945 33554432000 4194304 13684479 140737360708464 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/2640/statm: 35874 32945 1111 2317 0 33552 0
[pid=2632/tid=2639] ppid=2630 vsize=296324 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2639/stat : 2639 (python) S 2630 2632 2236 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 2 0 869268876 303435776 7920 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 51.17
Current children cumulated vsize (KiB) 725900

[startup+102.301 s]
/proc/loadavg: 2.11 1.62 0.78 3/551 2695
/proc/meminfo: memFree=29511056/32950928 swapFree=34366004/67111528
[pid=2632] ppid=2630 vsize=317340 CPUtime=0.72 cores=1,3,5,7
/proc/2632/stat : 2632 (python) S 2630 2632 2236 0 -1 4202496 12516 933 1 0 57 15 0 0 20 0 4 0 869268796 324956160 8059 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/2632/statm: 79335 8059 1875 364 0 14216 0
[pid=2638] ppid=2632 vsize=296324 CPUtime=0.22 cores=1,3,5,7
/proc/2638/stat : 2638 (python) S 2632 2632 2236 0 -1 4202560 1162 0 0 0 10 12 0 0 16 0 2 0 869268876 303435776 6463 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2638/statm: 74081 6463 412 364 0 8968 0
[pid=2640] ppid=2638 vsize=145348 CPUtime=51.17 cores=1,3,5,7
/proc/2640/stat : 2640 (scip-2.0.1.linu) T 2638 2640 2640 0 -1 4202496 49239 0 0 0 5000 117 0 0 25 0 1 0 869268876 148836352 33464 33554432000 4194304 13684479 140737360708464 18446744073709551615 7361271 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/2640/statm: 36337 33464 1101 2317 0 34015 0
[pid=2638/tid=2665] ppid=2632 vsize=296324 CPUtime=0 cores=1,3,5,7
/proc/2638/task/2665/stat : 2665 (python) S 2632 2632 2236 0 -1 4202560 41 0 0 0 0 0 0 0 16 0 2 0 869273994 303435776 6463 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554946 18446604460564632704 0 0 -1 7 0 0 0
[pid=2666] ppid=2632 vsize=296840 CPUtime=0.18 cores=1,3,5,7
/proc/2666/stat : 2666 (python) S 2632 2632 2236 0 -1 4202560 1114 0 0 0 9 9 0 0 16 0 2 0 869273997 303964160 6574 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/2666/statm: 74210 6574 397 364 0 9094 0
[pid=2668] ppid=2666 vsize=8538064 CPUtime=46.26 cores=1,3,5,7
/proc/2668/stat : 2668 (java) T 2666 2668 2668 0 -1 4202496 25515 0 1 0 4623 3 0 0 18 0 19 0 869273997 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/2668/statm: 2134516 19888 2261 9 0 2125257 0
[pid=2668/tid=2669] ppid=2666 vsize=8538064 CPUtime=44.99 cores=1,3,5,7
/proc/2668/task/2669/stat : 2669 (java) T 2666 2668 2668 0 -1 4202560 12511 0 1 0 4498 1 0 0 25 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 46912505903632 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2668/tid=2670] ppid=2666 vsize=8538064 CPUtime=0.01 cores=1,3,5,7
/proc/2668/task/2670/stat : 2670 (java) T 2666 2668 2668 0 -1 4202560 666 0 0 0 1 0 0 0 15 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=2668/tid=2671] ppid=2666 vsize=8538064 CPUtime=0.01 cores=1,3,5,7
/proc/2668/task/2671/stat : 2671 (java) T 2666 2668 2668 0 -1 4202560 347 0 0 0 1 0 0 0 15 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2668/tid=2672] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2672/stat : 2672 (java) T 2666 2668 2668 0 -1 4202560 19 0 0 0 0 0 0 0 15 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2668/tid=2673] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2673/stat : 2673 (java) T 2666 2668 2668 0 -1 4202560 211 0 0 0 0 0 0 0 15 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2668/tid=2674] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2674/stat : 2674 (java) T 2666 2668 2668 0 -1 4202560 55 0 0 0 0 0 0 0 15 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2668/tid=2675] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2675/stat : 2675 (java) T 2666 2668 2668 0 -1 4202560 85 0 0 0 0 0 0 0 15 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0

################
# More data... #
################

[pid=2759/tid=2773] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2773/stat : 2773 (java) S 2757 2759 2759 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 18 0 869288016 8746090496 16749 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606682521 0 4 0 16800975 18446604465102269184 0 0 -1 5 0 0 0
[pid=2759/tid=2774] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2774/stat : 2774 (java) S 2757 2759 2759 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869288018 8746090496 16749 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606690225 0 4 0 16800975 18446604465102269184 0 0 -1 5 0 0 0
[pid=2759/tid=2775] ppid=2757 vsize=8541104 CPUtime=0.29 cores=1,3,5,7
/proc/2759/task/2775/stat : 2775 (java) R 2757 2759 2759 0 -1 4202560 2940 0 0 0 29 0 0 0 25 0 18 0 869288018 8746090496 16750 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 47419898865166 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=2759/tid=2776] ppid=2757 vsize=8541104 CPUtime=0.29 cores=1,3,5,7
/proc/2759/task/2776/stat : 2776 (java) R 2757 2759 2759 0 -1 4202560 3477 0 0 0 29 0 0 0 25 0 18 0 869288018 8746090496 16750 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 47419897354880 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=2759/tid=2777] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2777/stat : 2777 (java) S 2757 2759 2759 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869288018 8746090496 16750 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606682521 0 4 0 16800975 18446604465102269184 0 0 -1 5 0 0 0
[pid=2759/tid=2778] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2778/stat : 2778 (java) S 2757 2759 2759 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 869288018 8746090496 16750 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606683136 0 4 0 16800975 18446604465102269184 0 0 -1 7 0 0 0
[pid=2632/tid=2639] ppid=2630 vsize=338004 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2639/stat : 2639 (python) S 2630 2632 2236 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 6 0 869268876 346116096 8109 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 3 0 0 0
[pid=2632/tid=2667] ppid=2630 vsize=338004 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2667/stat : 2667 (python) S 2630 2632 2236 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 6 0 869273997 346116096 8109 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 7 0 0 0
[pid=2632/tid=2694] ppid=2630 vsize=338004 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2694/stat : 2694 (python) S 2630 2632 2236 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 6 0 869278520 346116096 8109 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 1 0 0 0
[pid=2632/tid=2703] ppid=2630 vsize=338004 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2703/stat : 2703 (python) S 2630 2632 2236 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 6 0 869283236 346116096 8109 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 7 0 0 0
[pid=2632/tid=2758] ppid=2630 vsize=338004 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2758/stat : 2758 (python) S 2630 2632 2236 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 6 0 869288013 346116096 8109 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 195.03
Current children cumulated vsize (KiB) 19329432

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+192.701 s]
/proc/loadavg: 2.01 1.72 0.89 5/569 2789
/proc/meminfo: memFree=29143884/32950928 swapFree=34366004/67111528
[pid=2632] ppid=2630 vsize=338004 CPUtime=0.77 cores=1,3,5,7
/proc/2632/stat : 2632 (python) S 2630 2632 2236 0 -1 4202496 14379 933 1 0 62 15 0 0 20 0 6 0 869268796 346116096 8109 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606693323 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 0
/proc/2632/statm: 84501 8109 1879 364 0 19376 0
[pid=2638] ppid=2632 vsize=296324 CPUtime=0.22 cores=1,3,5,7
/proc/2638/stat : 2638 (python) S 2632 2632 2236 0 -1 4202560 1162 0 0 0 10 12 0 0 16 0 2 0 869268876 303435776 6463 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2638/statm: 74081 6463 412 364 0 8968 0
[pid=2640] ppid=2638 vsize=145348 CPUtime=51.17 cores=1,3,5,7
/proc/2640/stat : 2640 (scip-2.0.1.linu) T 2638 2640 2640 0 -1 4202496 49239 0 0 0 5000 117 0 0 25 0 1 0 869268876 148836352 33464 33554432000 4194304 13684479 140737360708464 18446744073709551615 7361271 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/2640/statm: 36337 33464 1101 2317 0 34015 0
[pid=2638/tid=2665] ppid=2632 vsize=296324 CPUtime=0 cores=1,3,5,7
/proc/2638/task/2665/stat : 2665 (python) S 2632 2632 2236 0 -1 4202560 41 0 0 0 0 0 0 0 16 0 2 0 869273994 303435776 6463 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554946 18446604460564632704 0 0 -1 7 0 0 0
[pid=2666] ppid=2632 vsize=296840 CPUtime=0.18 cores=1,3,5,7
/proc/2666/stat : 2666 (python) S 2632 2632 2236 0 -1 4202560 1114 0 0 0 9 9 0 0 16 0 2 0 869273997 303964160 6574 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/2666/statm: 74210 6574 397 364 0 9094 0
[pid=2668] ppid=2666 vsize=8538064 CPUtime=46.26 cores=1,3,5,7
/proc/2668/stat : 2668 (java) T 2666 2668 2668 0 -1 4202496 25515 0 1 0 4623 3 0 0 18 0 19 0 869273997 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 7 0 0 0
/proc/2668/statm: 2134516 19888 2261 9 0 2125257 0
[pid=2668/tid=2669] ppid=2666 vsize=8538064 CPUtime=44.99 cores=1,3,5,7
/proc/2668/task/2669/stat : 2669 (java) T 2666 2668 2668 0 -1 4202560 12511 0 1 0 4498 1 0 0 25 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 46912505903632 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2668/tid=2670] ppid=2666 vsize=8538064 CPUtime=0.01 cores=1,3,5,7
/proc/2668/task/2670/stat : 2670 (java) T 2666 2668 2668 0 -1 4202560 666 0 0 0 1 0 0 0 15 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=2668/tid=2671] ppid=2666 vsize=8538064 CPUtime=0.01 cores=1,3,5,7
/proc/2668/task/2671/stat : 2671 (java) T 2666 2668 2668 0 -1 4202560 347 0 0 0 1 0 0 0 15 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2668/tid=2672] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2672/stat : 2672 (java) T 2666 2668 2668 0 -1 4202560 19 0 0 0 0 0 0 0 15 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2668/tid=2673] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2673/stat : 2673 (java) T 2666 2668 2668 0 -1 4202560 211 0 0 0 0 0 0 0 15 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2668/tid=2674] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2674/stat : 2674 (java) T 2666 2668 2668 0 -1 4202560 55 0 0 0 0 0 0 0 15 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2668/tid=2675] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2675/stat : 2675 (java) T 2666 2668 2668 0 -1 4202560 85 0 0 0 0 0 0 0 15 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=2668/tid=2676] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2676/stat : 2676 (java) T 2666 2668 2668 0 -1 4202560 2 0 0 0 0 0 0 0 15 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2668/tid=2677] ppid=2666 vsize=8538064 CPUtime=0.01 cores=1,3,5,7
/proc/2668/task/2677/stat : 2677 (java) T 2666 2668 2668 0 -1 4202560 14 0 0 0 1 0 0 0 15 0 19 0 869273998 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2668/tid=2678] ppid=2666 vsize=8538064 CPUtime=0.13 cores=1,3,5,7
/proc/2668/task/2678/stat : 2678 (java) T 2666 2668 2668 0 -1 4202560 1662 0 0 0 13 0 0 0 15 0 19 0 869273999 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606683136 0 0 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=2668/tid=2679] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2679/stat : 2679 (java) T 2666 2668 2668 0 -1 4202560 16 0 0 0 0 0 0 0 18 0 19 0 869273999 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2668/tid=2680] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2680/stat : 2680 (java) T 2666 2668 2668 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869273999 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2668/tid=2681] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2681/stat : 2681 (java) T 2666 2668 2668 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869274001 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606690225 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2668/tid=2682] ppid=2666 vsize=8538064 CPUtime=0.52 cores=1,3,5,7
/proc/2668/task/2682/stat : 2682 (java) T 2666 2668 2668 0 -1 4202560 4922 0 0 0 52 0 0 0 15 0 19 0 869274001 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 1 0 0 0
[pid=2668/tid=2683] ppid=2666 vsize=8538064 CPUtime=0.51 cores=1,3,5,7
/proc/2668/task/2683/stat : 2683 (java) T 2666 2668 2668 0 -1 4202560 3628 0 0 0 51 0 0 0 15 0 19 0 869274001 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 3 0 0 0
[pid=2668/tid=2684] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2684/stat : 2684 (java) T 2666 2668 2668 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869274002 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606682521 0 4 0 16800975 18446744071562691360 0 0 -1 7 0 0 0
[pid=2668/tid=2685] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2685/stat : 2685 (java) T 2666 2668 2668 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 869274002 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606683136 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=2668/tid=2686] ppid=2666 vsize=8538064 CPUtime=0 cores=1,3,5,7
/proc/2668/task/2686/stat : 2686 (java) T 2666 2668 2668 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869274053 8742977536 19888 33554432000 1073741824 1073778376 140735299992864 18446744073709551615 235606683136 0 4 0 16800975 18446744071562691360 0 0 -1 5 0 0 0
[pid=2666/tid=2692] ppid=2632 vsize=296840 CPUtime=0 cores=1,3,5,7
/proc/2666/task/2692/stat : 2692 (python) S 2632 2632 2236 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 869278517 303964160 6574 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554946 18446604463185388736 0 0 -1 1 0 0 0
[pid=2693] ppid=2632 vsize=307096 CPUtime=0.22 cores=1,3,5,7
/proc/2693/stat : 2693 (python) S 2632 2632 2236 0 -1 4202560 1119 0 0 0 11 11 0 0 17 0 2 0 869278520 314466304 6578 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2693/statm: 76774 6578 397 364 0 11655 0
[pid=2695] ppid=2693 vsize=117632 CPUtime=47.12 cores=1,3,5,7
/proc/2695/stat : 2695 (scip-2.0.1.linu) T 2693 2695 2695 0 -1 4202496 47581 0 0 0 4656 56 0 0 25 0 1 0 869278520 120455168 26546 33554432000 4194304 15243407 140733365667168 18446744073709551615 8113544 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/2695/statm: 29408 26546 921 2698 0 26703 0
[pid=2693/tid=2701] ppid=2632 vsize=307096 CPUtime=0 cores=1,3,5,7
/proc/2693/task/2701/stat : 2701 (python) S 2632 2632 2236 0 -1 4202560 44 0 0 0 0 0 0 0 17 0 2 0 869283233 314466304 6578 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554946 18446604466513512640 0 0 -1 7 0 0 0
[pid=2702] ppid=2632 vsize=317352 CPUtime=0.25 cores=1,3,5,7
/proc/2702/stat : 2702 (python) S 2632 2632 2236 0 -1 4202560 1157 0 0 0 14 11 0 0 17 0 2 0 869283236 324968448 6601 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606693323 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/2702/statm: 79338 6601 398 364 0 14216 0
[pid=2704] ppid=2702 vsize=104368 CPUtime=47.73 cores=1,3,5,7
/proc/2704/stat : 2704 (wbo1.4a) T 2702 2704 2704 0 -1 4202496 97624 0 0 0 4743 30 0 0 25 0 1 0 869283236 106872832 25610 33554432000 134512640 135751879 4292739104 18446744073709551615 134620474 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/2704/statm: 26092 25610 146 303 0 25787 0
[pid=2702/tid=2756] ppid=2632 vsize=317352 CPUtime=0 cores=1,3,5,7
/proc/2702/task/2756/stat : 2756 (python) S 2632 2632 2236 0 -1 4202560 48 0 0 0 0 0 0 0 17 0 2 0 869288011 324968448 6601 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554946 18446604465102266496 0 0 -1 7 0 0 0
[pid=2757] ppid=2632 vsize=327760 CPUtime=0 cores=1,3,5,7
/proc/2757/stat : 2757 (python) S 2632 2632 2236 0 -1 4202560 802 0 0 0 0 0 0 0 16 0 1 0 869288013 335626240 6575 33554432000 4194304 5683644 140735101712176 18446744073709551615 235594886726 0 0 16781312 33554946 1897408438456025088 0 0 17 3 0 0 0
/proc/2757/statm: 81940 6575 349 364 0 16815 0
[pid=2759] ppid=2757 vsize=8540644 CPUtime=1.11 cores=1,3,5,7
/proc/2759/stat : 2759 (java) S 2757 2759 2759 0 -1 4202496 19633 0 1 0 108 3 0 0 20 0 18 0 869288013 8745619456 16492 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606669285 0 0 0 16800975 18446744073709551615 0 0 17 5 0 0 0
/proc/2759/statm: 2135161 16492 2222 9 0 2125902 0
[pid=2759/tid=2760] ppid=2757 vsize=8541104 CPUtime=0.55 cores=1,3,5,7
/proc/2759/task/2760/stat : 2760 (java) R 2757 2759 2759 0 -1 4202560 12077 0 1 0 53 2 0 0 18 0 18 0 869288014 8746090496 16746 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 46912505219208 0 4 0 16800975 0 0 0 -1 5 0 0 0
[pid=2759/tid=2761] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2761/stat : 2761 (java) S 2757 2759 2759 0 -1 4202560 1 0 0 0 0 0 0 0 22 0 18 0 869288015 8746090496 16746 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606682521 0 4 0 16800975 18446604465102269184 0 0 -1 5 0 0 0
[pid=2759/tid=2762] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2762/stat : 2762 (java) S 2757 2759 2759 0 -1 4202560 1 0 0 0 0 0 0 0 23 0 18 0 869288015 8746090496 16746 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606682521 0 4 0 16800975 18446604465102269184 0 0 -1 5 0 0 0
[pid=2759/tid=2763] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2763/stat : 2763 (java) S 2757 2759 2759 0 -1 4202560 1 0 0 0 0 0 0 0 24 0 18 0 869288015 8746090496 16747 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606682521 0 4 0 16800975 18446604465102269184 0 0 -1 5 0 0 0
[pid=2759/tid=2764] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2764/stat : 2764 (java) S 2757 2759 2759 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869288015 8746090496 16747 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606682521 0 4 0 16800975 18446604465102269184 0 0 -1 3 0 0 0
[pid=2759/tid=2765] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2765/stat : 2765 (java) S 2757 2759 2759 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869288015 8746090496 16747 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606682521 0 4 0 16800975 18446604465102269184 0 0 -1 3 0 0 0
[pid=2759/tid=2766] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2766/stat : 2766 (java) S 2757 2759 2759 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869288015 8746090496 16748 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606682521 0 4 0 16800975 18446604465102269184 0 0 -1 3 0 0 0
[pid=2759/tid=2767] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2767/stat : 2767 (java) S 2757 2759 2759 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869288015 8746090496 16748 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606682521 0 4 0 16800975 18446604465102269184 0 0 -1 3 0 0 0
[pid=2759/tid=2768] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2768/stat : 2768 (java) S 2757 2759 2759 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869288015 8746090496 16748 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606682521 0 4 0 16800975 18446604465102269184 0 0 -1 3 0 0 0
[pid=2759/tid=2769] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2769/stat : 2769 (java) S 2757 2759 2759 0 -1 4202560 2 0 0 0 0 0 0 0 25 0 18 0 869288016 8746090496 16749 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606683136 0 0 0 16800975 18446604465102269184 0 0 -1 5 0 0 0
[pid=2759/tid=2771] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2771/stat : 2771 (java) S 2757 2759 2759 0 -1 4202560 16 0 0 0 0 0 0 0 25 0 18 0 869288016 8746090496 16749 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606682521 0 4 0 16800975 18446604465102269184 0 0 -1 5 0 0 0
[pid=2759/tid=2773] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2773/stat : 2773 (java) S 2757 2759 2759 0 -1 4202560 7 0 0 0 0 0 0 0 25 0 18 0 869288016 8746090496 16749 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606682521 0 4 0 16800975 18446604465102269184 0 0 -1 5 0 0 0
[pid=2759/tid=2774] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2774/stat : 2774 (java) S 2757 2759 2759 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869288018 8746090496 16749 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606690225 0 4 0 16800975 18446604465102269184 0 0 -1 5 0 0 0
[pid=2759/tid=2775] ppid=2757 vsize=8541104 CPUtime=0.29 cores=1,3,5,7
/proc/2759/task/2775/stat : 2775 (java) R 2757 2759 2759 0 -1 4202560 2940 0 0 0 29 0 0 0 25 0 18 0 869288018 8746090496 16750 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 47419898865166 0 4 0 16800975 0 0 0 -1 3 0 0 0
[pid=2759/tid=2776] ppid=2757 vsize=8541104 CPUtime=0.29 cores=1,3,5,7
/proc/2759/task/2776/stat : 2776 (java) R 2757 2759 2759 0 -1 4202560 3477 0 0 0 29 0 0 0 25 0 18 0 869288018 8746090496 16750 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 47419897354880 0 4 0 16800975 0 0 0 -1 1 0 0 0
[pid=2759/tid=2777] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2777/stat : 2777 (java) S 2757 2759 2759 0 -1 4202560 1 0 0 0 0 0 0 0 25 0 18 0 869288018 8746090496 16750 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606682521 0 4 0 16800975 18446604465102269184 0 0 -1 5 0 0 0
[pid=2759/tid=2778] ppid=2757 vsize=8541104 CPUtime=0 cores=1,3,5,7
/proc/2759/task/2778/stat : 2778 (java) S 2757 2759 2759 0 -1 4202560 1 0 0 0 0 0 0 0 21 0 18 0 869288018 8746090496 16750 33554432000 1073741824 1073778376 140733847915312 18446744073709551615 235606683136 0 4 0 16800975 18446604465102269184 0 0 -1 7 0 0 0
[pid=2632/tid=2639] ppid=2630 vsize=338004 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2639/stat : 2639 (python) S 2630 2632 2236 0 -1 4202560 26 933 0 0 0 0 0 0 18 0 6 0 869268876 346116096 8109 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 3 0 0 0
[pid=2632/tid=2667] ppid=2630 vsize=338004 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2667/stat : 2667 (python) S 2630 2632 2236 0 -1 4202560 26 933 0 0 0 0 0 0 20 0 6 0 869273997 346116096 8109 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 7 0 0 0
[pid=2632/tid=2694] ppid=2630 vsize=338004 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2694/stat : 2694 (python) S 2630 2632 2236 0 -1 4202560 28 933 0 0 0 0 0 0 20 0 6 0 869278520 346116096 8109 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 1 0 0 0
[pid=2632/tid=2703] ppid=2630 vsize=338004 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2703/stat : 2703 (python) S 2630 2632 2236 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 6 0 869283236 346116096 8109 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 7 0 0 0
[pid=2632/tid=2758] ppid=2630 vsize=338004 CPUtime=0 cores=1,3,5,7
/proc/2632/task/2758/stat : 2758 (python) S 2630 2632 2236 0 -1 4202560 31 933 0 0 0 0 0 0 20 0 6 0 869288013 346116096 8109 33554432000 4194304 5683644 140735101712176 18446744073709551615 235606690225 0 0 16781312 33554434 18446604465102268288 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 195.03
Current children cumulated vsize (KiB) 19329432

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2632 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=626904
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=158975
# CPU time returned by wait4() is 0.785879
# while last known CPU time is 195.03
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 192.78
CPU time (s): 195.03
CPU user time (s): 192.36
CPU system time (s): 2.67
CPU usage (%): 101.167
Max. virtual memory (cumulated for all children) (KiB): 19329432

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.626904
system time used= 0.158975
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 15315
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1749
involuntary context switches= 23

runsolver used 1.05484 second user time and 2.31265 second system time

The end

Launcher Data 

Begin job on node120 at 2011-06-09 01:45:00
IDJOB=3481698
IDBENCH=2122
IDSOLVER=1970
FILE ID=node120/3481698-1307576700
RUNJOBID= node120-1307576358-2264
PBS_JOBID= 13547679
Free space on /tmp= 73736 MiB

SOLVER NAME= borg pb-opt-11.04.03
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB05/manquinho/primes-dimacs-cnf/normalized-par32-4.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.opt.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3481698-1307576700/watcher-3481698-1307576700 -o /tmp/evaluation-result-3481698-1307576700/solver-3481698-1307576700 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.opt.pickle HOME/instance-3481698-1307576700.opb -seed 852816353 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 172d8bfe30610a29dfe3bb9d98ed3f4c
RANDOM SEED=852816353

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      29993300 kB
Buffers:        146796 kB
Cached:         557140 kB
SwapCached:      12060 kB
Active:        2471716 kB
Inactive:       173800 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      29993300 kB
SwapTotal:    67111528 kB
SwapFree:     34366004 kB
Dirty:          207284 kB
Writeback:           0 kB
AnonPages:     1939036 kB
Mapped:          42592 kB
Slab:           145976 kB
PageTables:      97068 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS: 108016668 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73596 MiB
End job on node120 at 2011-06-09 01:48:15