Trace number 3482405

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-dec-11.04.03? (TO) 1800.06 1791.29

General information on the benchmark

Namenormalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/
manquinho/dbsg/normalized-dbsg_100_10_3_40.opb
MD5SUM29fd031d19832e8fd3e4ee8a0dfa62d0
Bench CategoryDEC-SMALLINT-NLC (no optimisation, small integers, non linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables200
Total number of constraints302
Number of constraints which are clauses100
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints201
Minimum length of a constraint2
Maximum length of a constraint200
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 40
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 200
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)2488
Sum of products size (including duplicates)4976
Number of different products1244
Sum of products size2488

Solver Data 

0.38/0.76	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.38/0.76	c INFO: solving HOME/instance-3482405-1307577589.opb
0.38/0.78	c INFO: wrote linearized instance to HOME/tmpwx5Ceb.opb
0.38/0.80	c INFO: parsing took 0.02 s
0.47/0.84	c INFO: features took 0.04 CPU seconds
0.47/0.87	c INFO: running clasp-1.3.7@0 for 45 with 1799 remaining (b = 0.57)
46.82/47.10	c INFO: running scip-2.0.1-spx@0 for 45 with 1753 remaining (b = 0.18)
93.32/93.30	c INFO: running scip-2.0.1-clp@0 for 45 with 1707 remaining (b = 0.03)
140.18/140.08	c INFO: running clasp-1.3.7@46 for 45 with 1661 remaining (b = 0.01)
189.70/189.34	c INFO: running pbct-0.1.2-linear@0 for 45 with 1611 remaining (b = 0.07)
237.21/236.60	c INFO: running scip-2.0.1-clp@46 for 45 with 1566 remaining (b = 0.01)
287.24/286.43	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1516 remaining (b = 0.01)
337.83/335.03	c INFO: running clasp-1.3.7@95 for 136 with 1466 remaining (b = 0.02)
474.70/471.58	c INFO: running scip-2.0.1-spx@45 for 45 with 1329 remaining (b = 0.01)
524.13/520.78	c INFO: running bsolo_pb10-l3@0 for 45 with 1281 remaining (b = 0.02)
571.73/568.18	c INFO: running scip-2.0.1-spx@94 for 410 with 1233 remaining (b = 0.06)
984.55/979.14	c INFO: running bsolo_pb10-l1@0 for 91 with 825 remaining (b = 0.01)
1077.64/1071.92	c INFO: wrote minion input file to HOME/tmpCHh3O3.minion
1077.64/1071.92	c INFO: running minion-0.12@0 for 45 with 733 remaining (b = 0.01)
1126.12/1120.21	c INFO: running scip-2.0.1-spx@502 for 547 with 684 remaining (b = 0.05)
1679.27/1670.98	c INFO: running bsolo_pb10-l2@0 for 45 with 137 remaining (b = 0.00)
1727.86/1719.35	c INFO: running wbo1.4a@0 for 89 with 89 remaining (b = 0.00)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482405-1307577589/watcher-3482405-1307577589 -o /tmp/evaluation-result-3482405-1307577589/solver-3482405-1307577589 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482405-1307577589.opb -seed 40093950 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 1.98 1.46 2/541 29266
/proc/meminfo: memFree=21645784/32951124 swapFree=63649284/67111528
[pid=29266] ppid=29264 vsize=15904 CPUtime=0 cores=0,2,4,6
/proc/29266/stat : 29266 (python) S 29264 29266 28679 0 -1 4202496 958 0 0 0 0 0 0 0 23 0 1 0 869357512 16285696 833 33554432000 4194304 5683644 140733755202960 18446744073709551615 210204645376 0 2147483391 16781312 2 18446744071699207358 0 0 17 2 0 0 0
/proc/29266/statm: 3976 833 357 364 0 463 0

[startup+0.053544 s]
/proc/loadavg: 2.02 1.98 1.46 2/541 29266
/proc/meminfo: memFree=21645784/32951124 swapFree=63649284/67111528
[pid=29266] ppid=29264 vsize=16392 CPUtime=0.01 cores=0,2,4,6
/proc/29266/stat : 29266 (python) S 29264 29266 28679 0 -1 4202496 1123 0 0 0 1 0 0 0 23 0 1 0 869357512 16785408 989 33554432000 4194304 5683644 140733755202960 18446744073709551615 210204645376 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/29266/statm: 4098 989 413 364 0 585 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 16392

[startup+0.101713 s]
/proc/loadavg: 2.02 1.98 1.46 2/541 29266
/proc/meminfo: memFree=21645784/32951124 swapFree=63649284/67111528
[pid=29266] ppid=29264 vsize=29784 CPUtime=0.03 cores=0,2,4,6
/proc/29266/stat : 29266 (python) S 29264 29266 28679 0 -1 4202496 1414 0 0 0 3 0 0 0 23 0 1 0 869357512 30498816 1257 33554432000 4194304 5683644 140733755202960 18446744073709551615 210204645376 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/29266/statm: 7446 1257 443 364 0 816 0
Current children cumulated CPU time (s) 0.03
Current children cumulated vsize (KiB) 29784

[startup+0.300496 s]
/proc/loadavg: 2.02 1.98 1.46 2/541 29266
/proc/meminfo: memFree=21645784/32951124 swapFree=63649284/67111528
[pid=29266] ppid=29264 vsize=123740 CPUtime=0.15 cores=0,2,4,6
/proc/29266/stat : 29266 (python) S 29264 29266 28679 0 -1 4202496 5356 928 1 0 10 5 0 0 17 0 1 0 869357512 126709760 3743 33554432000 4194304 5683644 140733755202960 18446744073709551615 210204645376 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/29266/statm: 30935 3743 987 364 0 2767 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 123740

[startup+0.700418 s]
/proc/loadavg: 2.02 1.98 1.46 2/541 29266
/proc/meminfo: memFree=21645784/32951124 swapFree=63649284/67111528
[pid=29266] ppid=29264 vsize=252548 CPUtime=0.38 cores=0,2,4,6
/proc/29266/stat : 29266 (python) S 29264 29266 28679 0 -1 4202496 8132 928 1 0 27 11 0 0 15 0 1 0 869357512 258609152 6245 33554432000 4194304 5683644 140733755202960 18446744073709551615 210204645376 0 2147483391 16781312 2 18446744071699207358 0 0 17 6 0 0 0
/proc/29266/statm: 63137 6245 1636 364 0 5031 0
Current children cumulated CPU time (s) 0.38
Current children cumulated vsize (KiB) 252548

[startup+1.50034 s]
/proc/loadavg: 2.02 1.98 1.46 3/545 29275
/proc/meminfo: memFree=21617976/32951124 swapFree=63649284/67111528
[pid=29266] ppid=29264 vsize=293784 CPUtime=0.53 cores=0,2,4,6
/proc/29266/stat : 29266 (python) S 29264 29266 28679 0 -1 4202496 10802 1329 1 0 40 11 2 0 18 0 2 0 869357512 300834816 7278 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/29266/statm: 73446 7278 1863 364 0 8333 0
[pid=29273] ppid=29266 vsize=283540 CPUtime=0 cores=0,2,4,6
/proc/29273/stat : 29273 (python) S 29266 29266 28679 0 -1 4202560 663 0 0 0 0 0 0 0 18 0 1 0 869357599 290344960 5727 33554432000 4194304 5683644 140733755202960 18446744073709551615 210204667407 0 0 16781312 33554946 13400378610120884482 0 0 17 6 0 0 0
/proc/29273/statm: 70885 5727 316 364 0 5772 0
[pid=29275] ppid=29273 vsize=2920 CPUtime=0.62 cores=0,2,4,6
/proc/29275/stat : 29275 (clasp-1.3.7-x86) R 29273 29275 29275 0 -1 4202496 750 0 0 0 62 0 0 0 21 0 1 0 869357599 2990080 483 33554432000 134512640 136139019 4286659456 18446744073709551615 134875844 0 0 16781312 16386 0 0 0 17 0 0 0 0
/proc/29275/statm: 730 483 183 398 0 330 0
[pid=29266/tid=29274] ppid=29264 vsize=293784 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29274/stat : 29274 (python) S 29264 29266 28679 0 -1 4202560 26 1329 0 0 0 0 2 0 18 0 2 0 869357599 300834816 7278 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1.15
Current children cumulated vsize (KiB) 580244

[startup+3.10108 s]
/proc/loadavg: 2.02 1.98 1.46 3/545 29275
/proc/meminfo: memFree=21616228/32951124 swapFree=63649284/67111528
[pid=29266] ppid=29264 vsize=293784 CPUtime=0.53 cores=0,2,4,6
/proc/29266/stat : 29266 (python) S 29264 29266 28679 0 -1 4202496 10802 1329 1 0 40 11 2 0 18 0 2 0 869357512 300834816 7278 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/29266/statm: 73446 7278 1863 364 0 8333 0
[pid=29273] ppid=29266 vsize=283540 CPUtime=0 cores=0,2,4,6
/proc/29273/stat : 29273 (python) S 29266 29266 28679 0 -1 4202560 688 0 0 0 0 0 0 0 18 0 1 0 869357599 290344960 5730 33554432000 4194304 5683644 140733755202960 18446744073709551615 210204667407 0 0 16781312 33554946 13400373318721175810 0 0 17 6 0 0 0
/proc/29273/statm: 70885 5730 319 364 0 5772 0
[pid=29275] ppid=29273 vsize=3316 CPUtime=2.22 cores=0,2,4,6
/proc/29275/stat : 29275 (clasp-1.3.7-x86) R 29273 29275 29275 0 -1 4202496 836 0 0 0 222 0 0 0 25 0 1 0 869357599 3395584 569 33554432000 134512640 136139019 4286659456 18446744073709551615 134828692 0 0 16781312 16386 0 0 0 17 0 0 0 0
/proc/29275/statm: 829 569 183 398 0 429 0
[pid=29266/tid=29274] ppid=29264 vsize=293784 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29274/stat : 29274 (python) S 29264 29266 28679 0 -1 4202560 26 1329 0 0 0 0 2 0 18 0 2 0 869357599 300834816 7278 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 2.75
Current children cumulated vsize (KiB) 580640

[startup+6.30051 s]
/proc/loadavg: 2.01 1.98 1.46 3/545 29275
/proc/meminfo: memFree=21613060/32951124 swapFree=63649284/67111528
[pid=29266] ppid=29264 vsize=293784 CPUtime=0.53 cores=0,2,4,6
/proc/29266/stat : 29266 (python) S 29264 29266 28679 0 -1 4202496 10802 1329 1 0 40 11 2 0 18 0 2 0 869357512 300834816 7278 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/29266/statm: 73446 7278 1863 364 0 8333 0
[pid=29273] ppid=29266 vsize=283540 CPUtime=0.01 cores=0,2,4,6
/proc/29273/stat : 29273 (python) S 29266 29266 28679 0 -1 4202560 853 0 0 0 1 0 0 0 18 0 1 0 869357599 290344960 5754 33554432000 4194304 5683644 140733755202960 18446744073709551615 210204667407 0 0 16781312 33554946 13400374074635419906 0 0 17 6 0 0 0
/proc/29273/statm: 70885 5754 343 364 0 5772 0
[pid=29275] ppid=29273 vsize=3580 CPUtime=5.42 cores=0,2,4,6
/proc/29275/stat : 29275 (clasp-1.3.7-x86) R 29273 29275 29275 0 -1 4202496 895 0 0 0 542 0 0 0 25 0 1 0 869357599 3665920 628 33554432000 134512640 136139019 4286659456 18446744073709551615 134598634 0 0 16781312 16386 0 0 0 17 0 0 0 0
/proc/29275/statm: 895 628 183 398 0 495 0
[pid=29266/tid=29274] ppid=29264 vsize=293784 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29274/stat : 29274 (python) S 29264 29266 28679 0 -1 4202560 26 1329 0 0 0 0 2 0 18 0 2 0 869357599 300834816 7278 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 5.96
Current children cumulated vsize (KiB) 580904

[startup+12.7004 s]
/proc/loadavg: 2.01 1.98 1.47 3/545 29275
/proc/meminfo: memFree=21615944/32951124 swapFree=63649284/67111528
[pid=29266] ppid=29264 vsize=293784 CPUtime=0.53 cores=0,2,4,6
/proc/29266/stat : 29266 (python) S 29264 29266 28679 0 -1 4202496 10802 1329 1 0 40 11 2 0 18 0 2 0 869357512 300834816 7278 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/29266/statm: 73446 7278 1863 364 0 8333 0
[pid=29273] ppid=29266 vsize=283540 CPUtime=0.03 cores=0,2,4,6
/proc/29273/stat : 29273 (python) S 29266 29266 28679 0 -1 4202560 859 0 0 0 2 1 0 0 18 0 1 0 869357599 290344960 5754 33554432000 4194304 5683644 140733755202960 18446744073709551615 210204667407 0 0 16781312 33554946 72556772316949304 0 0 17 6 0 0 0
/proc/29273/statm: 70885 5754 343 364 0 5772 0
[pid=29275] ppid=29273 vsize=3844 CPUtime=11.82 cores=0,2,4,6
/proc/29275/stat : 29275 (clasp-1.3.7-x86) R 29273 29275 29275 0 -1 4202496 967 0 0 0 1182 0 0 0 25 0 1 0 869357599 3936256 700 33554432000 134512640 136139019 4286659456 18446744073709551615 134875018 0 0 16781312 16386 0 0 0 17 0 0 0 0
/proc/29275/statm: 961 700 183 398 0 561 0
[pid=29266/tid=29274] ppid=29264 vsize=293784 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29274/stat : 29274 (python) S 29264 29266 28679 0 -1 4202560 26 1329 0 0 0 0 2 0 18 0 2 0 869357599 300834816 7278 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 12.38
Current children cumulated vsize (KiB) 581168

[startup+25.5003 s]
/proc/loadavg: 2.09 2.00 1.48 3/545 29276
/proc/meminfo: memFree=21616248/32951124 swapFree=63649284/67111528
[pid=29266] ppid=29264 vsize=293784 CPUtime=0.53 cores=0,2,4,6
/proc/29266/stat : 29266 (python) S 29264 29266 28679 0 -1 4202496 10802 1329 1 0 40 11 2 0 18 0 2 0 869357512 300834816 7278 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/29266/statm: 73446 7278 1863 364 0 8333 0
[pid=29273] ppid=29266 vsize=283540 CPUtime=0.09 cores=0,2,4,6
/proc/29273/stat : 29273 (python) S 29266 29266 28679 0 -1 4202560 864 0 0 0 5 4 0 0 18 0 1 0 869357599 290344960 5754 33554432000 4194304 5683644 140733755202960 18446744073709551615 210204667407 0 0 16781312 33554946 72556772316949304 0 0 17 6 0 0 0
/proc/29273/statm: 70885 5754 343 364 0 5772 0
[pid=29275] ppid=29273 vsize=4504 CPUtime=24.62 cores=0,2,4,6
/proc/29275/stat : 29275 (clasp-1.3.7-x86) R 29273 29275 29275 0 -1 4202496 1148 0 0 0 2462 0 0 0 25 0 1 0 869357599 4612096 881 33554432000 134512640 136139019 4286659456 18446744073709551615 134883787 0 0 16781312 16386 0 0 0 17 0 0 0 0
/proc/29275/statm: 1126 881 183 398 0 726 0
[pid=29266/tid=29274] ppid=29264 vsize=293784 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29274/stat : 29274 (python) S 29264 29266 28679 0 -1 4202560 26 1329 0 0 0 0 2 0 18 0 2 0 869357599 300834816 7278 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 25.24
Current children cumulated vsize (KiB) 581828

[startup+51.101 s]
/proc/loadavg: 2.06 2.00 1.49 3/549 29280
/proc/meminfo: memFree=21589308/32951124 swapFree=63649284/67111528
[pid=29266] ppid=29264 vsize=304544 CPUtime=0.56 cores=0,2,4,6
/proc/29266/stat : 29266 (python) S 29264 29266 28679 0 -1 4202496 11702 1329 1 0 42 12 2 0 20 0 3 0 869357512 311853056 7411 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/29266/statm: 76136 7411 1866 364 0 11020 0
[pid=29273] ppid=29266 vsize=293784 CPUtime=0.19 cores=0,2,4,6
/proc/29273/stat : 29273 (python) S 29266 29266 28679 0 -1 4202560 1144 0 0 0 10 9 0 0 19 0 2 0 869357599 300834816 5827 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/29273/statm: 73446 5827 411 364 0 8333 0
[pid=29275] ppid=29273 vsize=4856 CPUtime=46.19 cores=0,2,4,6
/proc/29275/stat : 29275 (clasp-1.3.7-x86) T 29273 29275 29275 0 -1 4202496 1212 0 0 0 4619 0 0 0 25 0 1 0 869357599 4972544 945 33554432000 134512640 136139019 4286659456 18446744073709551615 134877207 0 0 16781312 16386 18446744071562691360 0 0 17 0 0 0 0
/proc/29275/statm: 1214 945 183 398 0 814 0
[pid=29273/tid=29277] ppid=29266 vsize=293784 CPUtime=0 cores=0,2,4,6
/proc/29273/task/29277/stat : 29277 (python) S 29266 29266 28679 0 -1 4202560 41 0 0 0 0 0 0 0 19 0 2 0 869362220 300834816 5827 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554946 18446604448013108160 0 0 -1 0 0 0 0
[pid=29278] ppid=29266 vsize=294300 CPUtime=0.01 cores=0,2,4,6
/proc/29278/stat : 29278 (python) S 29266 29266 28679 0 -1 4202560 903 0 0 0 1 0 0 0 15 0 1 0 869362222 301363200 5885 33554432000 4194304 5683644 140733755202960 18446744073709551615 210204667462 0 0 16781312 33554946 1774336172063949058 0 0 17 6 0 0 0
/proc/29278/statm: 73575 5885 344 364 0 8459 0
[pid=29280] ppid=29278 vsize=50052 CPUtime=3.99 cores=0,2,4,6
/proc/29280/stat : 29280 (scip-2.0.1.linu) R 29278 29280 29280 0 -1 4202496 12651 0 0 0 387 12 0 0 25 0 1 0 869362222 51253248 10385 33554432000 4194304 13684479 140733410801856 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 0 0 0 0
/proc/29280/statm: 12513 10385 830 2317 0 10191 0
[pid=29266/tid=29274] ppid=29264 vsize=304544 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29274/stat : 29274 (python) S 29264 29266 28679 0 -1 4202560 26 1329 0 0 0 0 2 0 18 0 3 0 869357599 311853056 7411 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 6 0 0 0
[pid=29266/tid=29279] ppid=29264 vsize=304544 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29279/stat : 29279 (python) S 29264 29266 28679 0 -1 4202560 29 1329 0 0 0 0 2 0 20 0 3 0 869362222 311853056 7411 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 50.94
Current children cumulated vsize (KiB) 947536

[startup+102.319 s]
/proc/loadavg: 2.07 2.01 1.52 3/553 29295
/proc/meminfo: memFree=21508372/32951124 swapFree=63649284/67111528
[pid=29266] ppid=29264 vsize=314800 CPUtime=0.59 cores=0,2,4,6
/proc/29266/stat : 29266 (python) S 29264 29266 28679 0 -1 4202496 12601 1329 1 0 44 13 2 0 20 0 4 0 869357512 322355200 7442 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0
/proc/29266/statm: 78700 7442 1876 364 0 13581 0
[pid=29273] ppid=29266 vsize=293784 CPUtime=0.19 cores=0,2,4,6
/proc/29273/stat : 29273 (python) S 29266 29266 28679 0 -1 4202560 1144 0 0 0 10 9 0 0 19 0 2 0 869357599 300834816 5827 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/29273/statm: 73446 5827 411 364 0 8333 0
[pid=29275] ppid=29273 vsize=4856 CPUtime=46.19 cores=0,2,4,6
/proc/29275/stat : 29275 (clasp-1.3.7-x86) T 29273 29275 29275 0 -1 4202496 1212 0 0 0 4619 0 0 0 25 0 1 0 869357599 4972544 945 33554432000 134512640 136139019 4286659456 18446744073709551615 134877207 0 0 16781312 16386 18446744071562691360 0 0 17 0 0 0 0
/proc/29275/statm: 1214 945 183 398 0 814 0
[pid=29273/tid=29277] ppid=29266 vsize=293784 CPUtime=0 cores=0,2,4,6
/proc/29273/task/29277/stat : 29277 (python) S 29266 29266 28679 0 -1 4202560 41 0 0 0 0 0 0 0 19 0 2 0 869362220 300834816 5827 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554946 18446604448013108160 0 0 -1 0 0 0 0
[pid=29278] ppid=29266 vsize=294300 CPUtime=0.2 cores=0,2,4,6
/proc/29278/stat : 29278 (python) S 29266 29266 28679 0 -1 4202560 1112 0 0 0 10 10 0 0 17 0 2 0 869362222 301363200 5933 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/29278/statm: 73575 5933 391 364 0 8459 0
[pid=29280] ppid=29278 vsize=79544 CPUtime=46.16 cores=0,2,4,6
/proc/29280/stat : 29280 (scip-2.0.1.linu) T 29278 29280 29280 0 -1 4202496 21432 0 0 0 4580 36 0 0 25 0 1 0 869362222 81453056 17472 33554432000 4194304 13684479 140733410801856 18446744073709551615 11876362 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/29280/statm: 19886 17472 848 2317 0 17564 0
[pid=29278/tid=29292] ppid=29266 vsize=294300 CPUtime=0 cores=0,2,4,6
/proc/29278/task/29292/stat : 29292 (python) S 29266 29266 28679 0 -1 4202560 50 0 0 0 0 0 0 0 17 0 2 0 869366840 301363200 5933 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554946 18446604446543603712 0 0 -1 6 0 0 0
[pid=29293] ppid=29266 vsize=304556 CPUtime=0.03 cores=0,2,4,6
/proc/29293/stat : 29293 (python) S 29266 29266 28679 0 -1 4202560 905 0 0 0 2 1 0 0 15 0 1 0 869366843 311865344 5906 33554432000 4194304 5683644 140733755202960 18446744073709551615 210204667462 0 0 16781312 33554946 2226701407786893312 0 0 17 6 0 0 0

################
# More data... #
################

[pid=29266/tid=29599] ppid=29264 vsize=386888 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29599/stat : 29599 (python) S 29264 29266 28679 0 -1 4202560 26 1329 0 0 0 0 2 0 20 0 11 0 869529447 396173312 7567 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1791.12
Current children cumulated vsize (KiB) 12988036



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1791.2 s]
/proc/loadavg: 1.03 1.54 1.73 2/597 29602
/proc/meminfo: memFree=19686320/32951124 swapFree=63649284/67111528
[pid=29266] ppid=29264 vsize=386888 CPUtime=1.05 cores=0,2,4,6
/proc/29266/stat : 29266 (python) S 29264 29266 28679 0 -1 4202496 19172 1329 1 0 88 15 2 0 20 0 11 0 869357512 396173312 7567 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/29266/statm: 96722 7567 1890 364 0 31582 0
[pid=29273] ppid=29266 vsize=293784 CPUtime=0.97 cores=0,2,4,6
/proc/29273/stat : 29273 (python) S 29266 29266 28679 0 -1 4202560 1204 0 0 0 50 47 0 0 18 0 2 0 869357599 300834816 5828 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/29273/statm: 73446 5828 412 364 0 8333 0
[pid=29275] ppid=29273 vsize=6436 CPUtime=231.78 cores=0,2,4,6
/proc/29275/stat : 29275 (clasp-1.3.7-x86) T 29273 29275 29275 0 -1 4202496 1630 0 0 0 23178 0 0 0 25 0 1 0 869357599 6590464 1361 33554432000 134512640 136139019 4286659456 18446744073709551615 134832189 0 0 16781312 16386 18446744071562691360 0 0 17 6 0 0 0
/proc/29275/statm: 1609 1361 183 398 0 1209 0
[pid=29273/tid=29277] ppid=29266 vsize=293784 CPUtime=0 cores=0,2,4,6
/proc/29273/task/29277/stat : 29277 (python) S 29266 29266 28679 0 -1 4202560 42 0 0 0 0 0 0 0 18 0 2 0 869362220 300834816 5828 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554946 18446604448013108160 0 0 -1 0 0 0 0
[pid=29278] ppid=29266 vsize=294300 CPUtime=4.71 cores=0,2,4,6
/proc/29278/stat : 29278 (python) S 29266 29266 28679 0 -1 4202560 1214 0 0 0 241 230 0 0 15 0 2 0 869362222 301363200 5933 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/29278/statm: 73575 5933 391 364 0 8459 0
[pid=29280] ppid=29278 vsize=79544 CPUtime=1057.05 cores=0,2,4,6
/proc/29280/stat : 29280 (scip-2.0.1.linu) T 29278 29280 29280 0 -1 4202496 21447 0 0 0 104995 710 0 0 25 0 1 0 869362222 81453056 17487 33554432000 4194304 13684479 140733410801856 18446744073709551615 7126848 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/29280/statm: 19886 17487 848 2317 0 17564 0
[pid=29278/tid=29292] ppid=29266 vsize=294300 CPUtime=0 cores=0,2,4,6
/proc/29278/task/29292/stat : 29292 (python) S 29266 29266 28679 0 -1 4202560 51 0 0 0 0 0 0 0 15 0 2 0 869366840 301363200 5933 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554946 18446604446543603712 0 0 -1 6 0 0 0
[pid=29293] ppid=29266 vsize=304556 CPUtime=0.43 cores=0,2,4,6
/proc/29293/stat : 29293 (python) S 29266 29266 28679 0 -1 4202560 1136 0 0 0 21 22 0 0 15 0 2 0 869366843 311865344 5954 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/29293/statm: 76139 5954 391 364 0 11020 0
[pid=29295] ppid=29293 vsize=58388 CPUtime=96.52 cores=0,2,4,6
/proc/29295/stat : 29295 (scip-2.0.1.linu) T 29293 29295 29295 0 -1 4202496 30177 0 0 0 9615 37 0 0 25 0 1 0 869366843 59789312 11225 33554432000 4194304 15243407 140734629880480 18446744073709551615 8119102 0 0 16781312 2 18446744071562691360 0 0 17 4 0 0 0
/proc/29295/statm: 14597 11225 967 2698 0 11892 0
[pid=29293/tid=29297] ppid=29266 vsize=304556 CPUtime=0 cores=0,2,4,6
/proc/29293/task/29297/stat : 29297 (python) S 29266 29266 28679 0 -1 4202560 47 0 0 0 0 0 0 0 15 0 2 0 869371518 311865344 5954 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554946 18446604453721350528 0 0 -1 6 0 0 0
[pid=29299] ppid=29266 vsize=314972 CPUtime=0.2 cores=0,2,4,6
/proc/29299/stat : 29299 (python) S 29266 29266 28679 0 -1 4202560 1110 0 0 0 9 11 0 0 16 0 2 0 869376446 322531328 5981 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/29299/statm: 78743 5981 391 364 0 13621 0
[pid=29301] ppid=29299 vsize=51276 CPUtime=47.23 cores=0,2,4,6
/proc/29301/stat : 29301 (pbct-0.1.2-linu) T 29299 29301 29301 0 -1 4202496 12841 0 0 0 4579 144 0 0 25 0 1 0 869376446 52506624 12069 33554432000 134512640 136422188 4293071840 18446744073709551615 134870595 0 0 16781312 16387 18446744071562691360 0 0 17 0 0 0 0
/proc/29301/statm: 12819 12069 213 467 0 12350 0
[pid=29299/tid=29303] ppid=29266 vsize=314972 CPUtime=0 cores=0,2,4,6
/proc/29299/task/29303/stat : 29303 (python) S 29266 29266 28679 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869381170 322531328 5981 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554946 18446604445052712832 0 0 -1 6 0 0 0
[pid=29309] ppid=29266 vsize=325228 CPUtime=0.2 cores=0,2,4,6
/proc/29309/stat : 29309 (python) S 29266 29266 28679 0 -1 4202560 1160 0 0 0 9 11 0 0 16 0 2 0 869386156 333033472 5986 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/29309/statm: 81307 5986 391 364 0 16182 0
[pid=29311] ppid=29309 vsize=8549492 CPUtime=50.37 cores=0,2,4,6
/proc/29311/stat : 29311 (java) T 29309 29311 29311 0 -1 4202496 296503 0 1 0 5006 31 0 0 18 0 19 0 869386156 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216450021 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/29311/statm: 2137373 253605 2248 9 0 2128114 0
[pid=29311/tid=29312] ppid=29309 vsize=8549492 CPUtime=48.21 cores=0,2,4,6
/proc/29311/task/29312/stat : 29312 (java) T 29309 29311 29311 0 -1 4202560 247280 0 1 0 4797 24 0 0 25 0 19 0 869386157 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 46912505878825 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 8
[pid=29311/tid=29313] ppid=29309 vsize=8549492 CPUtime=0.05 cores=0,2,4,6
/proc/29311/task/29313/stat : 29313 (java) T 29309 29311 29311 0 -1 4202560 4631 0 0 0 5 0 0 0 15 0 19 0 869386158 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463257 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=29311/tid=29314] ppid=29309 vsize=8549492 CPUtime=0.09 cores=0,2,4,6
/proc/29311/task/29314/stat : 29314 (java) T 29309 29311 29311 0 -1 4202560 7511 0 0 0 9 0 0 0 15 0 19 0 869386158 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463257 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=29311/tid=29315] ppid=29309 vsize=8549492 CPUtime=0.06 cores=0,2,4,6
/proc/29311/task/29315/stat : 29315 (java) T 29309 29311 29311 0 -1 4202560 2985 0 0 0 6 0 0 0 15 0 19 0 869386158 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463257 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=29311/tid=29316] ppid=29309 vsize=8549492 CPUtime=0.05 cores=0,2,4,6
/proc/29311/task/29316/stat : 29316 (java) T 29309 29311 29311 0 -1 4202560 3538 0 0 0 5 0 0 0 15 0 19 0 869386158 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463257 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=29311/tid=29317] ppid=29309 vsize=8549492 CPUtime=0.06 cores=0,2,4,6
/proc/29311/task/29317/stat : 29317 (java) T 29309 29311 29311 0 -1 4202560 4546 0 0 0 6 0 0 0 15 0 19 0 869386158 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463257 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=29311/tid=29318] ppid=29309 vsize=8549492 CPUtime=0.06 cores=0,2,4,6
/proc/29311/task/29318/stat : 29318 (java) T 29309 29311 29311 0 -1 4202560 4341 0 0 0 6 0 0 0 15 0 19 0 869386158 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463257 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=29311/tid=29319] ppid=29309 vsize=8549492 CPUtime=0.1 cores=0,2,4,6
/proc/29311/task/29319/stat : 29319 (java) T 29309 29311 29311 0 -1 4202560 6145 0 0 0 10 0 0 0 15 0 19 0 869386158 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463257 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=29311/tid=29320] ppid=29309 vsize=8549492 CPUtime=0.06 cores=0,2,4,6
/proc/29311/task/29320/stat : 29320 (java) T 29309 29311 29311 0 -1 4202560 3702 0 0 0 6 0 0 0 15 0 19 0 869386158 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463257 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=29311/tid=29321] ppid=29309 vsize=8549492 CPUtime=0.01 cores=0,2,4,6
/proc/29311/task/29321/stat : 29321 (java) T 29309 29311 29311 0 -1 4202560 449 0 0 0 0 1 0 0 15 0 19 0 869386159 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463872 0 0 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=29311/tid=29322] ppid=29309 vsize=8549492 CPUtime=0 cores=0,2,4,6
/proc/29311/task/29322/stat : 29322 (java) T 29309 29311 29311 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869386159 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463257 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=29311/tid=29323] ppid=29309 vsize=8549492 CPUtime=0 cores=0,2,4,6
/proc/29311/task/29323/stat : 29323 (java) T 29309 29311 29311 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869386159 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463257 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=29311/tid=29324] ppid=29309 vsize=8549492 CPUtime=0 cores=0,2,4,6
/proc/29311/task/29324/stat : 29324 (java) T 29309 29311 29311 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869386162 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216470961 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=29311/tid=29325] ppid=29309 vsize=8549492 CPUtime=0.7 cores=0,2,4,6
/proc/29311/task/29325/stat : 29325 (java) T 29309 29311 29311 0 -1 4202560 4087 0 0 0 70 0 0 0 15 0 19 0 869386162 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463257 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=29311/tid=29326] ppid=29309 vsize=8549492 CPUtime=0.79 cores=0,2,4,6
/proc/29311/task/29326/stat : 29326 (java) T 29309 29311 29311 0 -1 4202560 5881 0 0 0 79 0 0 0 15 0 19 0 869386162 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463257 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=29311/tid=29327] ppid=29309 vsize=8549492 CPUtime=0 cores=0,2,4,6
/proc/29311/task/29327/stat : 29327 (java) T 29309 29311 29311 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869386162 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463257 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=29311/tid=29328] ppid=29309 vsize=8549492 CPUtime=0 cores=0,2,4,6
/proc/29311/task/29328/stat : 29328 (java) T 29309 29311 29311 0 -1 4202560 9 0 0 0 0 0 0 0 15 0 19 0 869386162 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463872 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=29311/tid=29329] ppid=29309 vsize=8549492 CPUtime=0 cores=0,2,4,6
/proc/29311/task/29329/stat : 29329 (java) T 29309 29311 29311 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869386193 8754679808 253605 33554432000 1073741824 1073778376 140733891184928 18446744073709551615 210216463872 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=29309/tid=29331] ppid=29266 vsize=325228 CPUtime=0 cores=0,2,4,6
/proc/29309/task/29331/stat : 29331 (python) S 29266 29266 28679 0 -1 4202560 50 0 0 0 0 0 0 0 16 0 2 0 869391012 333033472 5986 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554946 18446604452872200512 0 0 -1 4 0 0 0
[pid=29340] ppid=29266 vsize=335484 CPUtime=0.2 cores=0,2,4,6
/proc/29340/stat : 29340 (python) S 29266 29266 28679 0 -1 4202560 1164 0 0 0 9 11 0 0 19 0 2 0 869409590 343535616 6015 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554946 18446744073709551615 0 0 17 4 0 0 0
/proc/29340/statm: 83871 6015 391 364 0 18743 0
[pid=29342] ppid=29340 vsize=61820 CPUtime=47.37 cores=0,2,4,6
/proc/29342/stat : 29342 (bsolo_pb10) T 29340 29342 29342 0 -1 4202496 13312 0 0 0 4732 5 0 0 25 0 1 0 869409590 63303680 13014 33554432000 134512640 137138936 4291768416 18446744073709551615 134542508 0 0 16781312 16384 18446744071562691360 0 0 17 0 0 0 0
/proc/29342/statm: 15455 13014 192 642 0 14811 0
[pid=29340/tid=29345] ppid=29266 vsize=335484 CPUtime=0 cores=0,2,4,6
/proc/29340/task/29345/stat : 29345 (python) S 29266 29266 28679 0 -1 4202560 47 0 0 0 0 0 0 0 19 0 2 0 869414328 343535616 6015 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554946 18446604444355495232 0 0 -1 4 0 0 0
[pid=29452] ppid=29266 vsize=345740 CPUtime=0.4 cores=0,2,4,6
/proc/29452/stat : 29452 (python) S 29266 29266 28679 0 -1 4202560 1164 0 0 0 20 20 0 0 19 0 2 0 869455426 354037760 6022 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/29452/statm: 86435 6022 391 364 0 21304 0
[pid=29454] ppid=29452 vsize=153756 CPUtime=92.43 cores=0,2,4,6
/proc/29454/stat : 29454 (bsolo_pb10) T 29452 29454 29454 0 -1 4202496 36298 0 0 0 9228 15 0 0 25 0 1 0 869455427 157446144 35998 33554432000 134512640 137138936 4294657712 18446744073709551615 134542233 0 0 16781312 16384 18446744071562691360 0 0 17 0 0 0 0
/proc/29454/statm: 38439 35998 190 642 0 37795 0
[pid=29452/tid=29458] ppid=29266 vsize=345740 CPUtime=0 cores=0,2,4,6
/proc/29452/task/29458/stat : 29458 (python) S 29266 29266 28679 0 -1 4202560 48 0 0 0 0 0 0 0 19 0 2 0 869464683 354037760 6022 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554946 18446604443473909056 0 0 -1 0 0 0 0
[pid=29459] ppid=29266 vsize=355996 CPUtime=0.2 cores=0,2,4,6
/proc/29459/stat : 29459 (python) S 29266 29266 28679 0 -1 4202560 1206 0 0 0 11 9 0 0 19 0 2 0 869464704 364539904 6032 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/29459/statm: 88999 6032 397 364 0 23865 0
[pid=29461] ppid=29459 vsize=66692 CPUtime=48.26 cores=0,2,4,6
/proc/29461/stat : 29461 (minion) T 29459 29461 29461 0 -1 4202496 9792 0 0 0 4825 1 0 0 25 0 1 0 869464705 68292608 9410 33554432000 134512640 165565024 4293172896 18446744073709551615 142765004 0 0 16781312 8396802 18446744071562691360 0 0 17 0 0 0 0
/proc/29461/statm: 16673 9410 359 7582 0 9088 0
[pid=29459/tid=29463] ppid=29266 vsize=355996 CPUtime=0 cores=0,2,4,6
/proc/29459/task/29463/stat : 29463 (python) S 29266 29266 28679 0 -1 4202560 44 0 0 0 0 0 0 0 19 0 2 0 869469532 364539904 6032 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554946 18446604452666030272 0 0 -1 6 0 0 0
[pid=29593] ppid=29266 vsize=366388 CPUtime=0.21 cores=0,2,4,6
/proc/29593/stat : 29593 (python) S 29266 29266 28679 0 -1 4202560 1179 0 0 0 11 10 0 0 19 0 2 0 869524611 375181312 6067 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216474059 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/29593/statm: 91597 6067 397 364 0 26460 0
[pid=29595] ppid=29593 vsize=100632 CPUtime=48.34 cores=0,2,4,6
/proc/29595/stat : 29595 (bsolo_pb10) T 29593 29595 29595 0 -1 4202496 23018 0 0 0 4814 20 0 0 25 0 1 0 869524611 103047168 22720 33554432000 134512640 137138936 4294653152 18446744073709551615 136505225 0 0 16781312 16384 18446744071562691360 0 0 17 4 0 0 0
/proc/29595/statm: 25158 22720 192 642 0 24514 0
[pid=29593/tid=29597] ppid=29266 vsize=366388 CPUtime=0 cores=0,2,4,6
/proc/29593/task/29597/stat : 29597 (python) S 29266 29266 28679 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 869529446 375181312 6067 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554946 18446604450340766848 0 0 -1 4 0 0 0
[pid=29598] ppid=29266 vsize=376644 CPUtime=0.31 cores=0,2,4,6
/proc/29598/stat : 29598 (python) S 29266 29266 28679 0 -1 4202560 994 0 0 0 14 17 0 0 15 0 1 0 869529447 385683456 6017 33554432000 4194304 5683644 140733755202960 18446744073709551615 210204667462 0 0 16781312 33554946 72556772316949304 0 0 17 6 0 0 0
/proc/29598/statm: 94161 6017 344 364 0 29021 0
[pid=29600] ppid=29598 vsize=180656 CPUtime=71.83 cores=0,2,4,6
/proc/29600/stat : 29600 (wbo1.4a) R 29598 29600 29600 0 -1 4202496 44928 0 0 0 7127 56 0 0 25 0 1 0 869529447 184991744 44636 33554432000 134512640 135751879 4287768160 18446744073709551615 134611297 0 0 16781312 3 0 0 0 17 0 0 0 0
/proc/29600/statm: 45164 44636 143 303 0 44859 0
[pid=29266/tid=29274] ppid=29264 vsize=386888 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29274/stat : 29274 (python) S 29264 29266 28679 0 -1 4202560 36 1329 0 0 0 0 2 0 18 0 11 0 869357599 396173312 7567 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 6 0 0 0
[pid=29266/tid=29279] ppid=29264 vsize=386888 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29279/stat : 29279 (python) S 29264 29266 28679 0 -1 4202560 45 1329 0 0 0 0 2 0 18 0 11 0 869362222 396173312 7567 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 0 0 0 0
[pid=29266/tid=29294] ppid=29264 vsize=386888 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29294/stat : 29294 (python) S 29264 29266 28679 0 -1 4202560 34 1329 0 0 0 0 2 0 18 0 11 0 869366843 396173312 7567 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 0 0 0 0
[pid=29266/tid=29300] ppid=29264 vsize=386888 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29300/stat : 29300 (python) S 29264 29266 28679 0 -1 4202560 28 1329 0 0 0 0 2 0 20 0 11 0 869376446 396173312 7567 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 0 0 0 0
[pid=29266/tid=29310] ppid=29264 vsize=386888 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29310/stat : 29310 (python) S 29264 29266 28679 0 -1 4202560 28 1329 0 0 0 0 2 0 20 0 11 0 869386156 396173312 7567 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 4 0 0 0
[pid=29266/tid=29341] ppid=29264 vsize=386888 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29341/stat : 29341 (python) S 29264 29266 28679 0 -1 4202560 31 1329 0 0 0 0 2 0 20 0 11 0 869409590 396173312 7567 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 2 0 0 0
[pid=29266/tid=29453] ppid=29264 vsize=386888 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29453/stat : 29453 (python) S 29264 29266 28679 0 -1 4202560 32 1329 0 0 0 0 2 0 20 0 11 0 869455426 396173312 7567 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 6 0 0 0
[pid=29266/tid=29460] ppid=29264 vsize=386888 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29460/stat : 29460 (python) S 29264 29266 28679 0 -1 4202560 29 1329 0 0 0 0 2 0 20 0 11 0 869464704 396173312 7567 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 0 0 0 0
[pid=29266/tid=29594] ppid=29264 vsize=386888 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29594/stat : 29594 (python) S 29264 29266 28679 0 -1 4202560 29 1329 0 0 0 0 2 0 20 0 11 0 869524611 396173312 7567 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 6 0 0 0
[pid=29266/tid=29599] ppid=29264 vsize=386888 CPUtime=0.02 cores=0,2,4,6
/proc/29266/task/29599/stat : 29599 (python) S 29264 29266 28679 0 -1 4202560 26 1329 0 0 0 0 2 0 20 0 11 0 869529447 396173312 7567 33554432000 4194304 5683644 140733755202960 18446744073709551615 210216470961 0 0 16781312 33554434 18446604449318749504 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 13008672

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29266 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=901862
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=155976
# CPU time returned by wait4() is 1.05784
# while last known CPU time is 1800.06
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1791.29
CPU time (s): 1800.06
CPU user time (s): 1785.84
CPU system time (s): 14.22
CPU usage (%): 100.49
Max. virtual memory (cumulated for all children) (KiB): 13008672

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.901862
system time used= 0.155976
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 20509
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4039
involuntary context switches= 38

runsolver used 14.9677 second user time and 30.0024 second system time

The end

Launcher Data 

Begin job on node130 at 2011-06-09 01:59:49
IDJOB=3482405
IDBENCH=48366
IDSOLVER=1971
FILE ID=node130/3482405-1307577589
RUNJOBID= node130-1307576356-28697
PBS_JOBID= 13547669
Free space on /tmp= 73796 MiB

SOLVER NAME= borg pb-dec-11.04.03
BENCH NAME= PB07/normalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/manquinho/dbsg/normalized-dbsg_100_10_3_40.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482405-1307577589/watcher-3482405-1307577589 -o /tmp/evaluation-result-3482405-1307577589/solver-3482405-1307577589 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482405-1307577589.opb -seed 40093950 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 29fd031d19832e8fd3e4ee8a0dfa62d0
RANDOM SEED=40093950

node130.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.838
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21645816 kB
Buffers:        153512 kB
Cached:         549832 kB
SwapCached:      10812 kB
Active:       10859576 kB
Inactive:       168060 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21645816 kB
SwapTotal:    67111528 kB
SwapFree:     63649284 kB
Dirty:          102004 kB
Writeback:           0 kB
AnonPages:    10321916 kB
Mapped:          62436 kB
Slab:           138192 kB
PageTables:      70192 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 151549864 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73676 MiB
End job on node130 at 2011-06-09 02:29:43