Trace number 3482399

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-dec-11.04.03? (TO) 1800.07 1791.16

General information on the benchmark

Namenormalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/
manquinho/dbsg/normalized-dbsg_500_60_1_80.opb
MD5SUM8096e07164eab6008a97823c6b00b555
Bench CategoryDEC-SMALLINT-NLC (no optimisation, small integers, non linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables1000
Total number of constraints1502
Number of constraints which are clauses500
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints1001
Minimum length of a constraint2
Maximum length of a constraint1000
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 80
Number of bits of the biggest number in a constraint 7
Biggest sum of numbers in a constraint 1000
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)74732
Sum of products size (including duplicates)149464
Number of different products37366
Sum of products size74732

Solver Data 

0.32/0.64	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.32/0.64	c INFO: solving HOME/instance-3482399-1307577101.opb
1.05/1.21	c INFO: wrote linearized instance to HOME/tmpk2BctU.opb
1.67/1.76	c INFO: parsing took 0.54 s
2.78/2.85	c INFO: features took 1.08 CPU seconds
2.78/2.87	c INFO: running wbo1.4b-fixed@0 for 45 with 1797 remaining (b = 0.22)
49.41/49.23	c INFO: running scip-2.0.1-spx@0 for 45 with 1751 remaining (b = 0.04)
97.78/97.49	c INFO: running scip-2.0.1-clp@0 for 45 with 1704 remaining (b = 0.02)
145.21/144.69	c INFO: running clasp-1.3.7@0 for 45 with 1657 remaining (b = 0.02)
193.72/192.96	c INFO: running scip-2.0.1-clp@46 for 45 with 1609 remaining (b = 0.01)
240.30/239.22	c INFO: running clasp-1.3.7@48 for 45 with 1563 remaining (b = 0.01)
285.71/284.49	c INFO: running clasp-1.3.7@93 for 136 with 1518 remaining (b = 0.02)
424.12/422.18	c INFO: running scip-2.0.1-spx@47 for 45 with 1380 remaining (b = 0.01)
469.67/467.46	c INFO: running scip-2.0.1-spx@93 for 410 with 1335 remaining (b = 0.06)
886.73/882.45	c INFO: running bsolo_pb10-l1@0 for 91 with 922 remaining (b = 0.01)
979.04/974.23	c INFO: running scip-2.0.1-spx@505 for 547 with 830 remaining (b = 0.05)
1532.68/1525.14	c INFO: running wbo1.4a@0 for 45 with 282 remaining (b = 0.00)
1579.91/1572.19	c INFO: running scip-2.0.1-spx@1053 for 235 with 235 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482399-1307577101/watcher-3482399-1307577101 -o /tmp/evaluation-result-3482399-1307577101/solver-3482399-1307577101 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482399-1307577101.opb -seed 2097467692 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.01 1.88 1.12 2/615 5545
/proc/meminfo: memFree=21258948/32951124 swapFree=58940260/67111528
[pid=5545] ppid=5543 vsize=15764 CPUtime=0 cores=1,3,5,7
/proc/5545/stat : 5545 (python) R 5543 5545 4282 0 -1 4202496 846 0 0 0 0 0 0 0 25 0 1 0 869307960 16142336 728 33554432000 4194304 5683644 140736630882208 18446744073709551615 212687673344 0 2147483391 16781312 2 0 0 0 17 5 0 0 0
/proc/5545/statm: 3941 728 334 364 0 428 0

[startup+0.109321 s]
/proc/loadavg: 2.01 1.88 1.12 2/615 5545
/proc/meminfo: memFree=21258948/32951124 swapFree=58940260/67111528
[pid=5545] ppid=5543 vsize=85360 CPUtime=0.05 cores=1,3,5,7
/proc/5545/stat : 5545 (python) D 5543 5545 4282 0 -1 4202496 2586 0 0 0 4 1 0 0 17 0 1 0 869307960 87408640 2310 33554432000 4194304 5683644 140736630882208 18446744073709551615 212687681079 0 0 16781312 2 18446744071562154983 0 0 17 7 0 0 0
/proc/5545/statm: 21340 2310 709 364 0 1557 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85360

[startup+0.200303 s]
/proc/loadavg: 2.01 1.88 1.12 2/615 5545
/proc/meminfo: memFree=21258948/32951124 swapFree=58940260/67111528
[pid=5545] ppid=5543 vsize=85360 CPUtime=0.05 cores=1,3,5,7
/proc/5545/stat : 5545 (python) D 5543 5545 4282 0 -1 4202496 2586 0 0 0 4 1 0 0 17 0 1 0 869307960 87408640 2310 33554432000 4194304 5683644 140736630882208 18446744073709551615 212687681079 0 0 16781312 2 18446744071562154983 0 0 17 7 0 0 0
/proc/5545/statm: 21340 2310 709 364 0 1557 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 85360

[startup+0.300246 s]
/proc/loadavg: 2.01 1.88 1.12 2/615 5545
/proc/meminfo: memFree=21258948/32951124 swapFree=58940260/67111528
[pid=5545] ppid=5543 vsize=106648 CPUtime=0.1 cores=1,3,5,7
/proc/5545/stat : 5545 (python) S 5543 5545 4282 0 -1 4202496 4305 929 1 0 8 2 0 0 17 0 1 0 869307960 109207552 2829 33554432000 4194304 5683644 140736630882208 18446744073709551615 212682751623 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 16
/proc/5545/statm: 26662 2829 871 364 0 1910 0
Current children cumulated CPU time (s) 0.1
Current children cumulated vsize (KiB) 106648

[startup+0.70523 s]
/proc/loadavg: 2.01 1.88 1.12 2/615 5545
/proc/meminfo: memFree=21258948/32951124 swapFree=58940260/67111528
[pid=5545] ppid=5543 vsize=282536 CPUtime=0.36 cores=1,3,5,7
/proc/5545/stat : 5545 (python) S 5543 5545 4282 0 -1 4202496 9237 929 1 0 29 7 0 0 17 0 1 0 869307960 289316864 6968 33554432000 4194304 5683644 140736630882208 18446744073709551615 212687695375 0 0 16781312 2 2105955390171643904 0 0 17 7 0 0 16
/proc/5545/statm: 70634 6968 1777 364 0 5527 0
Current children cumulated CPU time (s) 0.36
Current children cumulated vsize (KiB) 282536

[startup+1.50106 s]
/proc/loadavg: 2.01 1.88 1.12 4/617 5551
/proc/meminfo: memFree=21228416/32951124 swapFree=58940260/67111528
[pid=5545] ppid=5543 vsize=298268 CPUtime=1.47 cores=1,3,5,7
/proc/5545/stat : 5545 (python) R 5543 5545 4282 0 -1 4202496 14895 1587 1 0 64 32 40 11 16 0 1 0 869307960 305426432 10815 33554432000 4194304 5683644 140736630882208 18446744073709551615 4539725 0 0 16781312 2 0 0 0 17 5 0 0 16
/proc/5545/statm: 74567 10815 1782 364 0 9460 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 298268

[startup+3.10073 s]
/proc/loadavg: 2.01 1.88 1.12 3/616 5551
/proc/meminfo: memFree=21211568/32951124 swapFree=58940260/67111528
[pid=5545] ppid=5543 vsize=315148 CPUtime=2.86 cores=1,3,5,7
/proc/5545/stat : 5545 (python) S 5543 5545 4282 0 -1 4202496 21959 1587 1 0 202 33 40 11 19 0 2 0 869307960 322711552 12629 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 16
/proc/5545/statm: 78787 12629 1873 364 0 13674 0
Current children cumulated CPU time (s) 2.86
Current children cumulated vsize (KiB) 315148

[startup+6.30115 s]
/proc/loadavg: 2.00 1.88 1.13 3/619 5555
/proc/meminfo: memFree=21185876/32951124 swapFree=58940260/67111528
[pid=5545] ppid=5543 vsize=315148 CPUtime=2.86 cores=1,3,5,7
/proc/5545/stat : 5545 (python) S 5543 5545 4282 0 -1 4202496 21959 1587 1 0 202 33 40 11 19 0 2 0 869307960 322711552 12629 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 16
/proc/5545/statm: 78787 12629 1873 364 0 13674 0
[pid=5552] ppid=5545 vsize=304904 CPUtime=0.02 cores=1,3,5,7
/proc/5552/stat : 5552 (python) S 5545 5545 4282 0 -1 4202560 871 0 0 0 1 1 0 0 15 0 1 0 869308248 312221696 11094 33554432000 4194304 5683644 140736630882208 18446744073709551615 212687695375 0 0 16781312 33554946 4294934789 0 0 17 5 0 0 0
/proc/5552/statm: 76226 11094 342 364 0 11113 0
[pid=5554] ppid=5552 vsize=26932 CPUtime=3.41 cores=1,3,5,7
/proc/5554/stat : 5554 (wbo1.4b-fixed) R 5552 5554 5554 0 -1 4202496 7266 0 0 0 337 4 0 0 25 0 1 0 869308248 27578368 6072 33554432000 134512640 135752315 4287599760 18446744073709551615 135270849 0 0 16781312 3 0 0 0 17 7 0 0 0
/proc/5554/statm: 6733 6072 146 303 0 6428 0
[pid=5545/tid=5553] ppid=5543 vsize=315148 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5553/stat : 5553 (python) S 5543 5545 4282 0 -1 4202560 27 1587 0 0 0 0 40 11 19 0 2 0 869308248 322711552 12629 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 646984

[startup+12.701 s]
/proc/loadavg: 2.00 1.88 1.13 3/619 5555
/proc/meminfo: memFree=21178016/32951124 swapFree=58940260/67111528
[pid=5545] ppid=5543 vsize=315148 CPUtime=2.86 cores=1,3,5,7
/proc/5545/stat : 5545 (python) S 5543 5545 4282 0 -1 4202496 21959 1587 1 0 202 33 40 11 19 0 2 0 869307960 322711552 12629 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 16
/proc/5545/statm: 78787 12629 1873 364 0 13674 0
[pid=5552] ppid=5545 vsize=304904 CPUtime=0.04 cores=1,3,5,7
/proc/5552/stat : 5552 (python) S 5545 5545 4282 0 -1 4202560 980 0 0 0 2 2 0 0 15 0 1 0 869308248 312221696 11099 33554432000 4194304 5683644 140736630882208 18446744073709551615 212687695375 0 0 16781312 33554946 4294934789 0 0 17 7 0 0 0
/proc/5552/statm: 76226 11099 347 364 0 11113 0
[pid=5554] ppid=5552 vsize=33532 CPUtime=9.81 cores=1,3,5,7
/proc/5554/stat : 5554 (wbo1.4b-fixed) R 5552 5554 5554 0 -1 4202496 8918 0 0 0 970 11 0 0 25 0 1 0 869308248 34336768 7724 33554432000 134512640 135752315 4287599760 18446744073709551615 134605012 0 0 16781312 3 0 0 0 17 1 0 0 0
/proc/5554/statm: 8383 7724 146 303 0 8078 0
[pid=5545/tid=5553] ppid=5543 vsize=315148 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5553/stat : 5553 (python) S 5543 5545 4282 0 -1 4202560 27 1587 0 0 0 0 40 11 19 0 2 0 869308248 322711552 12629 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 12.71
Current children cumulated vsize (KiB) 653584

[startup+25.5007 s]
/proc/loadavg: 2.00 1.89 1.15 3/619 5555
/proc/meminfo: memFree=21168232/32951124 swapFree=58940260/67111528
[pid=5545] ppid=5543 vsize=315148 CPUtime=2.86 cores=1,3,5,7
/proc/5545/stat : 5545 (python) S 5543 5545 4282 0 -1 4202496 21959 1587 1 0 202 33 40 11 19 0 2 0 869307960 322711552 12629 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554434 18446744073709551615 0 0 17 7 0 0 16
/proc/5545/statm: 78787 12629 1873 364 0 13674 0
[pid=5552] ppid=5545 vsize=304904 CPUtime=0.11 cores=1,3,5,7
/proc/5552/stat : 5552 (python) S 5545 5545 4282 0 -1 4202560 986 0 0 0 4 7 0 0 15 0 1 0 869308248 312221696 11099 33554432000 4194304 5683644 140736630882208 18446744073709551615 212687695375 0 0 16781312 33554946 5623753486446373698 0 0 17 7 0 0 0
/proc/5552/statm: 76226 11099 347 364 0 11113 0
[pid=5554] ppid=5552 vsize=43988 CPUtime=22.6 cores=1,3,5,7
/proc/5554/stat : 5554 (wbo1.4b-fixed) R 5552 5554 5554 0 -1 4202496 11536 0 0 0 2246 14 0 0 25 0 1 0 869308248 45043712 10342 33554432000 134512640 135752315 4287599760 18446744073709551615 134637627 0 0 16781312 3 0 0 0 17 1 0 0 0
/proc/5554/statm: 10997 10342 146 303 0 10692 0
[pid=5545/tid=5553] ppid=5543 vsize=315148 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5553/stat : 5553 (python) S 5543 5545 4282 0 -1 4202560 27 1587 0 0 0 0 40 11 19 0 2 0 869308248 322711552 12629 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 25.57
Current children cumulated vsize (KiB) 664040

[startup+51.101 s]
/proc/loadavg: 2.00 1.90 1.17 3/623 5560
/proc/meminfo: memFree=21003164/32951124 swapFree=58940260/67111528
[pid=5545] ppid=5543 vsize=325404 CPUtime=2.88 cores=1,3,5,7
/proc/5545/stat : 5545 (python) S 5543 5545 4282 0 -1 4202496 22856 1587 1 0 204 33 40 11 19 0 3 0 869307960 333213696 12636 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 16
/proc/5545/statm: 81351 12636 1876 364 0 16235 0
[pid=5552] ppid=5545 vsize=315148 CPUtime=0.23 cores=1,3,5,7
/proc/5552/stat : 5552 (python) S 5545 5545 4282 0 -1 4202560 1170 0 0 0 9 14 0 0 16 0 2 0 869308248 322711552 11167 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/5552/statm: 78787 11167 410 364 0 13674 0
[pid=5554] ppid=5552 vsize=68936 CPUtime=46.32 cores=1,3,5,7
/proc/5554/stat : 5554 (wbo1.4b-fixed) T 5552 5554 5554 0 -1 4202496 17768 0 0 0 4614 18 0 0 25 0 1 0 869308248 70590464 16574 33554432000 134512640 135752315 4287599760 18446744073709551615 134637616 0 0 16781312 3 18446744071562691360 0 0 17 1 0 0 0
/proc/5554/statm: 17234 16574 146 303 0 16929 0
[pid=5552/tid=5557] ppid=5545 vsize=315148 CPUtime=0 cores=1,3,5,7
/proc/5552/task/5557/stat : 5557 (python) S 5545 5545 4282 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 869312881 322711552 11167 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604468378725312 0 0 -1 1 0 0 0
[pid=5558] ppid=5545 vsize=315160 CPUtime=0 cores=1,3,5,7
/proc/5558/stat : 5558 (python) S 5545 5545 4282 0 -1 4202560 746 0 0 0 0 0 0 0 15 0 1 0 869312884 322723840 11075 33554432000 4194304 5683644 140736630882208 18446744073709551615 212687695430 0 0 16781312 33554946 4294934790 0 0 17 1 0 0 0
/proc/5558/statm: 78790 11075 319 364 0 13674 0
[pid=5560] ppid=5558 vsize=218364 CPUtime=1.84 cores=1,3,5,7
/proc/5560/stat : 5560 (scip-2.0.1.linu) R 5558 5560 5560 0 -1 4202496 53510 0 0 0 159 25 0 0 25 0 1 0 869312884 223604736 51750 33554432000 4194304 13684479 140737135650752 18446744073709551615 4369853 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/5560/statm: 54655 51755 682 2317 0 52333 0
[pid=5545/tid=5553] ppid=5543 vsize=325404 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5553/stat : 5553 (python) S 5543 5545 4282 0 -1 4202560 27 1587 0 0 0 0 40 11 19 0 3 0 869308248 333213696 12636 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 7 0 0 0
[pid=5545/tid=5559] ppid=5543 vsize=325404 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5559/stat : 5559 (python) S 5543 5545 4282 0 -1 4202560 29 1587 0 0 0 0 40 11 20 0 3 0 869312884 333213696 12636 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 51.27
Current children cumulated vsize (KiB) 1243012

[startup+102.302 s]
/proc/loadavg: 2.00 1.91 1.21 3/627 5565
/proc/meminfo: memFree=20495868/32951124 swapFree=58940260/67111528
[pid=5545] ppid=5543 vsize=335660 CPUtime=2.9 cores=1,3,5,7
/proc/5545/stat : 5545 (python) S 5543 5545 4282 0 -1 4202496 23763 1587 1 0 206 33 40 11 20 0 4 0 869307960 343715840 12642 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 16
/proc/5545/statm: 83915 12642 1878 364 0 18796 0
[pid=5552] ppid=5545 vsize=315148 CPUtime=0.23 cores=1,3,5,7
/proc/5552/stat : 5552 (python) S 5545 5545 4282 0 -1 4202560 1170 0 0 0 9 14 0 0 16 0 2 0 869308248 322711552 11167 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/5552/statm: 78787 11167 410 364 0 13674 0
[pid=5554] ppid=5552 vsize=68936 CPUtime=46.32 cores=1,3,5,7
/proc/5554/stat : 5554 (wbo1.4b-fixed) T 5552 5554 5554 0 -1 4202496 17768 0 0 0 4614 18 0 0 25 0 1 0 869308248 70590464 16574 33554432000 134512640 135752315 4287599760 18446744073709551615 134637616 0 0 16781312 3 18446744071562691360 0 0 17 1 0 0 0
/proc/5554/statm: 17234 16574 146 303 0 16929 0
[pid=5552/tid=5557] ppid=5545 vsize=315148 CPUtime=0 cores=1,3,5,7
/proc/5552/task/5557/stat : 5557 (python) S 5545 5545 4282 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 869312881 322711552 11167 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604468378725312 0 0 -1 1 0 0 0
[pid=5558] ppid=5545 vsize=315160 CPUtime=0.24 cores=1,3,5,7
/proc/5558/stat : 5558 (python) S 5545 5545 4282 0 -1 4202560 1113 0 0 0 11 13 0 0 16 0 2 0 869312884 322723840 11147 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/5558/statm: 78790 11147 390 364 0 13674 0
[pid=5560] ppid=5558 vsize=351364 CPUtime=48.21 cores=1,3,5,7
/proc/5560/stat : 5560 (scip-2.0.1.linu) T 5558 5560 5560 0 -1 4202496 89366 0 0 0 4782 39 0 0 25 0 1 0 869312884 359796736 84044 33554432000 4194304 13684479 140737135650752 18446744073709551615 7390848 0 0 16781312 2 18446744071562691360 0 0 17 3 0 0 0
/proc/5560/statm: 87841 84044 764 2317 0 85519 0
[pid=5558/tid=5562] ppid=5545 vsize=315160 CPUtime=0 cores=1,3,5,7
/proc/5558/task/5562/stat : 5562 (python) S 5545 5545 4282 0 -1 4202560 53 0 0 0 0 0 0 0 16 0 2 0 869317707 322723840 11147 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604456121756544 0 0 -1 7 0 0 0
[pid=5563] ppid=5545 vsize=325416 CPUtime=0.02 cores=1,3,5,7
/proc/5563/stat : 5563 (python) S 5545 5545 4282 0 -1 4202560 919 0 0 0 1 1 0 0 15 0 1 0 869317709 333225984 11103 33554432000 4194304 5683644 140736630882208 18446744073709551615 212687695430 0 0 16781312 33554946 17967571722299212038 0 0 17 3 0 0 0
/proc/5563/statm: 81354 11103 343 364 0 16235 0
[pid=5565] ppid=5563 vsize=354492 CPUtime=4.79 cores=1,3,5,7
/proc/5565/stat : 5565 (scip-2.0.1.linu) R 5563 5565 5565 0 -1 4202496 83029 0 0 0 444 35 0 0 25 0 1 0 869317710 362999808 76264 33554432000 4194304 15243407 140734170709200 18446744073709551615 13354455 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/5565/statm: 88623 76264 867 2698 0 85918 0
[pid=5545/tid=5553] ppid=5543 vsize=335660 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5553/stat : 5553 (python) S 5543 5545 4282 0 -1 4202560 27 1587 0 0 0 0 40 11 19 0 4 0 869308248 343715840 12642 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 7 0 0 0
[pid=5545/tid=5559] ppid=5543 vsize=335660 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5559/stat : 5559 (python) S 5543 5545 4282 0 -1 4202560 29 1587 0 0 0 0 40 11 20 0 4 0 869312884 343715840 12642 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 1 0 0 0
[pid=5545/tid=5564] ppid=5543 vsize=335660 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5564/stat : 5564 (python) S 5543 5545 4282 0 -1 4202560 29 1587 0 0 0 0 40 11 20 0 4 0 869317710 343715840 12642 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 102.71
Current children cumulated vsize (KiB) 2066176

[startup+162.301 s]
/proc/loadavg: 2.00 1.92 1.26 3/631 5571
/proc/meminfo: memFree=20178396/32951124 swapFree=58940260/67111528

################
# More data... #
################

/proc/5545/task/5564/stat : 5564 (python) S 5543 5545 4282 0 -1 4202560 32 1587 0 0 0 0 40 11 18 0 7 0 869317710 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 3 0 0 0
[pid=5545/tid=5569] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5569/stat : 5569 (python) S 5543 5545 4282 0 -1 4202560 30 1587 0 0 0 0 40 11 18 0 7 0 869322429 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 3 0 0 0
[pid=5545/tid=5613] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5613/stat : 5613 (python) S 5543 5545 4282 0 -1 4202560 27 1587 0 0 0 0 40 11 20 0 7 0 869396206 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 3 0 0 0
[pid=5545/tid=5686] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5686/stat : 5686 (python) S 5543 5545 4282 0 -1 4202560 29 1587 0 0 0 0 40 11 20 0 7 0 869460475 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1730.92
Current children cumulated vsize (KiB) 3857296

[startup+1782.3 s]
/proc/loadavg: 2.06 2.05 1.89 3/653 5699
/proc/meminfo: memFree=17917180/32951124 swapFree=58940260/67111528
[pid=5545] ppid=5543 vsize=366428 CPUtime=3.09 cores=1,3,5,7
/proc/5545/stat : 5545 (python) S 5543 5545 4282 0 -1 4202496 27279 1587 1 0 224 34 40 11 18 0 7 0 869307960 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 16
/proc/5545/statm: 91607 12660 1884 364 0 26479 0
[pid=5552] ppid=5545 vsize=315148 CPUtime=0.23 cores=1,3,5,7
/proc/5552/stat : 5552 (python) S 5545 5545 4282 0 -1 4202560 1170 0 0 0 9 14 0 0 16 0 2 0 869308248 322711552 11167 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/5552/statm: 78787 11167 410 364 0 13674 0
[pid=5554] ppid=5552 vsize=68936 CPUtime=46.32 cores=1,3,5,7
/proc/5554/stat : 5554 (wbo1.4b-fixed) T 5552 5554 5554 0 -1 4202496 17768 0 0 0 4614 18 0 0 25 0 1 0 869308248 70590464 16574 33554432000 134512640 135752315 4287599760 18446744073709551615 134637616 0 0 16781312 3 18446744071562691360 0 0 17 1 0 0 0
/proc/5554/statm: 17234 16574 146 303 0 16929 0
[pid=5552/tid=5557] ppid=5545 vsize=315148 CPUtime=0 cores=1,3,5,7
/proc/5552/task/5557/stat : 5557 (python) S 5545 5545 4282 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 869312881 322711552 11167 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604468378725312 0 0 -1 1 0 0 0
[pid=5558] ppid=5545 vsize=315160 CPUtime=6.4 cores=1,3,5,7
/proc/5558/stat : 5558 (python) S 5545 5545 4282 0 -1 4202560 1198 0 0 0 298 342 0 0 15 0 2 0 869312884 322723840 11147 33554432000 4194304 5683644 140736630882208 18446744073709551615 212687695430 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/5558/statm: 78790 11147 390 364 0 13674 0
[pid=5560] ppid=5558 vsize=579760 CPUtime=1269.5 cores=1,3,5,7
/proc/5560/stat : 5560 (scip-2.0.1.linu) R 5558 5560 5560 0 -1 4202496 148845 0 0 0 126301 649 0 0 25 0 1 0 869312884 593674240 141875 33554432000 4194304 13684479 140737135650752 18446744073709551615 7430768 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/5560/statm: 144940 141875 846 2317 0 142618 0
[pid=5558/tid=5562] ppid=5545 vsize=315160 CPUtime=0 cores=1,3,5,7
/proc/5558/task/5562/stat : 5562 (python) S 5545 5545 4282 0 -1 4202560 54 0 0 0 0 0 0 0 15 0 2 0 869317707 322723840 11147 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604456121756544 0 0 -1 7 0 0 0
[pid=5563] ppid=5545 vsize=325416 CPUtime=0.48 cores=1,3,5,7
/proc/5563/stat : 5563 (python) S 5545 5545 4282 0 -1 4202560 1154 0 0 0 20 28 0 0 15 0 2 0 869317709 333225984 11151 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/5563/statm: 81354 11151 390 364 0 16235 0
[pid=5565] ppid=5563 vsize=645600 CPUtime=93.4 cores=1,3,5,7
/proc/5565/stat : 5565 (scip-2.0.1.linu) T 5563 5565 5565 0 -1 4202496 191287 0 0 0 9250 90 0 0 25 0 1 0 869317710 661094400 146226 33554432000 4194304 15243407 140734170709200 18446744073709551615 8113811 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/5565/statm: 161400 146226 973 2698 0 158695 0
[pid=5563/tid=5567] ppid=5545 vsize=325416 CPUtime=0 cores=1,3,5,7
/proc/5563/task/5567/stat : 5567 (python) S 5545 5545 4282 0 -1 4202560 51 0 0 0 0 0 0 0 15 0 2 0 869322427 333225984 11151 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604464099580032 0 0 -1 3 0 0 0
[pid=5568] ppid=5545 vsize=335672 CPUtime=1.16 cores=1,3,5,7
/proc/5568/stat : 5568 (python) S 5545 5545 4282 0 -1 4202560 1230 0 0 0 56 60 0 0 15 0 2 0 869322429 343728128 11155 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/5568/statm: 83918 11155 390 364 0 18796 0
[pid=5570] ppid=5568 vsize=105040 CPUtime=231.15 cores=1,3,5,7
/proc/5570/stat : 5570 (clasp-1.3.7-x86) T 5568 5570 5570 0 -1 4202496 26227 0 0 0 23111 4 0 0 25 0 1 0 869322430 107560960 25155 33554432000 134512640 136139019 4293749328 18446744073709551615 134876588 0 0 16781312 16386 18446744071562691360 0 0 17 5 0 0 0
/proc/5570/statm: 26260 25155 183 398 0 25860 0
[pid=5568/tid=5573] ppid=5545 vsize=335672 CPUtime=0 cores=1,3,5,7
/proc/5568/task/5573/stat : 5573 (python) S 5545 5545 4282 0 -1 4202560 57 0 0 0 0 0 0 0 15 0 2 0 869327253 343728128 11155 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604468128017408 0 0 -1 7 0 0 0
[pid=5612] ppid=5545 vsize=345928 CPUtime=0.47 cores=1,3,5,7
/proc/5612/stat : 5612 (python) S 5545 5545 4282 0 -1 4202560 1180 0 0 0 20 27 0 0 16 0 2 0 869396205 354230272 11159 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/5612/statm: 86482 11159 390 364 0 21357 0
[pid=5614] ppid=5612 vsize=33004 CPUtime=91.75 cores=1,3,5,7
/proc/5614/stat : 5614 (bsolo_pb10) T 5612 5614 5614 0 -1 4202496 6813 0 0 0 9172 3 0 0 25 0 1 0 869396206 33796096 5696 33554432000 134512640 137138936 4291731376 18446744073709551615 135984584 0 0 16781312 16384 18446744071562691360 0 0 17 5 0 0 0
/proc/5614/statm: 8251 5696 184 642 0 7607 0
[pid=5612/tid=5617] ppid=5545 vsize=345928 CPUtime=0 cores=1,3,5,7
/proc/5612/task/5617/stat : 5617 (python) S 5545 5545 4282 0 -1 4202560 55 0 0 0 0 0 0 0 16 0 2 0 869405382 354230272 11159 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604460834968000 0 0 -1 5 0 0 0
[pid=5685] ppid=5545 vsize=356184 CPUtime=0.24 cores=1,3,5,7
/proc/5685/stat : 5685 (python) S 5545 5545 4282 0 -1 4202560 1177 0 0 0 10 14 0 0 16 0 2 0 869460475 364732416 11163 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/5685/statm: 89046 11163 390 364 0 23918 0
[pid=5687] ppid=5685 vsize=65020 CPUtime=47.03 cores=1,3,5,7
/proc/5687/stat : 5687 (wbo1.4a) T 5685 5687 5687 0 -1 4202496 16807 0 0 0 4687 16 0 0 25 0 1 0 869460475 66580480 15602 33554432000 134512640 135751879 4294918672 18446744073709551615 134611152 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/5687/statm: 16255 15602 143 303 0 15950 0
[pid=5685/tid=5689] ppid=5545 vsize=356184 CPUtime=0 cores=1,3,5,7
/proc/5685/task/5689/stat : 5689 (python) S 5545 5545 4282 0 -1 4202560 52 0 0 0 0 0 0 0 16 0 2 0 869465179 364732416 11163 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604458537833600 0 0 -1 1 0 0 0
[pid=5545/tid=5553] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5553/stat : 5553 (python) S 5543 5545 4282 0 -1 4202560 27 1587 0 0 0 0 40 11 19 0 7 0 869308248 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 7 0 0 0
[pid=5545/tid=5559] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5559/stat : 5559 (python) S 5543 5545 4282 0 -1 4202560 48 1587 0 0 0 0 40 11 18 0 7 0 869312884 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 1 0 0 0
[pid=5545/tid=5564] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5564/stat : 5564 (python) S 5543 5545 4282 0 -1 4202560 32 1587 0 0 0 0 40 11 18 0 7 0 869317710 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 3 0 0 0
[pid=5545/tid=5569] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5569/stat : 5569 (python) S 5543 5545 4282 0 -1 4202560 30 1587 0 0 0 0 40 11 18 0 7 0 869322429 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 3 0 0 0
[pid=5545/tid=5613] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5613/stat : 5613 (python) S 5543 5545 4282 0 -1 4202560 27 1587 0 0 0 0 40 11 20 0 7 0 869396206 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 3 0 0 0
[pid=5545/tid=5686] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5686/stat : 5686 (python) S 5543 5545 4282 0 -1 4202560 29 1587 0 0 0 0 40 11 20 0 7 0 869460475 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1791.22
Current children cumulated vsize (KiB) 3857296



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1791.1 s]
/proc/loadavg: 2.05 2.05 1.89 3/653 5699
/proc/meminfo: memFree=17891752/32951124 swapFree=58940260/67111528
[pid=5545] ppid=5543 vsize=366428 CPUtime=3.09 cores=1,3,5,7
/proc/5545/stat : 5545 (python) S 5543 5545 4282 0 -1 4202496 27279 1587 1 0 224 34 40 11 18 0 7 0 869307960 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 16
/proc/5545/statm: 91607 12660 1884 364 0 26479 0
[pid=5552] ppid=5545 vsize=315148 CPUtime=0.23 cores=1,3,5,7
/proc/5552/stat : 5552 (python) S 5545 5545 4282 0 -1 4202560 1170 0 0 0 9 14 0 0 16 0 2 0 869308248 322711552 11167 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/5552/statm: 78787 11167 410 364 0 13674 0
[pid=5554] ppid=5552 vsize=68936 CPUtime=46.32 cores=1,3,5,7
/proc/5554/stat : 5554 (wbo1.4b-fixed) T 5552 5554 5554 0 -1 4202496 17768 0 0 0 4614 18 0 0 25 0 1 0 869308248 70590464 16574 33554432000 134512640 135752315 4287599760 18446744073709551615 134637616 0 0 16781312 3 18446744071562691360 0 0 17 1 0 0 0
/proc/5554/statm: 17234 16574 146 303 0 16929 0
[pid=5552/tid=5557] ppid=5545 vsize=315148 CPUtime=0 cores=1,3,5,7
/proc/5552/task/5557/stat : 5557 (python) S 5545 5545 4282 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 869312881 322711552 11167 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604468378725312 0 0 -1 1 0 0 0
[pid=5558] ppid=5545 vsize=315160 CPUtime=6.44 cores=1,3,5,7
/proc/5558/stat : 5558 (python) S 5545 5545 4282 0 -1 4202560 1198 0 0 0 300 344 0 0 15 0 2 0 869312884 322723840 11147 33554432000 4194304 5683644 140736630882208 18446744073709551615 212687695430 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/5558/statm: 78790 11147 390 364 0 13674 0
[pid=5560] ppid=5558 vsize=579760 CPUtime=1278.31 cores=1,3,5,7
/proc/5560/stat : 5560 (scip-2.0.1.linu) R 5558 5560 5560 0 -1 4202496 148845 0 0 0 127178 653 0 0 25 0 1 0 869312884 593674240 141875 33554432000 4194304 13684479 140737135650752 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 3 0 0 0
/proc/5560/statm: 144940 141875 846 2317 0 142618 0
[pid=5558/tid=5562] ppid=5545 vsize=315160 CPUtime=0 cores=1,3,5,7
/proc/5558/task/5562/stat : 5562 (python) S 5545 5545 4282 0 -1 4202560 54 0 0 0 0 0 0 0 15 0 2 0 869317707 322723840 11147 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604456121756544 0 0 -1 7 0 0 0
[pid=5563] ppid=5545 vsize=325416 CPUtime=0.48 cores=1,3,5,7
/proc/5563/stat : 5563 (python) S 5545 5545 4282 0 -1 4202560 1154 0 0 0 20 28 0 0 15 0 2 0 869317709 333225984 11151 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/5563/statm: 81354 11151 390 364 0 16235 0
[pid=5565] ppid=5563 vsize=645600 CPUtime=93.4 cores=1,3,5,7
/proc/5565/stat : 5565 (scip-2.0.1.linu) T 5563 5565 5565 0 -1 4202496 191287 0 0 0 9250 90 0 0 25 0 1 0 869317710 661094400 146226 33554432000 4194304 15243407 140734170709200 18446744073709551615 8113811 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/5565/statm: 161400 146226 973 2698 0 158695 0
[pid=5563/tid=5567] ppid=5545 vsize=325416 CPUtime=0 cores=1,3,5,7
/proc/5563/task/5567/stat : 5567 (python) S 5545 5545 4282 0 -1 4202560 51 0 0 0 0 0 0 0 15 0 2 0 869322427 333225984 11151 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604464099580032 0 0 -1 3 0 0 0
[pid=5568] ppid=5545 vsize=335672 CPUtime=1.16 cores=1,3,5,7
/proc/5568/stat : 5568 (python) S 5545 5545 4282 0 -1 4202560 1230 0 0 0 56 60 0 0 15 0 2 0 869322429 343728128 11155 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/5568/statm: 83918 11155 390 364 0 18796 0
[pid=5570] ppid=5568 vsize=105040 CPUtime=231.15 cores=1,3,5,7
/proc/5570/stat : 5570 (clasp-1.3.7-x86) T 5568 5570 5570 0 -1 4202496 26227 0 0 0 23111 4 0 0 25 0 1 0 869322430 107560960 25155 33554432000 134512640 136139019 4293749328 18446744073709551615 134876588 0 0 16781312 16386 18446744071562691360 0 0 17 5 0 0 0
/proc/5570/statm: 26260 25155 183 398 0 25860 0
[pid=5568/tid=5573] ppid=5545 vsize=335672 CPUtime=0 cores=1,3,5,7
/proc/5568/task/5573/stat : 5573 (python) S 5545 5545 4282 0 -1 4202560 57 0 0 0 0 0 0 0 15 0 2 0 869327253 343728128 11155 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604468128017408 0 0 -1 7 0 0 0
[pid=5612] ppid=5545 vsize=345928 CPUtime=0.47 cores=1,3,5,7
/proc/5612/stat : 5612 (python) S 5545 5545 4282 0 -1 4202560 1180 0 0 0 20 27 0 0 16 0 2 0 869396205 354230272 11159 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/5612/statm: 86482 11159 390 364 0 21357 0
[pid=5614] ppid=5612 vsize=33004 CPUtime=91.75 cores=1,3,5,7
/proc/5614/stat : 5614 (bsolo_pb10) T 5612 5614 5614 0 -1 4202496 6813 0 0 0 9172 3 0 0 25 0 1 0 869396206 33796096 5696 33554432000 134512640 137138936 4291731376 18446744073709551615 135984584 0 0 16781312 16384 18446744071562691360 0 0 17 5 0 0 0
/proc/5614/statm: 8251 5696 184 642 0 7607 0
[pid=5612/tid=5617] ppid=5545 vsize=345928 CPUtime=0 cores=1,3,5,7
/proc/5612/task/5617/stat : 5617 (python) S 5545 5545 4282 0 -1 4202560 55 0 0 0 0 0 0 0 16 0 2 0 869405382 354230272 11159 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604460834968000 0 0 -1 5 0 0 0
[pid=5685] ppid=5545 vsize=356184 CPUtime=0.24 cores=1,3,5,7
/proc/5685/stat : 5685 (python) S 5545 5545 4282 0 -1 4202560 1177 0 0 0 10 14 0 0 16 0 2 0 869460475 364732416 11163 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699502027 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/5685/statm: 89046 11163 390 364 0 23918 0
[pid=5687] ppid=5685 vsize=65020 CPUtime=47.03 cores=1,3,5,7
/proc/5687/stat : 5687 (wbo1.4a) T 5685 5687 5687 0 -1 4202496 16807 0 0 0 4687 16 0 0 25 0 1 0 869460475 66580480 15602 33554432000 134512640 135751879 4294918672 18446744073709551615 134611152 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/5687/statm: 16255 15602 143 303 0 15950 0
[pid=5685/tid=5689] ppid=5545 vsize=356184 CPUtime=0 cores=1,3,5,7
/proc/5685/task/5689/stat : 5689 (python) S 5545 5545 4282 0 -1 4202560 52 0 0 0 0 0 0 0 16 0 2 0 869465179 364732416 11163 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554946 18446604458537833600 0 0 -1 1 0 0 0
[pid=5545/tid=5553] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5553/stat : 5553 (python) S 5543 5545 4282 0 -1 4202560 27 1587 0 0 0 0 40 11 19 0 7 0 869308248 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 7 0 0 0
[pid=5545/tid=5559] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5559/stat : 5559 (python) S 5543 5545 4282 0 -1 4202560 48 1587 0 0 0 0 40 11 18 0 7 0 869312884 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 1 0 0 0
[pid=5545/tid=5564] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5564/stat : 5564 (python) S 5543 5545 4282 0 -1 4202560 32 1587 0 0 0 0 40 11 18 0 7 0 869317710 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 3 0 0 0
[pid=5545/tid=5569] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5569/stat : 5569 (python) S 5543 5545 4282 0 -1 4202560 30 1587 0 0 0 0 40 11 18 0 7 0 869322429 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 3 0 0 0
[pid=5545/tid=5613] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5613/stat : 5613 (python) S 5543 5545 4282 0 -1 4202560 27 1587 0 0 0 0 40 11 20 0 7 0 869396206 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 3 0 0 0
[pid=5545/tid=5686] ppid=5543 vsize=366428 CPUtime=0.51 cores=1,3,5,7
/proc/5545/task/5686/stat : 5686 (python) S 5543 5545 4282 0 -1 4202560 29 1587 0 0 0 0 40 11 20 0 7 0 869460475 375222272 12660 33554432000 4194304 5683644 140736630882208 18446744073709551615 212699498929 0 0 16781312 33554434 18446604467981923648 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 3857296

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 5545 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=648597
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=467928
# CPU time returned by wait4() is 3.11652
# while last known CPU time is 1800.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1791.16
CPU time (s): 1800.07
CPU user time (s): 1786.91
CPU system time (s): 13.16
CPU usage (%): 100.497
Max. virtual memory (cumulated for all children) (KiB): 3857300

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.6486
system time used= 0.467928
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 28869
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 21015
involuntary context switches= 4711

runsolver used 10.5764 second user time and 26.256 second system time

The end

Launcher Data 

Begin job on node139 at 2011-06-09 01:51:42
IDJOB=3482399
IDBENCH=48360
IDSOLVER=1971
FILE ID=node139/3482399-1307577101
RUNJOBID= node139-1307576354-4301
PBS_JOBID= 13547660
Free space on /tmp= 73844 MiB

SOLVER NAME= borg pb-dec-11.04.03
BENCH NAME= PB07/normalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/manquinho/dbsg/normalized-dbsg_500_60_1_80.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482399-1307577101/watcher-3482399-1307577101 -o /tmp/evaluation-result-3482399-1307577101/solver-3482399-1307577101 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482399-1307577101.opb -seed 2097467692 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 8096e07164eab6008a97823c6b00b555
RANDOM SEED=2097467692

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.70
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5321.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.852
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      21259104 kB
Buffers:        177092 kB
Cached:         530176 kB
SwapCached:       3780 kB
Active:       11189728 kB
Inactive:       184576 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      21259104 kB
SwapTotal:    67111528 kB
SwapFree:     58940260 kB
Dirty:          102588 kB
Writeback:          12 kB
AnonPages:    10665288 kB
Mapped:          59916 kB
Slab:           159100 kB
PageTables:      86860 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 174104748 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73676 MiB
End job on node139 at 2011-06-09 02:21:35