Trace number 3482343

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-dec-11.04.03? (TO) 1800.1 1796.05

General information on the benchmark

Namenormalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/
manquinho/dbsg/normalized-dbsg_500_60_5_80.opb
MD5SUMd5640996c15a8815d620b5d6c220fea1
Bench CategoryDEC-SMALLINT-NLC (no optimisation, small integers, non linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables1000
Total number of constraints1502
Number of constraints which are clauses500
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints1001
Minimum length of a constraint2
Maximum length of a constraint1000
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 80
Number of bits of the biggest number in a constraint 7
Biggest sum of numbers in a constraint 1000
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)75000
Sum of products size (including duplicates)150000
Number of different products37500
Sum of products size75000

Solver Data 

0.30/0.47	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.30/0.47	c INFO: solving HOME/instance-3482343-1307576547.opb
0.59/1.00	c INFO: wrote linearized instance to HOME/tmpD9vE3V.opb
1.70/1.54	c INFO: parsing took 0.53 s
2.80/2.63	c INFO: features took 1.09 CPU seconds
2.80/2.66	c INFO: running wbo1.4b-fixed@0 for 45 with 1798 remaining (b = 0.22)
49.36/49.17	c INFO: running scip-2.0.1-spx@0 for 45 with 1751 remaining (b = 0.04)
96.87/96.54	c INFO: running scip-2.0.1-clp@0 for 45 with 1704 remaining (b = 0.02)
145.07/144.62	c INFO: running clasp-1.3.7@0 for 45 with 1657 remaining (b = 0.02)
193.24/192.75	c INFO: running scip-2.0.1-clp@47 for 45 with 1609 remaining (b = 0.01)
239.43/238.87	c INFO: running clasp-1.3.7@48 for 45 with 1563 remaining (b = 0.01)
285.77/285.00	c INFO: running clasp-1.3.7@94 for 136 with 1517 remaining (b = 0.02)
424.38/423.31	c INFO: running scip-2.0.1-spx@47 for 45 with 1378 remaining (b = 0.01)
470.58/469.43	c INFO: running scip-2.0.1-spx@93 for 410 with 1332 remaining (b = 0.06)
882.92/880.81	c INFO: running bsolo_pb10-l1@0 for 91 with 923 remaining (b = 0.01)
976.52/974.31	c INFO: running scip-2.0.1-spx@502 for 547 with 829 remaining (b = 0.05)
1530.97/1527.58	c INFO: running wbo1.4a@0 for 45 with 278 remaining (b = 0.00)
1580.88/1577.33	c INFO: running scip-2.0.1-spx@1053 for 229 with 229 remaining (b = 0.01)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482343-1307576547/watcher-3482343-1307576547 -o /tmp/evaluation-result-3482343-1307576547/solver-3482343-1307576547 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482343-1307576547.opb -seed 77872414 -budget 1800 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.85 0.63 0.22 2/276 29714
/proc/meminfo: memFree=31883440/32951124 swapFree=53958412/67111528
[pid=29714] ppid=29712 vsize=15776 CPUtime=0 cores=1,3,5,7
/proc/29714/stat : 29714 (python) S 29712 29714 28606 0 -1 4202496 904 0 0 0 0 0 0 0 25 0 1 0 869255483 16154624 784 33554432000 4194304 5683644 140736917443792 18446744073709551615 222921775104 0 2147483391 16781312 2 18446744071699199166 0 0 17 5 0 0 0
/proc/29714/statm: 3944 784 346 364 0 431 0

[startup+0.0898869 s]
/proc/loadavg: 1.85 0.63 0.22 2/276 29714
/proc/meminfo: memFree=31883440/32951124 swapFree=53958412/67111528
[pid=29714] ppid=29712 vsize=94064 CPUtime=0.06 cores=1,3,5,7
/proc/29714/stat : 29714 (python) S 29712 29714 28606 0 -1 4202496 2796 0 1 0 4 2 0 0 17 0 1 0 869255483 96321536 2468 33554432000 4194304 5683644 140736917443792 18446744073709551615 222921776896 0 0 16781312 2 18446744071562362840 0 0 17 7 0 0 0
/proc/29714/statm: 23516 2468 788 364 0 1627 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 94064

[startup+0.105243 s]
/proc/loadavg: 1.85 0.63 0.22 2/276 29714
/proc/meminfo: memFree=31883440/32951124 swapFree=53958412/67111528
[pid=29714] ppid=29712 vsize=96124 CPUtime=0.07 cores=1,3,5,7
/proc/29714/stat : 29714 (python) R 29712 29714 28606 0 -1 4202496 3169 930 1 0 5 2 0 0 18 0 1 0 869255483 98430976 2483 33554432000 4194304 5683644 140736917443792 18446744073709551615 5170248 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/29714/statm: 24031 2483 792 364 0 1626 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 96124

[startup+0.301393 s]
/proc/loadavg: 1.85 0.63 0.22 2/276 29714
/proc/meminfo: memFree=31883440/32951124 swapFree=53958412/67111528
[pid=29714] ppid=29712 vsize=202992 CPUtime=0.22 cores=1,3,5,7
/proc/29714/stat : 29714 (python) S 29712 29714 28606 0 -1 4202496 6688 930 1 0 16 6 0 0 17 0 1 0 869255483 207863808 4971 33554432000 4194304 5683644 140736917443792 18446744073709551615 222921775104 0 2147483391 16781312 2 18446744071699199166 0 0 17 7 0 0 0
/proc/29714/statm: 50748 4971 1472 364 0 3710 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 202992

[startup+0.700109 s]
/proc/loadavg: 1.85 0.63 0.22 2/276 29714
/proc/meminfo: memFree=31883440/32951124 swapFree=53958412/67111528
[pid=29714] ppid=29712 vsize=283192 CPUtime=0.4 cores=1,3,5,7
/proc/29714/stat : 29714 (python) S 29712 29714 28606 0 -1 4202496 9406 930 1 0 29 11 0 0 16 0 1 0 869255483 289988608 7137 33554432000 4194304 5683644 140736917443792 18446744073709551615 222921797135 0 0 16781312 2 2479122129035984896 0 0 17 7 0 0 0
/proc/29714/statm: 70798 7137 1777 364 0 5691 0
Current children cumulated CPU time (s) 0.4
Current children cumulated vsize (KiB) 283192

[startup+1.50097 s]
/proc/loadavg: 1.85 0.63 0.22 3/277 29720
/proc/meminfo: memFree=31849828/32951124 swapFree=53958412/67111528
[pid=29714] ppid=29712 vsize=307260 CPUtime=1.7 cores=1,3,5,7
/proc/29714/stat : 29714 (python) R 29712 29714 28606 0 -1 4202496 17117 1593 1 0 82 38 43 7 16 0 1 0 869255483 314634240 12979 33554432000 4194304 5683644 140736917443792 18446744073709551615 4623682 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/29714/statm: 76815 12979 1782 364 0 11708 0
Current children cumulated CPU time (s) 1.7
Current children cumulated vsize (KiB) 307260

[startup+3.10067 s]
/proc/loadavg: 1.85 0.63 0.22 3/277 29720
/proc/meminfo: memFree=31837428/32951124 swapFree=53958412/67111528
[pid=29714] ppid=29712 vsize=315496 CPUtime=2.86 cores=1,3,5,7
/proc/29714/stat : 29714 (python) S 29712 29714 28606 0 -1 4202496 22229 1593 1 0 197 39 43 7 19 0 2 0 869255483 323067904 12708 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/29714/statm: 78874 12708 1865 364 0 13761 0
Current children cumulated CPU time (s) 2.86
Current children cumulated vsize (KiB) 315496

[startup+6.30108 s]
/proc/loadavg: 1.87 0.65 0.23 3/280 29723
/proc/meminfo: memFree=31811492/32951124 swapFree=53958412/67111528
[pid=29714] ppid=29712 vsize=315496 CPUtime=2.86 cores=1,3,5,7
/proc/29714/stat : 29714 (python) S 29712 29714 28606 0 -1 4202496 22229 1593 1 0 197 39 43 7 19 0 2 0 869255483 323067904 12708 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/29714/statm: 78874 12708 1865 364 0 13761 0
[pid=29721] ppid=29714 vsize=305252 CPUtime=0 cores=1,3,5,7
/proc/29721/stat : 29721 (python) S 29714 29714 28606 0 -1 4202560 718 0 0 0 0 0 0 0 15 0 1 0 869255750 312578048 11157 33554432000 4194304 5683644 140736917443792 18446744073709551615 222921797135 0 0 16781312 33554946 13421007234964357384 0 0 17 5 0 0 0
/proc/29721/statm: 76313 11157 318 364 0 11200 0
[pid=29723] ppid=29721 vsize=27152 CPUtime=3.62 cores=1,3,5,7
/proc/29723/stat : 29723 (wbo1.4b-fixed) R 29721 29723 29723 0 -1 4202496 7329 0 0 0 359 3 0 0 25 0 1 0 869255750 27803648 6132 33554432000 134512640 135752315 4292848832 18446744073709551615 135270849 0 0 16781312 3 0 0 0 17 5 0 0 0
/proc/29723/statm: 6788 6132 146 303 0 6483 0
[pid=29714/tid=29722] ppid=29712 vsize=315496 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29722/stat : 29722 (python) S 29712 29714 28606 0 -1 4202560 28 1593 0 0 0 0 43 7 19 0 2 0 869255750 323067904 12708 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 6.48
Current children cumulated vsize (KiB) 647900

[startup+12.7009 s]
/proc/loadavg: 2.04 0.70 0.25 3/280 29723
/proc/meminfo: memFree=31802728/32951124 swapFree=53958412/67111528
[pid=29714] ppid=29712 vsize=315496 CPUtime=2.86 cores=1,3,5,7
/proc/29714/stat : 29714 (python) S 29712 29714 28606 0 -1 4202496 22229 1593 1 0 197 39 43 7 19 0 2 0 869255483 323067904 12708 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/29714/statm: 78874 12708 1865 364 0 13761 0
[pid=29721] ppid=29714 vsize=305252 CPUtime=0.01 cores=1,3,5,7
/proc/29721/stat : 29721 (python) S 29714 29714 28606 0 -1 4202560 865 0 0 0 0 1 0 0 15 0 1 0 869255750 312578048 11181 33554432000 4194304 5683644 140736917443792 18446744073709551615 222921797135 0 0 16781312 33554946 5623606151888251748 0 0 17 5 0 0 0
/proc/29721/statm: 76313 11181 342 364 0 11200 0
[pid=29723] ppid=29721 vsize=36656 CPUtime=10.02 cores=1,3,5,7
/proc/29723/stat : 29723 (wbo1.4b-fixed) R 29721 29723 29723 0 -1 4202496 9703 0 0 0 995 7 0 0 25 0 1 0 869255750 37535744 8506 33554432000 134512640 135752315 4292848832 18446744073709551615 134606610 0 0 16781312 3 0 0 0 17 3 0 0 0
/proc/29723/statm: 9164 8506 146 303 0 8859 0
[pid=29714/tid=29722] ppid=29712 vsize=315496 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29722/stat : 29722 (python) S 29712 29714 28606 0 -1 4202560 28 1593 0 0 0 0 43 7 19 0 2 0 869255750 323067904 12708 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 12.89
Current children cumulated vsize (KiB) 657404

[startup+25.5005 s]
/proc/loadavg: 2.03 0.77 0.28 3/280 29723
/proc/meminfo: memFree=31784024/32951124 swapFree=53958412/67111528
[pid=29714] ppid=29712 vsize=315496 CPUtime=2.86 cores=1,3,5,7
/proc/29714/stat : 29714 (python) S 29712 29714 28606 0 -1 4202496 22229 1593 1 0 197 39 43 7 19 0 2 0 869255483 323067904 12708 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/29714/statm: 78874 12708 1865 364 0 13761 0
[pid=29721] ppid=29714 vsize=305252 CPUtime=0.04 cores=1,3,5,7
/proc/29721/stat : 29721 (python) S 29714 29714 28606 0 -1 4202560 973 0 0 0 2 2 0 0 16 0 1 0 869255750 312578048 11186 33554432000 4194304 5683644 140736917443792 18446744073709551615 222921797135 0 0 16781312 33554946 5623606151888251748 0 0 17 5 0 0 0
/proc/29721/statm: 76313 11186 347 364 0 11200 0
[pid=29723] ppid=29721 vsize=46848 CPUtime=22.82 cores=1,3,5,7
/proc/29723/stat : 29723 (wbo1.4b-fixed) R 29721 29723 29723 0 -1 4202496 12264 0 0 0 2271 11 0 0 25 0 1 0 869255750 47972352 11067 33554432000 134512640 135752315 4292848832 18446744073709551615 134638580 0 0 16781312 3 0 0 0 17 3 0 0 0
/proc/29723/statm: 11712 11067 146 303 0 11407 0
[pid=29714/tid=29722] ppid=29712 vsize=315496 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29722/stat : 29722 (python) S 29712 29714 28606 0 -1 4202560 28 1593 0 0 0 0 43 7 19 0 2 0 869255750 323067904 12708 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 25.72
Current children cumulated vsize (KiB) 667596

[startup+51.1009 s]
/proc/loadavg: 2.02 0.86 0.32 3/288 29732
/proc/meminfo: memFree=31442912/32951124 swapFree=53958412/67111528
[pid=29714] ppid=29712 vsize=325752 CPUtime=2.88 cores=1,3,5,7
/proc/29714/stat : 29714 (python) S 29712 29714 28606 0 -1 4202496 23137 1593 1 0 199 39 43 7 20 0 3 0 869255483 333570048 12723 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 3 0 0 0
/proc/29714/statm: 81438 12723 1876 364 0 16322 0
[pid=29721] ppid=29714 vsize=315496 CPUtime=0.1 cores=1,3,5,7
/proc/29721/stat : 29721 (python) S 29714 29714 28606 0 -1 4202560 1156 0 0 0 5 5 0 0 16 0 2 0 869255750 323067904 11254 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/29721/statm: 78874 11254 410 364 0 13761 0
[pid=29723] ppid=29721 vsize=68904 CPUtime=46.48 cores=1,3,5,7
/proc/29723/stat : 29723 (wbo1.4b-fixed) T 29721 29723 29723 0 -1 4202496 17778 0 0 0 4633 15 0 0 25 0 1 0 869255750 70557696 16581 33554432000 134512640 135752315 4292848832 18446744073709551615 134605024 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/29723/statm: 17226 16581 146 303 0 16921 0
[pid=29721/tid=29729] ppid=29714 vsize=315496 CPUtime=0 cores=1,3,5,7
/proc/29721/task/29729/stat : 29729 (python) S 29714 29714 28606 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869260399 323067904 11254 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604471142503680 0 0 -1 5 0 0 0
[pid=29730] ppid=29714 vsize=315508 CPUtime=0 cores=1,3,5,7
/proc/29730/stat : 29730 (python) S 29714 29714 28606 0 -1 4202560 750 0 0 0 0 0 0 0 15 0 1 0 869260401 323080192 11162 33554432000 4194304 5683644 140736917443792 18446744073709551615 222921797190 0 0 16781312 33554946 4294934789 0 0 17 7 0 0 0
/proc/29730/statm: 78877 11162 319 364 0 13761 0
[pid=29732] ppid=29730 vsize=294552 CPUtime=1.91 cores=1,3,5,7
/proc/29732/stat : 29732 (scip-2.0.1.linu) R 29730 29732 29732 0 -1 4202496 68897 0 0 0 166 25 0 0 25 0 1 0 869260401 301621248 66848 33554432000 4194304 13684479 140736834275104 18446744073709551615 7188726 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/29732/statm: 73638 66848 696 2317 0 71316 0
[pid=29714/tid=29722] ppid=29712 vsize=325752 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29722/stat : 29722 (python) S 29712 29714 28606 0 -1 4202560 28 1593 0 0 0 0 43 7 19 0 3 0 869255750 333570048 12723 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
[pid=29714/tid=29731] ppid=29712 vsize=325752 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29731/stat : 29731 (python) S 29712 29714 28606 0 -1 4202560 32 1593 0 0 0 0 43 7 20 0 3 0 869260401 333570048 12723 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 51.37
Current children cumulated vsize (KiB) 1320212

[startup+102.31 s]
/proc/loadavg: 2.00 1.05 0.41 3/285 29809
/proc/meminfo: memFree=31206316/32951124 swapFree=53958412/67111528
[pid=29714] ppid=29712 vsize=336008 CPUtime=2.91 cores=1,3,5,7
/proc/29714/stat : 29714 (python) S 29712 29714 28606 0 -1 4202496 24013 1593 1 0 202 39 43 7 20 0 4 0 869255483 344072192 12729 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 1 0 0 0
/proc/29714/statm: 84002 12729 1878 364 0 18883 0
[pid=29721] ppid=29714 vsize=315496 CPUtime=0.1 cores=1,3,5,7
/proc/29721/stat : 29721 (python) S 29714 29714 28606 0 -1 4202560 1156 0 0 0 5 5 0 0 16 0 2 0 869255750 323067904 11254 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/29721/statm: 78874 11254 410 364 0 13761 0
[pid=29723] ppid=29721 vsize=68904 CPUtime=46.48 cores=1,3,5,7
/proc/29723/stat : 29723 (wbo1.4b-fixed) T 29721 29723 29723 0 -1 4202496 17778 0 0 0 4633 15 0 0 25 0 1 0 869255750 70557696 16581 33554432000 134512640 135752315 4292848832 18446744073709551615 134605024 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/29723/statm: 17226 16581 146 303 0 16921 0
[pid=29721/tid=29729] ppid=29714 vsize=315496 CPUtime=0 cores=1,3,5,7
/proc/29721/task/29729/stat : 29729 (python) S 29714 29714 28606 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869260399 323067904 11254 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604471142503680 0 0 -1 5 0 0 0
[pid=29730] ppid=29714 vsize=315508 CPUtime=0.1 cores=1,3,5,7
/proc/29730/stat : 29730 (python) S 29714 29714 28606 0 -1 4202560 1116 0 0 0 5 5 0 0 16 0 2 0 869260401 323080192 11234 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/29730/statm: 78877 11234 390 364 0 13761 0
[pid=29732] ppid=29730 vsize=352500 CPUtime=47.33 cores=1,3,5,7
/proc/29732/stat : 29732 (scip-2.0.1.linu) T 29730 29732 29732 0 -1 4202496 89488 0 0 0 4700 33 0 0 25 0 1 0 869260401 360960000 84099 33554432000 4194304 13684479 140736834275104 18446744073709551615 7354168 0 0 16781312 2 18446744071562691360 0 0 17 1 0 0 0
/proc/29732/statm: 88125 84099 763 2317 0 85803 0
[pid=29730/tid=29738] ppid=29714 vsize=315508 CPUtime=0 cores=1,3,5,7
/proc/29730/task/29738/stat : 29738 (python) S 29714 29714 28606 0 -1 4202560 54 0 0 0 0 0 0 0 16 0 2 0 869265135 323080192 11234 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604458913546688 0 0 -1 5 0 0 0
[pid=29739] ppid=29714 vsize=325764 CPUtime=0 cores=1,3,5,7
/proc/29739/stat : 29739 (python) S 29714 29714 28606 0 -1 4202560 908 0 0 0 0 0 0 0 15 0 1 0 869265137 333582336 11190 33554432000 4194304 5683644 140736917443792 18446744073709551615 222921797190 0 0 16781312 33554946 12188046781413556488 0 0 17 1 0 0 0
/proc/29739/statm: 81441 11190 343 364 0 16322 0
[pid=29741] ppid=29739 vsize=364492 CPUtime=5.75 cores=1,3,5,7
/proc/29741/stat : 29741 (scip-2.0.1.linu) R 29739 29741 29741 0 -1 4202496 85247 0 0 0 545 30 0 0 25 0 1 0 869265138 373239808 75688 33554432000 4194304 15243407 140735132391456 18446744073709551615 8114128 0 0 16781312 2 0 0 0 17 1 0 0 0
/proc/29741/statm: 91123 75688 866 2698 0 88418 0
[pid=29714/tid=29722] ppid=29712 vsize=336008 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29722/stat : 29722 (python) S 29712 29714 28606 0 -1 4202560 28 1593 0 0 0 0 43 7 19 0 4 0 869255750 344072192 12729 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
[pid=29714/tid=29731] ppid=29712 vsize=336008 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29731/stat : 29731 (python) S 29712 29714 28606 0 -1 4202560 32 1593 0 0 0 0 43 7 20 0 4 0 869260401 344072192 12729 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 3 0 0 0
[pid=29714/tid=29740] ppid=29712 vsize=336008 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29740/stat : 29740 (python) S 29712 29714 28606 0 -1 4202560 30 1593 0 0 0 0 43 7 20 0 4 0 869265138 344072192 12729 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 102.67
Current children cumulated vsize (KiB) 2078672

[startup+162.301 s]
/proc/loadavg: 2.11 1.25 0.52 3/296 29967
/proc/meminfo: memFree=30923124/32951124 swapFree=53958412/67111528

################
# More data... #
################

/proc/29714/task/29740/stat : 29740 (python) S 29712 29714 28606 0 -1 4202560 33 1593 0 0 0 0 43 7 18 0 7 0 869265138 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 1 0 0 0
[pid=29714/tid=29962] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29962/stat : 29962 (python) S 29712 29714 28606 0 -1 4202560 30 1593 0 0 0 0 43 7 18 0 7 0 869269946 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
[pid=29714/tid=30024] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/30024/stat : 30024 (python) S 29712 29714 28606 0 -1 4202560 29 1593 0 0 0 0 43 7 20 0 7 0 869343565 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
[pid=29714/tid=30234] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/30234/stat : 30234 (python) S 29712 29714 28606 0 -1 4202560 29 1593 0 0 0 0 43 7 20 0 7 0 869408242 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1726.23
Current children cumulated vsize (KiB) 3874280

[startup+1782.3 s]
/proc/loadavg: 2.00 2.02 1.74 3/344 30248
/proc/meminfo: memFree=29246340/32951124 swapFree=53958412/67111528
[pid=29714] ppid=29712 vsize=366776 CPUtime=3.09 cores=1,3,5,7
/proc/29714/stat : 29714 (python) S 29712 29714 28606 0 -1 4202496 27476 1593 1 0 219 40 43 7 18 0 7 0 869255483 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/29714/statm: 91694 12747 1884 364 0 26566 0
[pid=29721] ppid=29714 vsize=315496 CPUtime=0.1 cores=1,3,5,7
/proc/29721/stat : 29721 (python) S 29714 29714 28606 0 -1 4202560 1156 0 0 0 5 5 0 0 16 0 2 0 869255750 323067904 11254 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/29721/statm: 78874 11254 410 364 0 13761 0
[pid=29723] ppid=29721 vsize=68904 CPUtime=46.48 cores=1,3,5,7
/proc/29723/stat : 29723 (wbo1.4b-fixed) T 29721 29723 29723 0 -1 4202496 17778 0 0 0 4633 15 0 0 25 0 1 0 869255750 70557696 16581 33554432000 134512640 135752315 4292848832 18446744073709551615 134605024 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/29723/statm: 17226 16581 146 303 0 16921 0
[pid=29721/tid=29729] ppid=29714 vsize=315496 CPUtime=0 cores=1,3,5,7
/proc/29721/task/29729/stat : 29729 (python) S 29714 29714 28606 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869260399 323067904 11254 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604471142503680 0 0 -1 5 0 0 0
[pid=29730] ppid=29714 vsize=315508 CPUtime=2.88 cores=1,3,5,7
/proc/29730/stat : 29730 (python) S 29714 29714 28606 0 -1 4202560 1203 0 0 0 143 145 0 0 15 0 2 0 869260401 323080192 11234 33554432000 4194304 5683644 140736917443792 18446744073709551615 222921797190 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/29730/statm: 78877 11234 390 364 0 13761 0
[pid=29732] ppid=29730 vsize=576100 CPUtime=1263.05 cores=1,3,5,7
/proc/29732/stat : 29732 (scip-2.0.1.linu) R 29730 29732 29732 0 -1 4202496 148801 0 0 0 125795 510 0 0 25 0 1 0 869260401 589926400 141529 33554432000 4194304 13684479 140736834275104 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/29732/statm: 144025 141529 846 2317 0 141703 0
[pid=29730/tid=29738] ppid=29714 vsize=315508 CPUtime=0 cores=1,3,5,7
/proc/29730/task/29738/stat : 29738 (python) S 29714 29714 28606 0 -1 4202560 55 0 0 0 0 0 0 0 15 0 2 0 869265135 323080192 11234 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604458913546688 0 0 -1 5 0 0 0
[pid=29739] ppid=29714 vsize=325764 CPUtime=0.21 cores=1,3,5,7
/proc/29739/stat : 29739 (python) S 29714 29714 28606 0 -1 4202560 1141 0 0 0 9 12 0 0 15 0 2 0 869265137 333582336 11238 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/29739/statm: 81441 11238 390 364 0 16322 0
[pid=29741] ppid=29739 vsize=654552 CPUtime=94.13 cores=1,3,5,7
/proc/29741/stat : 29741 (scip-2.0.1.linu) T 29739 29741 29741 0 -1 4202496 214936 0 0 0 9328 85 0 0 25 0 1 0 869265138 670261248 143204 33554432000 4194304 15243407 140735132391456 18446744073709551615 8113472 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/29741/statm: 163638 143204 958 2698 0 160933 0
[pid=29739/tid=29960] ppid=29714 vsize=325764 CPUtime=0 cores=1,3,5,7
/proc/29739/task/29960/stat : 29960 (python) S 29714 29714 28606 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 869269943 333582336 11238 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604471147869376 0 0 -1 1 0 0 0
[pid=29961] ppid=29714 vsize=336020 CPUtime=0.52 cores=1,3,5,7
/proc/29961/stat : 29961 (python) S 29714 29714 28606 0 -1 4202560 1235 0 0 0 25 27 0 0 18 0 2 0 869269946 344084480 11242 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/29961/statm: 84005 11242 390 364 0 18883 0
[pid=29963] ppid=29961 vsize=116956 CPUtime=232.49 cores=1,3,5,7
/proc/29963/stat : 29963 (clasp-1.3.7-x86) T 29961 29963 29963 0 -1 4202496 29514 0 0 0 23245 4 0 0 25 0 1 0 869269946 119762944 28445 33554432000 134512640 136139019 4288071360 18446744073709551615 134632417 0 0 16781312 16386 18446744071562691360 0 0 17 3 0 0 0
/proc/29963/statm: 29239 28445 183 398 0 28839 0
[pid=29961/tid=29969] ppid=29714 vsize=336020 CPUtime=0 cores=1,3,5,7
/proc/29961/task/29969/stat : 29969 (python) S 29714 29714 28606 0 -1 4202560 57 0 0 0 0 0 0 0 18 0 2 0 869274757 344084480 11242 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604464346728512 0 0 -1 1 0 0 0
[pid=30023] ppid=29714 vsize=346276 CPUtime=0.21 cores=1,3,5,7
/proc/30023/stat : 30023 (python) S 29714 29714 28606 0 -1 4202560 1184 0 0 0 11 10 0 0 16 0 2 0 869343565 354586624 11246 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/30023/statm: 86569 11246 390 364 0 21444 0
[pid=30025] ppid=30023 vsize=33236 CPUtime=93.37 cores=1,3,5,7
/proc/30025/stat : 30025 (bsolo_pb10) T 30023 30025 30025 0 -1 4202496 6852 0 0 0 9332 5 0 0 25 0 1 0 869343566 34033664 5732 33554432000 134512640 137138936 4289752944 18446744073709551615 136502585 0 0 16781312 16384 18446744071562691360 0 0 17 7 0 0 0
/proc/30025/statm: 8309 5732 184 642 0 7665 0
[pid=30023/tid=30029] ppid=29714 vsize=346276 CPUtime=0 cores=1,3,5,7
/proc/30023/task/30029/stat : 30029 (python) S 29714 29714 28606 0 -1 4202560 55 0 0 0 0 0 0 0 16 0 2 0 869352913 354586624 11246 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604470055690624 0 0 -1 5 0 0 0
[pid=30233] ppid=29714 vsize=356532 CPUtime=0.11 cores=1,3,5,7
/proc/30233/stat : 30233 (python) S 29714 29714 28606 0 -1 4202560 1168 0 0 0 5 6 0 0 16 0 2 0 869408242 365088768 11250 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/30233/statm: 89133 11250 390 364 0 24005 0
[pid=30235] ppid=30233 vsize=62160 CPUtime=49.72 cores=1,3,5,7
/proc/30235/stat : 30235 (wbo1.4a) T 30233 30235 30235 0 -1 4202496 16093 0 0 0 4958 14 0 0 25 0 1 0 869408242 63651840 14888 33554432000 134512640 135751879 4286689872 18446744073709551615 134606320 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/30235/statm: 15540 14888 143 303 0 15235 0
[pid=30233/tid=30239] ppid=29714 vsize=356532 CPUtime=0 cores=1,3,5,7
/proc/30233/task/30239/stat : 30239 (python) S 29714 29714 28606 0 -1 4202560 52 0 0 0 0 0 0 0 16 0 2 0 869413216 365088768 11250 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604469852678208 0 0 -1 7 0 0 0
[pid=29714/tid=29722] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29722/stat : 29722 (python) S 29712 29714 28606 0 -1 4202560 28 1593 0 0 0 0 43 7 19 0 7 0 869255750 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
[pid=29714/tid=29731] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29731/stat : 29731 (python) S 29712 29714 28606 0 -1 4202560 51 1593 0 0 0 0 43 7 18 0 7 0 869260401 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 3 0 0 0
[pid=29714/tid=29740] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29740/stat : 29740 (python) S 29712 29714 28606 0 -1 4202560 33 1593 0 0 0 0 43 7 18 0 7 0 869265138 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 1 0 0 0
[pid=29714/tid=29962] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29962/stat : 29962 (python) S 29712 29714 28606 0 -1 4202560 30 1593 0 0 0 0 43 7 18 0 7 0 869269946 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
[pid=29714/tid=30024] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/30024/stat : 30024 (python) S 29712 29714 28606 0 -1 4202560 29 1593 0 0 0 0 43 7 20 0 7 0 869343565 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
[pid=29714/tid=30234] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/30234/stat : 30234 (python) S 29712 29714 28606 0 -1 4202560 29 1593 0 0 0 0 43 7 20 0 7 0 869408242 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1786.36
Current children cumulated vsize (KiB) 3874280



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1796 s]
/proc/loadavg: 2.23 2.07 1.76 3/344 30249
/proc/meminfo: memFree=29246312/32951124 swapFree=53958412/67111528
[pid=29714] ppid=29712 vsize=366776 CPUtime=3.09 cores=1,3,5,7
/proc/29714/stat : 29714 (python) S 29712 29714 28606 0 -1 4202496 27476 1593 1 0 219 40 43 7 18 0 7 0 869255483 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554434 18446744073709551615 0 0 17 5 0 0 0
/proc/29714/statm: 91694 12747 1884 364 0 26566 0
[pid=29721] ppid=29714 vsize=315496 CPUtime=0.1 cores=1,3,5,7
/proc/29721/stat : 29721 (python) S 29714 29714 28606 0 -1 4202560 1156 0 0 0 5 5 0 0 16 0 2 0 869255750 323067904 11254 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/29721/statm: 78874 11254 410 364 0 13761 0
[pid=29723] ppid=29721 vsize=68904 CPUtime=46.48 cores=1,3,5,7
/proc/29723/stat : 29723 (wbo1.4b-fixed) T 29721 29723 29723 0 -1 4202496 17778 0 0 0 4633 15 0 0 25 0 1 0 869255750 70557696 16581 33554432000 134512640 135752315 4292848832 18446744073709551615 134605024 0 0 16781312 3 18446744071562691360 0 0 17 3 0 0 0
/proc/29723/statm: 17226 16581 146 303 0 16921 0
[pid=29721/tid=29729] ppid=29714 vsize=315496 CPUtime=0 cores=1,3,5,7
/proc/29721/task/29729/stat : 29729 (python) S 29714 29714 28606 0 -1 4202560 45 0 0 0 0 0 0 0 16 0 2 0 869260399 323067904 11254 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604471142503680 0 0 -1 5 0 0 0
[pid=29730] ppid=29714 vsize=315508 CPUtime=2.9 cores=1,3,5,7
/proc/29730/stat : 29730 (python) S 29714 29714 28606 0 -1 4202560 1203 0 0 0 144 146 0 0 15 0 2 0 869260401 323080192 11234 33554432000 4194304 5683644 140736917443792 18446744073709551615 222921797190 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/29730/statm: 78877 11234 390 364 0 13761 0
[pid=29732] ppid=29730 vsize=576100 CPUtime=1276.77 cores=1,3,5,7
/proc/29732/stat : 29732 (scip-2.0.1.linu) R 29730 29732 29732 0 -1 4202496 148801 0 0 0 127161 516 0 0 25 0 1 0 869260401 589926400 141529 33554432000 4194304 13684479 140736834275104 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 5 0 0 0
/proc/29732/statm: 144025 141529 846 2317 0 141703 0
[pid=29730/tid=29738] ppid=29714 vsize=315508 CPUtime=0 cores=1,3,5,7
/proc/29730/task/29738/stat : 29738 (python) S 29714 29714 28606 0 -1 4202560 55 0 0 0 0 0 0 0 15 0 2 0 869265135 323080192 11234 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604458913546688 0 0 -1 5 0 0 0
[pid=29739] ppid=29714 vsize=325764 CPUtime=0.21 cores=1,3,5,7
/proc/29739/stat : 29739 (python) S 29714 29714 28606 0 -1 4202560 1141 0 0 0 9 12 0 0 15 0 2 0 869265137 333582336 11238 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 1 0 0 0
/proc/29739/statm: 81441 11238 390 364 0 16322 0
[pid=29741] ppid=29739 vsize=654552 CPUtime=94.13 cores=1,3,5,7
/proc/29741/stat : 29741 (scip-2.0.1.linu) T 29739 29741 29741 0 -1 4202496 214936 0 0 0 9328 85 0 0 25 0 1 0 869265138 670261248 143204 33554432000 4194304 15243407 140735132391456 18446744073709551615 8113472 0 0 16781312 2 18446744071562691360 0 0 17 5 0 0 0
/proc/29741/statm: 163638 143204 958 2698 0 160933 0
[pid=29739/tid=29960] ppid=29714 vsize=325764 CPUtime=0 cores=1,3,5,7
/proc/29739/task/29960/stat : 29960 (python) S 29714 29714 28606 0 -1 4202560 50 0 0 0 0 0 0 0 15 0 2 0 869269943 333582336 11238 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604471147869376 0 0 -1 1 0 0 0
[pid=29961] ppid=29714 vsize=336020 CPUtime=0.52 cores=1,3,5,7
/proc/29961/stat : 29961 (python) S 29714 29714 28606 0 -1 4202560 1235 0 0 0 25 27 0 0 18 0 2 0 869269946 344084480 11242 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/29961/statm: 84005 11242 390 364 0 18883 0
[pid=29963] ppid=29961 vsize=116956 CPUtime=232.49 cores=1,3,5,7
/proc/29963/stat : 29963 (clasp-1.3.7-x86) T 29961 29963 29963 0 -1 4202496 29514 0 0 0 23245 4 0 0 25 0 1 0 869269946 119762944 28445 33554432000 134512640 136139019 4288071360 18446744073709551615 134632417 0 0 16781312 16386 18446744071562691360 0 0 17 3 0 0 0
/proc/29963/statm: 29239 28445 183 398 0 28839 0
[pid=29961/tid=29969] ppid=29714 vsize=336020 CPUtime=0 cores=1,3,5,7
/proc/29961/task/29969/stat : 29969 (python) S 29714 29714 28606 0 -1 4202560 57 0 0 0 0 0 0 0 18 0 2 0 869274757 344084480 11242 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604464346728512 0 0 -1 1 0 0 0
[pid=30023] ppid=29714 vsize=346276 CPUtime=0.21 cores=1,3,5,7
/proc/30023/stat : 30023 (python) S 29714 29714 28606 0 -1 4202560 1184 0 0 0 11 10 0 0 16 0 2 0 869343565 354586624 11246 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 5 0 0 0
/proc/30023/statm: 86569 11246 390 364 0 21444 0
[pid=30025] ppid=30023 vsize=33236 CPUtime=93.37 cores=1,3,5,7
/proc/30025/stat : 30025 (bsolo_pb10) T 30023 30025 30025 0 -1 4202496 6852 0 0 0 9332 5 0 0 25 0 1 0 869343566 34033664 5732 33554432000 134512640 137138936 4289752944 18446744073709551615 136502585 0 0 16781312 16384 18446744071562691360 0 0 17 7 0 0 0
/proc/30025/statm: 8309 5732 184 642 0 7665 0
[pid=30023/tid=30029] ppid=29714 vsize=346276 CPUtime=0 cores=1,3,5,7
/proc/30023/task/30029/stat : 30029 (python) S 29714 29714 28606 0 -1 4202560 55 0 0 0 0 0 0 0 16 0 2 0 869352913 354586624 11246 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604470055690624 0 0 -1 5 0 0 0
[pid=30233] ppid=29714 vsize=356532 CPUtime=0.11 cores=1,3,5,7
/proc/30233/stat : 30233 (python) S 29714 29714 28606 0 -1 4202560 1168 0 0 0 5 6 0 0 16 0 2 0 869408242 365088768 11250 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933603787 0 0 16781312 33554946 18446744073709551615 0 0 17 7 0 0 0
/proc/30233/statm: 89133 11250 390 364 0 24005 0
[pid=30235] ppid=30233 vsize=62160 CPUtime=49.72 cores=1,3,5,7
/proc/30235/stat : 30235 (wbo1.4a) T 30233 30235 30235 0 -1 4202496 16093 0 0 0 4958 14 0 0 25 0 1 0 869408242 63651840 14888 33554432000 134512640 135751879 4286689872 18446744073709551615 134606320 0 0 16781312 3 18446744071562691360 0 0 17 5 0 0 0
/proc/30235/statm: 15540 14888 143 303 0 15235 0
[pid=30233/tid=30239] ppid=29714 vsize=356532 CPUtime=0 cores=1,3,5,7
/proc/30233/task/30239/stat : 30239 (python) S 29714 29714 28606 0 -1 4202560 52 0 0 0 0 0 0 0 16 0 2 0 869413216 365088768 11250 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554946 18446604469852678208 0 0 -1 7 0 0 0
[pid=29714/tid=29722] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29722/stat : 29722 (python) S 29712 29714 28606 0 -1 4202560 28 1593 0 0 0 0 43 7 19 0 7 0 869255750 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
[pid=29714/tid=29731] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29731/stat : 29731 (python) S 29712 29714 28606 0 -1 4202560 51 1593 0 0 0 0 43 7 18 0 7 0 869260401 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 3 0 0 0
[pid=29714/tid=29740] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29740/stat : 29740 (python) S 29712 29714 28606 0 -1 4202560 33 1593 0 0 0 0 43 7 18 0 7 0 869265138 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 1 0 0 0
[pid=29714/tid=29962] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/29962/stat : 29962 (python) S 29712 29714 28606 0 -1 4202560 30 1593 0 0 0 0 43 7 18 0 7 0 869269946 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
[pid=29714/tid=30024] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/30024/stat : 30024 (python) S 29712 29714 28606 0 -1 4202560 29 1593 0 0 0 0 43 7 20 0 7 0 869343565 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
[pid=29714/tid=30234] ppid=29712 vsize=366776 CPUtime=0.5 cores=1,3,5,7
/proc/29714/task/30234/stat : 30234 (python) S 29712 29714 28606 0 -1 4202560 29 1593 0 0 0 0 43 7 20 0 7 0 869408242 375578624 12747 33554432000 4194304 5683644 140736917443792 18446744073709551615 222933600689 0 0 16781312 33554434 18446604471163469952 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 3874280

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29714 and gives
#  childrusage.ru_utime.tv_sec=2
#  childrusage.ru_utime.tv_usec=631599
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=486925
# CPU time returned by wait4() is 3.11852
# while last known CPU time is 1800.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1796.05
CPU time (s): 1800.1
CPU user time (s): 1791.18
CPU system time (s): 8.92
CPU usage (%): 100.225
Max. virtual memory (cumulated for all children) (KiB): 3874280

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2.6316
system time used= 0.486925
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29072
page faults= 1
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 17327
involuntary context switches= 41

runsolver used 5.13822 second user time and 11.3543 second system time

The end

Launcher Data 

Begin job on node109 at 2011-06-09 01:42:27
IDJOB=3482343
IDBENCH=48304
IDSOLVER=1971
FILE ID=node109/3482343-1307576547
RUNJOBID= node109-1307576440-28625
PBS_JOBID= 13547696
Free space on /tmp= 74040 MiB

SOLVER NAME= borg pb-dec-11.04.03
BENCH NAME= PB07/normalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/manquinho/dbsg/normalized-dbsg_500_60_5_80.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482343-1307576547/watcher-3482343-1307576547 -o /tmp/evaluation-result-3482343-1307576547/solver-3482343-1307576547 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482343-1307576547.opb -seed 77872414 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d5640996c15a8815d620b5d6c220fea1
RANDOM SEED=77872414

node109.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31883844 kB
Buffers:        185184 kB
Cached:         503304 kB
SwapCached:       8632 kB
Active:         590340 kB
Inactive:       209824 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31883844 kB
SwapTotal:    67111528 kB
SwapFree:     53958412 kB
Dirty:          217136 kB
Writeback:           0 kB
AnonPages:      109064 kB
Mapped:          19144 kB
Slab:           165652 kB
PageTables:      38688 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 31051352 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73940 MiB
End job on node109 at 2011-06-09 02:12:25