Trace number 3737770

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB11: borg pb-dec-11.04.03? (MO) 1620.27 1616.26

General information on the benchmark

Namenormalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/
manquinho/dbsg/normalized-dbsg_200_25_5_40.opb
MD5SUMc1794605d16cd8196553c490f5507fd9
Bench CategoryDEC-SMALLINT-NLC (no optimisation, small integers, non linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables400
Total number of constraints602
Number of constraints which are clauses200
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints401
Minimum length of a constraint2
Maximum length of a constraint400
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 40
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 400
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)12452
Sum of products size (including duplicates)24904
Number of different products6226
Sum of products size12452

Solver Data 

0.35/1.05	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.35/1.05	c INFO: solving HOME/instance-3737770-1338716275.opb
0.40/1.14	c INFO: wrote linearized instance to HOME/tmpvaH3ob.opb
0.57/1.23	c INFO: parsing took 0.10 s
0.76/1.41	c INFO: features took 0.17 CPU seconds
0.76/1.43	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.39)
49.82/50.46	c INFO: running clasp-1.3.7@0 for 45 with 1750 remaining (b = 0.09)
97.05/97.61	c INFO: running scip-2.0.1-clp@0 for 45 with 1703 remaining (b = 0.03)
146.88/147.43	c INFO: running clasp-1.3.7@47 for 45 with 1654 remaining (b = 0.01)
192.06/192.58	c INFO: running scip-2.0.1-clp@49 for 45 with 1608 remaining (b = 0.01)
234.42/234.80	c INFO: running wbo1.4a@0 for 45 with 1566 remaining (b = 0.02)
281.76/282.16	c INFO: running clasp-1.3.7@92 for 136 with 1519 remaining (b = 0.02)
419.35/419.55	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1382 remaining (b = 0.01)
469.43/467.21	c INFO: running scip-2.0.1-spx@48 for 45 with 1332 remaining (b = 0.01)
512.99/510.76	c INFO: running bsolo_pb10-l3@0 for 45 with 1289 remaining (b = 0.01)
560.36/558.01	c INFO: running scip-2.0.1-spx@92 for 410 with 1242 remaining (b = 0.06)
975.83/972.84	c INFO: running bsolo_pb10-l1@0 for 91 with 829 remaining (b = 0.01)
1071.38/1068.21	c INFO: running scip-2.0.1-spx@505 for 547 with 733 remaining (b = 0.05)
1619.97/1615.90	c INFO: wrote minion input file to HOME/tmptvzxuN.minion
1619.97/1615.90	c INFO: running minion-0.12@0 for 45 with 189 remaining (b = 0.00)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3737770-1338716275/watcher-3737770-1338716275 -o /tmp/evaluation-result-3737770-1338716275/solver-3737770-1338716275 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3737770-1338716275.opb -seed 462299973 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.93 2.01 1.95 3/196 31074
/proc/meminfo: memFree=22842844/32873648 swapFree=7120/7120
[pid=31074] ppid=31072 vsize=15608 CPUtime=0 cores=0,2,4,6
/proc/31074/stat : 31074 (python) R 31072 31074 27000 0 -1 4202496 803 0 0 0 0 0 0 0 20 0 1 0 337754886 15982592 676 33554432000 4194304 5683644 140736096138352 140736096083080 219513631437 0 0 16781312 2 0 0 0 17 2 0 0 0 0 0
/proc/31074/statm: 3902 690 334 364 0 344 0

[startup+0.074682 s]
/proc/loadavg: 1.93 2.01 1.95 3/196 31074
/proc/meminfo: memFree=22842844/32873648 swapFree=7120/7120
[pid=31074] ppid=31072 vsize=54840 CPUtime=0.05 cores=0,2,4,6
/proc/31074/stat : 31074 (python) R 31072 31074 27000 0 -1 4202496 2264 0 0 0 4 1 0 0 20 0 1 0 337754886 56156160 1840 33554432000 4194304 5683644 140736096138352 140736096082584 219514004362 0 0 16781312 2 0 0 0 17 2 0 0 0 0 0
/proc/31074/statm: 13718 1846 501 364 0 1322 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 54840

[startup+0.100209 s]
/proc/loadavg: 1.93 2.01 1.95 3/196 31074
/proc/meminfo: memFree=22842844/32873648 swapFree=7120/7120
[pid=31074] ppid=31072 vsize=94520 CPUtime=0.07 cores=0,2,4,6
/proc/31074/stat : 31074 (python) R 31072 31074 27000 0 -1 4202496 3247 505 1 0 5 2 0 0 20 0 1 0 337754886 96788480 2549 33554432000 4194304 5683644 140736096138352 140736096090824 219504742688 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/31074/statm: 23630 2551 826 364 0 1620 0
Current children cumulated CPU time (s) 0.07
Current children cumulated vsize (KiB) 94520

[startup+0.300262 s]
/proc/loadavg: 1.93 2.01 1.95 3/196 31074
/proc/meminfo: memFree=22842844/32873648 swapFree=7120/7120
[pid=31074] ppid=31072 vsize=169712 CPUtime=0.23 cores=0,2,4,6
/proc/31074/stat : 31074 (python) R 31072 31074 27000 0 -1 4202496 6739 1008 1 0 18 5 0 0 20 0 1 0 337754886 173785088 4526 33554432000 4194304 5683644 140736096138352 140736096060488 4540219 0 0 16781312 2 0 0 0 17 2 0 0 0 0 0
/proc/31074/statm: 42428 4528 1253 364 0 3463 0
Current children cumulated CPU time (s) 0.23
Current children cumulated vsize (KiB) 169712

[startup+0.700245 s]
/proc/loadavg: 1.93 2.01 1.95 3/196 31074
/proc/meminfo: memFree=22842844/32873648 swapFree=7120/7120
[pid=31074] ppid=31072 vsize=260012 CPUtime=0.35 cores=0,2,4,6
/proc/31074/stat : 31074 (python) D 31072 31074 27000 0 -1 4202496 9114 1008 1 0 27 8 0 0 20 0 1 0 337754886 266252288 6408 33554432000 4194304 5683644 140736096138352 140736096088072 219513968487 0 0 16781312 2 18446744071580543392 0 0 17 2 0 0 0 0 0
/proc/31074/statm: 65003 6408 1706 364 0 5055 0
Current children cumulated CPU time (s) 0.35
Current children cumulated vsize (KiB) 260012

[startup+1.5001 s]
/proc/loadavg: 1.93 2.01 1.95 3/197 31080
/proc/meminfo: memFree=22813200/32873648 swapFree=7120/7120
[pid=31074] ppid=31072 vsize=360432 CPUtime=0.8 cores=0,2,4,6
/proc/31074/stat : 31074 (python) S 31072 31074 27000 0 -1 4202496 13123 1431 1 0 63 10 7 0 20 0 2 0 337754886 369082368 7995 33554432000 4194304 5683644 140736096138352 140736096133184 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 55 0 0
/proc/31074/statm: 90108 7995 1902 364 0 25331 0
Current children cumulated CPU time (s) 0.8
Current children cumulated vsize (KiB) 360432

[startup+3.10034 s]
/proc/loadavg: 2.02 2.03 1.96 3/200 31083
/proc/meminfo: memFree=22745504/32873648 swapFree=7120/7120
[pid=31074] ppid=31072 vsize=360432 CPUtime=0.8 cores=0,2,4,6
/proc/31074/stat : 31074 (python) S 31072 31074 27000 0 -1 4202496 13123 1431 1 0 63 10 7 0 20 0 2 0 337754886 369082368 7995 33554432000 4194304 5683644 140736096138352 140736096133184 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 55 0 0
/proc/31074/statm: 90108 7995 1902 364 0 25331 0
[pid=31081] ppid=31074 vsize=284652 CPUtime=0 cores=0,2,4,6
/proc/31081/stat : 31081 (python) S 31074 31074 27000 0 -1 4202560 717 0 0 0 0 0 0 0 20 0 1 0 337755030 291483648 6394 33554432000 4194304 5683644 140736096138352 140736096129440 219513979304 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/31081/statm: 71163 6394 307 364 0 6386 0
[pid=31083] ppid=31081 vsize=79228 CPUtime=1.65 cores=0,2,4,6
/proc/31083/stat : 31083 (scip-2.0.1.linu) R 31081 31083 31083 0 -1 4202496 18480 0 0 0 157 8 0 0 20 0 1 0 337755030 81129472 17411 33554432000 4194304 13684479 140734325499408 140734325491272 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0 0 0
/proc/31083/statm: 19807 17411 764 2317 0 17485 0
[pid=31074/tid=31082] ppid=31072 vsize=360432 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31082/stat : 31082 (python) S 31072 31074 27000 0 -1 4202560 27 1431 0 0 0 0 7 0 20 0 2 0 337755030 369082368 7995 33554432000 4194304 5683644 140736096138352 139776824906288 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 2.45
Current children cumulated vsize (KiB) 724312
heavy processes:

[startup+6.30032 s]
/proc/loadavg: 2.02 2.03 1.96 3/200 31083
/proc/meminfo: memFree=22743056/32873648 swapFree=7120/7120
[pid=31074] ppid=31072 vsize=360432 CPUtime=0.8 cores=0,2,4,6
/proc/31074/stat : 31074 (python) S 31072 31074 27000 0 -1 4202496 13123 1431 1 0 63 10 7 0 20 0 2 0 337754886 369082368 7995 33554432000 4194304 5683644 140736096138352 140736096133184 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 55 0 0
/proc/31074/statm: 90108 7995 1902 364 0 25331 0
[pid=31081] ppid=31074 vsize=284652 CPUtime=0 cores=0,2,4,6
/proc/31081/stat : 31081 (python) S 31074 31074 27000 0 -1 4202560 856 0 0 0 0 0 0 0 20 0 1 0 337755030 291483648 6417 33554432000 4194304 5683644 140736096138352 140736096129440 219513979304 0 0 16781312 33554946 18446744071580425449 0 0 17 0 0 0 0 0 0
/proc/31081/statm: 71163 6417 330 364 0 6386 0
[pid=31083] ppid=31081 vsize=79228 CPUtime=4.85 cores=0,2,4,6
/proc/31083/stat : 31083 (scip-2.0.1.linu) R 31081 31083 31083 0 -1 4202496 18480 0 0 0 476 9 0 0 20 0 1 0 337755030 81129472 17411 33554432000 4194304 13684479 140734325499408 140734325491224 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0 0 0
/proc/31083/statm: 19807 17411 764 2317 0 17485 0
[pid=31074/tid=31082] ppid=31072 vsize=360432 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31082/stat : 31082 (python) S 31072 31074 27000 0 -1 4202560 27 1431 0 0 0 0 7 0 20 0 2 0 337755030 369082368 7995 33554432000 4194304 5683644 140736096138352 139776824906288 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 5.65
Current children cumulated vsize (KiB) 724312

[startup+12.7003 s]
/proc/loadavg: 2.01 2.03 1.96 3/200 31083
/proc/meminfo: memFree=22696096/32873648 swapFree=7120/7120
[pid=31074] ppid=31072 vsize=360432 CPUtime=0.8 cores=0,2,4,6
/proc/31074/stat : 31074 (python) S 31072 31074 27000 0 -1 4202496 13123 1431 1 0 63 10 7 0 20 0 2 0 337754886 369082368 7995 33554432000 4194304 5683644 140736096138352 140736096133184 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 55 0 0
/proc/31074/statm: 90108 7995 1902 364 0 25331 0
[pid=31081] ppid=31074 vsize=284652 CPUtime=0 cores=0,2,4,6
/proc/31081/stat : 31081 (python) S 31074 31074 27000 0 -1 4202560 861 0 0 0 0 0 0 0 20 0 1 0 337755030 291483648 6417 33554432000 4194304 5683644 140736096138352 140736096129440 219513979304 0 0 16781312 33554946 18446744071580425449 0 0 17 0 0 0 0 0 0
/proc/31081/statm: 71163 6417 330 364 0 6386 0
[pid=31083] ppid=31081 vsize=124304 CPUtime=11.25 cores=0,2,4,6
/proc/31083/stat : 31083 (scip-2.0.1.linu) R 31081 31083 31083 0 -1 4202496 34720 0 0 0 1110 15 0 0 20 0 1 0 337755030 127287296 28776 33554432000 4194304 13684479 140734325499408 140734325488232 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0 0 0
/proc/31083/statm: 31076 28776 830 2317 0 28754 0
[pid=31074/tid=31082] ppid=31072 vsize=360432 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31082/stat : 31082 (python) S 31072 31074 27000 0 -1 4202560 27 1431 0 0 0 0 7 0 20 0 2 0 337755030 369082368 7995 33554432000 4194304 5683644 140736096138352 139776824906288 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 12.05
Current children cumulated vsize (KiB) 769388

[startup+25.5071 s]
/proc/loadavg: 2.01 2.03 1.96 3/200 31083
/proc/meminfo: memFree=22696104/32873648 swapFree=7120/7120
[pid=31074] ppid=31072 vsize=360432 CPUtime=0.8 cores=0,2,4,6
/proc/31074/stat : 31074 (python) S 31072 31074 27000 0 -1 4202496 13123 1431 1 0 63 10 7 0 20 0 2 0 337754886 369082368 7995 33554432000 4194304 5683644 140736096138352 140736096133184 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 55 0 0
/proc/31074/statm: 90108 7995 1902 364 0 25331 0
[pid=31081] ppid=31074 vsize=284652 CPUtime=0.03 cores=0,2,4,6
/proc/31081/stat : 31081 (python) S 31074 31074 27000 0 -1 4202560 972 0 0 0 2 1 0 0 20 0 1 0 337755030 291483648 6422 33554432000 4194304 5683644 140736096138352 140736096129440 219513979304 0 0 16781312 33554946 18446744071580425449 0 0 17 0 0 0 0 0 0
/proc/31081/statm: 71163 6422 335 364 0 6386 0
[pid=31083] ppid=31081 vsize=124304 CPUtime=24.06 cores=0,2,4,6
/proc/31083/stat : 31083 (scip-2.0.1.linu) R 31081 31083 31083 0 -1 4202496 34765 0 0 0 2386 20 0 0 20 0 1 0 337755030 127287296 28821 33554432000 4194304 13684479 140734325499408 140734325489656 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0 0 0
/proc/31083/statm: 31076 28821 833 2317 0 28754 0
[pid=31074/tid=31082] ppid=31072 vsize=360432 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31082/stat : 31082 (python) S 31072 31074 27000 0 -1 4202560 27 1431 0 0 0 0 7 0 20 0 2 0 337755030 369082368 7995 33554432000 4194304 5683644 140736096138352 139776824906288 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 24.89
Current children cumulated vsize (KiB) 769388

[startup+51.1004 s]
/proc/loadavg: 2.01 2.02 1.96 3/207 31090
/proc/meminfo: memFree=22617116/32873648 swapFree=7120/7120
[pid=31074] ppid=31072 vsize=436224 CPUtime=0.83 cores=0,2,4,6
/proc/31074/stat : 31074 (python) S 31072 31074 27000 0 -1 4202496 14088 1431 1 0 65 11 7 0 20 0 3 0 337754886 446693376 8004 33554432000 4194304 5683644 140736096138352 140736096133184 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 55 0 0
/proc/31074/statm: 109056 8004 1905 364 0 44276 0
[pid=31081] ppid=31074 vsize=360432 CPUtime=0.08 cores=0,2,4,6
/proc/31081/stat : 31081 (python) S 31074 31074 27000 0 -1 4202560 1154 0 0 0 5 3 0 0 20 0 2 0 337755030 369082368 6490 33554432000 4194304 5683644 140736096138352 140736096130000 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/31081/statm: 90108 6490 396 364 0 25331 0
[pid=31083] ppid=31081 vsize=123008 CPUtime=48.98 cores=0,2,4,6
/proc/31083/stat : 31083 (scip-2.0.1.linu) T 31081 31083 31083 0 -1 4202496 37853 0 0 0 4868 30 0 0 20 0 1 0 337755030 125960192 28672 33554432000 4194304 13684479 140734325499408 140734325494488 4900161 0 0 16781312 2 18446744071579387992 0 0 17 4 0 0 0 0 0
/proc/31083/statm: 30752 28672 843 2317 0 28430 0
[pid=31081/tid=31087] ppid=31074 vsize=360432 CPUtime=0 cores=0,2,4,6
/proc/31081/task/31087/stat : 31087 (python) S 31074 31074 27000 0 -1 4202560 43 0 0 0 0 0 0 0 20 0 2 0 337759930 369082368 6490 33554432000 4194304 5683644 140736096138352 139776824906288 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=31088] ppid=31074 vsize=360444 CPUtime=0 cores=0,2,4,6
/proc/31088/stat : 31088 (python) S 31074 31074 27000 0 -1 4202560 711 0 0 0 0 0 0 0 20 0 1 0 337759933 369094656 6398 33554432000 4194304 5683644 140736096138352 140736096129440 219513979363 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/31088/statm: 90111 6398 305 364 0 25331 0
[pid=31090] ppid=31088 vsize=7100 CPUtime=0.62 cores=0,2,4,6
/proc/31090/stat : 31090 (clasp-1.3.7-x86) R 31088 31090 31090 0 -1 4202496 1862 0 0 0 62 0 0 0 20 0 1 0 337759933 7270400 1507 33554432000 134512640 136139019 4286623216 4286622192 134883415 0 0 16781312 16386 0 0 0 17 0 0 0 0 0 0
/proc/31090/statm: 1775 1507 182 398 0 1375 0
[pid=31074/tid=31082] ppid=31072 vsize=436224 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31082/stat : 31082 (python) S 31072 31074 27000 0 -1 4202560 27 1431 0 0 0 0 7 0 20 0 3 0 337755030 446693376 8004 33554432000 4194304 5683644 140736096138352 139776824906288 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=31074/tid=31089] ppid=31072 vsize=436224 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31089/stat : 31089 (python) S 31072 31074 27000 0 -1 4202560 21 1431 0 0 0 0 7 0 20 0 3 0 337759933 446693376 8004 33554432000 4194304 5683644 140736096138352 139776814416432 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 50.51
Current children cumulated vsize (KiB) 1287208

[startup+102.301 s]
/proc/loadavg: 2.00 2.02 1.96 3/212 31095
/proc/meminfo: memFree=22433196/32873648 swapFree=7120/7120
[pid=31074] ppid=31072 vsize=512016 CPUtime=0.85 cores=0,2,4,6
/proc/31074/stat : 31074 (python) S 31072 31074 27000 0 -1 4202496 14972 1431 1 0 67 11 7 0 20 0 4 0 337754886 524304384 8012 33554432000 4194304 5683644 140736096138352 140736096133184 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 55 0 0
/proc/31074/statm: 128004 8012 1907 364 0 63221 0
[pid=31081] ppid=31074 vsize=360432 CPUtime=0.08 cores=0,2,4,6
/proc/31081/stat : 31081 (python) S 31074 31074 27000 0 -1 4202560 1154 0 0 0 5 3 0 0 20 0 2 0 337755030 369082368 6490 33554432000 4194304 5683644 140736096138352 140736096130000 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/31081/statm: 90108 6490 396 364 0 25331 0
[pid=31083] ppid=31081 vsize=123008 CPUtime=48.98 cores=0,2,4,6
/proc/31083/stat : 31083 (scip-2.0.1.linu) T 31081 31083 31083 0 -1 4202496 37853 0 0 0 4868 30 0 0 20 0 1 0 337755030 125960192 28672 33554432000 4194304 13684479 140734325499408 140734325494488 4900161 0 0 16781312 2 18446744071579387992 0 0 17 4 0 0 0 0 0
/proc/31083/statm: 30752 28672 843 2317 0 28430 0
[pid=31081/tid=31087] ppid=31074 vsize=360432 CPUtime=0 cores=0,2,4,6
/proc/31081/task/31087/stat : 31087 (python) S 31074 31074 27000 0 -1 4202560 43 0 0 0 0 0 0 0 20 0 2 0 337759930 369082368 6490 33554432000 4194304 5683644 140736096138352 139776824906288 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=31088] ppid=31074 vsize=360444 CPUtime=0.06 cores=0,2,4,6
/proc/31088/stat : 31088 (python) S 31074 31074 27000 0 -1 4202560 1067 0 0 0 4 2 0 0 20 0 2 0 337759933 369094656 6473 33554432000 4194304 5683644 140736096138352 140736096130000 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/31088/statm: 90111 6473 379 364 0 25331 0
[pid=31090] ppid=31088 vsize=16504 CPUtime=47.09 cores=0,2,4,6
/proc/31090/stat : 31090 (clasp-1.3.7-x86) T 31088 31090 31090 0 -1 4202496 4218 0 0 0 4708 1 0 0 20 0 1 0 337759933 16900096 3863 33554432000 134512640 136139019 4286623216 4286622128 134640605 0 0 16781312 16386 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/31090/statm: 4126 3863 182 398 0 3726 0
[pid=31088/tid=31092] ppid=31074 vsize=360444 CPUtime=0 cores=0,2,4,6
/proc/31088/task/31092/stat : 31092 (python) S 31074 31074 27000 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 337764645 369094656 6473 33554432000 4194304 5683644 140736096138352 139776824906288 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=31093] ppid=31074 vsize=436236 CPUtime=0 cores=0,2,4,6
/proc/31093/stat : 31093 (python) S 31074 31074 27000 0 -1 4202560 890 0 0 0 0 0 0 0 20 0 1 0 337764648 446705664 6429 33554432000 4194304 5683644 140736096138352 140736096129440 219513979363 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/31093/statm: 109059 6429 330 364 0 44276 0
[pid=31095] ppid=31093 vsize=143656 CPUtime=4.67 cores=0,2,4,6
/proc/31095/stat : 31095 (scip-2.0.1.linu) R 31093 31095 31095 0 -1 4202496 38306 0 0 0 452 15 0 0 20 0 1 0 337764648 147103744 30768 33554432000 4194304 15243407 140737394200416 140737394191208 13354455 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/31095/statm: 35914 30768 937 2698 0 33209 0
[pid=31074/tid=31082] ppid=31072 vsize=512016 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31082/stat : 31082 (python) S 31072 31074 27000 0 -1 4202560 27 1431 0 0 0 0 7 0 20 0 4 0 337755030 524304384 8012 33554432000 4194304 5683644 140736096138352 139776824906288 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=31074/tid=31089] ppid=31072 vsize=512016 CPUtime=0.07 cores=0,2,4,6

################
# More data... #
################

[pid=31236] ppid=31074 vsize=740008 CPUtime=0.16 cores=0,2,4,6
/proc/31236/stat : 31236 (python) S 31074 31074 27000 0 -1 4202560 1196 0 0 0 9 7 0 0 20 0 2 0 337852171 757768192 6629 33554432000 4194304 5683644 140736096138352 140736096130000 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/31236/statm: 185002 6629 379 364 0 120207 0
[pid=31238] ppid=31236 vsize=285944 CPUtime=95.33 cores=0,2,4,6
/proc/31238/stat : 31238 (bsolo_pb10) T 31236 31238 31238 0 -1 4202496 69778 0 0 0 9504 29 0 0 20 0 1 0 337852171 292806656 69057 33554432000 134512640 137138936 4289784112 4289783040 134542295 0 0 16781312 16384 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/31238/statm: 71486 69057 190 642 0 70842 0
[pid=31236/tid=31240] ppid=31074 vsize=740008 CPUtime=0 cores=0,2,4,6
/proc/31236/task/31240/stat : 31240 (python) S 31074 31074 27000 0 -1 4202560 49 0 0 0 0 0 0 0 20 0 2 0 337861707 757768192 6629 33554432000 4194304 5683644 140736096138352 139776772457008 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=31074/tid=31082] ppid=31072 vsize=815788 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31082/stat : 31082 (python) S 31072 31074 27000 0 -1 4202560 42 1431 0 0 0 0 7 0 20 0 8 0 337755030 835366912 8678 33554432000 4194304 5683644 140736096138352 139776824906288 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=31074/tid=31089] ppid=31072 vsize=815788 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31089/stat : 31089 (python) S 31072 31074 27000 0 -1 4202560 30 1431 0 0 0 0 7 0 20 0 8 0 337759933 835366912 8678 33554432000 4194304 5683644 140736096138352 139776814416432 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=31074/tid=31094] ppid=31072 vsize=815788 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31094/stat : 31094 (python) S 31072 31074 27000 0 -1 4202560 21 1431 0 0 0 0 7 0 20 0 8 0 337764648 835366912 8678 33554432000 4194304 5683644 140736096138352 139776803926576 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=31074/tid=31102] ppid=31072 vsize=815788 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31102/stat : 31102 (python) S 31072 31074 27000 0 -1 4202560 21 1431 0 0 0 0 7 0 20 0 8 0 337778367 835366912 8678 33554432000 4194304 5683644 140736096138352 139776793436720 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=31074/tid=31106] ppid=31072 vsize=815788 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31106/stat : 31106 (python) S 31072 31074 27000 0 -1 4202560 21 1431 0 0 0 0 7 0 20 0 8 0 337796842 835366912 8678 33554432000 4194304 5683644 140736096138352 139776782946864 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=31074/tid=31129] ppid=31072 vsize=815788 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31129/stat : 31129 (python) S 31072 31074 27000 0 -1 4202560 22 1431 0 0 0 0 7 0 20 0 8 0 337805963 835366912 8678 33554432000 4194304 5683644 140736096138352 139776772457008 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=31074/tid=31237] ppid=31072 vsize=815788 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31237/stat : 31237 (python) S 31072 31074 27000 0 -1 4202560 20 1431 0 0 0 0 7 0 20 0 8 0 337852171 835366912 8678 33554432000 4194304 5683644 140736096138352 139776422306352 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 1606.35
Current children cumulated vsize (KiB) 14893048



Maximum VSize exceeded: sending SIGTERM then SIGKILL

[startup+1616.2 s]
/proc/loadavg: 2.07 2.03 2.00 3/267 31276
/proc/meminfo: memFree=21384876/32873648 swapFree=7120/7120
[pid=31074] ppid=31072 vsize=891580 CPUtime=1.87 cores=0,2,4,6
/proc/31074/stat : 31074 (python) S 31072 31074 27000 0 -1 4202496 19959 1431 1 0 167 13 7 0 20 0 9 0 337754886 912977920 8686 33554432000 4194304 5683644 140736096138352 140736096133184 219517347085 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 55 0 0
/proc/31074/statm: 222895 8686 1917 364 0 158097 0
[pid=31081] ppid=31074 vsize=360432 CPUtime=1.9 cores=0,2,4,6
/proc/31081/stat : 31081 (python) S 31074 31074 27000 0 -1 4202560 1243 0 0 0 110 80 0 0 20 0 2 0 337755030 369082368 6500 33554432000 4194304 5683644 140736096138352 140736096130000 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/31081/statm: 90108 6500 406 364 0 25331 0
[pid=31083] ppid=31081 vsize=152708 CPUtime=1054.05 cores=0,2,4,6
/proc/31083/stat : 31083 (scip-2.0.1.linu) T 31081 31083 31083 0 -1 4202496 44983 0 0 0 105037 368 0 0 20 0 1 0 337755030 156372992 36240 33554432000 4194304 13684479 140734325499408 140734325493240 7390773 0 0 16781312 2 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/31083/statm: 38177 36240 847 2317 0 35855 0
[pid=31081/tid=31087] ppid=31074 vsize=360432 CPUtime=0 cores=0,2,4,6
/proc/31081/task/31087/stat : 31087 (python) S 31074 31074 27000 0 -1 4202560 43 0 0 0 0 0 0 0 20 0 2 0 337759930 369082368 6500 33554432000 4194304 5683644 140736096138352 139776824906288 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=31088] ppid=31074 vsize=360444 CPUtime=0.37 cores=0,2,4,6
/proc/31088/stat : 31088 (python) S 31074 31074 27000 0 -1 4202560 1174 0 0 0 20 17 0 0 20 0 2 0 337759933 369094656 6473 33554432000 4194304 5683644 140736096138352 140736096130000 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/31088/statm: 90111 6473 379 364 0 25331 0
[pid=31090] ppid=31088 vsize=20464 CPUtime=229.52 cores=0,2,4,6
/proc/31090/stat : 31090 (clasp-1.3.7-x86) T 31088 31090 31090 0 -1 4202496 5218 0 0 0 22951 1 0 0 20 0 1 0 337759933 20955136 4866 33554432000 134512640 136139019 4286623216 4286622192 134634749 0 0 16781312 16386 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/31090/statm: 5116 4866 182 398 0 4716 0
[pid=31088/tid=31092] ppid=31074 vsize=360444 CPUtime=0 cores=0,2,4,6
/proc/31088/task/31092/stat : 31092 (python) S 31074 31074 27000 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 337764645 369094656 6473 33554432000 4194304 5683644 140736096138352 139776824906288 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=31093] ppid=31074 vsize=436236 CPUtime=0.15 cores=0,2,4,6
/proc/31093/stat : 31093 (python) S 31074 31074 27000 0 -1 4202560 1141 0 0 0 10 5 0 0 20 0 2 0 337764648 446705664 6479 33554432000 4194304 5683644 140736096138352 140736096130000 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/31093/statm: 109059 6479 379 364 0 44276 0
[pid=31095] ppid=31093 vsize=122680 CPUtime=91.96 cores=0,2,4,6
/proc/31095/stat : 31095 (scip-2.0.1.linu) T 31093 31095 31095 0 -1 4202496 60650 0 0 0 9160 36 0 0 20 0 1 0 337764648 125624320 28645 33554432000 4194304 15243407 140737394200416 140737394194808 8125896 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/31095/statm: 30670 28645 981 2698 0 27965 0
[pid=31093/tid=31099] ppid=31074 vsize=436236 CPUtime=0 cores=0,2,4,6
/proc/31093/task/31099/stat : 31099 (python) S 31074 31074 27000 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 337769628 446705664 6479 33554432000 4194304 5683644 140736096138352 139776814416432 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=31101] ppid=31074 vsize=512028 CPUtime=0.07 cores=0,2,4,6
/proc/31101/stat : 31101 (python) S 31074 31074 27000 0 -1 4202560 1124 0 0 0 4 3 0 0 20 0 2 0 337778367 524316672 6485 33554432000 4194304 5683644 140736096138352 140736096130000 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/31101/statm: 128007 6485 379 364 0 63221 0
[pid=31103] ppid=31101 vsize=122296 CPUtime=47.31 cores=0,2,4,6
/proc/31103/stat : 31103 (wbo1.4a) T 31101 31103 31103 0 -1 4202496 30459 0 0 0 4709 22 0 0 20 0 1 0 337778368 125231104 30105 33554432000 134512640 135751879 4286842544 4286840720 134616336 0 0 16781312 3 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/31103/statm: 30574 30105 143 303 0 30269 0
[pid=31101/tid=31104] ppid=31074 vsize=512028 CPUtime=0 cores=0,2,4,6
/proc/31101/task/31104/stat : 31104 (python) S 31074 31074 27000 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 337783100 524316672 6485 33554432000 4194304 5683644 140736096138352 139776803926576 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=31105] ppid=31074 vsize=587820 CPUtime=0.08 cores=0,2,4,6
/proc/31105/stat : 31105 (python) S 31074 31074 27000 0 -1 4202560 1152 0 0 0 4 4 0 0 20 0 2 0 337796842 601927680 6491 33554432000 4194304 5683644 140736096138352 140736096130000 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/31105/statm: 146955 6491 379 364 0 82166 0
[pid=31107] ppid=31105 vsize=9624972 CPUtime=49.93 cores=0,2,4,6
/proc/31107/stat : 31107 (java) T 31105 31107 31107 0 -1 4202496 17432 0 1 0 4935 58 0 0 20 0 19 0 337796842 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140734491988720 219517321277 0 0 0 16800975 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/31107/statm: 2406243 538127 2272 9 0 2396937 0
[pid=31107/tid=31108] ppid=31105 vsize=9624972 CPUtime=47.32 cores=0,2,4,6
/proc/31107/task/31108/stat : 31108 (java) T 31105 31107 31107 0 -1 4202560 3855 0 1 0 4701 31 0 0 20 0 19 0 337796843 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058337037728 140058162859038 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=31107/tid=31109] ppid=31105 vsize=9624972 CPUtime=0.1 cores=0,2,4,6
/proc/31107/task/31109/stat : 31109 (java) T 31105 31107 31107 0 -1 4202560 70 0 0 0 7 3 0 0 20 0 19 0 337796844 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058298530472 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=31107/tid=31110] ppid=31105 vsize=9624972 CPUtime=0.11 cores=0,2,4,6
/proc/31107/task/31110/stat : 31110 (java) T 31105 31107 31107 0 -1 4202560 62 0 0 0 8 3 0 0 20 0 19 0 337796844 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058297477928 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=31107/tid=31111] ppid=31105 vsize=9624972 CPUtime=0.09 cores=0,2,4,6
/proc/31107/task/31111/stat : 31111 (java) T 31105 31107 31107 0 -1 4202560 36 0 0 0 6 3 0 0 20 0 19 0 337796844 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058296425384 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=31107/tid=31112] ppid=31105 vsize=9624972 CPUtime=0.11 cores=0,2,4,6
/proc/31107/task/31112/stat : 31112 (java) T 31105 31107 31107 0 -1 4202560 64 0 0 0 8 3 0 0 20 0 19 0 337796844 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058295372840 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=31107/tid=31113] ppid=31105 vsize=9624972 CPUtime=0.15 cores=0,2,4,6
/proc/31107/task/31113/stat : 31113 (java) T 31105 31107 31107 0 -1 4202560 83 0 0 0 11 4 0 0 20 0 19 0 337796844 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058294319272 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=31107/tid=31114] ppid=31105 vsize=9624972 CPUtime=0.1 cores=0,2,4,6
/proc/31107/task/31114/stat : 31114 (java) T 31105 31107 31107 0 -1 4202560 75 0 0 0 7 3 0 0 20 0 19 0 337796844 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058293266728 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=31107/tid=31115] ppid=31105 vsize=9624972 CPUtime=0.12 cores=0,2,4,6
/proc/31107/task/31115/stat : 31115 (java) T 31105 31107 31107 0 -1 4202560 75 0 0 0 9 3 0 0 20 0 19 0 337796844 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058292214184 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=31107/tid=31116] ppid=31105 vsize=9624972 CPUtime=0.09 cores=0,2,4,6
/proc/31107/task/31116/stat : 31116 (java) T 31105 31107 31107 0 -1 4202560 52 0 0 0 7 2 0 0 20 0 19 0 337796844 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058291161640 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=31107/tid=31117] ppid=31105 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/31107/task/31117/stat : 31117 (java) T 31105 31107 31107 0 -1 4202560 959 0 0 0 0 0 0 0 20 0 19 0 337796845 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058161044072 219517335465 0 0 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=31107/tid=31118] ppid=31105 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/31107/task/31118/stat : 31118 (java) T 31105 31107 31107 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 337796846 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058159990392 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=31107/tid=31119] ppid=31105 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/31107/task/31119/stat : 31119 (java) T 31105 31107 31107 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 337796846 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058158937736 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=31107/tid=31120] ppid=31105 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/31107/task/31120/stat : 31120 (java) T 31105 31107 31107 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337796848 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058157886480 219517343520 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=31107/tid=31121] ppid=31105 vsize=9624972 CPUtime=0.83 cores=0,2,4,6
/proc/31107/task/31121/stat : 31121 (java) T 31105 31107 31107 0 -1 4202560 4623 0 0 0 81 2 0 0 20 0 19 0 337796848 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058156832824 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=31107/tid=31122] ppid=31105 vsize=9624972 CPUtime=0.77 cores=0,2,4,6
/proc/31107/task/31122/stat : 31122 (java) T 31105 31107 31107 0 -1 4202560 6059 0 0 0 75 2 0 0 20 0 19 0 337796848 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058155780280 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=31107/tid=31123] ppid=31105 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/31107/task/31123/stat : 31123 (java) T 31105 31107 31107 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337796848 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058154727928 219517334588 0 4 0 16800975 18446744071579387992 0 0 -1 6 0 0 0 0 0
[pid=31107/tid=31124] ppid=31105 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/31107/task/31124/stat : 31124 (java) T 31105 31107 31107 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 19 0 337796848 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058153675592 219517335465 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=31107/tid=31125] ppid=31105 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/31107/task/31125/stat : 31125 (java) T 31105 31107 31107 0 -1 4202560 12 0 0 0 0 0 0 0 20 0 19 0 337796893 9855971328 538127 33554432000 1073741824 1073778376 140734491997584 140058152621352 219517335465 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=31105/tid=31127] ppid=31074 vsize=587820 CPUtime=0 cores=0,2,4,6
/proc/31105/task/31127/stat : 31127 (python) S 31074 31074 27000 0 -1 4202560 45 0 0 0 0 0 0 0 20 0 2 0 337801605 601927680 6491 33554432000 4194304 5683644 140736096138352 139776793436720 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=31128] ppid=31074 vsize=663612 CPUtime=0.08 cores=0,2,4,6
/proc/31128/stat : 31128 (python) S 31074 31074 27000 0 -1 4202560 1152 0 0 0 3 5 0 0 20 0 2 0 337805963 679538688 6497 33554432000 4194304 5683644 140736096138352 140736096130000 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/31128/statm: 165903 6497 379 364 0 101111 0
[pid=31130] ppid=31128 vsize=87616 CPUtime=47.2 cores=0,2,4,6
/proc/31130/stat : 31130 (bsolo_pb10) T 31128 31130 31130 0 -1 4202496 20177 0 0 0 4712 8 0 0 20 0 1 0 337805964 89718784 19459 33554432000 134512640 137138936 4290586240 4290585168 134542525 0 0 16781312 16384 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/31130/statm: 21904 19459 192 642 0 21260 0
[pid=31128/tid=31131] ppid=31074 vsize=663612 CPUtime=0 cores=0,2,4,6
/proc/31128/task/31131/stat : 31131 (python) S 31074 31074 27000 0 -1 4202560 50 0 0 0 0 0 0 0 20 0 2 0 337810686 679538688 6497 33554432000 4194304 5683644 140736096138352 139776782946864 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=31236] ppid=31074 vsize=740008 CPUtime=0.16 cores=0,2,4,6
/proc/31236/stat : 31236 (python) S 31074 31074 27000 0 -1 4202560 1196 0 0 0 9 7 0 0 20 0 2 0 337852171 757768192 6629 33554432000 4194304 5683644 140736096138352 140736096130000 219517347085 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/31236/statm: 185002 6629 379 364 0 120207 0
[pid=31238] ppid=31236 vsize=285944 CPUtime=95.33 cores=0,2,4,6
/proc/31238/stat : 31238 (bsolo_pb10) T 31236 31238 31238 0 -1 4202496 69778 0 0 0 9504 29 0 0 20 0 1 0 337852171 292806656 69057 33554432000 134512640 137138936 4289784112 4289783040 134542295 0 0 16781312 16384 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/31238/statm: 71486 69057 190 642 0 70842 0
[pid=31236/tid=31240] ppid=31074 vsize=740008 CPUtime=0 cores=0,2,4,6
/proc/31236/task/31240/stat : 31240 (python) S 31074 31074 27000 0 -1 4202560 49 0 0 0 0 0 0 0 20 0 2 0 337861707 757768192 6629 33554432000 4194304 5683644 140736096138352 139776772457008 219517343520 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=31274] ppid=31074 vsize=815800 CPUtime=0 cores=0,2,4,6
/proc/31274/stat : 31274 (python) S 31074 31074 27000 0 -1 4202560 813 0 0 0 0 0 0 0 20 0 1 0 337916477 835379200 7071 33554432000 4194304 5683644 140736096138352 140736096129440 219513979363 0 0 16781312 33554946 18446744071580425449 0 0 17 6 0 0 0 0 0
/proc/31274/statm: 203950 7071 308 364 0 139152 0
[pid=31276] ppid=31274 vsize=99392 CPUtime=0.29 cores=0,2,4,6
/proc/31276/stat : 31276 (minion) R 31274 31276 31276 0 -1 4202496 11395 0 0 0 27 2 0 0 20 0 1 0 337916478 101777408 17552 33554432000 134512640 165565024 4287538016 4287535296 142424327 0 0 16781312 8396802 0 0 0 17 2 0 0 0 0 0
/proc/31276/statm: 24848 17552 358 7582 0 17263 0
[pid=31074/tid=31082] ppid=31072 vsize=891580 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31082/stat : 31082 (python) S 31072 31074 27000 0 -1 4202560 42 1431 0 0 0 0 7 0 20 0 9 0 337755030 912977920 8686 33554432000 4194304 5683644 140736096138352 139776824906288 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=31074/tid=31089] ppid=31072 vsize=891580 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31089/stat : 31089 (python) S 31072 31074 27000 0 -1 4202560 30 1431 0 0 0 0 7 0 20 0 9 0 337759933 912977920 8686 33554432000 4194304 5683644 140736096138352 139776814416432 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=31074/tid=31094] ppid=31072 vsize=891580 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31094/stat : 31094 (python) S 31072 31074 27000 0 -1 4202560 21 1431 0 0 0 0 7 0 20 0 9 0 337764648 912977920 8686 33554432000 4194304 5683644 140736096138352 139776803926576 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=31074/tid=31102] ppid=31072 vsize=891580 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31102/stat : 31102 (python) S 31072 31074 27000 0 -1 4202560 21 1431 0 0 0 0 7 0 20 0 9 0 337778367 912977920 8686 33554432000 4194304 5683644 140736096138352 139776793436720 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=31074/tid=31106] ppid=31072 vsize=891580 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31106/stat : 31106 (python) S 31072 31074 27000 0 -1 4202560 21 1431 0 0 0 0 7 0 20 0 9 0 337796842 912977920 8686 33554432000 4194304 5683644 140736096138352 139776782946864 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=31074/tid=31129] ppid=31072 vsize=891580 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31129/stat : 31129 (python) S 31072 31074 27000 0 -1 4202560 22 1431 0 0 0 0 7 0 20 0 9 0 337805963 912977920 8686 33554432000 4194304 5683644 140736096138352 139776772457008 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=31074/tid=31237] ppid=31072 vsize=891580 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31237/stat : 31237 (python) S 31072 31074 27000 0 -1 4202560 20 1431 0 0 0 0 7 0 20 0 9 0 337852171 912977920 8686 33554432000 4194304 5683644 140736096138352 139776422306352 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=31074/tid=31275] ppid=31072 vsize=891580 CPUtime=0.07 cores=0,2,4,6
/proc/31074/task/31275/stat : 31275 (python) S 31072 31074 27000 0 -1 4202560 22 1431 0 0 0 0 7 0 20 0 9 0 337916477 912977920 8686 33554432000 4194304 5683644 140736096138352 139776411816496 219517343520 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
Current children cumulated CPU time (s) 1620.27
Current children cumulated vsize (KiB) 15884032

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31074 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=754733
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=149977
# CPU time returned by wait4() is 1.90471
# while last known CPU time is 1620.27
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1616.26
CPU time (s): 1620.27
CPU user time (s): 1613.69
CPU system time (s): 6.58
CPU usage (%): 100.248
Max. virtual memory (cumulated for all children) (KiB): 15884032

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.75473
system time used= 0.149977
maximum resident set size= 34744
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 21746
page faults= 1
swaps= 0
block input operations= 0
block output operations= 3064
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 6161
involuntary context switches= 50

runsolver used 8.21175 second user time and 20.2929 second system time

The end

Launcher Data 

Begin job on node114 at 2012-06-03 11:37:55
IDJOB=3737770
IDBENCH=48313
IDSOLVER=2327
FILE ID=node114/3737770-1338716275
RUNJOBID= node114-1338713908-27016
PBS_JOBID= 14636748
Free space on /tmp= 70000 MiB

SOLVER NAME= PB11: borg pb-dec-11.04.03
BENCH NAME= PB07/normalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/manquinho/dbsg/normalized-dbsg_200_25_5_40.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3737770-1338716275/watcher-3737770-1338716275 -o /tmp/evaluation-result-3737770-1338716275/solver-3737770-1338716275 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3737770-1338716275.opb -seed 462299973 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c1794605d16cd8196553c490f5507fd9
RANDOM SEED=462299973

node114.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5451.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.242
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        22843108 kB
Buffers:         1000300 kB
Cached:          4530892 kB
SwapCached:         2312 kB
Active:          6523568 kB
Inactive:        2508924 kB
Active(anon):    3487344 kB
Inactive(anon):     8524 kB
Active(file):    3036224 kB
Inactive(file):  2500400 kB
Unevictable:        7120 kB
Mlocked:            7120 kB
SwapTotal:      67108856 kB
SwapFree:       67103580 kB
Dirty:            104496 kB
Writeback:             0 kB
AnonPages:       3498228 kB
Mapped:            25332 kB
Shmem:               196 kB
Slab:             849040 kB
SReclaimable:     290512 kB
SUnreclaim:       558528 kB
KernelStack:        1616 kB
PageTables:        15428 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    4526200 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    235520 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 69936 MiB
End job on node114 at 2012-06-03 12:04:54