Trace number 3482341

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
borg pb-dec-11.04.03UNSAT 1615.52 1606.75

General information on the benchmark

Namenormalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/
manquinho/dbsg/normalized-dbsg_100_25_4_40.opb
MD5SUM4bc8406e35a3f2674c743b72d3a1792a
Bench CategoryDEC-SMALLINT-NLC (no optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark15.0377
Has Objective FunctionNO
SatisfiableNO
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved
Number of variables200
Total number of constraints302
Number of constraints which are clauses100
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints201
Minimum length of a constraint2
Maximum length of a constraint200
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 40
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 200
Number of bits of the biggest sum of numbers8
Number of products (including duplicates)6140
Sum of products size (including duplicates)12280
Number of different products3070
Sum of products size6140

Solver Data

0.30/0.49	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.30/0.49	c INFO: solving HOME/instance-3482341-1307576546.opb
0.38/0.56	c INFO: wrote linearized instance to HOME/tmpVgLfUt.opb
0.48/0.60	c INFO: parsing took 0.04 s
0.48/0.69	c INFO: features took 0.09 CPU seconds
0.58/0.71	c INFO: running scip-2.0.1-spx@0 for 45 with 1799 remaining (b = 0.43)
46.96/46.93	c INFO: running clasp-1.3.7@0 for 45 with 1753 remaining (b = 0.08)
95.33/95.14	c INFO: running scip-2.0.1-clp@0 for 45 with 1705 remaining (b = 0.03)
142.80/142.46	c INFO: running clasp-1.3.7@48 for 45 with 1658 remaining (b = 0.01)
189.70/189.10	c INFO: wrote minion input file to HOME/tmpmVQLc0.minion
189.70/189.10	c INFO: running minion-0.12@0 for 45 with 1612 remaining (b = 0.01)
238.17/237.48	c INFO: running scip-2.0.1-clp@47 for 45 with 1563 remaining (b = 0.01)
283.69/282.71	c INFO: running bsolo_pb10-l3@0 for 45 with 1518 remaining (b = 0.01)
332.95/331.89	c INFO: running clasp-1.3.7@94 for 136 with 1469 remaining (b = 0.02)
469.11/467.48	c INFO: running scip-2.0.1-spx@45 for 45 with 1333 remaining (b = 0.01)
519.65/517.71	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1283 remaining (b = 0.01)
570.66/566.40	c INFO: running scip-2.0.1-spx@95 for 410 with 1233 remaining (b = 0.06)
982.94/977.09	c INFO: running bsolo_pb10-l1@0 for 91 with 825 remaining (b = 0.01)
1075.62/1069.32	c INFO: running pbct-0.1.2-linear@0 for 45 with 733 remaining (b = 0.01)
1123.99/1117.57	c INFO: running scip-2.0.1-spx@503 for 547 with 685 remaining (b = 0.05)
1615.36/1606.73	s UNSATISFIABLE

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 977)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3482341-1307576546/watcher-3482341-1307576546 -o /tmp/evaluation-result-3482341-1307576546/solver-3482341-1307576546 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482341-1307576546.opb -seed 2115914433 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.84 0.63 0.22 2/484 30441
/proc/meminfo: memFree=31843588/32951124 swapFree=34789492/67111528
[pid=30441] ppid=30439 vsize=16240 CPUtime=0.01 cores=0,2,4,6
/proc/30441/stat : 30441 (python) R 30439 30441 29517 0 -1 4202496 1051 0 0 0 1 0 0 0 17 0 1 0 869257048 16629760 922 33554432000 4194304 5683644 140733315906784 18446744073709551615 212436012980 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/30441/statm: 4060 922 381 364 0 547 0

[startup+0.10315 s]
/proc/loadavg: 1.84 0.63 0.22 2/484 30441
/proc/meminfo: memFree=31843588/32951124 swapFree=34789492/67111528
[pid=30441] ppid=30439 vsize=96128 CPUtime=0.08 cores=0,2,4,6
/proc/30441/stat : 30441 (python) R 30439 30441 29517 0 -1 4202496 3169 930 1 0 6 2 0 0 18 0 1 0 869257048 98435072 2484 33554432000 4194304 5683644 140733315906784 18446744073709551615 5168783 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/30441/statm: 24032 2484 792 364 0 1627 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 96128

[startup+0.201187 s]
/proc/loadavg: 1.84 0.63 0.22 2/484 30441
/proc/meminfo: memFree=31843588/32951124 swapFree=34789492/67111528
[pid=30441] ppid=30439 vsize=123744 CPUtime=0.15 cores=0,2,4,6
/proc/30441/stat : 30441 (python) R 30439 30441 29517 0 -1 4202496 5358 930 1 0 11 4 0 0 17 0 1 0 869257048 126713856 3745 33554432000 4194304 5683644 140733315906784 18446744073709551615 212436013061 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/30441/statm: 30936 3745 987 364 0 2768 0
Current children cumulated CPU time (s) 0.15
Current children cumulated vsize (KiB) 123744

[startup+0.301166 s]
/proc/loadavg: 1.84 0.63 0.22 2/484 30441
/proc/meminfo: memFree=31843588/32951124 swapFree=34789492/67111528
[pid=30441] ppid=30439 vsize=179992 CPUtime=0.22 cores=0,2,4,6
/proc/30441/stat : 30441 (python) S 30439 30441 29517 0 -1 4202496 6270 930 1 0 16 6 0 0 17 0 1 0 869257048 184311808 4578 33554432000 4194304 5683644 140733315906784 18446744073709551615 212436015104 0 2147483391 16781312 2 18446744071699207358 0 0 17 4 0 0 0
/proc/30441/statm: 44999 4579 1244 364 0 3569 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 179992

[startup+0.701081 s]
/proc/loadavg: 1.84 0.63 0.22 2/484 30441
/proc/meminfo: memFree=31843588/32951124 swapFree=34789492/67111528
[pid=30441] ppid=30439 vsize=284892 CPUtime=0.58 cores=0,2,4,6
/proc/30441/stat : 30441 (python) R 30439 30441 29517 0 -1 4202496 10885 1349 1 0 44 11 3 0 17 0 1 0 869257048 291729408 7608 33554432000 4194304 5683644 140733315906784 18446744073709551615 212439425717 0 0 16781312 33554434 0 0 0 17 4 0 0 0
/proc/30441/statm: 71223 7608 1856 364 0 6113 0
Current children cumulated CPU time (s) 0.58
Current children cumulated vsize (KiB) 284892

[startup+1.50092 s]
/proc/loadavg: 1.84 0.63 0.22 3/488 30450
/proc/meminfo: memFree=31779316/32951124 swapFree=34789492/67111528
[pid=30441] ppid=30439 vsize=295148 CPUtime=0.6 cores=0,2,4,6
/proc/30441/stat : 30441 (python) S 30439 30441 29517 0 -1 4202496 11149 1349 1 0 46 11 3 0 19 0 2 0 869257048 302231552 7619 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/30441/statm: 73787 7619 1863 364 0 8674 0
[pid=30448] ppid=30441 vsize=284904 CPUtime=0 cores=0,2,4,6
/proc/30448/stat : 30448 (python) S 30441 30441 29517 0 -1 4202560 709 0 0 0 0 0 0 0 16 0 1 0 869257120 291741696 6071 33554432000 4194304 5683644 140733315906784 18446744073709551615 212436037135 0 0 16781312 33554946 11536438257642340609 0 0 17 4 0 0 0
/proc/30448/statm: 71226 6071 319 364 0 6113 0
[pid=30450] ppid=30448 vsize=50248 CPUtime=0.77 cores=0,2,4,6
/proc/30450/stat : 30450 (scip-2.0.1.linu) R 30448 30450 30450 0 -1 4202496 10951 0 0 0 69 8 0 0 21 0 1 0 869257120 51453952 10167 33554432000 4194304 13684479 140737097441904 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/30450/statm: 12562 10167 758 2317 0 10240 0
[pid=30441/tid=30449] ppid=30439 vsize=295148 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30449/stat : 30449 (python) S 30439 30441 29517 0 -1 4202560 25 1349 0 0 0 0 3 0 19 0 2 0 869257120 302231552 7619 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 630300

[startup+3.10061 s]
/proc/loadavg: 1.93 0.67 0.24 3/488 30450
/proc/meminfo: memFree=31775480/32951124 swapFree=34789492/67111528
[pid=30441] ppid=30439 vsize=295148 CPUtime=0.6 cores=0,2,4,6
/proc/30441/stat : 30441 (python) S 30439 30441 29517 0 -1 4202496 11149 1349 1 0 46 11 3 0 19 0 2 0 869257048 302231552 7619 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/30441/statm: 73787 7619 1863 364 0 8674 0
[pid=30448] ppid=30441 vsize=284904 CPUtime=0 cores=0,2,4,6
/proc/30448/stat : 30448 (python) S 30441 30441 29517 0 -1 4202560 841 0 0 0 0 0 0 0 15 0 1 0 869257120 291741696 6077 33554432000 4194304 5683644 140733315906784 18446744073709551615 212436037135 0 0 16781312 33554946 2259663439242723328 0 0 17 4 0 0 0
/proc/30448/statm: 71226 6077 325 364 0 6113 0
[pid=30450] ppid=30448 vsize=51064 CPUtime=2.37 cores=0,2,4,6
/proc/30450/stat : 30450 (scip-2.0.1.linu) R 30448 30450 30450 0 -1 4202496 11357 0 0 0 228 9 0 0 25 0 1 0 869257120 52289536 10568 33554432000 4194304 13684479 140737097441904 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 4 0 0 0
/proc/30450/statm: 12766 10568 764 2317 0 10444 0
[pid=30441/tid=30449] ppid=30439 vsize=295148 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30449/stat : 30449 (python) S 30439 30441 29517 0 -1 4202560 25 1349 0 0 0 0 3 0 19 0 2 0 869257120 302231552 7619 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 2.97
Current children cumulated vsize (KiB) 631116

[startup+6.30101 s]
/proc/loadavg: 1.93 0.67 0.24 3/488 30450
/proc/meminfo: memFree=31773792/32951124 swapFree=34789492/67111528
[pid=30441] ppid=30439 vsize=295148 CPUtime=0.6 cores=0,2,4,6
/proc/30441/stat : 30441 (python) S 30439 30441 29517 0 -1 4202496 11149 1349 1 0 46 11 3 0 19 0 2 0 869257048 302231552 7619 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/30441/statm: 73787 7619 1863 364 0 8674 0
[pid=30448] ppid=30441 vsize=284904 CPUtime=0.01 cores=0,2,4,6
/proc/30448/stat : 30448 (python) S 30441 30441 29517 0 -1 4202560 967 0 0 0 1 0 0 0 15 0 1 0 869257120 291741696 6100 33554432000 4194304 5683644 140733315906784 18446744073709551615 212436037135 0 0 16781312 33554946 11536429942585655553 0 0 17 4 0 0 0
/proc/30448/statm: 71226 6100 348 364 0 6113 0
[pid=30450] ppid=30448 vsize=51064 CPUtime=5.56 cores=0,2,4,6
/proc/30450/stat : 30450 (scip-2.0.1.linu) R 30448 30450 30450 0 -1 4202496 11361 0 0 0 546 10 0 0 25 0 1 0 869257120 52289536 10572 33554432000 4194304 13684479 140737097441904 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/30450/statm: 12766 10572 768 2317 0 10444 0
[pid=30441/tid=30449] ppid=30439 vsize=295148 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30449/stat : 30449 (python) S 30439 30441 29517 0 -1 4202560 25 1349 0 0 0 0 3 0 19 0 2 0 869257120 302231552 7619 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 631116

[startup+12.7008 s]
/proc/loadavg: 1.94 0.71 0.25 3/488 30450
/proc/meminfo: memFree=31746236/32951124 swapFree=34789492/67111528
[pid=30441] ppid=30439 vsize=295148 CPUtime=0.6 cores=0,2,4,6
/proc/30441/stat : 30441 (python) S 30439 30441 29517 0 -1 4202496 11149 1349 1 0 46 11 3 0 19 0 2 0 869257048 302231552 7619 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/30441/statm: 73787 7619 1863 364 0 8674 0
[pid=30448] ppid=30441 vsize=284904 CPUtime=0.03 cores=0,2,4,6
/proc/30448/stat : 30448 (python) S 30441 30441 29517 0 -1 4202560 970 0 0 0 2 1 0 0 15 0 1 0 869257120 291741696 6100 33554432000 4194304 5683644 140733315906784 18446744073709551615 212436037135 0 0 16781312 33554946 72556772316949340 0 0 17 6 0 0 0
/proc/30448/statm: 71226 6100 348 364 0 6113 0
[pid=30450] ppid=30448 vsize=77240 CPUtime=11.96 cores=0,2,4,6
/proc/30450/stat : 30450 (scip-2.0.1.linu) R 30448 30450 30450 0 -1 4202496 19946 0 0 0 1178 18 0 0 25 0 1 0 869257120 79093760 17193 33554432000 4194304 13684479 140737097441904 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/30450/statm: 19310 17193 834 2317 0 16988 0
[pid=30441/tid=30449] ppid=30439 vsize=295148 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30449/stat : 30449 (python) S 30439 30441 29517 0 -1 4202560 25 1349 0 0 0 0 3 0 19 0 2 0 869257120 302231552 7619 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 12.59
Current children cumulated vsize (KiB) 657292

[startup+25.5004 s]
/proc/loadavg: 1.95 0.75 0.27 3/488 30451
/proc/meminfo: memFree=31743136/32951124 swapFree=34789492/67111528
[pid=30441] ppid=30439 vsize=295148 CPUtime=0.6 cores=0,2,4,6
/proc/30441/stat : 30441 (python) S 30439 30441 29517 0 -1 4202496 11149 1349 1 0 46 11 3 0 19 0 2 0 869257048 302231552 7619 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/30441/statm: 73787 7619 1863 364 0 8674 0
[pid=30448] ppid=30441 vsize=284904 CPUtime=0.1 cores=0,2,4,6
/proc/30448/stat : 30448 (python) S 30441 30441 29517 0 -1 4202560 977 0 0 0 6 4 0 0 15 0 1 0 869257120 291741696 6100 33554432000 4194304 5683644 140733315906784 18446744073709551615 212436037135 0 0 16781312 33554946 4294934785 0 0 17 6 0 0 0
/proc/30448/statm: 71226 6100 348 364 0 6113 0
[pid=30450] ppid=30448 vsize=87760 CPUtime=24.76 cores=0,2,4,6
/proc/30450/stat : 30450 (scip-2.0.1.linu) R 30448 30450 30450 0 -1 4202496 24542 0 0 0 2449 27 0 0 20 0 1 0 869257120 89866240 19607 33554432000 4194304 13684479 140737097441904 18446744073709551615 4876496 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/30450/statm: 21940 19607 845 2317 0 19618 0
[pid=30441/tid=30449] ppid=30439 vsize=295148 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30449/stat : 30449 (python) S 30439 30441 29517 0 -1 4202560 25 1349 0 0 0 0 3 0 19 0 2 0 869257120 302231552 7619 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 667812

[startup+51.1176 s]
/proc/loadavg: 2.04 0.87 0.32 3/496 30459
/proc/meminfo: memFree=31555448/32951124 swapFree=34789492/67111528
[pid=30441] ppid=30439 vsize=305908 CPUtime=0.62 cores=0,2,4,6
/proc/30441/stat : 30441 (python) S 30439 30441 29517 0 -1 4202496 12093 1349 1 0 48 11 3 0 20 0 3 0 869257048 313249792 7760 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0
/proc/30441/statm: 76477 7760 1874 364 0 11361 0
[pid=30448] ppid=30441 vsize=295148 CPUtime=0.19 cores=0,2,4,6
/proc/30448/stat : 30448 (python) S 30441 30441 29517 0 -1 4202560 1155 0 0 0 11 8 0 0 16 0 2 0 869257120 302231552 6168 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/30448/statm: 73787 6168 411 364 0 8674 0
[pid=30450] ppid=30448 vsize=106428 CPUtime=46.17 cores=0,2,4,6
/proc/30450/stat : 30450 (scip-2.0.1.linu) T 30448 30450 30450 0 -1 4202496 32826 0 0 0 4576 41 0 0 18 0 1 0 869257120 108982272 24234 33554432000 4194304 13684479 140737097441904 18446744073709551615 7399135 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/30450/statm: 26607 24234 878 2317 0 24285 0
[pid=30448/tid=30456] ppid=30441 vsize=295148 CPUtime=0 cores=0,2,4,6
/proc/30448/task/30456/stat : 30456 (python) S 30441 30441 29517 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 869261739 302231552 6168 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554946 18446604442800480384 0 0 -1 6 0 0 0
[pid=30457] ppid=30441 vsize=295664 CPUtime=0.01 cores=0,2,4,6
/proc/30457/stat : 30457 (python) S 30441 30441 29517 0 -1 4202560 894 0 0 0 1 0 0 0 18 0 1 0 869261742 302759936 6226 33554432000 4194304 5683644 140733315906784 18446744073709551615 212436037190 0 0 16781312 33554946 10196269304349950210 0 0 17 6 0 0 0
/proc/30457/statm: 73916 6226 344 364 0 8800 0
[pid=30459] ppid=30457 vsize=4556 CPUtime=4.17 cores=0,2,4,6
/proc/30459/stat : 30459 (clasp-1.3.7-x86) R 30457 30459 30459 0 -1 4202496 1184 0 0 0 417 0 0 0 25 0 1 0 869261742 4665344 893 33554432000 134512640 136139019 4292452000 18446744073709551615 134640605 0 0 16781312 16386 0 0 0 17 4 0 0 0
/proc/30459/statm: 1139 893 183 398 0 739 0
[pid=30441/tid=30449] ppid=30439 vsize=305908 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30449/stat : 30449 (python) S 30439 30441 29517 0 -1 4202560 25 1349 0 0 0 0 3 0 19 0 3 0 869257120 313249792 7760 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 2 0 0 0
[pid=30441/tid=30458] ppid=30439 vsize=305908 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30458/stat : 30458 (python) S 30439 30441 29517 0 -1 4202560 25 1349 0 0 0 0 3 0 20 0 3 0 869261742 313249792 7760 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 6 0 0 0
Current children cumulated CPU time (s) 51.16
Current children cumulated vsize (KiB) 1007704

[startup+102.301 s]
/proc/loadavg: 2.01 1.04 0.41 3/504 30469
/proc/meminfo: memFree=30876472/32951124 swapFree=34789492/67111528
[pid=30441] ppid=30439 vsize=316164 CPUtime=0.64 cores=0,2,4,6
/proc/30441/stat : 30441 (python) S 30439 30441 29517 0 -1 4202496 13033 1349 1 0 50 11 3 0 20 0 4 0 869257048 323751936 7766 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/30441/statm: 79041 7766 1876 364 0 13922 0
[pid=30448] ppid=30441 vsize=295148 CPUtime=0.19 cores=0,2,4,6
/proc/30448/stat : 30448 (python) S 30441 30441 29517 0 -1 4202560 1155 0 0 0 11 8 0 0 16 0 2 0 869257120 302231552 6168 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/30448/statm: 73787 6168 411 364 0 8674 0
[pid=30450] ppid=30448 vsize=106428 CPUtime=46.17 cores=0,2,4,6
/proc/30450/stat : 30450 (scip-2.0.1.linu) T 30448 30450 30450 0 -1 4202496 32826 0 0 0 4576 41 0 0 18 0 1 0 869257120 108982272 24234 33554432000 4194304 13684479 140737097441904 18446744073709551615 7399135 0 0 16781312 2 18446744071562691360 0 0 17 2 0 0 0
/proc/30450/statm: 26607 24234 878 2317 0 24285 0
[pid=30448/tid=30456] ppid=30441 vsize=295148 CPUtime=0 cores=0,2,4,6
/proc/30448/task/30456/stat : 30456 (python) S 30441 30441 29517 0 -1 4202560 44 0 0 0 0 0 0 0 16 0 2 0 869261739 302231552 6168 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554946 18446604442800480384 0 0 -1 6 0 0 0
[pid=30457] ppid=30441 vsize=295664 CPUtime=0.19 cores=0,2,4,6
/proc/30457/stat : 30457 (python) S 30441 30441 29517 0 -1 4202560 1110 0 0 0 9 10 0 0 19 0 2 0 869261742 302759936 6274 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/30457/statm: 73916 6274 391 364 0 8800 0
[pid=30459] ppid=30457 vsize=7156 CPUtime=48.18 cores=0,2,4,6
/proc/30459/stat : 30459 (clasp-1.3.7-x86) T 30457 30459 30459 0 -1 4202496 1825 0 0 0 4818 0 0 0 25 0 1 0 869261742 7327744 1534 33554432000 134512640 136139019 4292452000 18446744073709551615 134598555 0 0 16781312 16386 18446744071562691360 0 0 17 4 0 0 0
/proc/30459/statm: 1789 1534 183 398 0 1389 0
[pid=30457/tid=30466] ppid=30441 vsize=295664 CPUtime=0 cores=0,2,4,6
/proc/30457/task/30466/stat : 30466 (python) S 30441 30441 29517 0 -1 4202560 50 0 0 0 0 0 0 0 19 0 2 0 869266561 302759936 6274 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554946 18446604446324020288 0 0 -1 6 0 0 0
[pid=30467] ppid=30441 vsize=305920 CPUtime=0.02 cores=0,2,4,6
/proc/30467/stat : 30467 (python) S 30441 30441 29517 0 -1 4202560 907 0 0 0 1 1 0 0 15 0 1 0 869266563 313262080 6230 33554432000 4194304 5683644 140733315906784 18446744073709551615 212436037190 0 0 16781312 33554946 3849832083669123072 0 0 17 6 0 0 0

################
# More data... #
################

/proc/30448/statm: 73787 6169 412 364 0 8674 0
[pid=30450] ppid=30448 vsize=106428 CPUtime=995.81 cores=0,2,4,6
/proc/30450/stat : 30450 (scip-2.0.1.linu) R 30448 30450 30450 0 -1 4202496 32833 0 0 0 98960 621 0 0 25 0 1 0 869257120 108982272 24241 33554432000 4194304 13684479 140737097441904 18446744073709551615 11876362 0 0 16781312 2 0 0 0 17 2 0 0 0
/proc/30450/statm: 26607 24241 879 2317 0 24285 0
[pid=30448/tid=30456] ppid=30441 vsize=295148 CPUtime=0 cores=0,2,4,6
/proc/30448/task/30456/stat : 30456 (python) S 30441 30441 29517 0 -1 4202560 45 0 0 0 0 0 0 0 15 0 2 0 869261739 302231552 6169 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554946 18446604442800480384 0 0 -1 6 0 0 0
[pid=30457] ppid=30441 vsize=295664 CPUtime=0.95 cores=0,2,4,6
/proc/30457/stat : 30457 (python) S 30441 30441 29517 0 -1 4202560 1183 0 0 0 46 49 0 0 18 0 2 0 869261742 302759936 6274 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/30457/statm: 73916 6274 391 364 0 8800 0
[pid=30459] ppid=30457 vsize=9944 CPUtime=229.96 cores=0,2,4,6
/proc/30459/stat : 30459 (clasp-1.3.7-x86) T 30457 30459 30459 0 -1 4202496 2536 0 0 0 22996 0 0 0 25 0 1 0 869261742 10182656 2242 33554432000 134512640 136139019 4292452000 18446744073709551615 134832144 0 0 16781312 16386 18446744071562691360 0 0 17 4 0 0 0
/proc/30459/statm: 2486 2242 183 398 0 2086 0
[pid=30457/tid=30466] ppid=30441 vsize=295664 CPUtime=0 cores=0,2,4,6
/proc/30457/task/30466/stat : 30466 (python) S 30441 30441 29517 0 -1 4202560 52 0 0 0 0 0 0 0 18 0 2 0 869266561 302759936 6274 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554946 18446604446324020288 0 0 -1 6 0 0 0
[pid=30467] ppid=30441 vsize=305920 CPUtime=0.39 cores=0,2,4,6
/proc/30467/stat : 30467 (python) S 30441 30441 29517 0 -1 4202560 1141 0 0 0 21 18 0 0 15 0 2 0 869266563 313262080 6278 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/30467/statm: 76480 6278 391 364 0 11361 0
[pid=30469] ppid=30467 vsize=79188 CPUtime=92.5 cores=0,2,4,6
/proc/30469/stat : 30469 (scip-2.0.1.linu) T 30467 30469 30469 0 -1 4202496 33236 0 0 0 9219 31 0 0 25 0 1 0 869266563 81088512 17459 33554432000 4194304 15243407 140736321421888 18446744073709551615 7220411 0 0 16781312 2 18446744071562691360 0 0 17 0 0 0 0
/proc/30469/statm: 19797 17459 980 2698 0 17092 0
[pid=30467/tid=30475] ppid=30441 vsize=305920 CPUtime=0 cores=0,2,4,6
/proc/30467/task/30475/stat : 30475 (python) S 30441 30441 29517 0 -1 4202560 46 0 0 0 0 0 0 0 15 0 2 0 869271293 313262080 6278 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554946 18446604441456878848 0 0 -1 6 0 0 0
[pid=30477] ppid=30441 vsize=316176 CPUtime=0.19 cores=0,2,4,6
/proc/30477/stat : 30477 (python) S 30441 30441 29517 0 -1 4202560 1115 0 0 0 9 10 0 0 19 0 2 0 869275959 323764224 6282 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/30477/statm: 79044 6282 391 364 0 13922 0
[pid=30479] ppid=30477 vsize=71092 CPUtime=48.34 cores=0,2,4,6
/proc/30479/stat : 30479 (minion) T 30477 30479 30479 0 -1 4202496 11070 0 0 0 4833 1 0 0 25 0 1 0 869275959 72798208 10516 33554432000 134512640 165565024 4288622592 18446744073709551615 142853384 0 0 16781312 8396802 18446744071562691360 0 0 17 0 0 0 0
/proc/30479/statm: 17773 10516 359 7582 0 10188 0
[pid=30477/tid=30485] ppid=30441 vsize=316176 CPUtime=0 cores=0,2,4,6
/proc/30477/task/30485/stat : 30485 (python) S 30441 30441 29517 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 869280795 323764224 6282 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554946 18446604445288707904 0 0 -1 6 0 0 0
[pid=30488] ppid=30441 vsize=326432 CPUtime=0.19 cores=0,2,4,6
/proc/30488/stat : 30488 (python) S 30441 30441 29517 0 -1 4202560 1149 0 0 0 9 10 0 0 16 0 2 0 869285320 334266368 6286 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/30488/statm: 81608 6286 391 364 0 16483 0
[pid=30490] ppid=30488 vsize=84920 CPUtime=49.13 cores=0,2,4,6
/proc/30490/stat : 30490 (bsolo_pb10) T 30488 30490 30490 0 -1 4202496 19206 0 0 0 4908 5 0 0 25 0 1 0 869285321 86958080 18808 33554432000 134512640 137138936 4294236256 18446744073709551615 134542233 0 0 16781312 16384 18446744071562691360 0 0 17 0 0 0 0
/proc/30490/statm: 21230 18808 192 642 0 20586 0
[pid=30488/tid=30493] ppid=30441 vsize=326432 CPUtime=0 cores=0,2,4,6
/proc/30488/task/30493/stat : 30493 (python) S 30441 30441 29517 0 -1 4202560 47 0 0 0 0 0 0 0 16 0 2 0 869290235 334266368 6286 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554946 18446604453144887488 0 0 -1 6 0 0 0
[pid=30508] ppid=30441 vsize=336688 CPUtime=0.2 cores=0,2,4,6
/proc/30508/stat : 30508 (python) S 30441 30441 29517 0 -1 4202560 1162 0 0 0 9 11 0 0 16 0 2 0 869308820 344768512 6290 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/30508/statm: 84172 6290 391 364 0 19044 0
[pid=30511] ppid=30508 vsize=8547632 CPUtime=50.77 cores=0,2,4,6
/proc/30511/stat : 30511 (java) T 30508 30511 30511 0 -1 4202496 311231 0 1 0 5039 38 0 0 18 0 19 0 869308821 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447819749 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/30511/statm: 2136908 290451 2245 9 0 2127649 0
[pid=30511/tid=30513] ppid=30508 vsize=8547632 CPUtime=48.3 cores=0,2,4,6
/proc/30511/task/30513/stat : 30513 (java) T 30508 30511 30511 0 -1 4202560 246199 0 1 0 4804 26 0 0 25 0 19 0 869308822 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 46912505947521 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 4
[pid=30511/tid=30514] ppid=30508 vsize=8547632 CPUtime=0.05 cores=0,2,4,6
/proc/30511/task/30514/stat : 30514 (java) T 30508 30511 30511 0 -1 4202560 5171 0 0 0 5 0 0 0 15 0 19 0 869308822 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=30511/tid=30516] ppid=30508 vsize=8547632 CPUtime=0.06 cores=0,2,4,6
/proc/30511/task/30516/stat : 30516 (java) T 30508 30511 30511 0 -1 4202560 6895 0 0 0 6 0 0 0 15 0 19 0 869308822 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=30511/tid=30517] ppid=30508 vsize=8547632 CPUtime=0.05 cores=0,2,4,6
/proc/30511/task/30517/stat : 30517 (java) T 30508 30511 30511 0 -1 4202560 5722 0 0 0 5 0 0 0 15 0 19 0 869308822 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=30511/tid=30518] ppid=30508 vsize=8547632 CPUtime=0.06 cores=0,2,4,6
/proc/30511/task/30518/stat : 30518 (java) T 30508 30511 30511 0 -1 4202560 6452 0 0 0 5 1 0 0 15 0 19 0 869308822 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=30511/tid=30519] ppid=30508 vsize=8547632 CPUtime=0.06 cores=0,2,4,6
/proc/30511/task/30519/stat : 30519 (java) T 30508 30511 30511 0 -1 4202560 5388 0 0 0 6 0 0 0 15 0 19 0 869308822 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=30511/tid=30520] ppid=30508 vsize=8547632 CPUtime=0.05 cores=0,2,4,6
/proc/30511/task/30520/stat : 30520 (java) T 30508 30511 30511 0 -1 4202560 4063 0 0 0 4 1 0 0 15 0 19 0 869308822 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=30511/tid=30521] ppid=30508 vsize=8547632 CPUtime=0.06 cores=0,2,4,6
/proc/30511/task/30521/stat : 30521 (java) T 30508 30511 30511 0 -1 4202560 7436 0 0 0 5 1 0 0 15 0 19 0 869308822 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=30511/tid=30522] ppid=30508 vsize=8547632 CPUtime=0.05 cores=0,2,4,6
/proc/30511/task/30522/stat : 30522 (java) T 30508 30511 30511 0 -1 4202560 5859 0 0 0 5 0 0 0 15 0 19 0 869308822 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=30511/tid=30523] ppid=30508 vsize=8547632 CPUtime=0 cores=0,2,4,6
/proc/30511/task/30523/stat : 30523 (java) T 30508 30511 30511 0 -1 4202560 745 0 0 0 0 0 0 0 15 0 19 0 869308823 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447833600 0 0 0 16800975 18446744071562691360 0 0 -1 0 0 0 0
[pid=30511/tid=30525] ppid=30508 vsize=8547632 CPUtime=0 cores=0,2,4,6
/proc/30511/task/30525/stat : 30525 (java) T 30508 30511 30511 0 -1 4202560 17 0 0 0 0 0 0 0 18 0 19 0 869308824 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=30511/tid=30526] ppid=30508 vsize=8547632 CPUtime=0 cores=0,2,4,6
/proc/30511/task/30526/stat : 30526 (java) T 30508 30511 30511 0 -1 4202560 10 0 0 0 0 0 0 0 18 0 19 0 869308824 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 4
[pid=30511/tid=30527] ppid=30508 vsize=8547632 CPUtime=0 cores=0,2,4,6
/proc/30511/task/30527/stat : 30527 (java) T 30508 30511 30511 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869308826 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447840689 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=30511/tid=30529] ppid=30508 vsize=8547632 CPUtime=0.97 cores=0,2,4,6
/proc/30511/task/30529/stat : 30529 (java) T 30508 30511 30511 0 -1 4202560 8485 0 0 0 96 1 0 0 15 0 19 0 869308826 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=30511/tid=30530] ppid=30508 vsize=8547632 CPUtime=0.92 cores=0,2,4,6
/proc/30511/task/30530/stat : 30530 (java) T 30508 30511 30511 0 -1 4202560 7411 0 0 0 91 1 0 0 15 0 19 0 869308826 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 2 0 0 0
[pid=30511/tid=30531] ppid=30508 vsize=8547632 CPUtime=0 cores=0,2,4,6
/proc/30511/task/30531/stat : 30531 (java) T 30508 30511 30511 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 19 0 869308826 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447832985 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=30511/tid=30533] ppid=30508 vsize=8547632 CPUtime=0 cores=0,2,4,6
/proc/30511/task/30533/stat : 30533 (java) T 30508 30511 30511 0 -1 4202560 5 0 0 0 0 0 0 0 15 0 19 0 869308826 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447833600 0 4 0 16800975 18446744071562691360 0 0 -1 4 0 0 0
[pid=30511/tid=30534] ppid=30508 vsize=8547632 CPUtime=0 cores=0,2,4,6
/proc/30511/task/30534/stat : 30534 (java) T 30508 30511 30511 0 -1 4202560 7 0 0 0 0 0 0 0 18 0 19 0 869308868 8752775168 290451 33554432000 1073741824 1073778376 140736483322240 18446744073709551615 212447833600 0 4 0 16800975 18446744071562691360 0 0 -1 6 0 0 0
[pid=30508/tid=30537] ppid=30441 vsize=336688 CPUtime=0 cores=0,2,4,6
/proc/30508/task/30537/stat : 30537 (python) S 30441 30441 29517 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869313687 344768512 6290 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554946 18446604445173062592 0 0 -1 6 0 0 0
[pid=30551] ppid=30441 vsize=346944 CPUtime=0.38 cores=0,2,4,6
/proc/30551/stat : 30551 (python) S 30441 30441 29517 0 -1 4202560 1167 0 0 0 19 19 0 0 17 0 2 0 869354758 355270656 6294 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/30551/statm: 86736 6294 391 364 0 21605 0
[pid=30553] ppid=30551 vsize=190128 CPUtime=92.2 cores=0,2,4,6
/proc/30553/stat : 30553 (bsolo_pb10) T 30551 30553 30553 0 -1 4202496 45493 0 0 0 9198 22 0 0 25 0 1 0 869354758 194691072 45095 33554432000 134512640 137138936 4291944320 18446744073709551615 134542316 0 0 16781312 16384 18446744071562691360 0 0 17 4 0 0 0
/proc/30553/statm: 47532 45095 190 642 0 46888 0
[pid=30551/tid=30584] ppid=30441 vsize=346944 CPUtime=0 cores=0,2,4,6
/proc/30551/task/30584/stat : 30584 (python) S 30441 30441 29517 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 869363979 355270656 6294 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554946 18446604450236029632 0 0 -1 6 0 0 0
[pid=30585] ppid=30441 vsize=357200 CPUtime=0.21 cores=0,2,4,6
/proc/30585/stat : 30585 (python) S 30441 30441 29517 0 -1 4202560 1218 0 0 0 11 10 0 0 19 0 2 0 869363981 365772800 6304 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/30585/statm: 89300 6304 397 364 0 24166 0
[pid=30588] ppid=30585 vsize=109704 CPUtime=48.23 cores=0,2,4,6
/proc/30588/stat : 30588 (pbct-0.1.2-linu) T 30585 30588 30588 0 -1 4202496 28001 0 0 0 4758 65 0 0 25 0 1 0 869363981 112336896 26145 33554432000 134512640 136422188 4290029072 18446744073709551615 134862381 0 0 16781312 16387 18446744071562691360 0 0 17 4 0 0 0
/proc/30588/statm: 27426 26145 213 467 0 26957 0
[pid=30585/tid=30604] ppid=30441 vsize=357200 CPUtime=0 cores=0,2,4,6
/proc/30585/task/30604/stat : 30604 (python) S 30441 30441 29517 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 869368805 365772800 6304 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554946 18446604450580246976 0 0 -1 6 0 0 0
[pid=30441/tid=30449] ppid=30439 vsize=367444 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30449/stat : 30449 (python) S 30439 30441 29517 0 -1 4202560 40 1349 0 0 0 0 3 0 18 0 9 0 869257120 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 2 0 0 0
[pid=30441/tid=30458] ppid=30439 vsize=367444 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30458/stat : 30458 (python) S 30439 30441 29517 0 -1 4202560 35 1349 0 0 0 0 3 0 18 0 9 0 869261742 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 6 0 0 0
[pid=30441/tid=30468] ppid=30439 vsize=367444 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30468/stat : 30468 (python) S 30439 30441 29517 0 -1 4202560 35 1349 0 0 0 0 3 0 18 0 9 0 869266563 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 4 0 0 0
[pid=30441/tid=30478] ppid=30439 vsize=367444 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30478/stat : 30478 (python) S 30439 30441 29517 0 -1 4202560 27 1349 0 0 0 0 3 0 20 0 9 0 869275959 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 4 0 0 0
[pid=30441/tid=30489] ppid=30439 vsize=367444 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30489/stat : 30489 (python) S 30439 30441 29517 0 -1 4202560 28 1349 0 0 0 0 3 0 20 0 9 0 869285321 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 0 0 0 0
[pid=30441/tid=30510] ppid=30439 vsize=367444 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30510/stat : 30510 (python) S 30439 30441 29517 0 -1 4202560 30 1349 0 0 0 0 3 0 20 0 9 0 869308820 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 0 0 0 0
[pid=30441/tid=30552] ppid=30439 vsize=367444 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30552/stat : 30552 (python) S 30439 30441 29517 0 -1 4202560 29 1349 0 0 0 0 3 0 20 0 9 0 869354758 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 0 0 0 0
[pid=30441/tid=30586] ppid=30439 vsize=367444 CPUtime=0.03 cores=0,2,4,6
/proc/30441/task/30586/stat : 30586 (python) S 30439 30441 29517 0 -1 4202560 25 1349 0 0 0 0 3 0 20 0 9 0 869363981 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1614.87
Current children cumulated vsize (KiB) 12146652

[startup+1606.7 s]
/proc/loadavg: 2.10 2.09 1.72 3/582 30623
/proc/meminfo: memFree=26530656/32951124 swapFree=34789492/67111528
[pid=30441] ppid=30439 vsize=367444 CPUtime=423.06 cores=0,2,4,6
/proc/30441/stat : 30441 (python) S 30439 30441 29517 0 -1 4202496 18727 72085 1 0 115 12 42049 130 17 0 9 0 869257048 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447847231 0 0 16781312 33554434 18446744073709551615 0 0 17 4 0 0 0
/proc/30441/statm: 91861 7796 1886 364 0 26727 0
[pid=30448] ppid=30441 vsize=0 CPUtime=1000.29 cores=0,2,4,6
/proc/30448/stat : 30448 (python) Z 30441 30441 29517 0 -1 4202588 1317 32838 0 0 209 203 98995 622 15 0 1 0 869257120 0 0 33554432000 0 0 0 0 0 0 0 16781824 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/30448/statm: 0 0 0 0 0 0 0
[pid=30508] ppid=30441 vsize=336688 CPUtime=0.2 cores=0,2,4,6
/proc/30508/stat : 30508 (python) S 30441 30441 29517 0 -1 4202560 1167 0 0 0 9 11 0 0 16 0 2 0 869308820 344768512 6290 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447847231 0 0 16781824 33554434 18446744073709551615 0 0 17 6 0 0 0
/proc/30508/statm: 84172 6290 391 364 0 19044 0
[pid=30511] ppid=30508 vsize=0 CPUtime=50.79 cores=0,2,4,6
/proc/30511/stat : 30511 (java) Z 30508 30511 30511 0 -1 4203548 311231 0 1 0 5039 40 0 0 18 0 2 0 869308821 0 0 33554432000 0 0 0 0 0 0 0 0 16800975 18446744073709551615 0 0 17 4 0 0 0
/proc/30511/statm: 0 0 0 0 0 0 0
[pid=30511/tid=30531] ppid=30508 vsize=0 CPUtime=0.02 cores=0,2,4,6
/proc/30511/task/30531/stat : 30531 (java) R 30508 30511 30511 0 -1 4203588 1 0 0 0 0 2 0 0 18 0 2 0 869308826 0 0 33554432000 0 0 0 0 0 0 4 0 16800975 18446744073709551615 0 0 -1 4 0 0 0
[pid=30508/tid=30537] ppid=30441 vsize=336688 CPUtime=0 cores=0,2,4,6
/proc/30508/task/30537/stat : 30537 (python) S 30441 30441 29517 0 -1 4202560 48 0 0 0 0 0 0 0 16 0 2 0 869313687 344768512 6290 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781824 33554434 18446604445173062592 0 0 -1 6 0 0 0
[pid=30551] ppid=30441 vsize=346944 CPUtime=0.38 cores=0,2,4,6
/proc/30551/stat : 30551 (python) S 30441 30441 29517 0 -1 4202560 1167 0 0 0 19 19 0 0 17 0 2 0 869354758 355270656 6294 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/30551/statm: 86736 6294 391 364 0 21605 0
[pid=30553] ppid=30551 vsize=190128 CPUtime=92.2 cores=0,2,4,6
/proc/30553/stat : 30553 (bsolo_pb10) T 30551 30553 30553 0 -1 4202496 45493 0 0 0 9198 22 0 0 25 0 1 0 869354758 194691072 45095 33554432000 134512640 137138936 4291944320 18446744073709551615 134542316 0 0 16781312 16384 18446744071562691360 0 0 17 4 0 0 0
/proc/30553/statm: 47532 45095 190 642 0 46888 0
[pid=30551/tid=30584] ppid=30441 vsize=346944 CPUtime=0 cores=0,2,4,6
/proc/30551/task/30584/stat : 30584 (python) S 30441 30441 29517 0 -1 4202560 46 0 0 0 0 0 0 0 17 0 2 0 869363979 355270656 6294 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554946 18446604450236029632 0 0 -1 6 0 0 0
[pid=30585] ppid=30441 vsize=357200 CPUtime=0.21 cores=0,2,4,6
/proc/30585/stat : 30585 (python) S 30441 30441 29517 0 -1 4202560 1218 0 0 0 11 10 0 0 19 0 2 0 869363981 365772800 6304 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447843787 0 0 16781312 33554946 18446744073709551615 0 0 17 6 0 0 0
/proc/30585/statm: 89300 6304 397 364 0 24166 0
[pid=30588] ppid=30585 vsize=109704 CPUtime=48.23 cores=0,2,4,6
/proc/30588/stat : 30588 (pbct-0.1.2-linu) T 30585 30588 30588 0 -1 4202496 28001 0 0 0 4758 65 0 0 25 0 1 0 869363981 112336896 26145 33554432000 134512640 136422188 4290029072 18446744073709551615 134862381 0 0 16781312 16387 18446744071562691360 0 0 17 4 0 0 0
/proc/30588/statm: 27426 26145 213 467 0 26957 0
[pid=30585/tid=30604] ppid=30441 vsize=357200 CPUtime=0 cores=0,2,4,6
/proc/30585/task/30604/stat : 30604 (python) S 30441 30441 29517 0 -1 4202560 46 0 0 0 0 0 0 0 19 0 2 0 869368805 365772800 6304 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554946 18446604450580246976 0 0 -1 6 0 0 0
[pid=30441/tid=30449] ppid=30439 vsize=367444 CPUtime=421.79 cores=0,2,4,6
/proc/30441/task/30449/stat : 30449 (python) S 30439 30441 29517 0 -1 4202560 40 72085 0 0 0 0 42049 130 18 0 9 0 869257120 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 2 0 0 0
[pid=30441/tid=30458] ppid=30439 vsize=367444 CPUtime=421.79 cores=0,2,4,6
/proc/30441/task/30458/stat : 30458 (python) S 30439 30441 29517 0 -1 4202560 35 72085 0 0 0 0 42049 130 18 0 9 0 869261742 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 6 0 0 0
[pid=30441/tid=30468] ppid=30439 vsize=367444 CPUtime=421.79 cores=0,2,4,6
/proc/30441/task/30468/stat : 30468 (python) S 30439 30441 29517 0 -1 4202560 35 72085 0 0 0 0 42049 130 18 0 9 0 869266563 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 4 0 0 0
[pid=30441/tid=30478] ppid=30439 vsize=367444 CPUtime=421.79 cores=0,2,4,6
/proc/30441/task/30478/stat : 30478 (python) S 30439 30441 29517 0 -1 4202560 27 72085 0 0 0 0 42049 130 20 0 9 0 869275959 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 4 0 0 0
[pid=30441/tid=30489] ppid=30439 vsize=367444 CPUtime=421.79 cores=0,2,4,6
/proc/30441/task/30489/stat : 30489 (python) S 30439 30441 29517 0 -1 4202560 28 72085 0 0 0 0 42049 130 20 0 9 0 869285321 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 0 0 0 0
[pid=30441/tid=30510] ppid=30439 vsize=367444 CPUtime=421.79 cores=0,2,4,6
/proc/30441/task/30510/stat : 30510 (python) S 30439 30441 29517 0 -1 4202560 30 72085 0 0 0 0 42049 130 20 0 9 0 869308820 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 0 0 0 0
[pid=30441/tid=30552] ppid=30439 vsize=367444 CPUtime=421.79 cores=0,2,4,6
/proc/30441/task/30552/stat : 30552 (python) S 30439 30441 29517 0 -1 4202560 29 72085 0 0 0 0 42049 130 20 0 9 0 869354758 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 0 0 0 0
[pid=30441/tid=30586] ppid=30439 vsize=367444 CPUtime=421.79 cores=0,2,4,6
/proc/30441/task/30586/stat : 30586 (python) S 30439 30441 29517 0 -1 4202560 25 72085 0 0 0 0 42049 130 20 0 9 0 869363981 376262656 7796 33554432000 4194304 5683644 140733315906784 18446744073709551615 212447840689 0 0 16781312 33554434 18446604448374459072 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1615.36
Current children cumulated vsize (KiB) 1708108

Child status: 0
Real time (s): 1606.75
CPU time (s): 1615.52
CPU user time (s): 1604.08
CPU system time (s): 11.4413
CPU usage (%): 100.546
Max. virtual memory (cumulated for all children) (KiB): 12146656

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1604.08
system time used= 11.4413
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 517551
page faults= 2
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8740
involuntary context switches= 5952

runsolver used 12.5991 second user time and 24.3863 second system time

The end

Launcher Data

Begin job on node102 at 2011-06-09 01:42:26
IDJOB=3482341
IDBENCH=48302
IDSOLVER=1971
FILE ID=node102/3482341-1307576546
RUNJOBID= node102-1307576441-29535
PBS_JOBID= 13547703
Free space on /tmp= 73928 MiB

SOLVER NAME= borg pb-dec-11.04.03
BENCH NAME= PB07/normalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/manquinho/dbsg/normalized-dbsg_100_25_4_40.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3482341-1307576546/watcher-3482341-1307576546 -o /tmp/evaluation-result-3482341-1307576546/solver-3482341-1307576546 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3482341-1307576546.opb -seed 2115914433 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4bc8406e35a3f2674c743b72d3a1792a
RANDOM SEED=2115914433

node102.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.65
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.828
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      31843620 kB
Buffers:        164648 kB
Cached:         481668 kB
SwapCached:      25580 kB
Active:         595724 kB
Inactive:       186340 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      31843620 kB
SwapTotal:    67111528 kB
SwapFree:     34789492 kB
Dirty:          218788 kB
Writeback:         364 kB
AnonPages:      133544 kB
Mapped:          15368 kB
Slab:           153916 kB
PageTables:     100980 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS: 135650920 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73820 MiB
End job on node102 at 2011-06-09 02:09:14