Trace number 3737705

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
PB11: borg pb-dec-11.04.03? (MO) 1661.52 1656.76

General information on the benchmark

Namenormalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/
manquinho/dbsg/normalized-dbsg_500_25_5_80.opb
MD5SUM611c10fb20bc9774d31ac4d0681f384d
Bench CategoryDEC-SMALLINT-NLC (no optimisation, small integers, non linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionNO
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved NO
Number of variables1000
Total number of constraints1502
Number of constraints which are clauses500
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints1001
Minimum length of a constraint2
Maximum length of a constraint1000
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 80
Number of bits of the biggest number in a constraint 7
Biggest sum of numbers in a constraint 1000
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)31412
Sum of products size (including duplicates)62824
Number of different products15706
Sum of products size31412

Solver Data 

0.38/0.52	c INFO: loaded portfolio from HOME/etc/borg-mix+class.dec.pickle
0.38/0.52	c INFO: solving HOME/instance-3737705-1338716225.opb
0.47/0.73	c INFO: wrote linearized instance to HOME/tmpo5o4J6.opb
0.86/0.97	c INFO: parsing took 0.23 s
1.26/1.38	c INFO: features took 0.41 CPU seconds
1.36/1.41	c INFO: running sat4j-pb-v20101225-cutting@0 for 45 with 1798 remaining (b = 0.48)
47.68/45.22	c INFO: running scip-2.0.1-spx@0 for 45 with 1753 remaining (b = 0.06)
95.21/92.70	c INFO: running clasp-1.3.7@0 for 45 with 1705 remaining (b = 0.02)
142.36/139.86	c INFO: running scip-2.0.1-clp@0 for 45 with 1658 remaining (b = 0.02)
190.21/187.63	c INFO: running scip-2.0.1-clp@47 for 45 with 1611 remaining (b = 0.01)
234.36/231.77	c INFO: running clasp-1.3.7@47 for 45 with 1567 remaining (b = 0.01)
279.64/276.92	c INFO: running clasp-1.3.7@92 for 136 with 1522 remaining (b = 0.02)
416.24/413.31	c INFO: running scip-2.0.1-spx@47 for 45 with 1385 remaining (b = 0.01)
461.40/458.46	c INFO: running bsolo_pb10-l1@0 for 91 with 1340 remaining (b = 0.01)
553.12/550.03	c INFO: running scip-2.0.1-spx@92 for 410 with 1249 remaining (b = 0.06)
967.97/964.20	c INFO: running bsolo_pb10-l3@0 for 45 with 836 remaining (b = 0.01)
1015.23/1011.47	c INFO: running scip-2.0.1-spx@505 for 547 with 788 remaining (b = 0.05)
1563.81/1559.19	c INFO: running wbo1.4a@0 for 45 with 242 remaining (b = 0.00)
1610.05/1605.37	c INFO: running scip-2.0.1-clp@91 for 45 with 196 remaining (b = 0.00)
1661.32/1656.52	c INFO: wrote minion input file to HOME/tmpTUuszL.minion
1661.32/1656.52	c INFO: running minion-0.12@0 for 45 with 147 remaining (b = 0.00)

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3737705-1338716225/watcher-3737705-1338716225 -o /tmp/evaluation-result-3737705-1338716225/solver-3737705-1338716225 -C 1800 -W 1900 -M 15500 python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3737705-1338716225.opb -seed 1244941453 -budget 1800 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.01 2.62 2.54 2/196 6564
/proc/meminfo: memFree=27920492/32873648 swapFree=7628/7628
[pid=6564] ppid=6562 vsize=15380 CPUtime=0 cores=0,2,4,6
/proc/6564/stat : 6564 (python) D 6562 6564 3958 0 -1 4202496 753 0 0 0 0 0 0 0 20 0 1 0 337748583 15749120 628 33554432000 4194304 5683644 140734323350304 140734323308760 217410519952 0 0 16781312 2 18446744072100588836 0 0 17 0 0 0 0 0 0
/proc/6564/statm: 3845 628 333 364 0 287 0

[startup+0.075396 s]
/proc/loadavg: 2.01 2.62 2.54 2/196 6564
/proc/meminfo: memFree=27920492/32873648 swapFree=7628/7628
[pid=6564] ppid=6562 vsize=50504 CPUtime=0.05 cores=0,2,4,6
/proc/6564/stat : 6564 (python) R 6562 6564 3958 0 -1 4202496 2195 0 0 0 4 1 0 0 20 0 1 0 337748583 51716096 1780 33554432000 4194304 5683644 140734323350304 140734323276632 217410146196 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/6564/statm: 12626 1780 489 364 0 1280 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 50504

[startup+0.100233 s]
/proc/loadavg: 2.01 2.62 2.54 2/196 6564
/proc/meminfo: memFree=27920492/32873648 swapFree=7628/7628
[pid=6564] ppid=6562 vsize=92388 CPUtime=0.06 cores=0,2,4,6
/proc/6564/stat : 6564 (python) R 6562 6564 3958 0 -1 4202496 3214 505 1 0 5 1 0 0 20 0 1 0 337748583 94605312 2540 33554432000 4194304 5683644 140734323350304 140734323302776 217410143973 0 0 16781312 2 0 0 0 17 2 0 0 0 0 0
/proc/6564/statm: 23097 2540 816 364 0 1619 0
Current children cumulated CPU time (s) 0.06
Current children cumulated vsize (KiB) 92388

[startup+0.300857 s]
/proc/loadavg: 2.01 2.62 2.54 2/196 6564
/proc/meminfo: memFree=27920492/32873648 swapFree=7628/7628
[pid=6564] ppid=6562 vsize=166944 CPUtime=0.22 cores=0,2,4,6
/proc/6564/stat : 6564 (python) R 6562 6564 3958 0 -1 4202496 6561 1008 1 0 17 5 0 0 20 0 1 0 337748583 170950656 4351 33554432000 4194304 5683644 140734323350304 140734323254536 140183416873399 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/6564/statm: 41736 4351 1227 364 0 3289 0
Current children cumulated CPU time (s) 0.22
Current children cumulated vsize (KiB) 166944

[startup+0.70019 s]
/proc/loadavg: 2.01 2.62 2.54 2/196 6564
/proc/meminfo: memFree=27920492/32873648 swapFree=7628/7628
[pid=6564] ppid=6562 vsize=283252 CPUtime=0.47 cores=0,2,4,6
/proc/6564/stat : 6564 (python) R 6562 6564 3958 0 -1 4202496 10628 1008 1 0 36 11 0 0 20 0 1 0 337748583 290050048 7523 33554432000 4194304 5683644 140734323350304 140734323341760 217410535848 0 0 16781312 2 0 0 0 17 0 0 0 0 0 0
/proc/6564/statm: 70813 7523 1807 364 0 6042 0
Current children cumulated CPU time (s) 0.47
Current children cumulated vsize (KiB) 283252

[startup+1.50014 s]
/proc/loadavg: 2.01 2.62 2.54 3/197 6570
/proc/meminfo: memFree=27888476/32873648 swapFree=7628/7628
[pid=6564] ppid=6562 vsize=366656 CPUtime=1.37 cores=0,2,4,6
/proc/6564/stat : 6564 (python) S 6562 6564 3958 0 -1 4202496 16147 1498 1 0 104 13 17 3 20 0 2 0 337748583 375455744 9528 33554432000 4194304 5683644 140734323350304 140734323345136 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6564/statm: 91664 9528 1903 364 0 26887 0
Current children cumulated CPU time (s) 1.37
Current children cumulated vsize (KiB) 366656

[startup+3.1007 s]
/proc/loadavg: 2.01 2.62 2.54 5/217 6590
/proc/meminfo: memFree=27794924/32873648 swapFree=7628/7628
[pid=6564] ppid=6562 vsize=366656 CPUtime=1.37 cores=0,2,4,6
/proc/6564/stat : 6564 (python) S 6562 6564 3958 0 -1 4202496 16147 1498 1 0 104 13 17 3 20 0 2 0 337748583 375455744 9528 33554432000 4194304 5683644 140734323350304 140734323345136 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6564/statm: 91664 9528 1903 364 0 26887 0
[pid=6571] ppid=6564 vsize=290876 CPUtime=0 cores=0,2,4,6
/proc/6571/stat : 6571 (python) S 6564 6564 3958 0 -1 4202560 741 0 0 0 0 0 0 0 20 0 1 0 337748724 297857024 7925 33554432000 4194304 5683644 140734323350304 140734323341392 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 0 0 0 0 0 0
/proc/6571/statm: 72719 7925 306 364 0 7942 0
[pid=6573] ppid=6571 vsize=9624972 CPUtime=3.11 cores=0,2,4,6
/proc/6573/stat : 6573 (java) S 6571 6573 6573 0 -1 4202496 14562 0 1 0 306 5 0 0 20 0 19 0 337748724 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140736682739424 217413877821 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6573/statm: 2406243 35946 2251 9 0 2396937 0
[pid=6573/tid=6574] ppid=6571 vsize=9624972 CPUtime=1.6 cores=0,2,4,6
/proc/6573/task/6574/stat : 6574 (java) R 6571 6573 6573 0 -1 4202560 2480 0 1 0 157 3 0 0 20 0 19 0 337748725 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140095072604088 140094937833520 0 4 0 16800975 0 0 0 -1 4 0 0 4 0 0
[pid=6573/tid=6575] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6575/stat : 6575 (java) S 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140095061666216 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6576] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6576/stat : 6576 (java) S 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140095060613672 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6577] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6577/stat : 6577 (java) S 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140095059560616 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6573/tid=6578] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6578/stat : 6578 (java) S 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140095058508072 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6573/tid=6579] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6579/stat : 6579 (java) S 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140095057456040 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6580] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6580/stat : 6580 (java) S 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140095056403496 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6573/tid=6581] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6581/stat : 6581 (java) S 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140094910184104 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6573/tid=6582] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6582/stat : 6582 (java) S 6571 6573 6573 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140094909131560 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6583] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6583/stat : 6583 (java) S 6571 6573 6573 0 -1 4202560 5 0 0 0 0 0 0 0 20 0 19 0 337748727 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140094896720232 217413892009 0 0 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6584] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6584/stat : 6584 (java) S 6571 6573 6573 0 -1 4202560 16 0 0 0 0 0 0 0 20 0 19 0 337748728 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140094895666552 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6585] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6585/stat : 6585 (java) S 6571 6573 6573 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 337748728 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140094894613384 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6586] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6586/stat : 6586 (java) S 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748730 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140094893562128 217413900064 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6587] ppid=6571 vsize=9624972 CPUtime=0.78 cores=0,2,4,6
/proc/6573/task/6587/stat : 6587 (java) R 6571 6573 6573 0 -1 4202560 5067 0 0 0 78 0 0 0 20 0 19 0 337748730 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140094892510008 140095079417427 0 4 0 16800975 0 0 0 -1 2 0 0 0 0 0
[pid=6573/tid=6588] ppid=6571 vsize=9624972 CPUtime=0.7 cores=0,2,4,6
/proc/6573/task/6588/stat : 6588 (java) S 6571 6573 6573 0 -1 4202560 5598 0 0 0 68 2 0 0 20 0 19 0 337748730 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140094891457464 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6589] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6589/stat : 6589 (java) S 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748730 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140094890404600 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6590] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6590/stat : 6590 (java) S 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748730 9855971328 35946 33554432000 1073741824 1073778376 140736682748288 140094889352264 217413892009 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6564/tid=6572] ppid=6562 vsize=366656 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6572/stat : 6572 (python) S 6562 6564 3958 0 -1 4202560 26 1498 0 0 0 0 17 3 20 0 2 0 337748724 375455744 9528 33554432000 4194304 5683644 140734323350304 140183237616176 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 4.48
Current children cumulated vsize (KiB) 10282504

[startup+6.30071 s]
/proc/loadavg: 2.17 2.64 2.55 3/218 6591
/proc/meminfo: memFree=27695564/32873648 swapFree=7628/7628
[pid=6564] ppid=6562 vsize=366656 CPUtime=1.37 cores=0,2,4,6
/proc/6564/stat : 6564 (python) S 6562 6564 3958 0 -1 4202496 16147 1498 1 0 104 13 17 3 20 0 2 0 337748583 375455744 9528 33554432000 4194304 5683644 140734323350304 140734323345136 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6564/statm: 91664 9528 1903 364 0 26887 0
[pid=6571] ppid=6564 vsize=290876 CPUtime=0 cores=0,2,4,6
/proc/6571/stat : 6571 (python) S 6564 6564 3958 0 -1 4202560 860 0 0 0 0 0 0 0 20 0 1 0 337748724 297857024 7947 33554432000 4194304 5683644 140734323350304 140734323341392 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 0 0 0 0 0 0
/proc/6571/statm: 72719 7947 328 364 0 7942 0
[pid=6573] ppid=6571 vsize=9624972 CPUtime=6.51 cores=0,2,4,6
/proc/6573/stat : 6573 (java) S 6571 6573 6573 0 -1 4202496 14715 0 1 0 643 8 0 0 20 0 19 0 337748724 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140736682739424 217413877821 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6573/statm: 2406243 48328 2266 9 0 2396937 0
[pid=6573/tid=6574] ppid=6571 vsize=9624972 CPUtime=4.77 cores=0,2,4,6
/proc/6573/task/6574/stat : 6574 (java) R 6571 6573 6573 0 -1 4202560 2500 0 1 0 473 4 0 0 20 0 19 0 337748725 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140095072602416 140094938691140 0 4 0 16800975 0 0 0 -1 4 0 0 4 0 0
[pid=6573/tid=6575] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6575/stat : 6575 (java) S 6571 6573 6573 0 -1 4202560 8 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140095061666216 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6573/tid=6576] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6576/stat : 6576 (java) S 6571 6573 6573 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140095060613672 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6577] ppid=6571 vsize=9624972 CPUtime=0.01 cores=0,2,4,6
/proc/6573/task/6577/stat : 6577 (java) S 6571 6573 6573 0 -1 4202560 14 0 0 0 1 0 0 0 20 0 19 0 337748726 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140095059560616 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6578] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6578/stat : 6578 (java) S 6571 6573 6573 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140095058508072 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6579] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6579/stat : 6579 (java) S 6571 6573 6573 0 -1 4202560 4 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140095057456040 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6580] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6580/stat : 6580 (java) S 6571 6573 6573 0 -1 4202560 10 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140095056403496 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6581] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6581/stat : 6581 (java) S 6571 6573 6573 0 -1 4202560 7 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140094910184104 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6573/tid=6582] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6582/stat : 6582 (java) S 6571 6573 6573 0 -1 4202560 5 0 0 0 0 0 0 0 20 0 19 0 337748726 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140094909131560 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6583] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6583/stat : 6583 (java) S 6571 6573 6573 0 -1 4202560 72 0 0 0 0 0 0 0 20 0 19 0 337748727 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140094896720232 217413892009 0 0 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6584] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6584/stat : 6584 (java) S 6571 6573 6573 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 337748728 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140094895666552 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6585] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6585/stat : 6585 (java) S 6571 6573 6573 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 19 0 337748728 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140094894613384 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6586] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6586/stat : 6586 (java) S 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748730 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140094893562128 217413900064 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6587] ppid=6571 vsize=9624972 CPUtime=0.86 cores=0,2,4,6
/proc/6573/task/6587/stat : 6587 (java) S 6571 6573 6573 0 -1 4202560 5075 0 0 0 86 0 0 0 20 0 19 0 337748730 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140094892510008 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6573/tid=6588] ppid=6571 vsize=9624972 CPUtime=0.73 cores=0,2,4,6
/proc/6573/task/6588/stat : 6588 (java) S 6571 6573 6573 0 -1 4202560 5599 0 0 0 71 2 0 0 20 0 19 0 337748730 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140094891457464 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6589] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6589/stat : 6589 (java) S 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748730 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140094890404600 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6590] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6590/stat : 6590 (java) S 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748730 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140094889352264 217413892009 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6591] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6591/stat : 6591 (java) S 6571 6573 6573 0 -1 4202560 12 0 0 0 0 0 0 0 20 0 19 0 337748794 9855971328 48328 33554432000 1073741824 1073778376 140736682748288 140094888297512 217413892009 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6564/tid=6572] ppid=6562 vsize=366656 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6572/stat : 6572 (python) S 6562 6564 3958 0 -1 4202560 26 1498 0 0 0 0 17 3 20 0 2 0 337748724 375455744 9528 33554432000 4194304 5683644 140734323350304 140183237616176 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
Current children cumulated CPU time (s) 7.88
Current children cumulated vsize (KiB) 10282504

[startup+12.7007 s]
/proc/loadavg: 2.16 2.63 2.55 3/218 6591
/proc/meminfo: memFree=27517300/32873648 swapFree=7628/7628
[pid=6564] ppid=6562 vsize=366656 CPUtime=1.37 cores=0,2,4,6
/proc/6564/stat : 6564 (python) S 6562 6564 3958 0 -1 4202496 16147 1498 1 0 104 13 17 3 20 0 2 0 337748583 375455744 9528 33554432000 4194304 5683644 140734323350304 140734323345136 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6564/statm: 91664 9528 1903 364 0 26887 0
[pid=6571] ppid=6564 vsize=290876 CPUtime=0.01 cores=0,2,4,6
/proc/6571/stat : 6571 (python) S 6564 6564 3958 0 -1 4202560 961 0 0 0 1 0 0 0 20 0 1 0 337748724 297857024 7953 33554432000 4194304 5683644 140734323350304 140734323341392 217410535848 0 0 16781312 33554946 18446744071580425449 0 0 17 0 0 0 0 0 0
/proc/6571/statm: 72719 7953 334 364 0 7942 0
[pid=6573] ppid=6571 vsize=9624972 CPUtime=13.17 cores=0,2,4,6
/proc/6573/stat : 6573 (java) S 6571 6573 6573 0 -1 4202496 15646 0 1 0 1301 16 0 0 20 0 19 0 337748724 9855971328 89241 33554432000 1073741824 1073778376 140736682748288 140736682739424 217413877821 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6573/statm: 2406243 89241 2266 9 0 2396937 0
[pid=6573/tid=6574] ppid=6571 vsize=9624972 CPUtime=11.1 cores=0,2,4,6
/proc/6573/task/6574/stat : 6574 (java) R 6571 6573 6573 0 -1 4202560 2555 0 1 0 1105 5 0 0 20 0 19 0 337748725 9855971328 89241 33554432000 1073741824 1073778376 140736682748288 140095072602880 140094938742752 0 4 0 16800975 0 0 0 -1 2 0 0 4 0 0
[pid=6573/tid=6575] ppid=6571 vsize=9624972 CPUtime=0.04 cores=0,2,4,6
/proc/6573/task/6575/stat : 6575 (java) S 6571 6573 6573 0 -1 4202560 124 0 0 0 3 1 0 0 20 0 19 0 337748726 9855971328 89241 33554432000 1073741824 1073778376 140736682748288 140095061666216 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6576] ppid=6571 vsize=9624972 CPUtime=0.03 cores=0,2,4,6
/proc/6573/task/6576/stat : 6576 (java) S 6571 6573 6573 0 -1 4202560 29 0 0 0 2 1 0 0 20 0 19 0 337748726 9855971328 89241 33554432000 1073741824 1073778376 140736682748288 140095060613672 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6577] ppid=6571 vsize=9624972 CPUtime=0.03 cores=0,2,4,6
/proc/6573/task/6577/stat : 6577 (java) S 6571 6573 6573 0 -1 4202560 23 0 0 0 3 0 0 0 20 0 19 0 337748726 9855971328 89241 33554432000 1073741824 1073778376 140736682748288 140095059560616 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6578] ppid=6571 vsize=9624972 CPUtime=0.02 cores=0,2,4,6
/proc/6573/task/6578/stat : 6578 (java) S 6571 6573 6573 0 -1 4202560 89 0 0 0 2 0 0 0 20 0 19 0 337748726 9855971328 89241 33554432000 1073741824 1073778376 140736682748288 140095058508072 217413891132 0 4 0 16800975 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6579] ppid=6571 vsize=9624972 CPUtime=0.04 cores=0,2,4,6

################
# More data... #
################

/proc/6836/stat : 6836 (wbo1.4a) T 6834 6836 6836 0 -1 4202496 24512 0 0 0 4597 17 0 0 20 0 1 0 337904502 99999744 23878 33554432000 134512640 135751879 4287204928 4287203120 134611152 0 0 16781312 3 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/6836/statm: 24414 23878 143 303 0 24109 0
[pid=6834/tid=6838] ppid=6564 vsize=745628 CPUtime=0 cores=0,2,4,6
/proc/6834/task/6838/stat : 6838 (python) S 6564 6564 3958 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 337909119 763523072 8034 33554432000 4194304 5683644 140734323350304 140183185166896 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6860] ppid=6564 vsize=821420 CPUtime=0 cores=0,2,4,6
/proc/6860/stat : 6860 (python) S 6564 6564 3958 0 -1 4202560 822 0 0 0 0 0 0 0 20 0 1 0 337914235 841134080 8476 33554432000 4194304 5683644 140734323350304 140734323341392 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/6860/statm: 205355 8476 307 364 0 140557 0
[pid=6862] ppid=6860 vsize=34796 CPUtime=0.17 cores=0,2,4,6
/proc/6862/stat : 6862 (minion) R 6860 6862 6862 0 -1 4202496 2612 0 0 0 17 0 0 0 20 0 1 0 337914235 35631104 1329 33554432000 134512640 165565024 4293649984 4293635156 159718384 0 0 16781312 0 0 0 0 17 0 0 0 0 0 0
/proc/6862/statm: 8699 1329 262 7582 0 1114 0
[pid=6564/tid=6572] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6572/stat : 6572 (python) S 6562 6564 3958 0 -1 4202560 26 1498 0 0 0 0 17 3 20 0 9 0 337748724 918732800 10093 33554432000 4194304 5683644 140734323350304 140183237616176 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6564/tid=6594] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6594/stat : 6594 (python) S 6562 6564 3958 0 -1 4202560 38 1498 0 0 0 0 17 3 20 0 9 0 337753105 918732800 10093 33554432000 4194304 5683644 140734323350304 140183227126320 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6564/tid=6598] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6598/stat : 6598 (python) S 6562 6564 3958 0 -1 4202560 23 1498 0 0 0 0 17 3 20 0 9 0 337757853 918732800 10093 33554432000 4194304 5683644 140734323350304 140183216636464 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6564/tid=6602] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6602/stat : 6602 (python) S 6562 6564 3958 0 -1 4202560 25 1498 0 0 0 0 17 3 20 0 9 0 337762569 918732800 10093 33554432000 4194304 5683644 140734323350304 140183206146608 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6564/tid=6614] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6614/stat : 6614 (python) S 6562 6564 3958 0 -1 4202560 21 1498 0 0 0 0 17 3 20 0 9 0 337794429 918732800 10093 33554432000 4194304 5683644 140734323350304 140183195656752 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6564/tid=6628] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6628/stat : 6628 (python) S 6562 6564 3958 0 -1 4202560 21 1498 0 0 0 0 17 3 20 0 9 0 337845003 918732800 10093 33554432000 4194304 5683644 140734323350304 140183185166896 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6564/tid=6835] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6835/stat : 6835 (python) S 6562 6564 3958 0 -1 4202560 20 1498 0 0 0 0 17 3 20 0 9 0 337904502 918732800 10093 33554432000 4194304 5683644 140734323350304 140182833586736 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6564/tid=6861] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6861/stat : 6861 (python) S 6562 6564 3958 0 -1 4202560 23 1498 0 0 0 0 17 3 20 0 9 0 337914235 918732800 10093 33554432000 4194304 5683644 140734323350304 140182823096880 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1661.52
Current children cumulated vsize (KiB) 16171680

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1656.7 s]
/proc/loadavg: 2.06 2.03 2.09 3/263 6862
/proc/meminfo: memFree=26081284/32873648 swapFree=7628/7628
[pid=6564] ppid=6562 vsize=897200 CPUtime=3.65 cores=0,2,4,6
/proc/6564/stat : 6564 (python) S 6562 6564 3958 0 -1 4202496 23021 1498 1 0 329 16 17 3 20 0 9 0 337748583 918732800 10093 33554432000 4194304 5683644 140734323350304 140734323345136 217413903629 0 0 16781312 33554434 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6564/statm: 224300 10093 1918 364 0 159502 0
[pid=6571] ppid=6564 vsize=366656 CPUtime=0.07 cores=0,2,4,6
/proc/6571/stat : 6571 (python) S 6564 6564 3958 0 -1 4202560 1153 0 0 0 5 2 0 0 20 0 2 0 337748724 375455744 8021 33554432000 4194304 5683644 140734323350304 140734323341952 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6571/statm: 91664 8021 395 364 0 26887 0
[pid=6573] ppid=6571 vsize=9624972 CPUtime=46.23 cores=0,2,4,6
/proc/6573/stat : 6573 (java) T 6571 6573 6573 0 -1 4202496 17184 0 1 0 4586 37 0 0 20 0 19 0 337748724 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140736682739424 217413877821 0 0 0 16800975 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6573/statm: 2406243 184554 2266 9 0 2396937 0
[pid=6573/tid=6574] ppid=6571 vsize=9624972 CPUtime=43.43 cores=0,2,4,6
/proc/6573/task/6574/stat : 6574 (java) T 6571 6573 6573 0 -1 4202560 2847 0 1 0 4336 7 0 0 20 0 19 0 337748725 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140095072603024 140094938866415 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 4 0 0
[pid=6573/tid=6575] ppid=6571 vsize=9624972 CPUtime=0.15 cores=0,2,4,6
/proc/6573/task/6575/stat : 6575 (java) T 6571 6573 6573 0 -1 4202560 350 0 0 0 10 5 0 0 20 0 19 0 337748726 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140095061666216 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6576] ppid=6571 vsize=9624972 CPUtime=0.08 cores=0,2,4,6
/proc/6573/task/6576/stat : 6576 (java) T 6571 6573 6573 0 -1 4202560 50 0 0 0 5 3 0 0 20 0 19 0 337748726 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140095060613672 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6573/tid=6577] ppid=6571 vsize=9624972 CPUtime=0.12 cores=0,2,4,6
/proc/6573/task/6577/stat : 6577 (java) T 6571 6573 6573 0 -1 4202560 226 0 0 0 9 3 0 0 20 0 19 0 337748726 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140095059560616 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6573/tid=6578] ppid=6571 vsize=9624972 CPUtime=0.13 cores=0,2,4,6
/proc/6573/task/6578/stat : 6578 (java) T 6571 6573 6573 0 -1 4202560 375 0 0 0 9 4 0 0 20 0 19 0 337748726 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140095058508072 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6579] ppid=6571 vsize=9624972 CPUtime=0.09 cores=0,2,4,6
/proc/6573/task/6579/stat : 6579 (java) T 6571 6573 6573 0 -1 4202560 50 0 0 0 7 2 0 0 20 0 19 0 337748726 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140095057456040 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6580] ppid=6571 vsize=9624972 CPUtime=0.1 cores=0,2,4,6
/proc/6573/task/6580/stat : 6580 (java) T 6571 6573 6573 0 -1 4202560 180 0 0 0 8 2 0 0 20 0 19 0 337748726 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140095056403496 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6573/tid=6581] ppid=6571 vsize=9624972 CPUtime=0.12 cores=0,2,4,6
/proc/6573/task/6581/stat : 6581 (java) T 6571 6573 6573 0 -1 4202560 245 0 0 0 9 3 0 0 20 0 19 0 337748726 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140094910184104 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6582] ppid=6571 vsize=9624972 CPUtime=0.13 cores=0,2,4,6
/proc/6573/task/6582/stat : 6582 (java) T 6571 6573 6573 0 -1 4202560 239 0 0 0 8 5 0 0 20 0 19 0 337748726 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140094909131560 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6583] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6583/stat : 6583 (java) T 6571 6573 6573 0 -1 4202560 238 0 0 0 0 0 0 0 20 0 19 0 337748727 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140094896720232 217413892009 0 0 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6573/tid=6584] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6584/stat : 6584 (java) T 6571 6573 6573 0 -1 4202560 17 0 0 0 0 0 0 0 20 0 19 0 337748728 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140094895666552 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6585] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6585/stat : 6585 (java) T 6571 6573 6573 0 -1 4202560 9 0 0 0 0 0 0 0 20 0 19 0 337748728 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140094894613384 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 6 0 0 0 0 0
[pid=6573/tid=6586] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6586/stat : 6586 (java) T 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748730 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140094893562128 217413900064 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6573/tid=6587] ppid=6571 vsize=9624972 CPUtime=0.86 cores=0,2,4,6
/proc/6573/task/6587/stat : 6587 (java) T 6571 6573 6573 0 -1 4202560 5075 0 0 0 86 0 0 0 20 0 19 0 337748730 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140094892510008 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 2 0 0 0 0 0
[pid=6573/tid=6588] ppid=6571 vsize=9624972 CPUtime=0.87 cores=0,2,4,6
/proc/6573/task/6588/stat : 6588 (java) T 6571 6573 6573 0 -1 4202560 5902 0 0 0 85 2 0 0 20 0 19 0 337748730 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140094891457464 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6589] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6589/stat : 6589 (java) T 6571 6573 6573 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 19 0 337748730 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140094890404600 217413891132 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6590] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6590/stat : 6590 (java) T 6571 6573 6573 0 -1 4202560 3 0 0 0 0 0 0 0 20 0 19 0 337748730 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140094889352264 217413892009 0 4 0 16800975 18446744071579387992 0 0 -1 0 0 0 0 0 0
[pid=6573/tid=6591] ppid=6571 vsize=9624972 CPUtime=0 cores=0,2,4,6
/proc/6573/task/6591/stat : 6591 (java) T 6571 6573 6573 0 -1 4202560 12 0 0 0 0 0 0 0 20 0 19 0 337748794 9855971328 184554 33554432000 1073741824 1073778376 140736682748288 140094888297512 217413892009 0 4 0 16800975 18446744071579387992 0 0 -1 6 0 0 0 0 0
[pid=6571/tid=6592] ppid=6564 vsize=366656 CPUtime=0 cores=0,2,4,6
/proc/6571/task/6592/stat : 6592 (python) S 6564 6564 3958 0 -1 4202560 44 0 0 0 0 0 0 0 20 0 2 0 337753103 375455744 8021 33554432000 4194304 5683644 140734323350304 140183237616176 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6593] ppid=6564 vsize=366668 CPUtime=1.84 cores=0,2,4,6
/proc/6593/stat : 6593 (python) S 6564 6564 3958 0 -1 4202560 1185 0 0 0 105 79 0 0 20 0 2 0 337753105 375468032 8004 33554432000 4194304 5683644 140734323350304 140734323341952 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/6593/statm: 91667 8004 378 364 0 26887 0
[pid=6595] ppid=6593 vsize=303688 CPUtime=1054.26 cores=0,2,4,6
/proc/6595/stat : 6595 (scip-2.0.1.linu) T 6593 6595 6595 0 -1 4202496 78082 0 0 0 105217 209 0 0 20 0 1 0 337753105 310976512 73030 33554432000 4194304 13684479 140736180423760 140736180417608 7354541 0 0 16781312 2 18446744071579387992 0 0 17 2 0 0 0 0 0
/proc/6595/statm: 75922 73030 847 2317 0 73600 0
[pid=6593/tid=6596] ppid=6564 vsize=366668 CPUtime=0 cores=0,2,4,6
/proc/6593/task/6596/stat : 6596 (python) S 6564 6564 3958 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 337757851 375468032 8004 33554432000 4194304 5683644 140734323350304 140183237616176 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6597] ppid=6564 vsize=442460 CPUtime=0.39 cores=0,2,4,6
/proc/6597/stat : 6597 (python) S 6564 6564 3958 0 -1 4202560 1169 0 0 0 22 17 0 0 20 0 2 0 337757853 453079040 8010 33554432000 4194304 5683644 140734323350304 140734323341952 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6597/statm: 110615 8010 378 364 0 45832 0
[pid=6599] ppid=6597 vsize=58476 CPUtime=228.55 cores=0,2,4,6
/proc/6599/stat : 6599 (clasp-1.3.7-x86) T 6597 6599 6599 0 -1 4202496 15099 0 0 0 22852 3 0 0 20 0 1 0 337757854 59879424 14329 33554432000 134512640 136139019 4290293040 4290291952 134640568 0 0 16781312 16386 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/6599/statm: 14619 14329 182 398 0 14219 0
[pid=6597/tid=6600] ppid=6564 vsize=442460 CPUtime=0 cores=0,2,4,6
/proc/6597/task/6600/stat : 6600 (python) S 6564 6564 3958 0 -1 4202560 45 0 0 0 0 0 0 0 20 0 2 0 337762567 453079040 8010 33554432000 4194304 5683644 140734323350304 140183227126320 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6601] ppid=6564 vsize=518252 CPUtime=0.24 cores=0,2,4,6
/proc/6601/stat : 6601 (python) S 6564 6564 3958 0 -1 4202560 1152 0 0 0 14 10 0 0 20 0 2 0 337762569 530690048 8016 33554432000 4194304 5683644 140734323350304 140734323341952 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6601/statm: 129563 8016 378 364 0 64777 0
[pid=6603] ppid=6601 vsize=251416 CPUtime=140.95 cores=0,2,4,6
/proc/6603/stat : 6603 (scip-2.0.1.linu) T 6601 6603 6603 0 -1 4202496 89957 0 0 0 14056 39 0 0 20 0 1 0 337762569 257449984 59055 33554432000 4194304 15243407 140734465753904 140734465748616 7128842 0 0 16781312 2 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/6603/statm: 62854 59055 961 2698 0 60149 0
[pid=6601/tid=6610] ppid=6564 vsize=518252 CPUtime=0 cores=0,2,4,6
/proc/6601/task/6610/stat : 6610 (python) S 6564 6564 3958 0 -1 4202560 47 0 0 0 0 0 0 0 20 0 2 0 337767344 530690048 8016 33554432000 4194304 5683644 140734323350304 140183216636464 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6613] ppid=6564 vsize=594044 CPUtime=0.15 cores=0,2,4,6
/proc/6613/stat : 6613 (python) S 6564 6564 3958 0 -1 4202560 1168 0 0 0 9 6 0 0 20 0 2 0 337794429 608301056 8022 33554432000 4194304 5683644 140734323350304 140734323341952 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6613/statm: 148511 8022 378 364 0 83722 0
[pid=6615] ppid=6613 vsize=287856 CPUtime=91.51 cores=0,2,4,6
/proc/6615/stat : 6615 (bsolo_pb10) T 6613 6615 6615 0 -1 4202496 70711 0 0 0 9132 19 0 0 20 0 1 0 337794429 294764544 69487 33554432000 134512640 137138936 4294072640 4294071568 134542301 0 0 16781312 16384 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/6615/statm: 71964 69487 190 642 0 71320 0
[pid=6613/tid=6617] ppid=6564 vsize=594044 CPUtime=0 cores=0,2,4,6
/proc/6613/task/6617/stat : 6617 (python) S 6564 6564 3958 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 337803584 608301056 8022 33554432000 4194304 5683644 140734323350304 140183206146608 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6627] ppid=6564 vsize=669836 CPUtime=0.08 cores=0,2,4,6
/proc/6627/stat : 6627 (python) S 6564 6564 3958 0 -1 4202560 1154 0 0 0 5 3 0 0 20 0 2 0 337845003 685912064 8028 33554432000 4194304 5683644 140734323350304 140734323341952 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6627/statm: 167459 8028 378 364 0 102667 0
[pid=6629] ppid=6627 vsize=90656 CPUtime=47.23 cores=0,2,4,6
/proc/6629/stat : 6629 (bsolo_pb10) T 6627 6629 6629 0 -1 4202496 21390 0 0 0 4714 9 0 0 20 0 1 0 337845003 92831744 20169 33554432000 134512640 137138936 4289442496 4289441392 134542805 0 0 16781312 16384 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/6629/statm: 22664 20169 192 642 0 22020 0
[pid=6627/tid=6630] ppid=6564 vsize=669836 CPUtime=0 cores=0,2,4,6
/proc/6627/task/6630/stat : 6630 (python) S 6564 6564 3958 0 -1 4202560 46 0 0 0 0 0 0 0 20 0 2 0 337849728 685912064 8028 33554432000 4194304 5683644 140734323350304 140183195656752 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6834] ppid=6564 vsize=745628 CPUtime=0.06 cores=0,2,4,6
/proc/6834/stat : 6834 (python) S 6564 6564 3958 0 -1 4202560 1159 0 0 0 4 2 0 0 20 0 2 0 337904502 763523072 8034 33554432000 4194304 5683644 140734323350304 140734323341952 217413903629 0 0 16781312 33554946 18446744073709551615 0 0 17 2 0 0 0 0 0
/proc/6834/statm: 186407 8034 378 364 0 121612 0
[pid=6836] ppid=6834 vsize=97656 CPUtime=46.14 cores=0,2,4,6
/proc/6836/stat : 6836 (wbo1.4a) T 6834 6836 6836 0 -1 4202496 24512 0 0 0 4597 17 0 0 20 0 1 0 337904502 99999744 23878 33554432000 134512640 135751879 4287204928 4287203120 134611152 0 0 16781312 3 18446744071579387992 0 0 17 0 0 0 0 0 0
/proc/6836/statm: 24414 23878 143 303 0 24109 0
[pid=6834/tid=6838] ppid=6564 vsize=745628 CPUtime=0 cores=0,2,4,6
/proc/6834/task/6838/stat : 6838 (python) S 6564 6564 3958 0 -1 4202560 48 0 0 0 0 0 0 0 20 0 2 0 337909119 763523072 8034 33554432000 4194304 5683644 140734323350304 140183185166896 217413900064 0 0 16781312 33554946 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6860] ppid=6564 vsize=821420 CPUtime=0 cores=0,2,4,6
/proc/6860/stat : 6860 (python) S 6564 6564 3958 0 -1 4202560 822 0 0 0 0 0 0 0 20 0 1 0 337914235 841134080 8476 33554432000 4194304 5683644 140734323350304 140734323341392 217410535907 0 0 16781312 33554946 18446744071580425449 0 0 17 2 0 0 0 0 0
/proc/6860/statm: 205355 8476 307 364 0 140557 0
[pid=6862] ppid=6860 vsize=34796 CPUtime=0.17 cores=0,2,4,6
/proc/6862/stat : 6862 (minion) R 6860 6862 6862 0 -1 4202496 2612 0 0 0 17 0 0 0 20 0 1 0 337914235 35631104 1329 33554432000 134512640 165565024 4293649984 4293635156 159718384 0 0 16781312 0 0 0 0 17 0 0 0 0 0 0
/proc/6862/statm: 8699 1329 262 7582 0 1114 0
[pid=6564/tid=6572] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6572/stat : 6572 (python) S 6562 6564 3958 0 -1 4202560 26 1498 0 0 0 0 17 3 20 0 9 0 337748724 918732800 10093 33554432000 4194304 5683644 140734323350304 140183237616176 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6564/tid=6594] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6594/stat : 6594 (python) S 6562 6564 3958 0 -1 4202560 38 1498 0 0 0 0 17 3 20 0 9 0 337753105 918732800 10093 33554432000 4194304 5683644 140734323350304 140183227126320 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 2 0 0 0 0 0
[pid=6564/tid=6598] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6598/stat : 6598 (python) S 6562 6564 3958 0 -1 4202560 23 1498 0 0 0 0 17 3 20 0 9 0 337757853 918732800 10093 33554432000 4194304 5683644 140734323350304 140183216636464 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6564/tid=6602] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6602/stat : 6602 (python) S 6562 6564 3958 0 -1 4202560 25 1498 0 0 0 0 17 3 20 0 9 0 337762569 918732800 10093 33554432000 4194304 5683644 140734323350304 140183206146608 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 0 0 0 0 0 0
[pid=6564/tid=6614] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6614/stat : 6614 (python) S 6562 6564 3958 0 -1 4202560 21 1498 0 0 0 0 17 3 20 0 9 0 337794429 918732800 10093 33554432000 4194304 5683644 140734323350304 140183195656752 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
[pid=6564/tid=6628] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6628/stat : 6628 (python) S 6562 6564 3958 0 -1 4202560 21 1498 0 0 0 0 17 3 20 0 9 0 337845003 918732800 10093 33554432000 4194304 5683644 140734323350304 140183185166896 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6564/tid=6835] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6835/stat : 6835 (python) S 6562 6564 3958 0 -1 4202560 20 1498 0 0 0 0 17 3 20 0 9 0 337904502 918732800 10093 33554432000 4194304 5683644 140734323350304 140182833586736 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 6 0 0 0 0 0
[pid=6564/tid=6861] ppid=6562 vsize=897200 CPUtime=0.2 cores=0,2,4,6
/proc/6564/task/6861/stat : 6861 (python) S 6562 6564 3958 0 -1 4202560 23 1498 0 0 0 0 17 3 20 0 9 0 337914235 918732800 10093 33554432000 4194304 5683644 140734323350304 140182823096880 217413900064 0 0 16781312 33554434 18446744071579510697 0 0 -1 4 0 0 0 0 0
Current children cumulated CPU time (s) 1661.52
Current children cumulated vsize (KiB) 16171680

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 6564 and gives
#  childrusage.ru_utime.tv_sec=3
#  childrusage.ru_utime.tv_usec=479471
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=190970
# CPU time returned by wait4() is 3.67044
# while last known CPU time is 1661.52
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1656.76
CPU time (s): 1661.52
CPU user time (s): 1656.81
CPU system time (s): 4.71
CPU usage (%): 100.287
Max. virtual memory (cumulated for all children) (KiB): 16171680

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3.47947
system time used= 0.19097
maximum resident set size= 40536
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 25007
page faults= 1
swaps= 0
block input operations= 0
block output operations= 7208
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12871
involuntary context switches= 32

runsolver used 9.02063 second user time and 21.3428 second system time

The end

Launcher Data 

Begin job on node122 at 2012-06-03 11:37:05
IDJOB=3737705
IDBENCH=48295
IDSOLVER=2327
FILE ID=node122/3737705-1338716225
RUNJOBID= node122-1338713392-3974
PBS_JOBID= 14636732
Free space on /tmp= 71068 MiB

SOLVER NAME= PB11: borg pb-dec-11.04.03
BENCH NAME= PB07/normalized-PB07/SATUNSAT-SMALLINT-NLC/submittedPB07/manquinho/dbsg/normalized-dbsg_500_25_5_80.opb
COMMAND LINE= python DIR/solve DIR/etc/borg-mix+class.dec.pickle BENCHNAME -seed RANDOMSEED -budget TIMEOUT
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3737705-1338716225/watcher-3737705-1338716225 -o /tmp/evaluation-result-3737705-1338716225/solver-3737705-1338716225 -C 1800 -W 1900 -M 15500  python HOME/solve HOME/etc/borg-mix+class.dec.pickle HOME/instance-3737705-1338716225.opb -seed 1244941453 -budget 1800

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 611c10fb20bc9774d31ac4d0681f384d
RANDOM SEED=1244941453

node122.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        27920384 kB
Buffers:          253336 kB
Cached:          1913196 kB
SwapCached:         1800 kB
Active:          2738204 kB
Inactive:        1390500 kB
Active(anon):    1962836 kB
Inactive(anon):     2052 kB
Active(file):     775368 kB
Inactive(file):  1388448 kB
Unevictable:        7628 kB
Mlocked:            7628 kB
SwapTotal:      67108856 kB
SwapFree:       67100160 kB
Dirty:            111056 kB
Writeback:             8 kB
AnonPages:       1968520 kB
Mapped:            23340 kB
Shmem:                72 kB
Slab:             676072 kB
SReclaimable:     117016 kB
SUnreclaim:       559056 kB
KernelStack:        1608 kB
PageTables:        11936 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    2671720 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    239616 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70984 MiB
End job on node122 at 2012-06-03 12:04:45