Trace number 3347209

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 9412.51 314.608

General information on the benchmark

Namemanol-pipe-c10nidw.cnf
MD5SUM943fd86d922b13236c21a74c4f82b6d0
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark9412.51
Satisfiable
(Un)Satisfiability was proved
Number of variables433601
Number of clauses1291714
Sum of the clauses size3013998
Maximum clause length3
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2861142
Number of clauses of size 3430571
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 32 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
9411.64/314.51	s UNSATISFIABLE
9412.23/314.60	solver [5] plingeling 276-6264d55-100731 answered
9412.23/314.60	Done

Verifier Data

No possible verification on an UNSAT instance

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3347209-1304853377/watcher-3347209-1304853377 -o /tmp/evaluation-result-3347209-1304853377/solver-3347209-1304853377 -C 160000 -W 5100 -M 266338304 ppfolio HOME/instance-3347209-1304853377.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 27.27 30.29 30.31 1/413 19334
/proc/meminfo: memFree=256732916/264257624 swapFree=67111528/67111528
[pid=19334] ppid=19332 vsize=18324 CPUtime=0 cores=0-31
/proc/19334/stat : 19334 (ppfolio) S 19332 19334 19308 0 -1 4202496 514 0 0 0 0 0 0 0 24 0 1 0 596824253 18763776 386 268435456000 4194304 4287625 140733797361312 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 12 0 0 0
/proc/19334/statm: 4581 386 337 23 0 91 0

[startup+0.0767449 s]
/proc/loadavg: 27.27 30.29 30.31 1/413 19334
/proc/meminfo: memFree=256732916/264257624 swapFree=67111528/67111528
[pid=19334] ppid=19332 vsize=18324 CPUtime=0 cores=0-31
/proc/19334/stat : 19334 (ppfolio) S 19332 19334 19308 0 -1 4202496 514 0 0 0 0 0 0 0 24 0 1 0 596824253 18763776 386 268435456000 4194304 4287625 140733797361312 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 12 0 0 0
/proc/19334/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.10074 s]
/proc/loadavg: 27.27 30.29 30.31 1/413 19334
/proc/meminfo: memFree=256732916/264257624 swapFree=67111528/67111528
[pid=19334] ppid=19332 vsize=18324 CPUtime=0 cores=0-31
/proc/19334/stat : 19334 (ppfolio) S 19332 19334 19308 0 -1 4202496 514 0 0 0 0 0 0 0 24 0 1 0 596824253 18763776 386 268435456000 4194304 4287625 140733797361312 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 12 0 0 0
/proc/19334/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.30077 s]
/proc/loadavg: 27.27 30.29 30.31 1/413 19334
/proc/meminfo: memFree=256732916/264257624 swapFree=67111528/67111528
[pid=19334] ppid=19332 vsize=18324 CPUtime=0 cores=0-31
/proc/19334/stat : 19334 (ppfolio) S 19332 19334 19308 0 -1 4202496 514 0 0 0 0 0 0 0 24 0 1 0 596824253 18763776 386 268435456000 4194304 4287625 140733797361312 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 12 0 0 0
/proc/19334/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700744 s]
/proc/loadavg: 27.27 30.29 30.31 1/413 19334
/proc/meminfo: memFree=256732916/264257624 swapFree=67111528/67111528
[pid=19334] ppid=19332 vsize=18324 CPUtime=0 cores=0-31
/proc/19334/stat : 19334 (ppfolio) S 19332 19334 19308 0 -1 4202496 514 0 0 0 0 0 0 0 24 0 1 0 596824253 18763776 386 268435456000 4194304 4287625 140733797361312 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 12 0 0 0
/proc/19334/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50076 s]
/proc/loadavg: 27.27 30.29 30.31 6/419 19345
/proc/meminfo: memFree=256248248/264257624 swapFree=67111528/67111528
[pid=19334] ppid=19332 vsize=18324 CPUtime=0 cores=0-31
/proc/19334/stat : 19334 (ppfolio) S 19332 19334 19308 0 -1 4202496 514 0 0 0 0 0 0 0 18 0 1 0 596824253 18763776 386 268435456000 4194304 4287625 140733797361312 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 12 0 0 0
/proc/19334/statm: 4581 386 337 23 0 91 0
[pid=19335] ppid=19334 vsize=204780 CPUtime=1.49 cores=0
/proc/19335/stat : 19335 (cryptominisat) R 19334 19334 19308 0 -1 4202496 37671 0 0 0 137 12 0 0 20 0 1 0 596824253 209694720 36652 268435456000 4194304 4587354 140734404890656 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/19335/statm: 51195 36652 304 96 0 47757 0
[pid=19336] ppid=19334 vsize=196032 CPUtime=1.49 cores=1
/proc/19336/stat : 19336 (clasp) R 19334 19334 19308 0 -1 4202496 55412 0 0 0 136 13 0 0 20 0 1 0 596824253 200736768 44367 268435456000 4194304 4785740 140735268654096 18446744073709551615 4483194 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19336/statm: 49008 44367 317 145 0 46053 0
[pid=19337] ppid=19334 vsize=491600 CPUtime=1.49 cores=2
/proc/19337/stat : 19337 (TNM) R 19334 19334 19308 0 -1 4202496 15409 0 0 0 143 6 0 0 20 0 1 0 596824253 503398400 15306 268435456000 134512640 134534564 4289552192 18446744073709551615 4155047 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/19337/statm: 122900 15308 91 6 0 121565 0
[pid=19338] ppid=19334 vsize=233944 CPUtime=1.49 cores=3
/proc/19338/stat : 19338 (march_hi) R 19334 19334 19308 0 -1 4194304 46646 0 0 0 135 14 0 0 20 0 1 0 596824253 239558656 43998 268435456000 4194304 4331988 140735507430448 18446744073709551615 258650604748 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/19338/statm: 58486 43998 116 34 0 56928 0
[pid=19339] ppid=19334 vsize=122432 CPUtime=1.48 cores=4-31
/proc/19339/stat : 19339 (plingeling) R 19334 19334 19308 0 -1 4202496 29384 1243 0 0 141 7 0 0 21 0 1 0 596824253 125370368 29267 268435456000 4194304 4356188 140733542995056 18446744073709551615 4278267 0 0 4096 17442 0 0 0 17 16 0 0 0
/proc/19339/statm: 30608 29267 129 40 0 29152 0
Current children cumulated CPU time (s) 7.44
Current children cumulated vsize (KiB) 1267112

[startup+3.10085 s]
/proc/loadavg: 27.27 30.29 30.31 6/419 19345
/proc/meminfo: memFree=255915064/264257624 swapFree=67111528/67111528
[pid=19334] ppid=19332 vsize=18324 CPUtime=0 cores=0-31
/proc/19334/stat : 19334 (ppfolio) S 19332 19334 19308 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 596824253 18763776 386 268435456000 4194304 4287625 140733797361312 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 12 0 0 0
/proc/19334/statm: 4581 386 337 23 0 91 0
[pid=19335] ppid=19334 vsize=279828 CPUtime=3.09 cores=0
/proc/19335/stat : 19335 (cryptominisat) R 19334 19334 19308 0 -1 4202496 56357 0 0 0 294 15 0 0 25 0 1 0 596824253 286543872 55338 268435456000 4194304 4587354 140734404890656 18446744073709551615 4421016 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/19335/statm: 69957 55338 310 96 0 66519 0
[pid=19336] ppid=19334 vsize=244692 CPUtime=3.08 cores=1
/proc/19336/stat : 19336 (clasp) R 19334 19334 19308 0 -1 4202496 67396 0 0 0 292 16 0 0 25 0 1 0 596824253 250564608 56351 268435456000 4194304 4785740 140735268654096 18446744073709551615 258650616632 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19336/statm: 61173 56351 317 145 0 58218 0
[pid=19337] ppid=19334 vsize=529220 CPUtime=3.09 cores=2
/proc/19337/stat : 19337 (TNM) R 19334 19334 19308 0 -1 4202496 26743 0 0 0 301 8 0 0 25 0 1 0 596824253 541921280 26640 268435456000 134512640 134534564 4289552192 18446744073709551615 134524712 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/19337/statm: 132305 26640 91 6 0 130970 0
[pid=19338] ppid=19334 vsize=244216 CPUtime=3.08 cores=3
/proc/19338/stat : 19338 (march_hi) R 19334 19334 19308 0 -1 4194304 92804 0 0 0 284 24 0 0 25 0 1 0 596824253 250077184 46964 268435456000 4194304 4331988 140735507430448 18446744073709551615 4251681 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/19338/statm: 61054 46964 126 34 0 59496 0
[pid=19339] ppid=19334 vsize=270576 CPUtime=3.08 cores=4-31
/proc/19339/stat : 19339 (plingeling) R 19334 19334 19308 0 -1 4202496 66202 1243 0 0 292 16 0 0 25 0 1 0 596824253 277069824 66061 268435456000 4194304 4356188 140733542995056 18446744073709551615 258650649933 0 0 4096 17442 0 0 0 17 16 0 0 0
/proc/19339/statm: 67644 66068 129 40 0 66188 0
Current children cumulated CPU time (s) 15.42
Current children cumulated vsize (KiB) 1586856

[startup+6.30095 s]
/proc/loadavg: 25.48 29.87 30.17 6/419 19345
/proc/meminfo: memFree=255403348/264257624 swapFree=67111528/67111528
[pid=19334] ppid=19332 vsize=18324 CPUtime=0 cores=0-31
/proc/19334/stat : 19334 (ppfolio) S 19332 19334 19308 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 596824253 18763776 386 268435456000 4194304 4287625 140733797361312 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 12 0 0 0
/proc/19334/statm: 4581 386 337 23 0 91 0
[pid=19335] ppid=19334 vsize=286288 CPUtime=6.29 cores=0
/proc/19335/stat : 19335 (cryptominisat) R 19334 19334 19308 0 -1 4202496 60214 0 0 0 613 16 0 0 25 0 1 0 596824253 293158912 55808 268435456000 4194304 4587354 140734404890656 18446744073709551615 4383873 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/19335/statm: 71572 55808 313 96 0 68134 0
[pid=19336] ppid=19334 vsize=289648 CPUtime=6.29 cores=1
/proc/19336/stat : 19336 (clasp) R 19334 19334 19308 0 -1 4202496 78173 0 0 0 610 19 0 0 25 0 1 0 596824253 296599552 67128 268435456000 4194304 4785740 140735268654096 18446744073709551615 4489730 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19336/statm: 72412 67128 317 145 0 69457 0
[pid=19337] ppid=19334 vsize=542288 CPUtime=6.29 cores=2
/proc/19337/stat : 19337 (TNM) R 19334 19334 19308 0 -1 4202496 44515 0 0 0 617 12 0 0 25 0 1 0 596824253 555302912 44412 268435456000 134512640 134534564 4289552192 18446744073709551615 134529352 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/19337/statm: 135572 44412 95 6 0 134237 0
[pid=19338] ppid=19334 vsize=277828 CPUtime=6.29 cores=3
/proc/19338/stat : 19338 (march_hi) R 19334 19334 19308 0 -1 4202496 189642 0 0 0 583 46 0 0 25 0 1 0 596824253 284495872 55385 268435456000 4194304 4331988 140735507430448 18446744073709551615 258650611634 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/19338/statm: 69457 55385 138 34 0 67899 0
[pid=19339] ppid=19334 vsize=459964 CPUtime=6.28 cores=4-31
/proc/19339/stat : 19339 (plingeling) R 19334 19334 19308 0 -1 4202496 113945 1243 0 0 603 25 0 0 25 0 1 0 596824253 471003136 113650 268435456000 4194304 4356188 140733542995056 18446744073709551615 4278432 0 0 4096 17442 0 0 0 17 16 0 0 0
/proc/19339/statm: 114991 113650 129 40 0 113535 0
Current children cumulated CPU time (s) 31.44
Current children cumulated vsize (KiB) 1874340

[startup+12.7012 s]
/proc/loadavg: 23.84 29.45 30.04 6/419 19345
/proc/meminfo: memFree=254702848/264257624 swapFree=67111528/67111528
[pid=19334] ppid=19332 vsize=18324 CPUtime=0 cores=0-31
/proc/19334/stat : 19334 (ppfolio) S 19332 19334 19308 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 596824253 18763776 386 268435456000 4194304 4287625 140733797361312 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 12 0 0 0
/proc/19334/statm: 4581 386 337 23 0 91 0
[pid=19335] ppid=19334 vsize=399724 CPUtime=12.68 cores=0
/proc/19335/stat : 19335 (cryptominisat) R 19334 19334 19308 0 -1 4202496 111158 0 0 0 1240 28 0 0 21 0 1 0 596824253 409317376 88916 268435456000 4194304 4587354 140734404890656 18446744073709551615 4244136 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/19335/statm: 99931 88916 328 96 0 96493 0
[pid=19336] ppid=19334 vsize=278196 CPUtime=12.68 cores=1
/proc/19336/stat : 19336 (clasp) R 19334 19334 19308 0 -1 4202496 82784 0 0 0 1248 20 0 0 25 0 1 0 596824253 284872704 64981 268435456000 4194304 4785740 140735268654096 18446744073709551615 4319104 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19336/statm: 69549 64981 338 145 0 66594 0
[pid=19337] ppid=19334 vsize=542288 CPUtime=12.69 cores=2
/proc/19337/stat : 19337 (TNM) R 19334 19334 19308 0 -1 4202496 44515 0 0 0 1257 12 0 0 25 0 1 0 596824253 555302912 44412 268435456000 134512640 134534564 4289552192 18446744073709551615 134529366 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/19337/statm: 135572 44412 95 6 0 134237 0
[pid=19338] ppid=19334 vsize=821364 CPUtime=12.68 cores=3
/proc/19338/stat : 19338 (march_hi) R 19334 19334 19308 0 -1 4202496 358430 0 0 0 1188 80 0 0 25 0 1 0 596824253 841076736 88838 268435456000 4194304 4331988 140735507430448 18446744073709551615 4251979 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/19338/statm: 205341 88838 149 34 0 203783 0
[pid=19339] ppid=19334 vsize=908204 CPUtime=12.68 cores=4-31
/proc/19339/stat : 19339 (plingeling) R 19334 19334 19308 0 -1 4202496 226280 1243 0 0 1219 49 0 0 25 0 1 0 596824253 930000896 225710 268435456000 4194304 4356188 140733542995056 18446744073709551615 258650955760 0 0 4096 17442 0 0 0 17 16 0 0 0
/proc/19339/statm: 227051 225710 129 40 0 225595 0
Current children cumulated CPU time (s) 63.41
Current children cumulated vsize (KiB) 2968100

[startup+25.5026 s]
/proc/loadavg: 21.67 28.67 29.77 32/447 19373
/proc/meminfo: memFree=253372236/264257624 swapFree=67111528/67111528
[pid=19334] ppid=19332 vsize=18324 CPUtime=0 cores=0-31
/proc/19334/stat : 19334 (ppfolio) S 19332 19334 19308 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 596824253 18763776 386 268435456000 4194304 4287625 140733797361312 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 12 0 0 0
/proc/19334/statm: 4581 386 337 23 0 91 0
[pid=19335] ppid=19334 vsize=399724 CPUtime=25.48 cores=0
/proc/19335/stat : 19335 (cryptominisat) R 19334 19334 19308 0 -1 4202496 111527 0 0 0 2520 28 0 0 25 0 1 0 596824253 409317376 89266 268435456000 4194304 4587354 140734404890656 18446744073709551615 4521984 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/19335/statm: 99931 89266 331 96 0 96493 0
[pid=19336] ppid=19334 vsize=278196 CPUtime=25.48 cores=1
/proc/19336/stat : 19336 (clasp) R 19334 19334 19308 0 -1 4202496 82784 0 0 0 2528 20 0 0 25 0 1 0 596824253 284872704 64981 268435456000 4194304 4785740 140735268654096 18446744073709551615 4561965 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19336/statm: 69549 64981 338 145 0 66594 0
[pid=19337] ppid=19334 vsize=542288 CPUtime=25.49 cores=2
/proc/19337/stat : 19337 (TNM) R 19334 19334 19308 0 -1 4202496 44515 0 0 0 2537 12 0 0 25 0 1 0 596824253 555302912 44412 268435456000 134512640 134534564 4289552192 18446744073709551615 134529374 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/19337/statm: 135572 44412 95 6 0 134237 0
[pid=19338] ppid=19334 vsize=835452 CPUtime=25.48 cores=3
/proc/19338/stat : 19338 (march_hi) R 19334 19334 19308 0 -1 4202496 452986 0 0 0 2450 98 0 0 25 0 1 0 596824253 855502848 170125 268435456000 4194304 4331988 140735507430448 18446744073709551615 4228841 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/19338/statm: 208863 170125 172 34 0 207305 0
[pid=19339] ppid=19334 vsize=2550700 CPUtime=95.96 cores=4-31
/proc/19339/stat : 19339 (plingeling) S 19334 19334 19308 0 -1 4202496 863194 1243 0 0 9260 336 0 0 19 0 29 0 596824253 2611916800 513525 268435456000 4194304 4356188 140733542995056 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 12 0 0 0
/proc/19339/statm: 637675 513531 147 40 0 636219 0
[pid=19339/tid=19346] ppid=19334 vsize=2550700 CPUtime=2.64 cores=4-31
/proc/19339/task/19346/stat : 19346 (plingeling) R 19334 19334 19308 0 -1 4202560 12813 1243 0 0 256 8 0 0 18 0 29 0 596826533 2611916800 513537 268435456000 4194304 4356188 140733542995056 18446744073709551615 258650653309 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=19339/tid=19347] ppid=19334 vsize=2550700 CPUtime=2.65 cores=4-31
/proc/19339/task/19347/stat : 19347 (plingeling) R 19334 19334 19308 0 -1 4202560 12960 1243 0 0 258 7 0 0 18 0 29 0 596826533 2611916800 513544 268435456000 4194304 4356188 140733542995056 18446744073709551615 4265871 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=19339/tid=19348] ppid=19334 vsize=2550700 CPUtime=2.45 cores=4-31
/proc/19339/task/19348/stat : 19348 (plingeling) R 19334 19334 19308 0 -1 4202560 10877 1243 0 0 242 3 0 0 25 0 29 0 596826533 2611916800 513551 268435456000 4194304 4356188 140733542995056 18446744073709551615 4259314 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=19339/tid=19349] ppid=19334 vsize=2550700 CPUtime=2.61 cores=4-31
/proc/19339/task/19349/stat : 19349 (plingeling) R 19334 19334 19308 0 -1 4202560 16146 1243 0 0 251 10 0 0 18 0 29 0 596826533 2611916800 513559 268435456000 4194304 4356188 140733542995056 18446744073709551615 4212626 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=19339/tid=19350] ppid=19334 vsize=2550700 CPUtime=2.63 cores=4-31
/proc/19339/task/19350/stat : 19350 (plingeling) R 19334 19334 19308 0 -1 4202560 13344 1243 0 0 256 7 0 0 25 0 29 0 596826533 2611916800 513565 268435456000 4194304 4356188 140733542995056 18446744073709551615 4264173 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=19339/tid=19351] ppid=19334 vsize=2550700 CPUtime=2.66 cores=4-31
/proc/19339/task/19351/stat : 19351 (plingeling) R 19334 19334 19308 0 -1 4202560 25606 1243 0 0 258 8 0 0 25 0 29 0 596826533 2611916800 513572 268435456000 4194304 4356188 140733542995056 18446744073709551615 4259349 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=19339/tid=19352] ppid=19334 vsize=2550700 CPUtime=2.63 cores=4-31
/proc/19339/task/19352/stat : 19352 (plingeling) R 19334 19334 19308 0 -1 4202560 16517 1243 0 0 259 4 0 0 18 0 29 0 596826533 2611916800 513579 268435456000 4194304 4356188 140733542995056 18446744073709551615 4219786 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=19339/tid=19353] ppid=19334 vsize=2550700 CPUtime=2.64 cores=4-31
/proc/19339/task/19353/stat : 19353 (plingeling) R 19334 19334 19308 0 -1 4202560 12392 1243 0 0 254 10 0 0 18 0 29 0 596826533 2611916800 513587 268435456000 4194304 4356188 140733542995056 18446744073709551615 4264305 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=19339/tid=19354] ppid=19334 vsize=2550700 CPUtime=2.65 cores=4-31
/proc/19339/task/19354/stat : 19354 (plingeling) R 19334 19334 19308 0 -1 4202560 12939 1243 0 0 257 8 0 0 18 0 29 0 596826533 2611916800 513594 268435456000 4194304 4356188 140733542995056 18446744073709551615 4264368 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=19339/tid=19355] ppid=19334 vsize=2550700 CPUtime=2.64 cores=4-31

################
# More data... #
################

[pid=19339/tid=19355] ppid=19334 vsize=3763896 CPUtime=288.36 cores=4-31
/proc/19339/task/19355/stat : 19355 (plingeling) R 19334 19334 19308 0 -1 4202560 55882 1243 0 0 28791 45 0 0 25 0 29 0 596826533 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4328498 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=19339/tid=19356] ppid=19334 vsize=3763896 CPUtime=288.18 cores=4-31
/proc/19339/task/19356/stat : 19356 (plingeling) R 19334 19334 19308 0 -1 4202560 38027 1243 0 0 28779 39 0 0 25 0 29 0 596826534 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=19339/tid=19357] ppid=19334 vsize=3763896 CPUtime=288.26 cores=4-31
/proc/19339/task/19357/stat : 19357 (plingeling) R 19334 19334 19308 0 -1 4202560 25141 1243 0 0 28815 11 0 0 25 0 29 0 596826534 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=19339/tid=19358] ppid=19334 vsize=3763896 CPUtime=288.51 cores=4-31
/proc/19339/task/19358/stat : 19358 (plingeling) R 19334 19334 19308 0 -1 4202560 45792 1243 0 0 28819 32 0 0 25 0 29 0 596826534 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4330982 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=19339/tid=19359] ppid=19334 vsize=3763896 CPUtime=288.74 cores=4-31
/proc/19339/task/19359/stat : 19359 (plingeling) R 19334 19334 19308 0 -1 4202560 43132 1243 0 0 28841 33 0 0 25 0 29 0 596826534 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19339/tid=19360] ppid=19334 vsize=3763896 CPUtime=288.07 cores=4-31
/proc/19339/task/19360/stat : 19360 (plingeling) R 19334 19334 19308 0 -1 4202560 53417 1243 0 0 28786 21 0 0 25 0 29 0 596826534 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4330990 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=19339/tid=19361] ppid=19334 vsize=3763896 CPUtime=288.32 cores=4-31
/proc/19339/task/19361/stat : 19361 (plingeling) R 19334 19334 19308 0 -1 4202560 46244 1243 0 0 28798 34 0 0 25 0 29 0 596826534 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=19339/tid=19362] ppid=19334 vsize=3763896 CPUtime=288.14 cores=4-31
/proc/19339/task/19362/stat : 19362 (plingeling) R 19334 19334 19308 0 -1 4202560 38490 1243 0 0 28786 28 0 0 25 0 29 0 596826534 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331383 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=19339/tid=19363] ppid=19334 vsize=3763896 CPUtime=288.26 cores=4-31
/proc/19339/task/19363/stat : 19363 (plingeling) R 19334 19334 19308 0 -1 4202560 43479 1243 0 0 28807 19 0 0 25 0 29 0 596826534 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4334437 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=19339/tid=19364] ppid=19334 vsize=3763896 CPUtime=287.88 cores=4-31
/proc/19339/task/19364/stat : 19364 (plingeling) R 19334 19334 19308 0 -1 4202560 48214 1243 0 0 28743 45 0 0 25 0 29 0 596826534 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=19339/tid=19365] ppid=19334 vsize=3763896 CPUtime=288.16 cores=4-31
/proc/19339/task/19365/stat : 19365 (plingeling) R 19334 19334 19308 0 -1 4202560 17119 1243 0 0 28810 6 0 0 25 0 29 0 596826534 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=19339/tid=19366] ppid=19334 vsize=3763896 CPUtime=288.22 cores=4-31
/proc/19339/task/19366/stat : 19366 (plingeling) R 19334 19334 19308 0 -1 4202560 43013 1243 0 0 28787 35 0 0 25 0 29 0 596826535 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=19339/tid=19367] ppid=19334 vsize=3763896 CPUtime=288.71 cores=4-31
/proc/19339/task/19367/stat : 19367 (plingeling) R 19334 19334 19308 0 -1 4202560 51470 1243 0 0 28857 14 0 0 25 0 29 0 596826535 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331323 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19339/tid=19368] ppid=19334 vsize=3763896 CPUtime=288.48 cores=4-31
/proc/19339/task/19368/stat : 19368 (plingeling) R 19334 19334 19308 0 -1 4202560 46894 1243 0 0 28826 22 0 0 25 0 29 0 596826535 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331035 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=19339/tid=19369] ppid=19334 vsize=3763896 CPUtime=288.64 cores=4-31
/proc/19339/task/19369/stat : 19369 (plingeling) R 19334 19334 19308 0 -1 4202560 52259 1243 0 0 28818 46 0 0 25 0 29 0 596826535 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4270872 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=19339/tid=19370] ppid=19334 vsize=3763896 CPUtime=288.56 cores=4-31
/proc/19339/task/19370/stat : 19370 (plingeling) R 19334 19334 19308 0 -1 4202560 49529 1243 0 0 28818 38 0 0 25 0 29 0 596826535 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4212207 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=19339/tid=19371] ppid=19334 vsize=3763896 CPUtime=288.68 cores=4-31
/proc/19339/task/19371/stat : 19371 (plingeling) R 19334 19334 19308 0 -1 4202560 56381 1243 0 0 28835 33 0 0 25 0 29 0 596826535 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4279459 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=19339/tid=19372] ppid=19334 vsize=3763896 CPUtime=288.05 cores=4-31
/proc/19339/task/19372/stat : 19372 (plingeling) R 19334 19334 19308 0 -1 4202560 40627 1243 0 0 28781 24 0 0 25 0 29 0 596826535 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19339/tid=19373] ppid=19334 vsize=3763896 CPUtime=288.53 cores=4-31
/proc/19339/task/19373/stat : 19373 (plingeling) R 19334 19334 19308 0 -1 4202560 30547 1243 0 0 28840 13 0 0 25 0 29 0 596826535 3854229504 835585 268435456000 4194304 4356188 140733542995056 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 15 0 0 0
Current children cumulated CPU time (s) 9336.61
Current children cumulated vsize (KiB) 7960764

[startup+313.522 s]
/proc/loadavg: 31.93 30.73 30.36 33/447 19381
/proc/meminfo: memFree=251825752/264257624 swapFree=67111528/67111528
[pid=19334] ppid=19332 vsize=18324 CPUtime=0 cores=0-31
/proc/19334/stat : 19334 (ppfolio) S 19332 19334 19308 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 596824253 18763776 386 268435456000 4194304 4287625 140733797361312 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 12 0 0 0
/proc/19334/statm: 4581 386 337 23 0 91 0
[pid=19335] ppid=19334 vsize=2499392 CPUtime=313.44 cores=0
/proc/19335/stat : 19335 (cryptominisat) R 19334 19334 19308 0 -1 4202496 151703 0 0 0 31298 46 0 0 25 0 1 0 596824253 2559377408 106435 268435456000 4194304 4587354 140734404890656 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/19335/statm: 624848 106435 334 96 0 621410 0
[pid=19336] ppid=19334 vsize=301676 CPUtime=313.45 cores=1
/proc/19336/stat : 19336 (clasp) R 19334 19334 19308 0 -1 4202496 88840 0 0 0 31320 25 0 0 25 0 1 0 596824253 308916224 71037 268435456000 4194304 4785740 140735268654096 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19336/statm: 75419 71037 338 145 0 72464 0
[pid=19337] ppid=19334 vsize=542288 CPUtime=313.45 cores=2
/proc/19337/stat : 19337 (TNM) R 19334 19334 19308 0 -1 4202496 44515 0 0 0 31333 12 0 0 25 0 1 0 596824253 555302912 44412 268435456000 134512640 134534564 4289552192 18446744073709551615 134528534 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/19337/statm: 135572 44412 95 6 0 134237 0
[pid=19338] ppid=19334 vsize=835452 CPUtime=313.44 cores=3
/proc/19338/stat : 19338 (march_hi) R 19334 19334 19308 0 -1 4202496 452986 0 0 0 31246 98 0 0 25 0 1 0 596824253 855502848 170125 268435456000 4194304 4331988 140735507430448 18446744073709551615 4229294 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/19338/statm: 208863 170125 172 34 0 207305 0
[pid=19339] ppid=19334 vsize=3763880 CPUtime=8134.61 cores=4-31
/proc/19339/stat : 19339 (plingeling) S 19334 19334 19308 0 -1 4202496 1691163 1243 0 0 812562 899 0 0 19 0 29 0 596824253 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 12 0 0 0
/proc/19339/statm: 940970 835581 159 40 0 939514 0
[pid=19339/tid=19346] ppid=19334 vsize=3763880 CPUtime=290.24 cores=4-31
/proc/19339/task/19346/stat : 19346 (plingeling) R 19334 19334 19308 0 -1 4202560 50721 1243 0 0 28998 26 0 0 25 0 29 0 596826533 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=19339/tid=19347] ppid=19334 vsize=3763880 CPUtime=290.2 cores=4-31
/proc/19339/task/19347/stat : 19347 (plingeling) R 19334 19334 19308 0 -1 4202560 57854 1243 0 0 28987 33 0 0 25 0 29 0 596826533 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4234232 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=19339/tid=19348] ppid=19334 vsize=3763880 CPUtime=289.89 cores=4-31
/proc/19339/task/19348/stat : 19348 (plingeling) R 19334 19334 19308 0 -1 4202560 47733 1243 0 0 28967 22 0 0 25 0 29 0 596826533 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4237251 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=19339/tid=19349] ppid=19334 vsize=3763880 CPUtime=289.94 cores=4-31
/proc/19339/task/19349/stat : 19349 (plingeling) R 19334 19334 19308 0 -1 4202560 24176 1243 0 0 28983 11 0 0 25 0 29 0 596826533 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=19339/tid=19350] ppid=19334 vsize=3763880 CPUtime=283.32 cores=4-31
/proc/19339/task/19350/stat : 19350 (plingeling) R 19334 19334 19308 0 -1 4202560 42498 1243 0 0 28293 39 0 0 25 0 29 0 596826533 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=19339/tid=19351] ppid=19334 vsize=3763880 CPUtime=289.9 cores=4-31
/proc/19339/task/19351/stat : 19351 (plingeling) R 19334 19334 19308 0 -1 4202560 53818 1243 0 0 28951 39 0 0 25 0 29 0 596826533 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=19339/tid=19352] ppid=19334 vsize=3763880 CPUtime=289.97 cores=4-31
/proc/19339/task/19352/stat : 19352 (plingeling) R 19334 19334 19308 0 -1 4202560 45228 1243 0 0 28965 32 0 0 25 0 29 0 596826533 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=19339/tid=19353] ppid=19334 vsize=3763880 CPUtime=289.82 cores=4-31
/proc/19339/task/19353/stat : 19353 (plingeling) R 19334 19334 19308 0 -1 4202560 47187 1243 0 0 28955 27 0 0 25 0 29 0 596826533 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=19339/tid=19354] ppid=19334 vsize=3763880 CPUtime=288.79 cores=4-31
/proc/19339/task/19354/stat : 19354 (plingeling) R 19334 19334 19308 0 -1 4202560 46030 1243 0 0 28850 29 0 0 25 0 29 0 596826533 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4237473 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=19339/tid=19355] ppid=19334 vsize=3763880 CPUtime=289.98 cores=4-31
/proc/19339/task/19355/stat : 19355 (plingeling) R 19334 19334 19308 0 -1 4202560 55882 1243 0 0 28953 45 0 0 25 0 29 0 596826533 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=19339/tid=19356] ppid=19334 vsize=3763880 CPUtime=289.8 cores=4-31
/proc/19339/task/19356/stat : 19356 (plingeling) R 19334 19334 19308 0 -1 4202560 38027 1243 0 0 28941 39 0 0 25 0 29 0 596826534 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=19339/tid=19357] ppid=19334 vsize=3763880 CPUtime=289.88 cores=4-31
/proc/19339/task/19357/stat : 19357 (plingeling) R 19334 19334 19308 0 -1 4202560 25141 1243 0 0 28977 11 0 0 25 0 29 0 596826534 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4241599 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=19339/tid=19358] ppid=19334 vsize=3763880 CPUtime=290.13 cores=4-31
/proc/19339/task/19358/stat : 19358 (plingeling) R 19334 19334 19308 0 -1 4202560 45792 1243 0 0 28981 32 0 0 25 0 29 0 596826534 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331458 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=19339/tid=19359] ppid=19334 vsize=3763880 CPUtime=290.36 cores=4-31
/proc/19339/task/19359/stat : 19359 (plingeling) R 19334 19334 19308 0 -1 4202560 43132 1243 0 0 29003 33 0 0 25 0 29 0 596826534 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=19339/tid=19360] ppid=19334 vsize=3763880 CPUtime=289.68 cores=4-31
/proc/19339/task/19360/stat : 19360 (plingeling) R 19334 19334 19308 0 -1 4202560 53417 1243 0 0 28947 21 0 0 25 0 29 0 596826534 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4334437 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=19339/tid=19361] ppid=19334 vsize=3763880 CPUtime=289.94 cores=4-31
/proc/19339/task/19361/stat : 19361 (plingeling) R 19334 19334 19308 0 -1 4202560 46244 1243 0 0 28960 34 0 0 25 0 29 0 596826534 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=19339/tid=19362] ppid=19334 vsize=3763880 CPUtime=289.76 cores=4-31
/proc/19339/task/19362/stat : 19362 (plingeling) R 19334 19334 19308 0 -1 4202560 38490 1243 0 0 28948 28 0 0 25 0 29 0 596826534 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331165 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=19339/tid=19363] ppid=19334 vsize=3763880 CPUtime=289.88 cores=4-31
/proc/19339/task/19363/stat : 19363 (plingeling) R 19334 19334 19308 0 -1 4202560 43479 1243 0 0 28969 19 0 0 25 0 29 0 596826534 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331281 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=19339/tid=19364] ppid=19334 vsize=3763880 CPUtime=289.5 cores=4-31
/proc/19339/task/19364/stat : 19364 (plingeling) R 19334 19334 19308 0 -1 4202560 48214 1243 0 0 28905 45 0 0 25 0 29 0 596826534 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=19339/tid=19365] ppid=19334 vsize=3763880 CPUtime=289.77 cores=4-31
/proc/19339/task/19365/stat : 19365 (plingeling) R 19334 19334 19308 0 -1 4202560 17119 1243 0 0 28971 6 0 0 25 0 29 0 596826534 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=19339/tid=19366] ppid=19334 vsize=3763880 CPUtime=289.83 cores=4-31
/proc/19339/task/19366/stat : 19366 (plingeling) R 19334 19334 19308 0 -1 4202560 43013 1243 0 0 28948 35 0 0 25 0 29 0 596826535 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4258696 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=19339/tid=19367] ppid=19334 vsize=3763880 CPUtime=290.33 cores=4-31
/proc/19339/task/19367/stat : 19367 (plingeling) R 19334 19334 19308 0 -1 4202560 51470 1243 0 0 29019 14 0 0 25 0 29 0 596826535 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4334538 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=19339/tid=19368] ppid=19334 vsize=3763880 CPUtime=290.1 cores=4-31
/proc/19339/task/19368/stat : 19368 (plingeling) R 19334 19334 19308 0 -1 4202560 46894 1243 0 0 28988 22 0 0 25 0 29 0 596826535 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=19339/tid=19369] ppid=19334 vsize=3763880 CPUtime=290.26 cores=4-31
/proc/19339/task/19369/stat : 19369 (plingeling) R 19334 19334 19308 0 -1 4202560 52259 1243 0 0 28980 46 0 0 25 0 29 0 596826535 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=19339/tid=19370] ppid=19334 vsize=3763880 CPUtime=290.18 cores=4-31
/proc/19339/task/19370/stat : 19370 (plingeling) R 19334 19334 19308 0 -1 4202560 49529 1243 0 0 28980 38 0 0 25 0 29 0 596826535 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=19339/tid=19371] ppid=19334 vsize=3763880 CPUtime=290.3 cores=4-31
/proc/19339/task/19371/stat : 19371 (plingeling) R 19334 19334 19308 0 -1 4202560 56381 1243 0 0 28997 33 0 0 25 0 29 0 596826535 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=19339/tid=19372] ppid=19334 vsize=3763880 CPUtime=289.67 cores=4-31
/proc/19339/task/19372/stat : 19372 (plingeling) R 19334 19334 19308 0 -1 4202560 40627 1243 0 0 28943 24 0 0 25 0 29 0 596826535 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4331491 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=19339/tid=19373] ppid=19334 vsize=3763880 CPUtime=290.15 cores=4-31
/proc/19339/task/19373/stat : 19373 (plingeling) R 19334 19334 19308 0 -1 4202560 30547 1243 0 0 29002 13 0 0 25 0 29 0 596826535 3854213120 835581 268435456000 4194304 4356188 140733542995056 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 15 0 0 0
Current children cumulated CPU time (s) 9388.39
Current children cumulated vsize (KiB) 7961012

[startup+314.302 s]
/proc/loadavg: 31.93 30.73 30.36 33/447 19381
/proc/meminfo: memFree=251825752/264257624 swapFree=67111528/67111528
[pid=19334] ppid=19332 vsize=18324 CPUtime=0 cores=0-31
/proc/19334/stat : 19334 (ppfolio) S 19332 19334 19308 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 596824253 18763776 386 268435456000 4194304 4287625 140733797361312 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 12 0 0 0
/proc/19334/statm: 4581 386 337 23 0 91 0
[pid=19335] ppid=19334 vsize=2499392 CPUtime=314.22 cores=0
/proc/19335/stat : 19335 (cryptominisat) R 19334 19334 19308 0 -1 4202496 151729 0 0 0 31376 46 0 0 25 0 1 0 596824253 2559377408 106460 268435456000 4194304 4587354 140734404890656 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/19335/statm: 624848 106460 334 96 0 621410 0
[pid=19336] ppid=19334 vsize=301940 CPUtime=314.22 cores=1
/proc/19336/stat : 19336 (clasp) R 19334 19334 19308 0 -1 4202496 88894 0 0 0 31397 25 0 0 25 0 1 0 596824253 309186560 71091 268435456000 4194304 4785740 140735268654096 18446744073709551615 4562640 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/19336/statm: 75485 71091 338 145 0 72530 0
[pid=19337] ppid=19334 vsize=542288 CPUtime=314.23 cores=2
/proc/19337/stat : 19337 (TNM) R 19334 19334 19308 0 -1 4202496 44515 0 0 0 31411 12 0 0 25 0 1 0 596824253 555302912 44412 268435456000 134512640 134534564 4289552192 18446744073709551615 134528926 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/19337/statm: 135572 44412 95 6 0 134237 0
[pid=19338] ppid=19334 vsize=835452 CPUtime=314.22 cores=3
/proc/19338/stat : 19338 (march_hi) R 19334 19334 19308 0 -1 4202496 452986 0 0 0 31324 98 0 0 25 0 1 0 596824253 855502848 170125 268435456000 4194304 4331988 140735507430448 18446744073709551615 4229665 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/19338/statm: 208863 170125 172 34 0 207305 0
[pid=19339] ppid=19334 vsize=3753636 CPUtime=8154.26 cores=4-31
/proc/19339/stat : 19339 (plingeling) S 19334 19334 19308 0 -1 4202496 1691164 1243 0 0 814526 900 0 0 17 0 2 0 596824253 3843723264 835574 268435456000 4194304 4356188 140733542995056 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 12 0 0 0
/proc/19339/statm: 938409 835574 160 40 0 936953 0
[pid=19339/tid=19350] ppid=19334 vsize=3753636 CPUtime=284.09 cores=4-31
/proc/19339/task/19350/stat : 19350 (plingeling) R 19334 19334 19308 0 -1 4202560 42498 1243 0 0 28370 39 0 0 25 0 2 0 596826533 3843723264 835574 268435456000 4194304 4356188 140733542995056 18446744073709551615 4259342 0 0 4096 17442 0 0 0 -1 25 0 0 0
Current children cumulated CPU time (s) 9411.15
Current children cumulated vsize (KiB) 7951032

[startup+314.501 s]
/proc/loadavg: 31.93 30.73 30.36 6/419 19381
/proc/meminfo: memFree=253980084/264257624 swapFree=67111528/67111528
[pid=19334] ppid=19332 vsize=18324 CPUtime=0 cores=0-31
/proc/19334/stat : 19334 (ppfolio) S 19332 19334 19308 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 596824253 18763776 386 268435456000 4194304 4287625 140733797361312 18446744073709551615 258650975999 0 0 4096 65536 2774548873216 0 0 17 12 0 0 0
/proc/19334/statm: 4581 386 337 23 0 91 0
[pid=19335] ppid=19334 vsize=0 CPUtime=314.44 cores=0
/proc/19335/stat : 19335 (cryptominisat) R 19334 19334 19308 0 -1 4203524 151737 0 0 0 31397 47 0 0 25 0 1 0 596824253 0 0 268435456000 0 0 0 0 0 0 0 4096 2 18446744073709551615 0 0 17 0 0 0 0
/proc/19335/statm: 0 0 0 0 0 0 0
[pid=19336] ppid=19334 vsize=0 CPUtime=314.44 cores=1
/proc/19336/stat : 19336 (clasp) R 19334 19334 19308 0 -1 4203524 88907 0 0 0 31418 26 0 0 25 0 1 0 596824253 0 0 268435456000 0 0 0 0 0 0 0 4096 16386 18446744073709551615 0 0 17 1 0 0 0
/proc/19336/statm: 0 0 0 0 0 0 0
[pid=19337] ppid=19334 vsize=0 CPUtime=314.44 cores=2
/proc/19337/stat : 19337 (TNM) R 19334 19334 19308 0 -1 4203524 44515 0 0 0 31432 12 0 0 25 0 1 0 596824253 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 2 0 0 0
/proc/19337/statm: 0 0 0 0 0 0 0
[pid=19338] ppid=19334 vsize=0 CPUtime=314.44 cores=3
/proc/19338/stat : 19338 (march_hi) R 19334 19334 19308 0 -1 4203524 452986 0 0 0 31345 99 0 0 25 0 1 0 596824253 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/19338/statm: 0 0 0 0 0 0 0
[pid=19339] ppid=19334 vsize=0 CPUtime=8154.47 cores=4-31
/proc/19339/stat : 19339 (plingeling) R 19334 19334 19308 0 -1 4202500 1691167 1243 0 0 814529 918 0 0 16 0 1 0 596824253 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 12 0 0 0
/proc/19339/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 9412.23
Current children cumulated vsize (KiB) 18324

Child status: 0
Real time (s): 314.608
CPU time (s): 9412.51
CPU user time (s): 9401.25
CPU system time (s): 11.2563
CPU usage (%): 2991.82
Max. virtual memory (cumulated for all children) (KiB): 8132888

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 9401.25
system time used= 11.2563
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 2431091
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4269
involuntary context switches= 23278

runsolver used 1.89471 second user time and 6.79597 second system time

The end

Launcher Data

Begin job on node200 at 2011-05-08 13:16:18
IDJOB=3347209
IDBENCH=69591
IDSOLVER=1808
FILE ID=node200/3347209-1304853377
RUNJOBID= node200-1304853377-19322
PBS_JOBID= 13281981
Free space on /tmp= 62028 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT_RACE08/cnf/manol-pipe-c10nidw.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3347209-1304853377/watcher-3347209-1304853377 -o /tmp/evaluation-result-3347209-1304853377/solver-3347209-1304853377 -C 160000 -W 5100 -M 266338304  ppfolio HOME/instance-3347209-1304853377.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 943fd86d922b13236c21a74c4f82b6d0
RANDOM SEED=1855359104

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      256733320 kB
Buffers:        358420 kB
Cached:        6816304 kB
SwapCached:          0 kB
Active:        6352048 kB
Inactive:       891504 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      256733320 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           33836 kB
Writeback:           0 kB
AnonPages:       68900 kB
Mapped:          14480 kB
Slab:           192376 kB
PageTables:       4444 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   195308 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62020 MiB
End job on node200 at 2011-05-08 13:21:33