Trace number 3347515

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 13009.1 417.029

General information on the benchmark

Nameapplication/manthey/traffic/
traffic_b_unsat.cnf
MD5SUM3dc443ddf213a09407d2a75925179735
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark2684.29
Satisfiable
(Un)Satisfiability was proved
Number of variables26061
Number of clauses742909
Sum of the clauses size2791650
Maximum clause length4
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 244599
Number of clauses of size 390788
Number of clauses of size 4607522
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 32 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
13008.64/416.97	s UNSATISFIABLE
13009.00/417.02	solver [5] plingeling 276-6264d55-100731 answered
13009.00/417.02	Done

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3347515-1305220971/watcher-3347515-1305220971 -o /tmp/evaluation-result-3347515-1305220971/solver-3347515-1305220971 -C 160000 -W 5100 -M 266338304 ppfolio HOME/instance-3347515-1305220971.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 29.54 29.56 28.33 1/413 21248
/proc/meminfo: memFree=255621348/264257624 swapFree=67111528/67111528
[pid=21248] ppid=21246 vsize=18324 CPUtime=0 cores=0-31
/proc/21248/stat : 21248 (ppfolio) S 21246 21248 21150 0 -1 4202496 514 0 0 0 0 0 0 0 23 0 1 0 633583611 18763776 386 268435456000 4194304 4287625 140734788546896 18446744073709551615 258650975999 0 0 4096 65536 9197547811548168191 0 0 17 16 0 0 0
/proc/21248/statm: 4581 386 337 23 0 91 0

[startup+0.062023 s]
/proc/loadavg: 29.54 29.56 28.33 1/413 21248
/proc/meminfo: memFree=255621348/264257624 swapFree=67111528/67111528
[pid=21248] ppid=21246 vsize=18324 CPUtime=0 cores=0-31
/proc/21248/stat : 21248 (ppfolio) S 21246 21248 21150 0 -1 4202496 514 0 0 0 0 0 0 0 23 0 1 0 633583611 18763776 386 268435456000 4194304 4287625 140734788546896 18446744073709551615 258650975999 0 0 4096 65536 9197547811548168191 0 0 17 16 0 0 0
/proc/21248/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.101055 s]
/proc/loadavg: 29.54 29.56 28.33 1/413 21248
/proc/meminfo: memFree=255621348/264257624 swapFree=67111528/67111528
[pid=21248] ppid=21246 vsize=18324 CPUtime=0 cores=0-31
/proc/21248/stat : 21248 (ppfolio) S 21246 21248 21150 0 -1 4202496 514 0 0 0 0 0 0 0 23 0 1 0 633583611 18763776 386 268435456000 4194304 4287625 140734788546896 18446744073709551615 258650975999 0 0 4096 65536 9197547811548168191 0 0 17 16 0 0 0
/proc/21248/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.301036 s]
/proc/loadavg: 29.54 29.56 28.33 1/413 21248
/proc/meminfo: memFree=255621348/264257624 swapFree=67111528/67111528
[pid=21248] ppid=21246 vsize=18324 CPUtime=0 cores=0-31
/proc/21248/stat : 21248 (ppfolio) S 21246 21248 21150 0 -1 4202496 514 0 0 0 0 0 0 0 23 0 1 0 633583611 18763776 386 268435456000 4194304 4287625 140734788546896 18446744073709551615 258650975999 0 0 4096 65536 9197547811548168191 0 0 17 16 0 0 0
/proc/21248/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.701059 s]
/proc/loadavg: 29.54 29.56 28.33 1/413 21248
/proc/meminfo: memFree=255621348/264257624 swapFree=67111528/67111528
[pid=21248] ppid=21246 vsize=18324 CPUtime=0 cores=0-31
/proc/21248/stat : 21248 (ppfolio) S 21246 21248 21150 0 -1 4202496 514 0 0 0 0 0 0 0 20 0 1 0 633583611 18763776 386 268435456000 4194304 4287625 140734788546896 18446744073709551615 258650975999 0 0 4096 65536 9197547811548168191 0 0 17 16 0 0 0
/proc/21248/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.5011 s]
/proc/loadavg: 29.54 29.56 28.33 6/419 21259
/proc/meminfo: memFree=255359640/264257624 swapFree=67111528/67111528
[pid=21248] ppid=21246 vsize=18324 CPUtime=0 cores=0-31
/proc/21248/stat : 21248 (ppfolio) S 21246 21248 21150 0 -1 4202496 514 0 0 0 0 0 0 0 17 0 1 0 633583611 18763776 386 268435456000 4194304 4287625 140734788546896 18446744073709551615 258650975999 0 0 4096 65536 9197547811548168191 0 0 17 16 0 0 0
/proc/21248/statm: 4581 386 337 23 0 91 0
[pid=21249] ppid=21248 vsize=138052 CPUtime=1.48 cores=0
/proc/21249/stat : 21249 (cryptominisat) R 21248 21248 21150 0 -1 4202496 24178 0 0 0 142 6 0 0 20 0 1 0 633583612 141365248 23381 268435456000 4194304 4587354 140737315219776 18446744073709551615 258650616632 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21249/statm: 34513 23382 308 96 0 31075 0
[pid=21250] ppid=21248 vsize=83508 CPUtime=1.48 cores=1
/proc/21250/stat : 21250 (clasp) R 21248 21248 21150 0 -1 4202496 21740 0 0 0 142 6 0 0 20 0 1 0 633583612 85512192 17265 268435456000 4194304 4785740 140733295732688 18446744073709551615 4495638 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21250/statm: 20877 17265 312 145 0 17922 0
[pid=21251] ppid=21248 vsize=507968 CPUtime=1.48 cores=2
/proc/21251/stat : 21251 (TNM) R 21248 21248 21150 0 -1 4202496 17281 0 0 0 144 4 0 0 20 0 1 0 633583612 520159232 17179 268435456000 134512640 134534564 4291373216 18446744073709551615 134524577 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/21251/statm: 126992 17179 91 6 0 125657 0
[pid=21252] ppid=21248 vsize=90500 CPUtime=1.48 cores=3
/proc/21252/stat : 21252 (march_hi) R 21248 21248 21150 0 -1 4194304 13974 0 0 0 142 6 0 0 20 0 1 0 633583612 92672000 13869 268435456000 4194304 4331988 140736683976624 18446744073709551615 4251649 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/21252/statm: 22625 13869 116 34 0 21067 0
[pid=21253] ppid=21248 vsize=149700 CPUtime=1.47 cores=4-31
/proc/21253/stat : 21253 (plingeling) R 21248 21248 21150 0 -1 4202496 36343 1245 0 0 139 8 0 0 21 0 1 0 633583612 153292800 36084 268435456000 4194304 4356188 140737096846288 18446744073709551615 258650574459 0 0 4096 17442 0 0 0 17 9 0 0 0
/proc/21253/statm: 37425 36084 129 40 0 35969 0
Current children cumulated CPU time (s) 7.39
Current children cumulated vsize (KiB) 988052

[startup+3.10114 s]
/proc/loadavg: 29.54 29.56 28.33 6/419 21259
/proc/meminfo: memFree=255059564/264257624 swapFree=67111528/67111528
[pid=21248] ppid=21246 vsize=18324 CPUtime=0 cores=0-31
/proc/21248/stat : 21248 (ppfolio) S 21246 21248 21150 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 633583611 18763776 386 268435456000 4194304 4287625 140734788546896 18446744073709551615 258650975999 0 0 4096 65536 9197547811548168191 0 0 17 16 0 0 0
/proc/21248/statm: 4581 386 337 23 0 91 0
[pid=21249] ppid=21248 vsize=182336 CPUtime=3.08 cores=0
/proc/21249/stat : 21249 (cryptominisat) R 21248 21248 21150 0 -1 4202496 36681 0 0 0 300 8 0 0 25 0 1 0 633583612 186712064 35680 268435456000 4194304 4587354 140737315219776 18446744073709551615 4388261 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21249/statm: 45584 35680 314 96 0 42146 0
[pid=21250] ppid=21248 vsize=83508 CPUtime=3.08 cores=1
/proc/21250/stat : 21250 (clasp) R 21248 21248 21150 0 -1 4202496 21742 0 0 0 302 6 0 0 25 0 1 0 633583612 85512192 17267 268435456000 4194304 4785740 140733295732688 18446744073709551615 4495638 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21250/statm: 20877 17267 312 145 0 17922 0
[pid=21251] ppid=21248 vsize=507968 CPUtime=3.08 cores=2
/proc/21251/stat : 21251 (TNM) R 21248 21248 21150 0 -1 4202496 17281 0 0 0 304 4 0 0 25 0 1 0 633583612 520159232 17179 268435456000 134512640 134534564 4291373216 18446744073709551615 134524536 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/21251/statm: 126992 17179 91 6 0 125657 0
[pid=21252] ppid=21248 vsize=97840 CPUtime=3.08 cores=3
/proc/21252/stat : 21252 (march_hi) R 21248 21248 21150 0 -1 4202496 50905 0 0 0 294 14 0 0 25 0 1 0 633583612 100188160 15782 268435456000 4194304 4331988 140736683976624 18446744073709551615 4252174 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/21252/statm: 24460 15782 146 34 0 22902 0
[pid=21253] ppid=21248 vsize=407748 CPUtime=3.08 cores=4-31
/proc/21253/stat : 21253 (plingeling) R 21248 21248 21150 0 -1 4202496 100802 1245 0 0 288 20 0 0 25 0 1 0 633583612 417533952 100543 268435456000 4194304 4356188 140737096846288 18446744073709551615 258650649933 0 0 4096 17442 0 0 0 17 9 0 0 0
/proc/21253/statm: 101937 100549 129 40 0 100481 0
Current children cumulated CPU time (s) 15.4
Current children cumulated vsize (KiB) 1297724

[startup+6.30122 s]
/proc/loadavg: 27.58 29.15 28.21 6/419 21259
/proc/meminfo: memFree=254605028/264257624 swapFree=67111528/67111528
[pid=21248] ppid=21246 vsize=18324 CPUtime=0 cores=0-31
/proc/21248/stat : 21248 (ppfolio) S 21246 21248 21150 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 633583611 18763776 386 268435456000 4194304 4287625 140734788546896 18446744073709551615 258650975999 0 0 4096 65536 9197547811548168191 0 0 17 16 0 0 0
/proc/21248/statm: 4581 386 337 23 0 91 0
[pid=21249] ppid=21248 vsize=207584 CPUtime=6.28 cores=0
/proc/21249/stat : 21249 (cryptominisat) R 21248 21248 21150 0 -1 4202496 46804 0 0 0 618 10 0 0 25 0 1 0 633583612 212566016 38271 268435456000 4194304 4587354 140737315219776 18446744073709551615 258650652548 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21249/statm: 51896 38271 325 96 0 48458 0
[pid=21250] ppid=21248 vsize=98348 CPUtime=6.28 cores=1
/proc/21250/stat : 21250 (clasp) R 21248 21248 21150 0 -1 4202496 27236 0 0 0 620 8 0 0 25 0 1 0 633583612 100708352 21310 268435456000 4194304 4785740 140733295732688 18446744073709551615 4553224 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21250/statm: 24587 21310 338 145 0 21632 0
[pid=21251] ppid=21248 vsize=507968 CPUtime=6.28 cores=2
/proc/21251/stat : 21251 (TNM) R 21248 21248 21150 0 -1 4202496 17281 0 0 0 624 4 0 0 25 0 1 0 633583612 520159232 17179 268435456000 134512640 134534564 4291373216 18446744073709551615 134524573 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/21251/statm: 126992 17179 91 6 0 125657 0
[pid=21252] ppid=21248 vsize=147884 CPUtime=6.29 cores=3
/proc/21252/stat : 21252 (march_hi) R 21248 21248 21150 0 -1 4202496 86020 0 0 0 607 22 0 0 25 0 1 0 633583612 151433216 28082 268435456000 4194304 4331988 140736683976624 18446744073709551615 4271412 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/21252/statm: 36971 28082 149 34 0 35413 0
[pid=21253] ppid=21248 vsize=751812 CPUtime=6.28 cores=4-31
/proc/21253/stat : 21253 (plingeling) R 21248 21248 21150 0 -1 4202496 186871 1245 0 0 592 36 0 0 25 0 1 0 633583612 769855488 186612 268435456000 4194304 4356188 140737096846288 18446744073709551615 4277592 0 0 4096 17442 0 0 0 17 9 0 0 0
/proc/21253/statm: 187953 186612 129 40 0 186497 0
Current children cumulated CPU time (s) 31.41
Current children cumulated vsize (KiB) 1731920

[startup+12.7024 s]
/proc/loadavg: 25.77 28.75 28.08 33/447 21287
/proc/meminfo: memFree=253575900/264257624 swapFree=67111528/67111528
[pid=21248] ppid=21246 vsize=18324 CPUtime=0 cores=0-31
/proc/21248/stat : 21248 (ppfolio) S 21246 21248 21150 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 633583611 18763776 386 268435456000 4194304 4287625 140734788546896 18446744073709551615 258650975999 0 0 4096 65536 9197547811548168191 0 0 17 16 0 0 0
/proc/21248/statm: 4581 386 337 23 0 91 0
[pid=21249] ppid=21248 vsize=207584 CPUtime=12.69 cores=0
/proc/21249/stat : 21249 (cryptominisat) R 21248 21248 21150 0 -1 4202496 47183 0 0 0 1258 11 0 0 25 0 1 0 633583612 212566016 38637 268435456000 4194304 4587354 140737315219776 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21249/statm: 51896 38637 332 96 0 48458 0
[pid=21250] ppid=21248 vsize=98348 CPUtime=12.68 cores=1
/proc/21250/stat : 21250 (clasp) R 21248 21248 21150 0 -1 4202496 27236 0 0 0 1260 8 0 0 25 0 1 0 633583612 100708352 21310 268435456000 4194304 4785740 140733295732688 18446744073709551615 4287229 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21250/statm: 24587 21310 338 145 0 21632 0
[pid=21251] ppid=21248 vsize=520640 CPUtime=12.68 cores=2
/proc/21251/stat : 21251 (TNM) R 21248 21248 21150 0 -1 4202496 24307 0 0 0 1262 6 0 0 25 0 1 0 633583612 533135360 24205 268435456000 134512640 134534564 4291373216 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/21251/statm: 130160 24205 95 6 0 128825 0
[pid=21252] ppid=21248 vsize=277420 CPUtime=12.69 cores=3
/proc/21252/stat : 21252 (march_hi) R 21248 21248 21150 0 -1 4202496 117774 0 0 0 1240 29 0 0 25 0 1 0 633583612 284078080 59836 268435456000 4194304 4331988 140736683976624 18446744073709551615 258650616632 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/21252/statm: 69355 59836 149 34 0 67797 0
[pid=21253] ppid=21248 vsize=1864456 CPUtime=44.95 cores=4-31
/proc/21253/stat : 21253 (plingeling) S 21248 21248 21150 0 -1 4202496 422805 1245 0 0 4401 94 0 0 19 0 29 0 633583612 1909202944 330183 268435456000 4194304 4356188 140737096846288 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 17 0 0 0
/proc/21253/statm: 466114 330192 148 40 0 464658 0
[pid=21253/tid=21260] ppid=21248 vsize=1864456 CPUtime=1.21 cores=4-31
/proc/21253/task/21260/stat : 21260 (plingeling) R 21248 21248 21150 0 -1 4202560 2057 1245 0 0 121 0 0 0 19 0 29 0 633584759 1909202944 330203 268435456000 4194304 4356188 140737096846288 18446744073709551615 4265845 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21253/tid=21261] ppid=21248 vsize=1864456 CPUtime=1.2 cores=4-31
/proc/21253/task/21261/stat : 21261 (plingeling) R 21248 21248 21150 0 -1 4202560 2462 1245 0 0 120 0 0 0 19 0 29 0 633584759 1909202944 330217 268435456000 4194304 4356188 140737096846288 18446744073709551615 4246351 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21253/tid=21262] ppid=21248 vsize=1864456 CPUtime=1.21 cores=4-31
/proc/21253/task/21262/stat : 21262 (plingeling) R 21248 21248 21150 0 -1 4202560 3294 1245 0 0 120 1 0 0 19 0 29 0 633584759 1909202944 330227 268435456000 4194304 4356188 140737096846288 18446744073709551615 4212576 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=21253/tid=21263] ppid=21248 vsize=1864456 CPUtime=1.21 cores=4-31
/proc/21253/task/21263/stat : 21263 (plingeling) R 21248 21248 21150 0 -1 4202560 3124 1245 0 0 120 1 0 0 18 0 29 0 633584759 1909202944 330242 268435456000 4194304 4356188 140737096846288 18446744073709551615 4246607 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=21253/tid=21264] ppid=21248 vsize=1864456 CPUtime=1.21 cores=4-31
/proc/21253/task/21264/stat : 21264 (plingeling) R 21248 21248 21150 0 -1 4202560 1743 1245 0 0 121 0 0 0 19 0 29 0 633584759 1909202944 330258 268435456000 4194304 4356188 140737096846288 18446744073709551615 4265866 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21253/tid=21265] ppid=21248 vsize=1864456 CPUtime=1.21 cores=4-31
/proc/21253/task/21265/stat : 21265 (plingeling) R 21248 21248 21150 0 -1 4202560 2686 1245 0 0 121 0 0 0 19 0 29 0 633584759 1909202944 330275 268435456000 4194304 4356188 140737096846288 18446744073709551615 4212626 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21253/tid=21266] ppid=21248 vsize=1864456 CPUtime=1.2 cores=4-31
/proc/21253/task/21266/stat : 21266 (plingeling) R 21248 21248 21150 0 -1 4202560 3172 1245 0 0 120 0 0 0 22 0 29 0 633584759 1909202944 330290 268435456000 4194304 4356188 140737096846288 18446744073709551615 4212994 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=21253/tid=21267] ppid=21248 vsize=1864456 CPUtime=1.2 cores=4-31
/proc/21253/task/21267/stat : 21267 (plingeling) R 21248 21248 21150 0 -1 4202560 2660 1245 0 0 120 0 0 0 22 0 29 0 633584760 1909202944 330304 268435456000 4194304 4356188 140737096846288 18446744073709551615 4265845 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=21253/tid=21268] ppid=21248 vsize=1864456 CPUtime=1.18 cores=4-31
/proc/21253/task/21268/stat : 21268 (plingeling) S 21248 21248 21150 0 -1 4202560 1800 1245 0 0 118 0 0 0 22 0 29 0 633584760 1909202944 330320 268435456000 4194304 4356188 140737096846288 18446744073709551615 258651060958 0 0 4096 17442 18446744071566932744 0 0 -1 26 0 0 0
[pid=21253/tid=21269] ppid=21248 vsize=1864456 CPUtime=1.2 cores=4-31
/proc/21253/task/21269/stat : 21269 (plingeling) R 21248 21248 21150 0 -1 4202560 1742 1245 0 0 120 0 0 0 22 0 29 0 633584760 1909202944 330336 268435456000 4194304 4356188 140737096846288 18446744073709551615 4265845 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=21253/tid=21270] ppid=21248 vsize=1864456 CPUtime=1.2 cores=4-31
/proc/21253/task/21270/stat : 21270 (plingeling) R 21248 21248 21150 0 -1 4202560 1743 1245 0 0 120 0 0 0 18 0 29 0 633584760 1909202944 330350 268435456000 4194304 4356188 140737096846288 18446744073709551615 258650648512 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=21253/tid=21271] ppid=21248 vsize=1864456 CPUtime=1.17 cores=4-31
/proc/21253/task/21271/stat : 21271 (plingeling) R 21248 21248 21150 0 -1 4202560 2072 1245 0 0 117 0 0 0 22 0 29 0 633584760 1909202944 330365 268435456000 4194304 4356188 140737096846288 18446744073709551615 4264368 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=21253/tid=21272] ppid=21248 vsize=1864456 CPUtime=1.2 cores=4-31
/proc/21253/task/21272/stat : 21272 (plingeling) R 21248 21248 21150 0 -1 4202560 2821 1245 0 0 120 0 0 0 19 0 29 0 633584760 1909202944 330383 268435456000 4194304 4356188 140737096846288 18446744073709551615 4210544 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=21253/tid=21273] ppid=21248 vsize=1864456 CPUtime=1.18 cores=4-31
/proc/21253/task/21273/stat : 21273 (plingeling) R 21248 21248 21150 0 -1 4202560 1847 1245 0 0 118 0 0 0 19 0 29 0 633584760 1909202944 330399 268435456000 4194304 4356188 140737096846288 18446744073709551615 4264368 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=21253/tid=21274] ppid=21248 vsize=1864456 CPUtime=1.19 cores=4-31
/proc/21253/task/21274/stat : 21274 (plingeling) R 21248 21248 21150 0 -1 4202560 1904 1245 0 0 119 0 0 0 19 0 29 0 633584760 1909202944 330415 268435456000 4194304 4356188 140737096846288 18446744073709551615 4264368 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=21253/tid=21275] ppid=21248 vsize=1865480 CPUtime=1.19 cores=4-31
/proc/21253/task/21275/stat : 21275 (plingeling) R 21248 21248 21150 0 -1 4202560 2268 1245 0 0 119 0 0 0 19 0 29 0 633584761 1910251520 330432 268435456000 4194304 4356188 140737096846288 18446744073709551615 258650649933 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=21253/tid=21276] ppid=21248 vsize=1865480 CPUtime=1.19 cores=4-31
/proc/21253/task/21276/stat : 21276 (plingeling) R 21248 21248 21150 0 -1 4202560 2464 1245 0 0 119 0 0 0 19 0 29 0 633584761 1910251520 330455 268435456000 4194304 4356188 140737096846288 18446744073709551615 258650649933 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=21253/tid=21277] ppid=21248 vsize=1865480 CPUtime=1.17 cores=4-31
/proc/21253/task/21277/stat : 21277 (plingeling) R 21248 21248 21150 0 -1 4202560 2218 1245 0 0 117 0 0 0 22 0 29 0 633584761 1910251520 330474 268435456000 4194304 4356188 140737096846288 18446744073709551615 258650653112 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=21253/tid=21278] ppid=21248 vsize=1865480 CPUtime=1.19 cores=4-31
/proc/21253/task/21278/stat : 21278 (plingeling) R 21248 21248 21150 0 -1 4202560 2901 1245 0 0 118 1 0 0 22 0 29 0 633584761 1910251520 330493 268435456000 4194304 4356188 140737096846288 18446744073709551615 4246557 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=21253/tid=21279] ppid=21248 vsize=1865480 CPUtime=1.17 cores=4-31
/proc/21253/task/21279/stat : 21279 (plingeling) R 21248 21248 21150 0 -1 4202560 2972 1245 0 0 116 1 0 0 19 0 29 0 633584761 1910251520 330508 268435456000 4194304 4356188 140737096846288 18446744073709551615 4212984 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=21253/tid=21280] ppid=21248 vsize=1865480 CPUtime=1.18 cores=4-31
/proc/21253/task/21280/stat : 21280 (plingeling) R 21248 21248 21150 0 -1 4202560 1799 1245 0 0 118 0 0 0 19 0 29 0 633584761 1910251520 330523 268435456000 4194304 4356188 140737096846288 18446744073709551615 4266142 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=21253/tid=21281] ppid=21248 vsize=1865480 CPUtime=1.18 cores=4-31

################
# More data... #
################

[pid=21253/tid=21282] ppid=21248 vsize=1997788 CPUtime=402.51 cores=4-31
/proc/21253/task/21282/stat : 21282 (plingeling) R 21248 21248 21150 0 -1 4202560 6021 1245 0 0 40246 5 0 0 25 0 29 0 633584762 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4244400 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=21253/tid=21283] ppid=21248 vsize=1997788 CPUtime=402.68 cores=4-31
/proc/21253/task/21283/stat : 21283 (plingeling) R 21248 21248 21150 0 -1 4202560 7974 1245 0 0 40267 1 0 0 25 0 29 0 633584762 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=21253/tid=21284] ppid=21248 vsize=1997788 CPUtime=402.38 cores=4-31
/proc/21253/task/21284/stat : 21284 (plingeling) R 21248 21248 21150 0 -1 4202560 6890 1245 0 0 40236 2 0 0 25 0 29 0 633584762 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4330995 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=21253/tid=21285] ppid=21248 vsize=1997788 CPUtime=402.69 cores=4-31
/proc/21253/task/21285/stat : 21285 (plingeling) R 21248 21248 21150 0 -1 4202560 8450 1245 0 0 40260 9 0 0 25 0 29 0 633584762 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4236939 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=21253/tid=21286] ppid=21248 vsize=1997788 CPUtime=402.53 cores=4-31
/proc/21253/task/21286/stat : 21286 (plingeling) R 21248 21248 21150 0 -1 4202560 6662 1245 0 0 40245 8 0 0 25 0 29 0 633584762 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=21253/tid=21287] ppid=21248 vsize=1997788 CPUtime=402.71 cores=4-31
/proc/21253/task/21287/stat : 21287 (plingeling) R 21248 21248 21150 0 -1 4202560 10735 1245 0 0 40269 2 0 0 25 0 29 0 633584762 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4236939 0 0 4096 17442 0 0 0 -1 16 0 0 0
Current children cumulated CPU time (s) 12931.4
Current children cumulated vsize (KiB) 4575024

[startup+415.903 s]
/proc/loadavg: 32.10 31.24 29.49 33/447 21300
/proc/meminfo: memFree=253221788/264257624 swapFree=67111528/67111528
[pid=21248] ppid=21246 vsize=18324 CPUtime=0 cores=0-31
/proc/21248/stat : 21248 (ppfolio) S 21246 21248 21150 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 633583611 18763776 386 268435456000 4194304 4287625 140734788546896 18446744073709551615 258650975999 0 0 4096 65536 9197547811548168191 0 0 17 16 0 0 0
/proc/21248/statm: 4581 386 337 23 0 91 0
[pid=21249] ppid=21248 vsize=1113408 CPUtime=415.81 cores=0
/proc/21249/stat : 21249 (cryptominisat) R 21248 21248 21150 0 -1 4202496 68532 0 0 0 41558 23 0 0 25 0 1 0 633583612 1140129792 39600 268435456000 4194304 4587354 140737315219776 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21249/statm: 278352 39600 333 96 0 274914 0
[pid=21250] ppid=21248 vsize=159332 CPUtime=415.81 cores=1
/proc/21250/stat : 21250 (clasp) R 21248 21248 21150 0 -1 4202496 42293 0 0 0 41560 21 0 0 25 0 1 0 633583612 163155968 36367 268435456000 4194304 4785740 140733295732688 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21250/statm: 39833 36367 338 145 0 36878 0
[pid=21251] ppid=21248 vsize=520640 CPUtime=415.81 cores=2
/proc/21251/stat : 21251 (TNM) R 21248 21248 21150 0 -1 4202496 24307 0 0 0 41575 6 0 0 25 0 1 0 633583612 533135360 24205 268435456000 134512640 134534564 4291373216 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/21251/statm: 130160 24205 95 6 0 128825 0
[pid=21252] ppid=21248 vsize=765532 CPUtime=415.81 cores=3
/proc/21252/stat : 21252 (march_hi) R 21248 21248 21150 0 -1 4202496 374543 0 0 0 41486 95 0 0 25 0 1 0 633583612 783904768 137851 268435456000 4194304 4331988 140736683976624 18446744073709551615 4210448 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/21252/statm: 191383 137851 173 34 0 189825 0
[pid=21253] ppid=21248 vsize=1997788 CPUtime=11319.3 cores=4-31
/proc/21253/stat : 21253 (plingeling) S 21248 21248 21150 0 -1 4202496 622861 1245 0 0 1131708 218 0 0 19 0 29 0 633583612 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 17 0 0 0
/proc/21253/statm: 499447 363201 159 40 0 497991 0
[pid=21253/tid=21260] ppid=21248 vsize=1997788 CPUtime=404.34 cores=4-31
/proc/21253/task/21260/stat : 21260 (plingeling) R 21248 21248 21150 0 -1 4202560 11489 1245 0 0 40425 9 0 0 25 0 29 0 633584759 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4284043 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=21253/tid=21261] ppid=21248 vsize=1997788 CPUtime=404.29 cores=4-31
/proc/21253/task/21261/stat : 21261 (plingeling) R 21248 21248 21150 0 -1 4202560 7939 1245 0 0 40427 2 0 0 25 0 29 0 633584759 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=21253/tid=21262] ppid=21248 vsize=1997788 CPUtime=404.3 cores=4-31
/proc/21253/task/21262/stat : 21262 (plingeling) R 21248 21248 21150 0 -1 4202560 6529 1245 0 0 40428 2 0 0 25 0 29 0 633584759 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=21253/tid=21263] ppid=21248 vsize=1997788 CPUtime=404.33 cores=4-31
/proc/21253/task/21263/stat : 21263 (plingeling) R 21248 21248 21150 0 -1 4202560 12400 1245 0 0 40429 4 0 0 25 0 29 0 633584759 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4330999 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=21253/tid=21264] ppid=21248 vsize=1997788 CPUtime=404.33 cores=4-31
/proc/21253/task/21264/stat : 21264 (plingeling) R 21248 21248 21150 0 -1 4202560 12155 1245 0 0 40425 8 0 0 25 0 29 0 633584759 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4331337 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=21253/tid=21265] ppid=21248 vsize=1997788 CPUtime=404.33 cores=4-31
/proc/21253/task/21265/stat : 21265 (plingeling) R 21248 21248 21150 0 -1 4202560 9137 1245 0 0 40431 2 0 0 25 0 29 0 633584759 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4331028 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=21253/tid=21266] ppid=21248 vsize=1997788 CPUtime=404.31 cores=4-31
/proc/21253/task/21266/stat : 21266 (plingeling) R 21248 21248 21150 0 -1 4202560 6982 1245 0 0 40423 8 0 0 25 0 29 0 633584759 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=21253/tid=21267] ppid=21248 vsize=1997788 CPUtime=404.33 cores=4-31
/proc/21253/task/21267/stat : 21267 (plingeling) R 21248 21248 21150 0 -1 4202560 10501 1245 0 0 40431 2 0 0 25 0 29 0 633584760 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4225594 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=21253/tid=21268] ppid=21248 vsize=1997788 CPUtime=404.3 cores=4-31
/proc/21253/task/21268/stat : 21268 (plingeling) R 21248 21248 21150 0 -1 4202560 10749 1245 0 0 40422 8 0 0 25 0 29 0 633584760 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4331015 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=21253/tid=21269] ppid=21248 vsize=1997788 CPUtime=404.33 cores=4-31
/proc/21253/task/21269/stat : 21269 (plingeling) R 21248 21248 21150 0 -1 4202560 6810 1245 0 0 40431 2 0 0 25 0 29 0 633584760 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=21253/tid=21270] ppid=21248 vsize=1997788 CPUtime=404.3 cores=4-31
/proc/21253/task/21270/stat : 21270 (plingeling) R 21248 21248 21150 0 -1 4202560 11194 1245 0 0 40422 8 0 0 25 0 29 0 633584760 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=21253/tid=21271] ppid=21248 vsize=1997788 CPUtime=392.85 cores=4-31
/proc/21253/task/21271/stat : 21271 (plingeling) R 21248 21248 21150 0 -1 4202560 7271 1245 0 0 39283 2 0 0 25 0 29 0 633584760 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=21253/tid=21272] ppid=21248 vsize=1997788 CPUtime=404.32 cores=4-31
/proc/21253/task/21272/stat : 21272 (plingeling) R 21248 21248 21150 0 -1 4202560 10755 1245 0 0 40423 9 0 0 25 0 29 0 633584760 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4331340 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=21253/tid=21273] ppid=21248 vsize=1997788 CPUtime=404.3 cores=4-31
/proc/21253/task/21273/stat : 21273 (plingeling) R 21248 21248 21150 0 -1 4202560 7164 1245 0 0 40429 1 0 0 25 0 29 0 633584760 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4238589 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=21253/tid=21274] ppid=21248 vsize=1997788 CPUtime=404.26 cores=4-31
/proc/21253/task/21274/stat : 21274 (plingeling) R 21248 21248 21150 0 -1 4202560 12250 1245 0 0 40417 9 0 0 25 0 29 0 633584760 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=21253/tid=21275] ppid=21248 vsize=1997788 CPUtime=403.43 cores=4-31
/proc/21253/task/21275/stat : 21275 (plingeling) R 21248 21248 21150 0 -1 4202560 6583 1245 0 0 40342 1 0 0 25 0 29 0 633584761 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4279656 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=21253/tid=21276] ppid=21248 vsize=1997788 CPUtime=404.28 cores=4-31
/proc/21253/task/21276/stat : 21276 (plingeling) R 21248 21248 21150 0 -1 4202560 9681 1245 0 0 40426 2 0 0 25 0 29 0 633584761 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=21253/tid=21277] ppid=21248 vsize=1997788 CPUtime=404.29 cores=4-31
/proc/21253/task/21277/stat : 21277 (plingeling) R 21248 21248 21150 0 -1 4202560 10469 1245 0 0 40427 2 0 0 25 0 29 0 633584761 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4331383 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=21253/tid=21278] ppid=21248 vsize=1997788 CPUtime=404.31 cores=4-31
/proc/21253/task/21278/stat : 21278 (plingeling) R 21248 21248 21150 0 -1 4202560 14066 1245 0 0 40421 10 0 0 25 0 29 0 633584761 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=21253/tid=21279] ppid=21248 vsize=1997788 CPUtime=404.3 cores=4-31
/proc/21253/task/21279/stat : 21279 (plingeling) R 21248 21248 21150 0 -1 4202560 12415 1245 0 0 40426 4 0 0 25 0 29 0 633584761 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4210544 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=21253/tid=21280] ppid=21248 vsize=1997788 CPUtime=404.3 cores=4-31
/proc/21253/task/21280/stat : 21280 (plingeling) R 21248 21248 21150 0 -1 4202560 13779 1245 0 0 40421 9 0 0 25 0 29 0 633584761 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=21253/tid=21281] ppid=21248 vsize=1997788 CPUtime=404.31 cores=4-31
/proc/21253/task/21281/stat : 21281 (plingeling) R 21248 21248 21150 0 -1 4202560 6871 1245 0 0 40429 2 0 0 25 0 29 0 633584761 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=21253/tid=21282] ppid=21248 vsize=1997788 CPUtime=404.11 cores=4-31
/proc/21253/task/21282/stat : 21282 (plingeling) R 21248 21248 21150 0 -1 4202560 6021 1245 0 0 40406 5 0 0 25 0 29 0 633584762 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4210587 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=21253/tid=21283] ppid=21248 vsize=1997788 CPUtime=404.28 cores=4-31
/proc/21253/task/21283/stat : 21283 (plingeling) R 21248 21248 21150 0 -1 4202560 7974 1245 0 0 40427 1 0 0 25 0 29 0 633584762 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=21253/tid=21284] ppid=21248 vsize=1997788 CPUtime=403.98 cores=4-31
/proc/21253/task/21284/stat : 21284 (plingeling) R 21248 21248 21150 0 -1 4202560 6890 1245 0 0 40396 2 0 0 25 0 29 0 633584762 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4260341 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=21253/tid=21285] ppid=21248 vsize=1997788 CPUtime=404.29 cores=4-31
/proc/21253/task/21285/stat : 21285 (plingeling) R 21248 21248 21150 0 -1 4202560 8450 1245 0 0 40420 9 0 0 25 0 29 0 633584762 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4225618 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=21253/tid=21286] ppid=21248 vsize=1997788 CPUtime=404.13 cores=4-31
/proc/21253/task/21286/stat : 21286 (plingeling) R 21248 21248 21150 0 -1 4202560 6662 1245 0 0 40405 8 0 0 25 0 29 0 633584762 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4331050 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=21253/tid=21287] ppid=21248 vsize=1997788 CPUtime=404.31 cores=4-31
/proc/21253/task/21287/stat : 21287 (plingeling) R 21248 21248 21150 0 -1 4202560 10735 1245 0 0 40429 2 0 0 25 0 29 0 633584762 2045734912 363201 268435456000 4194304 4356188 140737096846288 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 16 0 0 0
Current children cumulated CPU time (s) 12982.5
Current children cumulated vsize (KiB) 4575024

[startup+416.702 s]
/proc/loadavg: 32.10 31.24 29.49 33/447 21300
/proc/meminfo: memFree=253221788/264257624 swapFree=67111528/67111528
[pid=21248] ppid=21246 vsize=18324 CPUtime=0 cores=0-31
/proc/21248/stat : 21248 (ppfolio) S 21246 21248 21150 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 633583611 18763776 386 268435456000 4194304 4287625 140734788546896 18446744073709551615 258650975999 0 0 4096 65536 9197547811548168191 0 0 17 16 0 0 0
/proc/21248/statm: 4581 386 337 23 0 91 0
[pid=21249] ppid=21248 vsize=1113408 CPUtime=416.61 cores=0
/proc/21249/stat : 21249 (cryptominisat) R 21248 21248 21150 0 -1 4202496 68532 0 0 0 41638 23 0 0 25 0 1 0 633583612 1140129792 39600 268435456000 4194304 4587354 140737315219776 18446744073709551615 4238491 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21249/statm: 278352 39600 333 96 0 274914 0
[pid=21250] ppid=21248 vsize=159480 CPUtime=416.6 cores=1
/proc/21250/stat : 21250 (clasp) R 21248 21248 21150 0 -1 4202496 42301 0 0 0 41639 21 0 0 25 0 1 0 633583612 163307520 36375 268435456000 4194304 4785740 140733295732688 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21250/statm: 39870 36375 338 145 0 36915 0
[pid=21251] ppid=21248 vsize=520640 CPUtime=416.61 cores=2
/proc/21251/stat : 21251 (TNM) R 21248 21248 21150 0 -1 4202496 24307 0 0 0 41655 6 0 0 25 0 1 0 633583612 533135360 24205 268435456000 134512640 134534564 4291373216 18446744073709551615 134530151 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/21251/statm: 130160 24205 95 6 0 128825 0
[pid=21252] ppid=21248 vsize=765532 CPUtime=416.6 cores=3
/proc/21252/stat : 21252 (march_hi) R 21248 21248 21150 0 -1 4202496 374543 0 0 0 41565 95 0 0 25 0 1 0 633583612 783904768 137851 268435456000 4194304 4331988 140736683976624 18446744073709551615 4237398 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/21252/statm: 191383 137851 173 34 0 189825 0
[pid=21253] ppid=21248 vsize=1997788 CPUtime=11340.9 cores=4-31
/proc/21253/stat : 21253 (plingeling) S 21248 21248 21150 0 -1 4202496 622862 1245 0 0 1133871 218 0 0 18 0 9 0 633583612 2045734912 363202 268435456000 4194304 4356188 140737096846288 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 17 0 0 0
/proc/21253/statm: 499447 363202 160 40 0 497991 0
[pid=21253/tid=21263] ppid=21248 vsize=1997788 CPUtime=405.13 cores=4-31
/proc/21253/task/21263/stat : 21263 (plingeling) R 21248 21248 21150 0 -1 4202560 12400 1245 0 0 40509 4 0 0 25 0 9 0 633584759 2045734912 363202 268435456000 4194304 4356188 140737096846288 18446744073709551615 4250782 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=21253/tid=21267] ppid=21248 vsize=1997788 CPUtime=405.12 cores=4-31
/proc/21253/task/21267/stat : 21267 (plingeling) R 21248 21248 21150 0 -1 4202560 10501 1245 0 0 40510 2 0 0 25 0 9 0 633584760 2045734912 363202 268435456000 4194304 4356188 140737096846288 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=21253/tid=21268] ppid=21248 vsize=1997788 CPUtime=405.1 cores=4-31
/proc/21253/task/21268/stat : 21268 (plingeling) R 21248 21248 21150 0 -1 4202560 10749 1245 0 0 40502 8 0 0 25 0 9 0 633584760 2045734912 363202 268435456000 4194304 4356188 140737096846288 18446744073709551615 4237401 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=21253/tid=21269] ppid=21248 vsize=1997788 CPUtime=405.13 cores=4-31
/proc/21253/task/21269/stat : 21269 (plingeling) R 21248 21248 21150 0 -1 4202560 6810 1245 0 0 40511 2 0 0 25 0 9 0 633584760 2045734912 363202 268435456000 4194304 4356188 140737096846288 18446744073709551615 4238512 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=21253/tid=21271] ppid=21248 vsize=1997788 CPUtime=393.64 cores=4-31
/proc/21253/task/21271/stat : 21271 (plingeling) R 21248 21248 21150 0 -1 4202560 7271 1245 0 0 39362 2 0 0 25 0 9 0 633584760 2045734912 363202 268435456000 4194304 4356188 140737096846288 18446744073709551615 4331002 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=21253/tid=21279] ppid=21248 vsize=1997788 CPUtime=405.1 cores=4-31
/proc/21253/task/21279/stat : 21279 (plingeling) R 21248 21248 21150 0 -1 4202560 12415 1245 0 0 40506 4 0 0 25 0 9 0 633584761 2045734912 363202 268435456000 4194304 4356188 140737096846288 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=21253/tid=21285] ppid=21248 vsize=1997788 CPUtime=405.09 cores=4-31
/proc/21253/task/21285/stat : 21285 (plingeling) R 21248 21248 21150 0 -1 4202560 8450 1245 0 0 40500 9 0 0 25 0 9 0 633584762 2045734912 363202 268435456000 4194304 4356188 140737096846288 18446744073709551615 4237986 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=21253/tid=21287] ppid=21248 vsize=1997788 CPUtime=405.1 cores=4-31
/proc/21253/task/21287/stat : 21287 (plingeling) R 21248 21248 21150 0 -1 4202560 10735 1245 0 0 40508 2 0 0 25 0 9 0 633584762 2045734912 363202 268435456000 4194304 4356188 140737096846288 18446744073709551615 4225712 0 0 4096 17442 0 0 0 -1 16 0 0 0
Current children cumulated CPU time (s) 13007.3
Current children cumulated vsize (KiB) 4575172

[startup+416.92 s]
/proc/loadavg: 32.10 31.24 29.49 6/420 21300
/proc/meminfo: memFree=253222252/264257624 swapFree=67111528/67111528
[pid=21248] ppid=21246 vsize=18324 CPUtime=0 cores=0-31
/proc/21248/stat : 21248 (ppfolio) S 21246 21248 21150 0 -1 4202496 514 0 0 0 0 0 0 0 15 0 1 0 633583611 18763776 386 268435456000 4194304 4287625 140734788546896 18446744073709551615 258650975999 0 0 4096 65536 9197547811548168191 0 0 17 16 0 0 0
/proc/21248/statm: 4581 386 337 23 0 91 0
[pid=21249] ppid=21248 vsize=1113408 CPUtime=416.83 cores=0
/proc/21249/stat : 21249 (cryptominisat) R 21248 21248 21150 0 -1 4202496 68532 0 0 0 41660 23 0 0 25 0 1 0 633583612 1140129792 39600 268435456000 4194304 4587354 140737315219776 18446744073709551615 4238752 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/21249/statm: 278352 39600 333 96 0 274914 0
[pid=21250] ppid=21248 vsize=159480 CPUtime=416.82 cores=1
/proc/21250/stat : 21250 (clasp) R 21248 21248 21150 0 -1 4202496 42301 0 0 0 41661 21 0 0 25 0 1 0 633583612 163307520 36375 268435456000 4194304 4785740 140733295732688 18446744073709551615 4287237 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/21250/statm: 39870 36375 338 145 0 36915 0
[pid=21251] ppid=21248 vsize=520640 CPUtime=416.83 cores=2
/proc/21251/stat : 21251 (TNM) R 21248 21248 21150 0 -1 4202496 24307 0 0 0 41677 6 0 0 25 0 1 0 633583612 533135360 24205 268435456000 134512640 134534564 4291373216 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/21251/statm: 130160 24205 95 6 0 128825 0
[pid=21252] ppid=21248 vsize=765532 CPUtime=416.82 cores=3
/proc/21252/stat : 21252 (march_hi) R 21248 21248 21150 0 -1 4202496 374543 0 0 0 41587 95 0 0 25 0 1 0 633583612 783904768 137851 268435456000 4194304 4331988 140736683976624 18446744073709551615 4237171 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/21252/statm: 191383 137851 173 34 0 189825 0
[pid=21253] ppid=21248 vsize=978740 CPUtime=11341.3 cores=4-31
/proc/21253/stat : 21253 (plingeling) R 21248 21248 21150 0 -1 4202496 622862 1245 0 0 1133911 223 0 0 15 0 1 0 633583612 1002229760 171779 268435456000 4194304 4356188 140737096846288 18446744073709551615 258650999159 0 0 4096 0 0 0 0 17 17 0 0 0
/proc/21253/statm: 244685 171267 160 40 0 243229 0
Current children cumulated CPU time (s) 13008.6
Current children cumulated vsize (KiB) 3556124

[startup+417.002 s]
/proc/loadavg: 32.10 31.24 29.49 6/420 21300
/proc/meminfo: memFree=253222252/264257624 swapFree=67111528/67111528
[pid=21248] ppid=21246 vsize=18324 CPUtime=12592.1 cores=0-31
/proc/21248/stat : 21248 (ppfolio) S 21246 21248 21150 0 -1 4202496 515 759250 0 0 0 0 1258926 284 15 0 1 0 633583611 18763776 387 268435456000 4194304 4287625 140734788546896 18446744073709551615 258650975999 0 0 4096 65536 9192446627351101439 0 0 17 16 0 0 0
/proc/21248/statm: 4581 387 338 23 0 91 0
[pid=21252] ppid=21248 vsize=0 CPUtime=416.9 cores=3
/proc/21252/stat : 21252 (march_hi) R 21248 21248 21150 0 -1 4203524 374543 0 0 0 41592 98 0 0 25 0 1 0 633583612 0 0 268435456000 0 0 0 0 0 0 0 4096 0 18446744073709551615 0 0 17 3 0 0 0
/proc/21252/statm: 0 0 0 0 0 0 0
Current children cumulated CPU time (s) 13009
Current children cumulated vsize (KiB) 18324

Child status: 0
Real time (s): 417.029
CPU time (s): 13009.1
CPU user time (s): 13005.2
CPU system time (s): 3.86641
CPU usage (%): 3119.46
Max. virtual memory (cumulated for all children) (KiB): 5323556

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 13005.2
system time used= 3.86641
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1134328
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 1625
involuntary context switches= 32424

runsolver used 2.07568 second user time and 9.66953 second system time

The end

Launcher Data 

Begin job on node200 at 2011-05-12 19:22:52
IDJOB=3347515
IDBENCH=82501
IDSOLVER=1808
FILE ID=node200/3347515-1305220971
RUNJOBID= node200-1305220738-21164
PBS_JOBID= 13282096
Free space on /tmp= 62032 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/manthey/traffic/traffic_b_unsat.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3347515-1305220971/watcher-3347515-1305220971 -o /tmp/evaluation-result-3347515-1305220971/solver-3347515-1305220971 -C 160000 -W 5100 -M 266338304  ppfolio HOME/instance-3347515-1305220971.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 3dc443ddf213a09407d2a75925179735
RANDOM SEED=36276260

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255621752 kB
Buffers:        429940 kB
Cached:        7801844 kB
SwapCached:          0 kB
Active:        7377052 kB
Inactive:       923824 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255621752 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           28288 kB
Writeback:           0 kB
AnonPages:       69104 kB
Mapped:          14392 kB
Slab:           249708 kB
PageTables:       3904 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   193116 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62024 MiB
End job on node200 at 2011-05-12 19:29:49