Trace number 3347713

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio parUNSAT 1576.93 54.7933

General information on the benchmark

NameSAT02/industrial/nam/fpga-routing/
k2fix_gr_rcs_w9.shuffled.cnf
MD5SUM3469bb30890bba597175d692c3430b0e
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark702.513
Satisfiable
(Un)Satisfiability was proved
Number of variables11313
Number of clauses305160
Sum of the clauses size619119
Maximum clause length9
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2303903
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 51257

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 32 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31
1576.93/54.78	s UNSATISFIABLE
1576.93/54.79	solver [5] plingeling 276-6264d55-100731 answered
1576.93/54.79	Done

Verifier Data 

No possible verification on an UNSAT instance

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3347713-1306150077/watcher-3347713-1306150077 -o /tmp/evaluation-result-3347713-1306150077/solver-3347713-1306150077 -C 160000 -W 5100 -M 266338304 ppfolio HOME/instance-3347713-1306150077.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 24.59 30.26 31.42 1/413 1816
/proc/meminfo: memFree=255297276/264257624 swapFree=67111528/67111528
[pid=1816] ppid=1814 vsize=18324 CPUtime=0 cores=0-31
/proc/1816/stat : 1816 (ppfolio) S 1814 1816 1658 0 -1 4202496 513 0 0 0 0 0 0 0 20 0 1 0 726494207 18763776 386 268435456000 4194304 4287625 140734548116416 18446744073709551615 258650975999 0 0 4096 65536 9179084125099786239 0 0 17 12 0 0 0
/proc/1816/statm: 4581 386 337 23 0 91 0

[startup+0.116724 s]
/proc/loadavg: 24.59 30.26 31.42 1/413 1816
/proc/meminfo: memFree=255297276/264257624 swapFree=67111528/67111528
[pid=1816] ppid=1814 vsize=18324 CPUtime=0 cores=0-31
/proc/1816/stat : 1816 (ppfolio) S 1814 1816 1658 0 -1 4202496 513 0 0 0 0 0 0 0 20 0 1 0 726494207 18763776 386 268435456000 4194304 4287625 140734548116416 18446744073709551615 258650975999 0 0 4096 65536 9179084125099786239 0 0 17 12 0 0 0
/proc/1816/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.200726 s]
/proc/loadavg: 24.59 30.26 31.42 1/413 1816
/proc/meminfo: memFree=255297276/264257624 swapFree=67111528/67111528
[pid=1816] ppid=1814 vsize=18324 CPUtime=0 cores=0-31
/proc/1816/stat : 1816 (ppfolio) S 1814 1816 1658 0 -1 4202496 513 0 0 0 0 0 0 0 20 0 1 0 726494207 18763776 386 268435456000 4194304 4287625 140734548116416 18446744073709551615 258650975999 0 0 4096 65536 9179084125099786239 0 0 17 12 0 0 0
/proc/1816/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300711 s]
/proc/loadavg: 24.59 30.26 31.42 1/413 1816
/proc/meminfo: memFree=255297276/264257624 swapFree=67111528/67111528
[pid=1816] ppid=1814 vsize=18324 CPUtime=0 cores=0-31
/proc/1816/stat : 1816 (ppfolio) S 1814 1816 1658 0 -1 4202496 513 0 0 0 0 0 0 0 18 0 1 0 726494207 18763776 386 268435456000 4194304 4287625 140734548116416 18446744073709551615 258650975999 0 0 4096 65536 9179084125099786239 0 0 17 12 0 0 0
/proc/1816/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700702 s]
/proc/loadavg: 24.59 30.26 31.42 1/413 1816
/proc/meminfo: memFree=255297276/264257624 swapFree=67111528/67111528
[pid=1816] ppid=1814 vsize=18324 CPUtime=0 cores=0-31
/proc/1816/stat : 1816 (ppfolio) S 1814 1816 1658 0 -1 4202496 513 0 0 0 0 0 0 0 15 0 1 0 726494207 18763776 386 268435456000 4194304 4287625 140734548116416 18446744073709551615 258650975999 0 0 4096 65536 9179084125099786239 0 0 17 12 0 0 0
/proc/1816/statm: 4581 386 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50073 s]
/proc/loadavg: 23.02 29.84 31.27 6/419 1827
/proc/meminfo: memFree=255127028/264257624 swapFree=67111528/67111528
[pid=1816] ppid=1814 vsize=18324 CPUtime=0 cores=0-31
/proc/1816/stat : 1816 (ppfolio) S 1814 1816 1658 0 -1 4202496 513 0 0 0 0 0 0 0 15 0 1 0 726494207 18763776 386 268435456000 4194304 4287625 140734548116416 18446744073709551615 258650975999 0 0 4096 65536 9179084125099786239 0 0 17 12 0 0 0
/proc/1816/statm: 4581 386 337 23 0 91 0
[pid=1817] ppid=1816 vsize=70264 CPUtime=1.48 cores=0
/proc/1817/stat : 1817 (cryptominisat) R 1816 1816 1658 0 -1 4202496 15955 0 0 0 144 4 0 0 18 0 1 0 726494207 71950336 11758 268435456000 4194304 4587354 140733695677472 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1817/statm: 17566 11758 324 96 0 14128 0
[pid=1818] ppid=1816 vsize=37368 CPUtime=1.48 cores=1
/proc/1818/stat : 1818 (clasp) R 1816 1816 1658 0 -1 4202496 8033 0 0 0 146 2 0 0 20 0 1 0 726494207 38264832 6632 268435456000 4194304 4785740 140734938648240 18446744073709551615 258650616632 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1818/statm: 9342 6632 317 145 0 6387 0
[pid=1819] ppid=1816 vsize=466520 CPUtime=1.48 cores=2
/proc/1819/stat : 1819 (TNM) R 1816 1816 1658 0 -1 4202496 5143 0 0 0 146 2 0 0 20 0 1 0 726494207 477716480 5041 268435456000 134512640 134534564 4287243040 18446744073709551615 134524508 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1819/statm: 116630 5041 91 6 0 115295 0
[pid=1820] ppid=1816 vsize=39148 CPUtime=1.48 cores=3
/proc/1820/stat : 1820 (march_hi) R 1816 1816 1658 0 -1 4202496 21625 0 0 0 143 5 0 0 20 0 1 0 726494207 40087552 5372 268435456000 4194304 4331988 140733740910416 18446744073709551615 4251649 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1820/statm: 9787 5372 147 34 0 8229 0
[pid=1821] ppid=1816 vsize=64936 CPUtime=1.49 cores=4-31
/proc/1821/stat : 1821 (plingeling) R 1816 1816 1658 0 -1 4202496 14976 1243 0 0 143 5 0 1 21 0 1 0 726494207 66494464 14861 268435456000 4194304 4356188 140736513906912 18446744073709551615 4213242 0 0 4096 17442 0 0 0 17 10 0 0 0
/proc/1821/statm: 16234 14861 129 40 0 14778 0
Current children cumulated CPU time (s) 7.41
Current children cumulated vsize (KiB) 696560

[startup+3.10078 s]
/proc/loadavg: 23.02 29.84 31.27 6/419 1827
/proc/meminfo: memFree=255088500/264257624 swapFree=67111528/67111528
[pid=1816] ppid=1814 vsize=18324 CPUtime=0 cores=0-31
/proc/1816/stat : 1816 (ppfolio) S 1814 1816 1658 0 -1 4202496 513 0 0 0 0 0 0 0 15 0 1 0 726494207 18763776 386 268435456000 4194304 4287625 140734548116416 18446744073709551615 258650975999 0 0 4096 65536 9179084125099786239 0 0 17 12 0 0 0
/proc/1816/statm: 4581 386 337 23 0 91 0
[pid=1817] ppid=1816 vsize=70264 CPUtime=3.08 cores=0
/proc/1817/stat : 1817 (cryptominisat) R 1816 1816 1658 0 -1 4202496 16841 0 0 0 304 4 0 0 20 0 1 0 726494207 71950336 12637 268435456000 4194304 4587354 140733695677472 18446744073709551615 4250346 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1817/statm: 17566 12637 324 96 0 14128 0
[pid=1818] ppid=1816 vsize=41912 CPUtime=3.08 cores=1
/proc/1818/stat : 1818 (clasp) R 1816 1816 1658 0 -1 4202496 9737 0 0 0 306 2 0 0 25 0 1 0 726494207 42917888 7739 268435456000 4194304 4785740 140734938648240 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1818/statm: 10478 7739 338 145 0 7523 0
[pid=1819] ppid=1816 vsize=469424 CPUtime=3.08 cores=2
/proc/1819/stat : 1819 (TNM) R 1816 1816 1658 0 -1 4202496 7656 0 0 0 305 3 0 0 25 0 1 0 726494207 480690176 7554 268435456000 134512640 134534564 4287243040 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1819/statm: 117356 7554 95 6 0 116021 0
[pid=1820] ppid=1816 vsize=62628 CPUtime=3.08 cores=3
/proc/1820/stat : 1820 (march_hi) R 1816 1816 1658 0 -1 4202496 32068 0 0 0 302 6 0 0 25 0 1 0 726494207 64131072 7129 268435456000 4194304 4331988 140733740910416 18446744073709551615 4228307 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1820/statm: 15657 7129 173 34 0 14099 0
[pid=1821] ppid=1816 vsize=93608 CPUtime=3.09 cores=4-31
/proc/1821/stat : 1821 (plingeling) R 1816 1816 1658 0 -1 4202496 22144 1243 0 0 302 6 0 1 25 0 1 0 726494207 95854592 22029 268435456000 4194304 4356188 140736513906912 18446744073709551615 4213193 0 0 4096 17442 0 0 0 17 10 0 0 0
/proc/1821/statm: 23402 22029 129 40 0 21946 0
Current children cumulated CPU time (s) 15.41
Current children cumulated vsize (KiB) 756160

[startup+6.30086 s]
/proc/loadavg: 23.02 29.84 31.27 6/419 1827
/proc/meminfo: memFree=255017096/264257624 swapFree=67111528/67111528
[pid=1816] ppid=1814 vsize=18324 CPUtime=0 cores=0-31
/proc/1816/stat : 1816 (ppfolio) S 1814 1816 1658 0 -1 4202496 513 0 0 0 0 0 0 0 15 0 1 0 726494207 18763776 386 268435456000 4194304 4287625 140734548116416 18446744073709551615 258650975999 0 0 4096 65536 9179084125099786239 0 0 17 12 0 0 0
/proc/1816/statm: 4581 386 337 23 0 91 0
[pid=1817] ppid=1816 vsize=255024 CPUtime=6.28 cores=0
/proc/1817/stat : 1817 (cryptominisat) R 1816 1816 1658 0 -1 4202496 20711 0 0 0 623 5 0 0 25 0 1 0 726494207 261144576 14931 268435456000 4194304 4587354 140733695677472 18446744073709551615 4364672 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1817/statm: 63756 14931 338 96 0 60318 0
[pid=1818] ppid=1816 vsize=42352 CPUtime=6.28 cores=1
/proc/1818/stat : 1818 (clasp) R 1816 1816 1658 0 -1 4202496 9864 0 0 0 626 2 0 0 25 0 1 0 726494207 43368448 7866 268435456000 4194304 4785740 140734938648240 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1818/statm: 10588 7866 338 145 0 7633 0
[pid=1819] ppid=1816 vsize=469424 CPUtime=6.28 cores=2
/proc/1819/stat : 1819 (TNM) R 1816 1816 1658 0 -1 4202496 7656 0 0 0 625 3 0 0 25 0 1 0 726494207 480690176 7554 268435456000 134512640 134534564 4287243040 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1819/statm: 117356 7554 95 6 0 116021 0
[pid=1820] ppid=1816 vsize=63040 CPUtime=6.28 cores=3
/proc/1820/stat : 1820 (march_hi) R 1816 1816 1658 0 -1 4202496 32157 0 0 0 622 6 0 0 25 0 1 0 726494207 64552960 7218 268435456000 4194304 4331988 140733740910416 18446744073709551615 4263143 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1820/statm: 15760 7218 173 34 0 14202 0
[pid=1821] ppid=1816 vsize=756372 CPUtime=10.61 cores=4-31
/proc/1821/stat : 1821 (plingeling) S 1816 1816 1658 0 -1 4202496 69278 1243 0 0 928 132 0 1 20 0 29 0 726494207 774524928 36294 268435456000 4194304 4356188 140736513906912 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 18 0 0 0
/proc/1821/statm: 189093 36294 148 40 0 187637 0
Current children cumulated CPU time (s) 35.73
Current children cumulated vsize (KiB) 1604536

[startup+12.7021 s]
/proc/loadavg: 22.41 29.47 31.14 33/447 1855
/proc/meminfo: memFree=254706664/264257624 swapFree=67111528/67111528
[pid=1816] ppid=1814 vsize=18324 CPUtime=0 cores=0-31
/proc/1816/stat : 1816 (ppfolio) S 1814 1816 1658 0 -1 4202496 513 0 0 0 0 0 0 0 15 0 1 0 726494207 18763776 386 268435456000 4194304 4287625 140734548116416 18446744073709551615 258650975999 0 0 4096 65536 9179084125099786239 0 0 17 12 0 0 0
/proc/1816/statm: 4581 386 337 23 0 91 0
[pid=1817] ppid=1816 vsize=253004 CPUtime=12.68 cores=0
/proc/1817/stat : 1817 (cryptominisat) R 1816 1816 1658 0 -1 4202496 25855 0 0 0 1262 6 0 0 25 0 1 0 726494207 259076096 18291 268435456000 4194304 4587354 140733695677472 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1817/statm: 63251 18291 338 96 0 59813 0
[pid=1818] ppid=1816 vsize=49412 CPUtime=12.68 cores=1
/proc/1818/stat : 1818 (clasp) R 1816 1816 1658 0 -1 4202496 11625 0 0 0 1265 3 0 0 25 0 1 0 726494207 50597888 9627 268435456000 4194304 4785740 140734938648240 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1818/statm: 12353 9627 338 145 0 9398 0
[pid=1819] ppid=1816 vsize=469424 CPUtime=12.68 cores=2
/proc/1819/stat : 1819 (TNM) R 1816 1816 1658 0 -1 4202496 7656 0 0 0 1265 3 0 0 25 0 1 0 726494207 480690176 7554 268435456000 134512640 134534564 4287243040 18446744073709551615 134528302 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1819/statm: 117356 7554 95 6 0 116021 0
[pid=1820] ppid=1816 vsize=63412 CPUtime=12.68 cores=3
/proc/1820/stat : 1820 (march_hi) R 1816 1816 1658 0 -1 4202496 32239 0 0 0 1262 6 0 0 25 0 1 0 726494207 64933888 7300 268435456000 4194304 4331988 140733740910416 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1820/statm: 15853 7300 173 34 0 14295 0
[pid=1821] ppid=1816 vsize=1015028 CPUtime=187.68 cores=4-31
/proc/1821/stat : 1821 (plingeling) S 1816 1816 1658 0 -1 4202496 155258 1243 0 0 18543 224 0 1 20 0 29 0 726494207 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 18 0 0 0
/proc/1821/statm: 253757 103706 159 40 0 252301 0
[pid=1821/tid=1828] ppid=1816 vsize=1015028 CPUtime=6.41 cores=4-31
/proc/1821/task/1828/stat : 1828 (plingeling) R 1816 1816 1658 0 -1 4202560 5090 1243 0 0 631 9 0 1 25 0 29 0 726494809 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=1821/tid=1829] ppid=1816 vsize=1015028 CPUtime=6.48 cores=4-31
/proc/1821/task/1829/stat : 1829 (plingeling) R 1816 1816 1658 0 -1 4202560 2868 1243 0 0 640 7 0 1 25 0 29 0 726494809 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4238533 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1821/tid=1830] ppid=1816 vsize=1015028 CPUtime=6.54 cores=4-31
/proc/1821/task/1830/stat : 1830 (plingeling) R 1816 1816 1658 0 -1 4202560 4280 1243 0 0 647 6 0 1 25 0 29 0 726494809 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4287185 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1821/tid=1831] ppid=1816 vsize=1015028 CPUtime=6.55 cores=4-31
/proc/1821/task/1831/stat : 1831 (plingeling) R 1816 1816 1658 0 -1 4202560 4408 1243 0 0 650 4 0 1 25 0 29 0 726494809 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=1821/tid=1832] ppid=1816 vsize=1015028 CPUtime=6.56 cores=4-31
/proc/1821/task/1832/stat : 1832 (plingeling) R 1816 1816 1658 0 -1 4202560 5795 1243 0 0 648 7 0 1 25 0 29 0 726494809 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4271346 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=1821/tid=1833] ppid=1816 vsize=1015028 CPUtime=6.53 cores=4-31
/proc/1821/task/1833/stat : 1833 (plingeling) R 1816 1816 1658 0 -1 4202560 3358 1243 0 0 647 5 0 1 25 0 29 0 726494809 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4238099 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=1821/tid=1834] ppid=1816 vsize=1015028 CPUtime=6.49 cores=4-31
/proc/1821/task/1834/stat : 1834 (plingeling) R 1816 1816 1658 0 -1 4202560 5226 1243 0 0 639 9 0 1 25 0 29 0 726494809 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4330862 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1821/tid=1835] ppid=1816 vsize=1015028 CPUtime=6.5 cores=4-31
/proc/1821/task/1835/stat : 1835 (plingeling) R 1816 1816 1658 0 -1 4202560 3663 1243 0 0 641 8 0 1 25 0 29 0 726494809 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=1821/tid=1836] ppid=1816 vsize=1015028 CPUtime=6.47 cores=4-31
/proc/1821/task/1836/stat : 1836 (plingeling) R 1816 1816 1658 0 -1 4202560 2959 1243 0 0 640 6 0 1 25 0 29 0 726494810 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4211026 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=1821/tid=1837] ppid=1816 vsize=1015028 CPUtime=6.48 cores=4-31
/proc/1821/task/1837/stat : 1837 (plingeling) R 1816 1816 1658 0 -1 4202560 3710 1243 0 0 639 8 0 1 25 0 29 0 726494810 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4330964 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=1821/tid=1838] ppid=1816 vsize=1015028 CPUtime=6.49 cores=4-31
/proc/1821/task/1838/stat : 1838 (plingeling) R 1816 1816 1658 0 -1 4202560 4839 1243 0 0 639 9 0 1 25 0 29 0 726494810 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=1821/tid=1839] ppid=1816 vsize=1015028 CPUtime=6.51 cores=4-31
/proc/1821/task/1839/stat : 1839 (plingeling) R 1816 1816 1658 0 -1 4202560 2375 1243 0 0 643 7 0 1 25 0 29 0 726494810 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331694 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=1821/tid=1840] ppid=1816 vsize=1015028 CPUtime=6.38 cores=4-31
/proc/1821/task/1840/stat : 1840 (plingeling) R 1816 1816 1658 0 -1 4202560 3968 1243 0 0 629 8 0 1 25 0 29 0 726494810 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4208840 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=1821/tid=1841] ppid=1816 vsize=1015028 CPUtime=6.49 cores=4-31
/proc/1821/task/1841/stat : 1841 (plingeling) R 1816 1816 1658 0 -1 4202560 5896 1243 0 0 640 8 0 1 25 0 29 0 726494810 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331305 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=1821/tid=1842] ppid=1816 vsize=1015028 CPUtime=6.49 cores=4-31
/proc/1821/task/1842/stat : 1842 (plingeling) R 1816 1816 1658 0 -1 4202560 4020 1243 0 0 640 8 0 1 25 0 29 0 726494810 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=1821/tid=1843] ppid=1816 vsize=1015028 CPUtime=6.49 cores=4-31
/proc/1821/task/1843/stat : 1843 (plingeling) R 1816 1816 1658 0 -1 4202560 5219 1243 0 0 640 8 0 1 25 0 29 0 726494810 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4298729 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=1821/tid=1844] ppid=1816 vsize=1015028 CPUtime=6.49 cores=4-31
/proc/1821/task/1844/stat : 1844 (plingeling) R 1816 1816 1658 0 -1 4202560 2856 1243 0 0 640 8 0 1 25 0 29 0 726494810 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331019 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=1821/tid=1845] ppid=1816 vsize=1015028 CPUtime=6.5 cores=4-31
/proc/1821/task/1845/stat : 1845 (plingeling) R 1816 1816 1658 0 -1 4202560 5121 1243 0 0 641 8 0 1 25 0 29 0 726494810 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4279761 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=1821/tid=1846] ppid=1816 vsize=1015028 CPUtime=6.5 cores=4-31
/proc/1821/task/1846/stat : 1846 (plingeling) R 1816 1816 1658 0 -1 4202560 3451 1243 0 0 641 8 0 1 25 0 29 0 726494810 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4280649 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=1821/tid=1847] ppid=1816 vsize=1015028 CPUtime=6.56 cores=4-31
/proc/1821/task/1847/stat : 1847 (plingeling) R 1816 1816 1658 0 -1 4202560 4674 1243 0 0 651 4 0 1 25 0 29 0 726494810 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331106 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=1821/tid=1848] ppid=1816 vsize=1015028 CPUtime=6.47 cores=4-31
/proc/1821/task/1848/stat : 1848 (plingeling) R 1816 1816 1658 0 -1 4202560 3980 1243 0 0 639 7 0 1 25 0 29 0 726494810 1039388672 103706 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331311 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=1821/tid=1849] ppid=1816 vsize=1015028 CPUtime=6.48 cores=4-31

################
# More data... #
################

[pid=1821/tid=1854] ppid=1816 vsize=1378272 CPUtime=46.39 cores=4-31
/proc/1821/task/1854/stat : 1854 (plingeling) R 1816 1816 1658 0 -1 4202560 8635 1243 0 0 4630 8 0 1 25 0 29 0 726494810 1411350528 195846 268435456000 4194304 4356188 140736513906912 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=1821/tid=1855] ppid=1816 vsize=1378272 CPUtime=47.32 cores=4-31
/proc/1821/task/1855/stat : 1855 (plingeling) R 1816 1816 1658 0 -1 4202560 7401 1243 0 0 4730 1 0 1 25 0 29 0 726494810 1411350528 195846 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1545.14
Current children cumulated vsize (KiB) 2278980

[startup+54.4015 s]
/proc/loadavg: 27.14 29.80 31.18 33/447 1857
/proc/meminfo: memFree=254313624/264257624 swapFree=67111528/67111528
[pid=1816] ppid=1814 vsize=18324 CPUtime=0 cores=0-31
/proc/1816/stat : 1816 (ppfolio) S 1814 1816 1658 0 -1 4202496 513 0 0 0 0 0 0 0 15 0 1 0 726494207 18763776 386 268435456000 4194304 4287625 140734548116416 18446744073709551615 258650975999 0 0 4096 65536 9179084125099786239 0 0 17 12 0 0 0
/proc/1816/statm: 4581 386 337 23 0 91 0
[pid=1817] ppid=1816 vsize=266552 CPUtime=54.38 cores=0
/proc/1817/stat : 1817 (cryptominisat) R 1816 1816 1658 0 -1 4202496 41295 0 0 0 5429 9 0 0 25 0 1 0 726494207 272949248 22875 268435456000 4194304 4587354 140733695677472 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1817/statm: 66638 22875 338 96 0 63200 0
[pid=1818] ppid=1816 vsize=81252 CPUtime=54.37 cores=1
/proc/1818/stat : 1818 (clasp) R 1816 1816 1658 0 -1 4202496 19444 0 0 0 5429 8 0 0 25 0 1 0 726494207 83202048 17446 268435456000 4194304 4785740 140734938648240 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1818/statm: 20313 17446 338 145 0 17358 0
[pid=1819] ppid=1816 vsize=469424 CPUtime=54.37 cores=2
/proc/1819/stat : 1819 (TNM) R 1816 1816 1658 0 -1 4202496 7656 0 0 0 5434 3 0 0 25 0 1 0 726494207 480690176 7554 268435456000 134512640 134534564 4287243040 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1819/statm: 117356 7554 95 6 0 116021 0
[pid=1820] ppid=1816 vsize=65696 CPUtime=54.37 cores=3
/proc/1820/stat : 1820 (march_hi) R 1816 1816 1658 0 -1 4202496 32665 0 0 0 5430 7 0 0 25 0 1 0 726494207 67272704 7726 268435456000 4194304 4331988 140733740910416 18446744073709551615 4316070 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1820/statm: 16424 7726 173 34 0 14866 0
[pid=1821] ppid=1816 vsize=1378272 CPUtime=1353.2 cores=4-31
/proc/1821/stat : 1821 (plingeling) S 1816 1816 1658 0 -1 4202496 286541 1243 0 0 134972 347 0 1 20 0 29 0 726494207 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 18 0 0 0
/proc/1821/statm: 344568 195782 159 40 0 343112 0
[pid=1821/tid=1828] ppid=1816 vsize=1378272 CPUtime=48.08 cores=4-31
/proc/1821/task/1828/stat : 1828 (plingeling) R 1816 1816 1658 0 -1 4202560 8131 1243 0 0 4793 14 0 1 25 0 29 0 726494809 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4258696 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=1821/tid=1829] ppid=1816 vsize=1378272 CPUtime=48.11 cores=4-31
/proc/1821/task/1829/stat : 1829 (plingeling) R 1816 1816 1658 0 -1 4202560 7782 1243 0 0 4797 13 0 1 25 0 29 0 726494809 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1821/tid=1830] ppid=1816 vsize=1378272 CPUtime=48.22 cores=4-31
/proc/1821/task/1830/stat : 1830 (plingeling) R 1816 1816 1658 0 -1 4202560 10222 1243 0 0 4809 12 0 1 25 0 29 0 726494809 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4336036 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=1821/tid=1831] ppid=1816 vsize=1378272 CPUtime=48.18 cores=4-31
/proc/1821/task/1831/stat : 1831 (plingeling) R 1816 1816 1658 0 -1 4202560 6456 1243 0 0 4812 5 0 1 25 0 29 0 726494809 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331992 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=1821/tid=1832] ppid=1816 vsize=1378272 CPUtime=48.2 cores=4-31
/proc/1821/task/1832/stat : 1832 (plingeling) R 1816 1816 1658 0 -1 4202560 10193 1243 0 0 4807 12 0 1 25 0 29 0 726494809 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4261931 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=1821/tid=1833] ppid=1816 vsize=1378272 CPUtime=48.18 cores=4-31
/proc/1821/task/1833/stat : 1833 (plingeling) R 1816 1816 1658 0 -1 4202560 9460 1243 0 0 4806 11 0 1 25 0 29 0 726494809 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4212130 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=1821/tid=1834] ppid=1816 vsize=1378272 CPUtime=48.15 cores=4-31
/proc/1821/task/1834/stat : 1834 (plingeling) R 1816 1816 1658 0 -1 4202560 9291 1243 0 0 4799 15 0 1 25 0 29 0 726494809 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4257364 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=1821/tid=1835] ppid=1816 vsize=1378272 CPUtime=48.18 cores=4-31
/proc/1821/task/1835/stat : 1835 (plingeling) R 1816 1816 1658 0 -1 4202560 11681 1243 0 0 4794 23 0 1 25 0 29 0 726494809 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4259356 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=1821/tid=1836] ppid=1816 vsize=1378272 CPUtime=48.09 cores=4-31
/proc/1821/task/1836/stat : 1836 (plingeling) R 1816 1816 1658 0 -1 4202560 8178 1243 0 0 4796 12 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4261931 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=1821/tid=1837] ppid=1816 vsize=1378272 CPUtime=48.17 cores=4-31
/proc/1821/task/1837/stat : 1837 (plingeling) R 1816 1816 1658 0 -1 4202560 8435 1243 0 0 4807 9 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4245442 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=1821/tid=1838] ppid=1816 vsize=1378272 CPUtime=48.11 cores=4-31
/proc/1821/task/1838/stat : 1838 (plingeling) R 1816 1816 1658 0 -1 4202560 6887 1243 0 0 4801 9 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4225739 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=1821/tid=1839] ppid=1816 vsize=1378272 CPUtime=48.2 cores=4-31
/proc/1821/task/1839/stat : 1839 (plingeling) R 1816 1816 1658 0 -1 4202560 5702 1243 0 0 4811 8 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4261931 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=1821/tid=1840] ppid=1816 vsize=1378272 CPUtime=47.84 cores=4-31
/proc/1821/task/1840/stat : 1840 (plingeling) R 1816 1816 1658 0 -1 4202560 7854 1243 0 0 4774 9 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=1821/tid=1841] ppid=1816 vsize=1378272 CPUtime=48.18 cores=4-31
/proc/1821/task/1841/stat : 1841 (plingeling) R 1816 1816 1658 0 -1 4202560 10941 1243 0 0 4807 10 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=1821/tid=1842] ppid=1816 vsize=1378272 CPUtime=48.19 cores=4-31
/proc/1821/task/1842/stat : 1842 (plingeling) R 1816 1816 1658 0 -1 4202560 9989 1243 0 0 4804 14 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4210834 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=1821/tid=1843] ppid=1816 vsize=1378272 CPUtime=48.12 cores=4-31
/proc/1821/task/1843/stat : 1843 (plingeling) R 1816 1816 1658 0 -1 4202560 10441 1243 0 0 4797 14 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4332239 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=1821/tid=1844] ppid=1816 vsize=1378272 CPUtime=48.18 cores=4-31
/proc/1821/task/1844/stat : 1844 (plingeling) R 1816 1816 1658 0 -1 4202560 8155 1243 0 0 4803 14 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4250551 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=1821/tid=1845] ppid=1816 vsize=1378272 CPUtime=48.12 cores=4-31
/proc/1821/task/1845/stat : 1845 (plingeling) R 1816 1816 1658 0 -1 4202560 10325 1243 0 0 4797 14 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=1821/tid=1846] ppid=1816 vsize=1378272 CPUtime=48.18 cores=4-31
/proc/1821/task/1846/stat : 1846 (plingeling) R 1816 1816 1658 0 -1 4202560 8658 1243 0 0 4807 10 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=1821/tid=1847] ppid=1816 vsize=1378272 CPUtime=48.25 cores=4-31
/proc/1821/task/1847/stat : 1847 (plingeling) R 1816 1816 1658 0 -1 4202560 6722 1243 0 0 4819 5 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=1821/tid=1848] ppid=1816 vsize=1378272 CPUtime=48.16 cores=4-31
/proc/1821/task/1848/stat : 1848 (plingeling) R 1816 1816 1658 0 -1 4202560 9621 1243 0 0 4802 13 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=1821/tid=1849] ppid=1816 vsize=1378272 CPUtime=48.15 cores=4-31
/proc/1821/task/1849/stat : 1849 (plingeling) R 1816 1816 1658 0 -1 4202560 6549 1243 0 0 4806 8 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4238533 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=1821/tid=1850] ppid=1816 vsize=1378272 CPUtime=48.17 cores=4-31
/proc/1821/task/1850/stat : 1850 (plingeling) R 1816 1816 1658 0 -1 4202560 11952 1243 0 0 4802 14 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4237394 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=1821/tid=1851] ppid=1816 vsize=1378272 CPUtime=48.15 cores=4-31
/proc/1821/task/1851/stat : 1851 (plingeling) R 1816 1816 1658 0 -1 4202560 13077 1243 0 0 4793 21 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=1821/tid=1852] ppid=1816 vsize=1378272 CPUtime=48.17 cores=4-31
/proc/1821/task/1852/stat : 1852 (plingeling) R 1816 1816 1658 0 -1 4202560 8540 1243 0 0 4802 14 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=1821/tid=1853] ppid=1816 vsize=1378272 CPUtime=48.16 cores=4-31
/proc/1821/task/1853/stat : 1853 (plingeling) R 1816 1816 1658 0 -1 4202560 8730 1243 0 0 4803 12 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=1821/tid=1854] ppid=1816 vsize=1378272 CPUtime=47.16 cores=4-31
/proc/1821/task/1854/stat : 1854 (plingeling) R 1816 1816 1658 0 -1 4202560 8635 1243 0 0 4707 8 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4261931 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=1821/tid=1855] ppid=1816 vsize=1378272 CPUtime=48.12 cores=4-31
/proc/1821/task/1855/stat : 1855 (plingeling) R 1816 1816 1658 0 -1 4202560 7401 1243 0 0 4810 1 0 1 25 0 29 0 726494810 1411350528 195782 268435456000 4194304 4356188 140736513906912 18446744073709551615 4244400 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1570.69
Current children cumulated vsize (KiB) 2279520

[startup+54.6015 s]
/proc/loadavg: 27.14 29.80 31.18 33/447 1857
/proc/meminfo: memFree=254313624/264257624 swapFree=67111528/67111528
[pid=1816] ppid=1814 vsize=18324 CPUtime=0 cores=0-31
/proc/1816/stat : 1816 (ppfolio) S 1814 1816 1658 0 -1 4202496 513 0 0 0 0 0 0 0 15 0 1 0 726494207 18763776 386 268435456000 4194304 4287625 140734548116416 18446744073709551615 258650975999 0 0 4096 65536 9179084125099786239 0 0 17 12 0 0 0
/proc/1816/statm: 4581 386 337 23 0 91 0
[pid=1817] ppid=1816 vsize=266552 CPUtime=54.58 cores=0
/proc/1817/stat : 1817 (cryptominisat) R 1816 1816 1658 0 -1 4202496 41295 0 0 0 5449 9 0 0 25 0 1 0 726494207 272949248 22875 268435456000 4194304 4587354 140733695677472 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1817/statm: 66638 22875 338 96 0 63200 0
[pid=1818] ppid=1816 vsize=81384 CPUtime=54.57 cores=1
/proc/1818/stat : 1818 (clasp) R 1816 1816 1658 0 -1 4202496 19480 0 0 0 5449 8 0 0 25 0 1 0 726494207 83337216 17482 268435456000 4194304 4785740 140734938648240 18446744073709551615 4552653 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1818/statm: 20346 17482 338 145 0 17391 0
[pid=1819] ppid=1816 vsize=469424 CPUtime=54.57 cores=2
/proc/1819/stat : 1819 (TNM) R 1816 1816 1658 0 -1 4202496 7656 0 0 0 5454 3 0 0 25 0 1 0 726494207 480690176 7554 268435456000 134512640 134534564 4287243040 18446744073709551615 134528710 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1819/statm: 117356 7554 95 6 0 116021 0
[pid=1820] ppid=1816 vsize=65696 CPUtime=54.57 cores=3
/proc/1820/stat : 1820 (march_hi) R 1816 1816 1658 0 -1 4202496 32668 0 0 0 5450 7 0 0 25 0 1 0 726494207 67272704 7729 268435456000 4194304 4331988 140733740910416 18446744073709551615 4265504 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1820/statm: 16424 7729 173 34 0 14866 0
[pid=1821] ppid=1816 vsize=1378272 CPUtime=1357.84 cores=4-31
/proc/1821/stat : 1821 (plingeling) S 1816 1816 1658 0 -1 4202496 286542 1243 0 0 135436 347 0 1 20 0 10 0 726494207 1411350528 195783 268435456000 4194304 4356188 140736513906912 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 18 0 0 0
/proc/1821/statm: 344568 195783 160 40 0 343112 0
[pid=1821/tid=1828] ppid=1816 vsize=1378272 CPUtime=48.28 cores=4-31
/proc/1821/task/1828/stat : 1828 (plingeling) R 1816 1816 1658 0 -1 4202560 8131 1243 0 0 4813 14 0 1 25 0 10 0 726494809 1411350528 195783 268435456000 4194304 4356188 140736513906912 18446744073709551615 4332020 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=1821/tid=1829] ppid=1816 vsize=1378272 CPUtime=48.31 cores=4-31
/proc/1821/task/1829/stat : 1829 (plingeling) R 1816 1816 1658 0 -1 4202560 7782 1243 0 0 4817 13 0 1 25 0 10 0 726494809 1411350528 195783 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1821/tid=1831] ppid=1816 vsize=1378272 CPUtime=48.38 cores=4-31
/proc/1821/task/1831/stat : 1831 (plingeling) R 1816 1816 1658 0 -1 4202560 6456 1243 0 0 4832 5 0 1 25 0 10 0 726494809 1411350528 195783 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=1821/tid=1836] ppid=1816 vsize=1378272 CPUtime=48.29 cores=4-31
/proc/1821/task/1836/stat : 1836 (plingeling) R 1816 1816 1658 0 -1 4202560 8178 1243 0 0 4816 12 0 1 25 0 10 0 726494810 1411350528 195783 268435456000 4194304 4356188 140736513906912 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=1821/tid=1839] ppid=1816 vsize=1378272 CPUtime=48.4 cores=4-31
/proc/1821/task/1839/stat : 1839 (plingeling) R 1816 1816 1658 0 -1 4202560 5702 1243 0 0 4831 8 0 1 25 0 10 0 726494810 1411350528 195783 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=1821/tid=1842] ppid=1816 vsize=1378272 CPUtime=48.39 cores=4-31
/proc/1821/task/1842/stat : 1842 (plingeling) R 1816 1816 1658 0 -1 4202560 9989 1243 0 0 4824 14 0 1 25 0 10 0 726494810 1411350528 195783 268435456000 4194304 4356188 140736513906912 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=1821/tid=1844] ppid=1816 vsize=1378272 CPUtime=48.38 cores=4-31
/proc/1821/task/1844/stat : 1844 (plingeling) R 1816 1816 1658 0 -1 4202560 8155 1243 0 0 4823 14 0 1 25 0 10 0 726494810 1411350528 195783 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331350 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=1821/tid=1854] ppid=1816 vsize=1378272 CPUtime=47.36 cores=4-31
/proc/1821/task/1854/stat : 1854 (plingeling) R 1816 1816 1658 0 -1 4202560 8635 1243 0 0 4727 8 0 1 25 0 10 0 726494810 1411350528 195783 268435456000 4194304 4356188 140736513906912 18446744073709551615 4212249 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=1821/tid=1855] ppid=1816 vsize=1378272 CPUtime=48.32 cores=4-31
/proc/1821/task/1855/stat : 1855 (plingeling) R 1816 1816 1658 0 -1 4202560 7401 1243 0 0 4830 1 0 1 25 0 10 0 726494810 1411350528 195783 268435456000 4194304 4356188 140736513906912 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1576.13
Current children cumulated vsize (KiB) 2279652

[startup+54.7016 s]
/proc/loadavg: 27.14 29.80 31.18 33/447 1857
/proc/meminfo: memFree=254313624/264257624 swapFree=67111528/67111528
[pid=1816] ppid=1814 vsize=18324 CPUtime=0 cores=0-31
/proc/1816/stat : 1816 (ppfolio) S 1814 1816 1658 0 -1 4202496 513 0 0 0 0 0 0 0 15 0 1 0 726494207 18763776 386 268435456000 4194304 4287625 140734548116416 18446744073709551615 258650975999 0 0 4096 65536 9179084125099786239 0 0 17 12 0 0 0
/proc/1816/statm: 4581 386 337 23 0 91 0
[pid=1817] ppid=1816 vsize=266552 CPUtime=54.68 cores=0
/proc/1817/stat : 1817 (cryptominisat) R 1816 1816 1658 0 -1 4202496 41295 0 0 0 5459 9 0 0 25 0 1 0 726494207 272949248 22875 268435456000 4194304 4587354 140733695677472 18446744073709551615 4248752 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/1817/statm: 66638 22875 338 96 0 63200 0
[pid=1818] ppid=1816 vsize=81520 CPUtime=54.67 cores=1
/proc/1818/stat : 1818 (clasp) R 1816 1816 1658 0 -1 4202496 19508 0 0 0 5459 8 0 0 25 0 1 0 726494207 83476480 17510 268435456000 4194304 4785740 140734938648240 18446744073709551615 4416832 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/1818/statm: 20380 17510 338 145 0 17425 0
[pid=1819] ppid=1816 vsize=469424 CPUtime=54.67 cores=2
/proc/1819/stat : 1819 (TNM) R 1816 1816 1658 0 -1 4202496 7656 0 0 0 5464 3 0 0 25 0 1 0 726494207 480690176 7554 268435456000 134512640 134534564 4287243040 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/1819/statm: 117356 7554 95 6 0 116021 0
[pid=1820] ppid=1816 vsize=65696 CPUtime=54.67 cores=3
/proc/1820/stat : 1820 (march_hi) R 1816 1816 1658 0 -1 4202496 32675 0 0 0 5460 7 0 0 25 0 1 0 726494207 67272704 7736 268435456000 4194304 4331988 140733740910416 18446744073709551615 4228270 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/1820/statm: 16424 7736 173 34 0 14866 0
[pid=1821] ppid=1816 vsize=1378272 CPUtime=1358.24 cores=4-31
/proc/1821/stat : 1821 (plingeling) S 1816 1816 1658 0 -1 4202496 286542 1243 0 0 135476 347 0 1 18 0 3 0 726494207 1411350528 195783 268435456000 4194304 4356188 140736513906912 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 18 0 0 0
/proc/1821/statm: 344568 195783 160 40 0 343112 0
[pid=1821/tid=1829] ppid=1816 vsize=1378272 CPUtime=48.41 cores=4-31
/proc/1821/task/1829/stat : 1829 (plingeling) R 1816 1816 1658 0 -1 4202560 7782 1243 0 0 4827 13 0 1 25 0 3 0 726494809 1411350528 195783 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331055 0 0 4096 17442 0 0 0 -1 4 0 0 0
[pid=1821/tid=1839] ppid=1816 vsize=1378272 CPUtime=48.5 cores=4-31
/proc/1821/task/1839/stat : 1839 (plingeling) R 1816 1816 1658 0 -1 4202560 5702 1243 0 0 4841 8 0 1 25 0 3 0 726494810 1411350528 195783 268435456000 4194304 4356188 140736513906912 18446744073709551615 4331151 0 0 4096 17442 0 0 0 -1 12 0 0 0
Current children cumulated CPU time (s) 1576.93
Current children cumulated vsize (KiB) 2279788

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1816 and gives
#  childrusage.ru_utime.tv_sec=1518
#  childrusage.ru_utime.tv_usec=880095
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=794423
# CPU time returned by wait4() is 1522.67
# while last known CPU time is 1576.93
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 54.7933
CPU time (s): 1576.93
CPU user time (s): 1573.18
CPU system time (s): 3.75
CPU usage (%): 2877.96
Max. virtual memory (cumulated for all children) (KiB): 2457828

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1518.88
system time used= 3.79442
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 356804
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3777
involuntary context switches= 3621

runsolver used 0.313952 second user time and 1.18482 second system time

The end

Launcher Data 

Begin job on node200 at 2011-05-23 13:27:58
IDJOB=3347713
IDBENCH=88066
IDSOLVER=1808
FILE ID=node200/3347713-1306150077
RUNJOBID= node200-1306150053-1672
PBS_JOBID= 13387845
Free space on /tmp= 62044 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT02/industrial/nam/fpga-routing/k2fix_gr_rcs_w9.shuffled.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3347713-1306150077/watcher-3347713-1306150077 -o /tmp/evaluation-result-3347713-1306150077/solver-3347713-1306150077 -C 160000 -W 5100 -M 266338304  ppfolio HOME/instance-3347713-1306150077.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 3469bb30890bba597175d692c3430b0e
RANDOM SEED=542903098

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255297556 kB
Buffers:        459932 kB
Cached:        8076524 kB
SwapCached:          0 kB
Active:        7625876 kB
Inactive:       979720 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255297556 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           15876 kB
Writeback:           0 kB
AnonPages:       69588 kB
Mapped:          14532 kB
Slab:           254320 kB
PageTables:       4020 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   191144 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62032 MiB
End job on node200 at 2011-05-23 13:28:53