Trace number 3347455

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 160003 5009.34

General information on the benchmark

Nameapplication/jarvisalo/smtqfbv-aigs/
smtlib-qfbv-aigs-countbits128-tseitin.cnf
MD5SUM47da9e46b00ffd3e0b0f453a6c3c9f38
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkUNSAT
Best CPU time to get the best result obtained on this benchmark122099
Satisfiable
(Un)Satisfiability was proved
Number of variables95810
Number of clauses287045
Sum of the clauses size669769
Maximum clause length3
Minimum clause length1
Number of clauses of size 12
Number of clauses of size 2191362
Number of clauses of size 395681
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 32 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	[5] plingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 1
0.00/0.00	Starting TNM 2009 on core(s) 2
0.00/0.00	Starting march_hi 2009 on core(s) 3
0.00/0.00	Starting plingeling 276-6264d55-100731 on core(s) 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 961)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3347455-1305174644/watcher-3347455-1305174644 -o /tmp/evaluation-result-3347455-1305174644/solver-3347455-1305174644 -C 160000 -W 5100 -M 266338304 ppfolio HOME/instance-3347455-1305174644.cnf 

running on 32 cores: 0,4,8,12,16,20,24,28,1,5,9,13,17,21,25,29,2,6,10,14,18,22,26,30,3,7,11,15,19,23,27,31

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 160000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 160030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5100 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 272730423296 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 272730474496 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 29.79 31.73 31.96 1/413 15760
/proc/meminfo: memFree=255742216/264257624 swapFree=67111528/67111528
[pid=15760] ppid=15758 vsize=18324 CPUtime=0 cores=0-31
/proc/15760/stat : 15760 (ppfolio) S 15758 15760 15734 0 -1 4202496 511 0 0 0 0 0 0 0 20 0 1 0 628950856 18763776 385 268435456000 4194304 4287625 140733832244416 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 8 0 0 0
/proc/15760/statm: 4581 385 337 23 0 91 0

[startup+0.113367 s]
/proc/loadavg: 29.79 31.73 31.96 1/413 15760
/proc/meminfo: memFree=255742216/264257624 swapFree=67111528/67111528
[pid=15760] ppid=15758 vsize=18324 CPUtime=0 cores=0-31
/proc/15760/stat : 15760 (ppfolio) S 15758 15760 15734 0 -1 4202496 511 0 0 0 0 0 0 0 20 0 1 0 628950856 18763776 385 268435456000 4194304 4287625 140733832244416 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 8 0 0 0
/proc/15760/statm: 4581 385 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.200399 s]
/proc/loadavg: 29.79 31.73 31.96 1/413 15760
/proc/meminfo: memFree=255742216/264257624 swapFree=67111528/67111528
[pid=15760] ppid=15758 vsize=18324 CPUtime=0 cores=0-31
/proc/15760/stat : 15760 (ppfolio) S 15758 15760 15734 0 -1 4202496 511 0 0 0 0 0 0 0 20 0 1 0 628950856 18763776 385 268435456000 4194304 4287625 140733832244416 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 8 0 0 0
/proc/15760/statm: 4581 385 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300364 s]
/proc/loadavg: 29.79 31.73 31.96 1/413 15760
/proc/meminfo: memFree=255742216/264257624 swapFree=67111528/67111528
[pid=15760] ppid=15758 vsize=18324 CPUtime=0 cores=0-31
/proc/15760/stat : 15760 (ppfolio) S 15758 15760 15734 0 -1 4202496 511 0 0 0 0 0 0 0 18 0 1 0 628950856 18763776 385 268435456000 4194304 4287625 140733832244416 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 8 0 0 0
/proc/15760/statm: 4581 385 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700361 s]
/proc/loadavg: 29.79 31.73 31.96 1/413 15760
/proc/meminfo: memFree=255742216/264257624 swapFree=67111528/67111528
[pid=15760] ppid=15758 vsize=18324 CPUtime=0 cores=0-31
/proc/15760/stat : 15760 (ppfolio) S 15758 15760 15734 0 -1 4202496 511 0 0 0 0 0 0 0 18 0 1 0 628950856 18763776 385 268435456000 4194304 4287625 140733832244416 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 8 0 0 0
/proc/15760/statm: 4581 385 337 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50137 s]
/proc/loadavg: 27.80 31.29 31.82 6/419 15771
/proc/meminfo: memFree=255459204/264257624 swapFree=67111528/67111528
[pid=15760] ppid=15758 vsize=18324 CPUtime=0 cores=0-31
/proc/15760/stat : 15760 (ppfolio) S 15758 15760 15734 0 -1 4202496 511 0 0 0 0 0 0 0 18 0 1 0 628950856 18763776 385 268435456000 4194304 4287625 140733832244416 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 8 0 0 0
/proc/15760/statm: 4581 385 337 23 0 91 0
[pid=15761] ppid=15760 vsize=57932 CPUtime=1.49 cores=0
/proc/15761/stat : 15761 (cryptominisat) R 15760 15760 15734 0 -1 4202496 8954 0 0 0 146 3 0 0 20 0 1 0 628950857 59322368 8649 268435456000 4194304 4587354 140733945100816 18446744073709551615 4237665 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15761/statm: 14483 8649 304 96 0 11045 0
[pid=15762] ppid=15760 vsize=65492 CPUtime=1.48 cores=1
/proc/15762/stat : 15762 (clasp) R 15760 15760 15734 0 -1 4202496 17019 0 0 0 144 4 0 0 20 0 1 0 628950857 67063808 13370 268435456000 4194304 4785740 140736412701616 18446744073709551615 4536814 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/15762/statm: 16373 13370 331 145 0 13418 0
[pid=15763] ppid=15760 vsize=471932 CPUtime=1.48 cores=2
/proc/15763/stat : 15763 (TNM) R 15760 15760 15734 0 -1 4202496 10063 0 0 0 145 3 0 0 20 0 1 0 628950857 483258368 9961 268435456000 134512640 134534564 4294935424 18446744073709551615 134529953 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/15763/statm: 117983 9961 95 6 0 116648 0
[pid=15764] ppid=15760 vsize=59880 CPUtime=1.49 cores=3
/proc/15764/stat : 15764 (march_hi) R 15760 15760 15734 0 -1 4202496 56654 0 0 0 135 14 0 0 20 0 1 0 628950857 61317120 10741 268435456000 4194304 4331988 140736273096960 18446744073709551615 4251649 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/15764/statm: 14970 10741 142 34 0 13412 0
[pid=15765] ppid=15760 vsize=164948 CPUtime=1.48 cores=4-31
/proc/15765/stat : 15765 (plingeling) R 15760 15760 15734 0 -1 4202496 39942 1237 0 0 138 10 0 0 21 0 1 0 628950857 168906752 39827 268435456000 4194304 4356188 140737227048768 18446744073709551615 258650649933 0 0 4096 17442 0 0 0 17 11 0 0 0
/proc/15765/statm: 41237 39834 129 40 0 39781 0
Current children cumulated CPU time (s) 7.42
Current children cumulated vsize (KiB) 838508

[startup+3.10143 s]
/proc/loadavg: 27.80 31.29 31.82 6/419 15771
/proc/meminfo: memFree=255283256/264257624 swapFree=67111528/67111528
[pid=15760] ppid=15758 vsize=18324 CPUtime=0 cores=0-31
/proc/15760/stat : 15760 (ppfolio) S 15758 15760 15734 0 -1 4202496 511 0 0 0 0 0 0 0 15 0 1 0 628950856 18763776 385 268435456000 4194304 4287625 140733832244416 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 8 0 0 0
/proc/15760/statm: 4581 385 337 23 0 91 0
[pid=15761] ppid=15760 vsize=76168 CPUtime=3.08 cores=0
/proc/15761/stat : 15761 (cryptominisat) R 15760 15760 15734 0 -1 4202496 13514 0 0 0 304 4 0 0 25 0 1 0 628950857 77996032 13209 268435456000 4194304 4587354 140733945100816 18446744073709551615 4421069 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15761/statm: 19042 13209 310 96 0 15604 0
[pid=15762] ppid=15760 vsize=65492 CPUtime=3.08 cores=1
/proc/15762/stat : 15762 (clasp) R 15760 15760 15734 0 -1 4202496 17026 0 0 0 304 4 0 0 25 0 1 0 628950857 67063808 13377 268435456000 4194304 4785740 140736412701616 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/15762/statm: 16373 13377 338 145 0 13418 0
[pid=15763] ppid=15760 vsize=475760 CPUtime=3.08 cores=2
/proc/15763/stat : 15763 (TNM) R 15760 15760 15734 0 -1 4202496 10064 0 0 0 305 3 0 0 25 0 1 0 628950857 487178240 9962 268435456000 134512640 134534564 4294935424 18446744073709551615 3902468 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/15763/statm: 118940 9962 95 6 0 117605 0
[pid=15764] ppid=15760 vsize=189488 CPUtime=3.09 cores=3
/proc/15764/stat : 15764 (march_hi) R 15760 15760 15734 0 -1 4202496 82201 0 0 0 291 18 0 0 25 0 1 0 628950857 194035712 22388 268435456000 4194304 4331988 140736273096960 18446744073709551615 4226543 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/15764/statm: 47372 22388 168 34 0 45814 0
[pid=15765] ppid=15760 vsize=342864 CPUtime=3.07 cores=4-31
/proc/15765/stat : 15765 (plingeling) R 15760 15760 15734 0 -1 4202496 84490 1237 0 0 289 18 0 0 25 0 1 0 628950857 351092736 84375 268435456000 4194304 4356188 140737227048768 18446744073709551615 4278302 0 0 4096 17442 0 0 0 17 11 0 0 0
/proc/15765/statm: 85716 84375 129 40 0 84260 0
Current children cumulated CPU time (s) 15.4
Current children cumulated vsize (KiB) 1168096

[startup+6.30251 s]
/proc/loadavg: 28.14 31.30 31.82 33/447 15799
/proc/meminfo: memFree=254793516/264257624 swapFree=67111528/67111528
[pid=15760] ppid=15758 vsize=18324 CPUtime=0 cores=0-31
/proc/15760/stat : 15760 (ppfolio) S 15758 15760 15734 0 -1 4202496 511 0 0 0 0 0 0 0 15 0 1 0 628950856 18763776 385 268435456000 4194304 4287625 140733832244416 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 8 0 0 0
/proc/15760/statm: 4581 385 337 23 0 91 0
[pid=15761] ppid=15760 vsize=76168 CPUtime=6.28 cores=0
/proc/15761/stat : 15761 (cryptominisat) R 15760 15760 15734 0 -1 4202496 13514 0 0 0 624 4 0 0 25 0 1 0 628950857 77996032 13209 268435456000 4194304 4587354 140733945100816 18446744073709551615 4421100 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15761/statm: 19042 13209 310 96 0 15604 0
[pid=15762] ppid=15760 vsize=67776 CPUtime=6.29 cores=1
/proc/15762/stat : 15762 (clasp) R 15760 15760 15734 0 -1 4202496 17621 0 0 0 624 5 0 0 25 0 1 0 628950857 69402624 13972 268435456000 4194304 4785740 140736412701616 18446744073709551615 4312619 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/15762/statm: 16944 13972 338 145 0 13989 0
[pid=15763] ppid=15760 vsize=475760 CPUtime=6.28 cores=2
/proc/15763/stat : 15763 (TNM) R 15760 15760 15734 0 -1 4202496 10064 0 0 0 625 3 0 0 25 0 1 0 628950857 487178240 9962 268435456000 134512640 134534564 4294935424 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/15763/statm: 118940 9962 95 6 0 117605 0
[pid=15764] ppid=15760 vsize=202308 CPUtime=6.29 cores=3
/proc/15764/stat : 15764 (march_hi) R 15760 15760 15734 0 -1 4202496 97485 0 0 0 608 21 0 0 25 0 1 0 628950857 207163392 37672 268435456000 4194304 4331988 140736273096960 18446744073709551615 4229539 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/15764/statm: 50577 37672 172 34 0 49019 0
[pid=15765] ppid=15760 vsize=1107824 CPUtime=58.82 cores=4-31
/proc/15765/stat : 15765 (plingeling) S 15760 15760 15734 0 -1 4202496 270730 1237 0 0 5648 234 0 0 18 0 29 0 628950857 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 23 0 0 0
/proc/15765/statm: 276956 173512 148 40 0 275500 0
[pid=15765/tid=15772] ppid=15760 vsize=1107824 CPUtime=1.95 cores=4-31
/proc/15765/task/15772/stat : 15772 (plingeling) R 15760 15760 15734 0 -1 4202560 5685 1237 0 0 187 8 0 0 25 0 29 0 628951274 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4210557 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=15765/tid=15773] ppid=15760 vsize=1107824 CPUtime=1.94 cores=4-31
/proc/15765/task/15773/stat : 15773 (plingeling) R 15760 15760 15734 0 -1 4202560 5214 1237 0 0 188 6 0 0 19 0 29 0 628951274 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4258922 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15765/tid=15774] ppid=15760 vsize=1107824 CPUtime=1.87 cores=4-31
/proc/15765/task/15774/stat : 15774 (plingeling) R 15760 15760 15734 0 -1 4202560 5232 1237 0 0 185 2 0 0 18 0 29 0 628951274 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4260245 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=15765/tid=15775] ppid=15760 vsize=1107824 CPUtime=1.91 cores=4-31
/proc/15765/task/15775/stat : 15775 (plingeling) R 15760 15760 15734 0 -1 4202560 5299 1237 0 0 180 11 0 0 19 0 29 0 628951274 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4244699 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=15765/tid=15776] ppid=15760 vsize=1107824 CPUtime=1.91 cores=4-31
/proc/15765/task/15776/stat : 15776 (plingeling) R 15760 15760 15734 0 -1 4202560 3402 1237 0 0 182 9 0 0 18 0 29 0 628951275 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4212263 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=15765/tid=15777] ppid=15760 vsize=1107824 CPUtime=1.91 cores=4-31
/proc/15765/task/15777/stat : 15777 (plingeling) R 15760 15760 15734 0 -1 4202560 5924 1237 0 0 182 9 0 0 25 0 29 0 628951275 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4244324 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=15765/tid=15778] ppid=15760 vsize=1107824 CPUtime=1.93 cores=4-31
/proc/15765/task/15778/stat : 15778 (plingeling) R 15760 15760 15734 0 -1 4202560 3638 1237 0 0 187 6 0 0 19 0 29 0 628951275 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4260245 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=15765/tid=15779] ppid=15760 vsize=1107824 CPUtime=2.07 cores=4-31
/proc/15765/task/15779/stat : 15779 (plingeling) R 15760 15760 15734 0 -1 4202560 7587 1237 0 0 200 7 0 0 20 0 29 0 628951275 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4260345 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=15765/tid=15780] ppid=15760 vsize=1107824 CPUtime=1.99 cores=4-31
/proc/15765/task/15780/stat : 15780 (plingeling) R 15760 15760 15734 0 -1 4202560 5977 1237 0 0 191 8 0 0 19 0 29 0 628951275 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4244400 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=15765/tid=15781] ppid=15760 vsize=1107824 CPUtime=1.87 cores=4-31
/proc/15765/task/15781/stat : 15781 (plingeling) R 15760 15760 15734 0 -1 4202560 4219 1237 0 0 181 6 0 0 19 0 29 0 628951275 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4244483 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15765/tid=15782] ppid=15760 vsize=1107824 CPUtime=1.97 cores=4-31
/proc/15765/task/15782/stat : 15782 (plingeling) R 15760 15760 15734 0 -1 4202560 4005 1237 0 0 190 7 0 0 19 0 29 0 628951275 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4262956 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=15765/tid=15783] ppid=15760 vsize=1107824 CPUtime=1.99 cores=4-31
/proc/15765/task/15783/stat : 15783 (plingeling) R 15760 15760 15734 0 -1 4202560 5367 1237 0 0 193 6 0 0 19 0 29 0 628951275 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4244324 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=15765/tid=15784] ppid=15760 vsize=1107824 CPUtime=1.95 cores=4-31
/proc/15765/task/15784/stat : 15784 (plingeling) R 15760 15760 15734 0 -1 4202560 5800 1237 0 0 187 8 0 0 25 0 29 0 628951275 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4259314 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=15765/tid=15785] ppid=15760 vsize=1107824 CPUtime=1.92 cores=4-31
/proc/15765/task/15785/stat : 15785 (plingeling) R 15760 15760 15734 0 -1 4202560 6809 1237 0 0 184 8 0 0 18 0 29 0 628951275 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4244400 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=15765/tid=15786] ppid=15760 vsize=1107824 CPUtime=1.99 cores=4-31
/proc/15765/task/15786/stat : 15786 (plingeling) R 15760 15760 15734 0 -1 4202560 3478 1237 0 0 193 6 0 0 20 0 29 0 628951275 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4259346 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15765/tid=15787] ppid=15760 vsize=1107824 CPUtime=1.94 cores=4-31
/proc/15765/task/15787/stat : 15787 (plingeling) R 15760 15760 15734 0 -1 4202560 4507 1237 0 0 187 7 0 0 25 0 29 0 628951275 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4261279 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=15765/tid=15788] ppid=15760 vsize=1107824 CPUtime=1.94 cores=4-31
/proc/15765/task/15788/stat : 15788 (plingeling) R 15760 15760 15734 0 -1 4202560 5826 1237 0 0 189 5 0 0 19 0 29 0 628951275 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4262944 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=15765/tid=15789] ppid=15760 vsize=1107824 CPUtime=2.03 cores=4-31
/proc/15765/task/15789/stat : 15789 (plingeling) R 15760 15760 15734 0 -1 4202560 7077 1237 0 0 196 7 0 0 20 0 29 0 628951276 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4245463 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=15765/tid=15790] ppid=15760 vsize=1107824 CPUtime=1.94 cores=4-31
/proc/15765/task/15790/stat : 15790 (plingeling) R 15760 15760 15734 0 -1 4202560 3997 1237 0 0 187 7 0 0 19 0 29 0 628951276 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4259390 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=15765/tid=15791] ppid=15760 vsize=1107824 CPUtime=1.87 cores=4-31
/proc/15765/task/15791/stat : 15791 (plingeling) R 15760 15760 15734 0 -1 4202560 7452 1237 0 0 177 10 0 0 19 0 29 0 628951276 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4244400 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=15765/tid=15792] ppid=15760 vsize=1107824 CPUtime=1.95 cores=4-31
/proc/15765/task/15792/stat : 15792 (plingeling) R 15760 15760 15734 0 -1 4202560 6777 1237 0 0 188 7 0 0 19 0 29 0 628951276 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4259314 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=15765/tid=15793] ppid=15760 vsize=1107824 CPUtime=2.04 cores=4-31
/proc/15765/task/15793/stat : 15793 (plingeling) R 15760 15760 15734 0 -1 4202560 6789 1237 0 0 198 6 0 0 20 0 29 0 628951276 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4267675 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=15765/tid=15794] ppid=15760 vsize=1107824 CPUtime=1.94 cores=4-31
/proc/15765/task/15794/stat : 15794 (plingeling) R 15760 15760 15734 0 -1 4202560 5612 1237 0 0 190 4 0 0 19 0 29 0 628951276 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4244260 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=15765/tid=15795] ppid=15760 vsize=1107824 CPUtime=1.92 cores=4-31
/proc/15765/task/15795/stat : 15795 (plingeling) R 15760 15760 15734 0 -1 4202560 5980 1237 0 0 185 7 0 0 18 0 29 0 628951276 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4244324 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=15765/tid=15796] ppid=15760 vsize=1107824 CPUtime=1.9 cores=4-31
/proc/15765/task/15796/stat : 15796 (plingeling) R 15760 15760 15734 0 -1 4202560 8510 1237 0 0 180 10 0 0 19 0 29 0 628951276 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4244483 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=15765/tid=15797] ppid=15760 vsize=1107824 CPUtime=1.86 cores=4-31
/proc/15765/task/15797/stat : 15797 (plingeling) R 15760 15760 15734 0 -1 4202560 6821 1237 0 0 175 11 0 0 21 0 29 0 628951276 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4244400 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=15765/tid=15798] ppid=15760 vsize=1107824 CPUtime=1.89 cores=4-31
/proc/15765/task/15798/stat : 15798 (plingeling) R 15760 15760 15734 0 -1 4202560 3480 1237 0 0 188 1 0 0 19 0 29 0 628951276 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4247443 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=15765/tid=15799] ppid=15760 vsize=1107824 CPUtime=2.01 cores=4-31
/proc/15765/task/15799/stat : 15799 (plingeling) R 15760 15760 15734 0 -1 4202560 7066 1237 0 0 193 8 0 0 20 0 29 0 628951276 1134411776 173512 268435456000 4194304 4356188 140737227048768 18446744073709551615 4244400 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 83.96
Current children cumulated vsize (KiB) 1948160

[startup+12.7017 s]
/proc/loadavg: 28.45 31.31 31.82 33/447 15799
/proc/meminfo: memFree=254516024/264257624 swapFree=67111528/67111528
[pid=15760] ppid=15758 vsize=18324 CPUtime=0 cores=0-31
/proc/15760/stat : 15760 (ppfolio) S 15758 15760 15734 0 -1 4202496 511 0 0 0 0 0 0 0 15 0 1 0 628950856 18763776 385 268435456000 4194304 4287625 140733832244416 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 8 0 0 0
/proc/15760/statm: 4581 385 337 23 0 91 0
[pid=15761] ppid=15760 vsize=156696 CPUtime=12.69 cores=0
/proc/15761/stat : 15761 (cryptominisat) R 15760 15760 15734 0 -1 4202496 31704 0 0 0 1261 8 0 0 25 0 1 0 628950857 160456704 24792 268435456000 4194304 4587354 140733945100816 18446744073709551615 4238421 0 0 4096 2 0 0 0 17 0 0 0 0

################
# More data... #
################

[pid=15763] ppid=15760 vsize=475764 CPUtime=4961.23 cores=2
/proc/15763/stat : 15763 (TNM) R 15760 15760 15734 0 -1 4202496 10073 0 0 0 496120 3 0 0 25 0 1 0 628950857 487182336 9971 268435456000 134512640 134534564 4294935424 18446744073709551615 134529640 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/15763/statm: 118941 9971 103 6 0 117606 0
[pid=15764] ppid=15760 vsize=887620 CPUtime=4961.36 cores=3
/proc/15764/stat : 15764 (march_hi) R 15760 15760 15734 0 -1 4202496 233642 0 0 0 496043 93 0 0 25 0 1 0 628950857 908922880 173414 268435456000 4194304 4331988 140736273096960 18446744073709551615 4287234 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/15764/statm: 221905 173414 235 34 0 220347 0
[pid=15765] ppid=15760 vsize=4451872 CPUtime=138656 cores=4-31
/proc/15765/stat : 15765 (plingeling) S 15760 15760 15734 0 -1 4202496 4156422 1237 0 0 13863113 2453 0 0 18 0 29 0 628950857 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 23 0 0 0
/proc/15765/statm: 1112968 997783 159 40 0 1111512 0
[pid=15765/tid=15772] ppid=15760 vsize=4451872 CPUtime=4956.96 cores=4-31
/proc/15765/task/15772/stat : 15772 (plingeling) R 15760 15760 15734 0 -1 4202560 315262 1237 0 0 495526 170 0 0 25 0 29 0 628951274 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4237470 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=15765/tid=15773] ppid=15760 vsize=4451872 CPUtime=4919.05 cores=4-31
/proc/15765/task/15773/stat : 15773 (plingeling) R 15760 15760 15734 0 -1 4202560 42564 1237 0 0 491891 14 0 0 25 0 29 0 628951274 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=15765/tid=15774] ppid=15760 vsize=4451872 CPUtime=4956.85 cores=4-31
/proc/15765/task/15774/stat : 15774 (plingeling) R 15760 15760 15734 0 -1 4202560 318600 1237 0 0 495409 276 0 0 25 0 29 0 628951274 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=15765/tid=15775] ppid=15760 vsize=4451872 CPUtime=4956.9 cores=4-31
/proc/15765/task/15775/stat : 15775 (plingeling) R 15760 15760 15734 0 -1 4202560 228473 1237 0 0 495602 88 0 0 25 0 29 0 628951274 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=15765/tid=15776] ppid=15760 vsize=4451872 CPUtime=4956.95 cores=4-31
/proc/15765/task/15776/stat : 15776 (plingeling) R 15760 15760 15734 0 -1 4202560 37377 1237 0 0 495669 26 0 0 25 0 29 0 628951275 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4281557 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=15765/tid=15777] ppid=15760 vsize=4451872 CPUtime=4956.95 cores=4-31
/proc/15765/task/15777/stat : 15777 (plingeling) R 15760 15760 15734 0 -1 4202560 163559 1237 0 0 495593 102 0 0 25 0 29 0 628951275 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=15765/tid=15778] ppid=15760 vsize=4451872 CPUtime=4956.95 cores=4-31
/proc/15765/task/15778/stat : 15778 (plingeling) R 15760 15760 15734 0 -1 4202560 177305 1237 0 0 495578 117 0 0 25 0 29 0 628951275 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331451 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=15765/tid=15779] ppid=15760 vsize=4451872 CPUtime=4956.99 cores=4-31
/proc/15765/task/15779/stat : 15779 (plingeling) R 15760 15760 15734 0 -1 4202560 145204 1237 0 0 495611 88 0 0 25 0 29 0 628951275 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=15765/tid=15780] ppid=15760 vsize=4451872 CPUtime=4957.06 cores=4-31
/proc/15765/task/15780/stat : 15780 (plingeling) R 15760 15760 15734 0 -1 4202560 237981 1237 0 0 495631 75 0 0 25 0 29 0 628951275 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4330969 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=15765/tid=15781] ppid=15760 vsize=4451872 CPUtime=4898.92 cores=4-31
/proc/15765/task/15781/stat : 15781 (plingeling) R 15760 15760 15734 0 -1 4202560 40079 1237 0 0 489859 33 0 0 25 0 29 0 628951275 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4283954 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15765/tid=15782] ppid=15760 vsize=4451872 CPUtime=4956.93 cores=4-31
/proc/15765/task/15782/stat : 15782 (plingeling) R 15760 15760 15734 0 -1 4202560 102948 1237 0 0 495631 62 0 0 25 0 29 0 628951275 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331011 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=15765/tid=15783] ppid=15760 vsize=4451872 CPUtime=4957.06 cores=4-31
/proc/15765/task/15783/stat : 15783 (plingeling) R 15760 15760 15734 0 -1 4202560 66410 1237 0 0 495679 27 0 0 25 0 29 0 628951275 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=15765/tid=15784] ppid=15760 vsize=4451872 CPUtime=4954.67 cores=4-31
/proc/15765/task/15784/stat : 15784 (plingeling) R 15760 15760 15734 0 -1 4202560 116887 1237 0 0 495364 103 0 0 25 0 29 0 628951275 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4283920 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=15765/tid=15785] ppid=15760 vsize=4451872 CPUtime=4956.99 cores=4-31
/proc/15765/task/15785/stat : 15785 (plingeling) R 15760 15760 15734 0 -1 4202560 96998 1237 0 0 495651 48 0 0 25 0 29 0 628951275 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4284052 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=15765/tid=15786] ppid=15760 vsize=4451872 CPUtime=4957.06 cores=4-31
/proc/15765/task/15786/stat : 15786 (plingeling) R 15760 15760 15734 0 -1 4202560 26901 1237 0 0 495681 25 0 0 25 0 29 0 628951275 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4237203 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15765/tid=15787] ppid=15760 vsize=4451872 CPUtime=4957.01 cores=4-31
/proc/15765/task/15787/stat : 15787 (plingeling) R 15760 15760 15734 0 -1 4202560 219000 1237 0 0 495477 224 0 0 25 0 29 0 628951275 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4283920 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=15765/tid=15788] ppid=15760 vsize=4451872 CPUtime=4955.5 cores=4-31
/proc/15765/task/15788/stat : 15788 (plingeling) R 15760 15760 15734 0 -1 4202560 40151 1237 0 0 495529 21 0 0 25 0 29 0 628951275 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331366 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=15765/tid=15789] ppid=15760 vsize=4451872 CPUtime=4957.08 cores=4-31
/proc/15765/task/15789/stat : 15789 (plingeling) R 15760 15760 15734 0 -1 4202560 54121 1237 0 0 495678 30 0 0 25 0 29 0 628951276 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4281782 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=15765/tid=15790] ppid=15760 vsize=4451872 CPUtime=4956.94 cores=4-31
/proc/15765/task/15790/stat : 15790 (plingeling) R 15760 15760 15734 0 -1 4202560 219138 1237 0 0 495547 147 0 0 25 0 29 0 628951276 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4284014 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=15765/tid=15791] ppid=15760 vsize=4451872 CPUtime=4956.92 cores=4-31
/proc/15765/task/15791/stat : 15791 (plingeling) R 15760 15760 15734 0 -1 4202560 210642 1237 0 0 495600 92 0 0 25 0 29 0 628951276 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4238570 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=15765/tid=15792] ppid=15760 vsize=4451872 CPUtime=4957.01 cores=4-31
/proc/15765/task/15792/stat : 15792 (plingeling) R 15760 15760 15734 0 -1 4202560 119468 1237 0 0 495661 40 0 0 25 0 29 0 628951276 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4210740 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=15765/tid=15793] ppid=15760 vsize=4451872 CPUtime=4957.1 cores=4-31
/proc/15765/task/15793/stat : 15793 (plingeling) R 15760 15760 15734 0 -1 4202560 190820 1237 0 0 495631 79 0 0 25 0 29 0 628951276 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331062 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=15765/tid=15794] ppid=15760 vsize=4451872 CPUtime=4956.99 cores=4-31
/proc/15765/task/15794/stat : 15794 (plingeling) R 15760 15760 15734 0 -1 4202560 57344 1237 0 0 495676 23 0 0 25 0 29 0 628951276 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331060 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=15765/tid=15795] ppid=15760 vsize=4451872 CPUtime=4956.98 cores=4-31
/proc/15765/task/15795/stat : 15795 (plingeling) R 15760 15760 15734 0 -1 4202560 177369 1237 0 0 495563 135 0 0 25 0 29 0 628951276 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4244400 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=15765/tid=15796] ppid=15760 vsize=4451872 CPUtime=4956.4 cores=4-31
/proc/15765/task/15796/stat : 15796 (plingeling) R 15760 15760 15734 0 -1 4202560 135794 1237 0 0 495580 60 0 0 25 0 29 0 628951276 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15765/tid=15797] ppid=15760 vsize=4451872 CPUtime=4913.03 cores=4-31
/proc/15765/task/15797/stat : 15797 (plingeling) R 15760 15760 15734 0 -1 4202560 48888 1237 0 0 491274 29 0 0 25 0 29 0 628951276 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331309 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=15765/tid=15798] ppid=15760 vsize=4451872 CPUtime=4956.95 cores=4-31
/proc/15765/task/15798/stat : 15798 (plingeling) R 15760 15760 15734 0 -1 4202560 187040 1237 0 0 495558 137 0 0 25 0 29 0 628951276 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331337 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=15765/tid=15799] ppid=15760 vsize=4451872 CPUtime=4957 cores=4-31
/proc/15765/task/15799/stat : 15799 (plingeling) R 15760 15760 15734 0 -1 4202560 266899 1237 0 0 495559 141 0 0 25 0 29 0 628951276 4558716928 997783 268435456000 4194304 4356188 140737227048768 18446744073709551615 4284187 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 158500
Current children cumulated vsize (KiB) 7396876



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+5009.3 s]
/proc/loadavg: 32.12 32.09 32.07 33/447 15943
/proc/meminfo: memFree=249439716/264257624 swapFree=67111528/67111528
[pid=15760] ppid=15758 vsize=18324 CPUtime=0 cores=0-31
/proc/15760/stat : 15760 (ppfolio) S 15758 15760 15734 0 -1 4202496 511 0 0 0 0 0 0 0 15 0 1 0 628950856 18763776 385 268435456000 4194304 4287625 140733832244416 18446744073709551615 258650975999 0 0 4096 65536 9201901190399393791 0 0 17 8 0 0 0
/proc/15760/statm: 4581 385 337 23 0 91 0
[pid=15761] ppid=15760 vsize=475488 CPUtime=5008.34 cores=0
/proc/15761/stat : 15761 (cryptominisat) R 15760 15760 15734 0 -1 4202496 947832 0 0 0 500391 443 0 0 25 0 1 0 628950857 486899712 74053 268435456000 4194304 4587354 140733945100816 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15761/statm: 118872 74053 336 96 0 115434 0
[pid=15762] ppid=15760 vsize=1249232 CPUtime=5007.4 cores=1
/proc/15762/stat : 15762 (clasp) R 15760 15760 15734 0 -1 4202496 312017 0 0 0 500630 110 0 0 25 0 1 0 628950857 1279213568 308368 268435456000 4194304 4785740 140736412701616 18446744073709551615 4549040 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/15762/statm: 312308 308368 338 145 0 309353 0
[pid=15763] ppid=15760 vsize=475764 CPUtime=5008.24 cores=2
/proc/15763/stat : 15763 (TNM) R 15760 15760 15734 0 -1 4202496 10073 0 0 0 500821 3 0 0 25 0 1 0 628950857 487182336 9971 268435456000 134512640 134534564 4294935424 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 2 0 0 0
/proc/15763/statm: 118941 9971 103 6 0 117606 0
[pid=15764] ppid=15760 vsize=890484 CPUtime=5008.36 cores=3
/proc/15764/stat : 15764 (march_hi) R 15760 15760 15734 0 -1 4202496 234478 0 0 0 500743 93 0 0 25 0 1 0 628950857 911855616 174249 268435456000 4194304 4331988 140736273096960 18446744073709551615 4240137 0 0 4096 0 0 0 0 17 3 0 0 0
/proc/15764/statm: 222621 174249 235 34 0 221063 0
[pid=15765] ppid=15760 vsize=4490704 CPUtime=139971 cores=4-31
/proc/15765/stat : 15765 (plingeling) S 15760 15760 15734 0 -1 4202496 4203546 1237 0 0 13994581 2481 0 0 18 0 29 0 628950857 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 258662759221 0 0 4096 17442 18446744073709551615 0 0 17 23 0 0 0
/proc/15765/statm: 1122676 1007491 159 40 0 1121220 0
[pid=15765/tid=15772] ppid=15760 vsize=4490704 CPUtime=5003.97 cores=4-31
/proc/15765/task/15772/stat : 15772 (plingeling) R 15760 15760 15734 0 -1 4202560 322430 1237 0 0 500225 172 0 0 25 0 29 0 628951274 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4274287 0 0 4096 17442 0 0 0 -1 28 0 0 0
[pid=15765/tid=15773] ppid=15760 vsize=4490704 CPUtime=4964.73 cores=4-31
/proc/15765/task/15773/stat : 15773 (plingeling) R 15760 15760 15734 0 -1 4202560 46660 1237 0 0 496458 15 0 0 25 0 29 0 628951274 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331268 0 0 4096 17442 0 0 0 -1 31 0 0 0
[pid=15765/tid=15774] ppid=15760 vsize=4490704 CPUtime=5003.86 cores=4-31
/proc/15765/task/15774/stat : 15774 (plingeling) R 15760 15760 15734 0 -1 4202560 318600 1237 0 0 500110 276 0 0 25 0 29 0 628951274 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 26 0 0 0
[pid=15765/tid=15775] ppid=15760 vsize=4490704 CPUtime=5003.91 cores=4-31
/proc/15765/task/15775/stat : 15775 (plingeling) R 15760 15760 15734 0 -1 4202560 230521 1237 0 0 500298 93 0 0 25 0 29 0 628951274 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4281672 0 0 4096 17442 0 0 0 -1 11 0 0 0
[pid=15765/tid=15776] ppid=15760 vsize=4490704 CPUtime=5003.97 cores=4-31
/proc/15765/task/15776/stat : 15776 (plingeling) R 15760 15760 15734 0 -1 4202560 37383 1237 0 0 500371 26 0 0 25 0 29 0 628951275 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4273720 0 0 4096 17442 0 0 0 -1 8 0 0 0
[pid=15765/tid=15777] ppid=15760 vsize=4490704 CPUtime=5003.97 cores=4-31
/proc/15765/task/15777/stat : 15777 (plingeling) R 15760 15760 15734 0 -1 4202560 163559 1237 0 0 500294 103 0 0 25 0 29 0 628951275 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331074 0 0 4096 17442 0 0 0 -1 19 0 0 0
[pid=15765/tid=15778] ppid=15760 vsize=4490704 CPUtime=5003.96 cores=4-31
/proc/15765/task/15778/stat : 15778 (plingeling) R 15760 15760 15734 0 -1 4202560 178841 1237 0 0 500279 117 0 0 25 0 29 0 628951275 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4281706 0 0 4096 17442 0 0 0 -1 30 0 0 0
[pid=15765/tid=15779] ppid=15760 vsize=4490704 CPUtime=5004 cores=4-31
/proc/15765/task/15779/stat : 15779 (plingeling) R 15760 15760 15734 0 -1 4202560 145204 1237 0 0 500312 88 0 0 25 0 29 0 628951275 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4332046 0 0 4096 17442 0 0 0 -1 13 0 0 0
[pid=15765/tid=15780] ppid=15760 vsize=4490704 CPUtime=5004.08 cores=4-31
/proc/15765/task/15780/stat : 15780 (plingeling) R 15760 15760 15734 0 -1 4202560 237981 1237 0 0 500333 75 0 0 25 0 29 0 628951275 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 12 0 0 0
[pid=15765/tid=15781] ppid=15760 vsize=4490704 CPUtime=4945.93 cores=4-31
/proc/15765/task/15781/stat : 15781 (plingeling) R 15760 15760 15734 0 -1 4202560 40079 1237 0 0 494560 33 0 0 25 0 29 0 628951275 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4330986 0 0 4096 17442 0 0 0 -1 5 0 0 0
[pid=15765/tid=15782] ppid=15760 vsize=4490704 CPUtime=5003.94 cores=4-31
/proc/15765/task/15782/stat : 15782 (plingeling) R 15760 15760 15734 0 -1 4202560 102948 1237 0 0 500332 62 0 0 25 0 29 0 628951275 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4330982 0 0 4096 17442 0 0 0 -1 10 0 0 0
[pid=15765/tid=15783] ppid=15760 vsize=4490704 CPUtime=5004.07 cores=4-31
/proc/15765/task/15783/stat : 15783 (plingeling) R 15760 15760 15734 0 -1 4202560 66410 1237 0 0 500380 27 0 0 25 0 29 0 628951275 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4284028 0 0 4096 17442 0 0 0 -1 14 0 0 0
[pid=15765/tid=15784] ppid=15760 vsize=4490704 CPUtime=5001.66 cores=4-31
/proc/15765/task/15784/stat : 15784 (plingeling) R 15760 15760 15734 0 -1 4202560 116887 1237 0 0 500062 104 0 0 25 0 29 0 628951275 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331960 0 0 4096 17442 0 0 0 -1 16 0 0 0
[pid=15765/tid=15785] ppid=15760 vsize=4490704 CPUtime=5004 cores=4-31
/proc/15765/task/15785/stat : 15785 (plingeling) R 15760 15760 15734 0 -1 4202560 99046 1237 0 0 500351 49 0 0 25 0 29 0 628951275 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4210544 0 0 4096 17442 0 0 0 -1 27 0 0 0
[pid=15765/tid=15786] ppid=15760 vsize=4490704 CPUtime=5004.07 cores=4-31
/proc/15765/task/15786/stat : 15786 (plingeling) R 15760 15760 15734 0 -1 4202560 26901 1237 0 0 500382 25 0 0 25 0 29 0 628951275 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 6 0 0 0
[pid=15765/tid=15787] ppid=15760 vsize=4490704 CPUtime=5004.03 cores=4-31
/proc/15765/task/15787/stat : 15787 (plingeling) R 15760 15760 15734 0 -1 4202560 223096 1237 0 0 500178 225 0 0 25 0 29 0 628951275 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4244632 0 0 4096 17442 0 0 0 -1 24 0 0 0
[pid=15765/tid=15788] ppid=15760 vsize=4490704 CPUtime=5002.5 cores=4-31
/proc/15765/task/15788/stat : 15788 (plingeling) R 15760 15760 15734 0 -1 4202560 40159 1237 0 0 500229 21 0 0 25 0 29 0 628951275 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4330973 0 0 4096 17442 0 0 0 -1 20 0 0 0
[pid=15765/tid=15789] ppid=15760 vsize=4490704 CPUtime=5004.09 cores=4-31
/proc/15765/task/15789/stat : 15789 (plingeling) R 15760 15760 15734 0 -1 4202560 58217 1237 0 0 500378 31 0 0 25 0 29 0 628951276 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 25 0 0 0
[pid=15765/tid=15790] ppid=15760 vsize=4490704 CPUtime=5003.95 cores=4-31
/proc/15765/task/15790/stat : 15790 (plingeling) R 15760 15760 15734 0 -1 4202560 220674 1237 0 0 500247 148 0 0 25 0 29 0 628951276 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331035 0 0 4096 17442 0 0 0 -1 18 0 0 0
[pid=15765/tid=15791] ppid=15760 vsize=4490704 CPUtime=5003.93 cores=4-31
/proc/15765/task/15791/stat : 15791 (plingeling) R 15760 15760 15734 0 -1 4202560 210642 1237 0 0 500301 92 0 0 25 0 29 0 628951276 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4279656 0 0 4096 17442 0 0 0 -1 23 0 0 0
[pid=15765/tid=15792] ppid=15760 vsize=4490704 CPUtime=5004.03 cores=4-31
/proc/15765/task/15792/stat : 15792 (plingeling) R 15760 15760 15734 0 -1 4202560 121516 1237 0 0 500362 41 0 0 25 0 29 0 628951276 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331451 0 0 4096 17442 0 0 0 -1 29 0 0 0
[pid=15765/tid=15793] ppid=15760 vsize=4490704 CPUtime=5004.12 cores=4-31
/proc/15765/task/15793/stat : 15793 (plingeling) R 15760 15760 15734 0 -1 4202560 193380 1237 0 0 500332 80 0 0 25 0 29 0 628951276 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4284043 0 0 4096 17442 0 0 0 -1 9 0 0 0
[pid=15765/tid=15794] ppid=15760 vsize=4490704 CPUtime=5004.01 cores=4-31
/proc/15765/task/15794/stat : 15794 (plingeling) R 15760 15760 15734 0 -1 4202560 61440 1237 0 0 500368 33 0 0 25 0 29 0 628951276 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4279504 0 0 4096 17442 0 0 0 -1 17 0 0 0
[pid=15765/tid=15795] ppid=15760 vsize=4490704 CPUtime=5004 cores=4-31
/proc/15765/task/15795/stat : 15795 (plingeling) R 15760 15760 15734 0 -1 4202560 181465 1237 0 0 500264 136 0 0 25 0 29 0 628951276 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331154 0 0 4096 17442 0 0 0 -1 22 0 0 0
[pid=15765/tid=15796] ppid=15760 vsize=4490704 CPUtime=5003.41 cores=4-31
/proc/15765/task/15796/stat : 15796 (plingeling) R 15760 15760 15734 0 -1 4202560 135800 1237 0 0 500281 60 0 0 25 0 29 0 628951276 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4330960 0 0 4096 17442 0 0 0 -1 7 0 0 0
[pid=15765/tid=15797] ppid=15760 vsize=4490704 CPUtime=4960.04 cores=4-31
/proc/15765/task/15797/stat : 15797 (plingeling) R 15760 15760 15734 0 -1 4202560 48888 1237 0 0 495975 29 0 0 25 0 29 0 628951276 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4279478 0 0 4096 17442 0 0 0 -1 15 0 0 0
[pid=15765/tid=15798] ppid=15760 vsize=4490704 CPUtime=5003.97 cores=4-31
/proc/15765/task/15798/stat : 15798 (plingeling) R 15760 15760 15734 0 -1 4202560 190112 1237 0 0 500259 138 0 0 25 0 29 0 628951276 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4236941 0 0 4096 17442 0 0 0 -1 21 0 0 0
[pid=15765/tid=15799] ppid=15760 vsize=4490704 CPUtime=5004.01 cores=4-31
/proc/15765/task/15799/stat : 15799 (plingeling) R 15760 15760 15734 0 -1 4202560 271507 1237 0 0 500257 144 0 0 25 0 29 0 628951276 4598480896 1007491 268435456000 4194304 4356188 140737227048768 18446744073709551615 4331328 0 0 4096 17442 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 160003
Current children cumulated vsize (KiB) 7599996

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 15760 and gives
#  childrusage.ru_utime.tv_sec=5008
#  childrusage.ru_utime.tv_usec=223634
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=45993
# CPU time returned by wait4() is 5008.27
# while last known CPU time is 160003
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5009.34
CPU time (s): 160003
CPU user time (s): 159972
CPU system time (s): 31.3
CPU usage (%): 3194.09
Max. virtual memory (cumulated for all children) (KiB): 11001696

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5008.22
system time used= 0.045993
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 10585
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 513
involuntary context switches= 17522

runsolver used 28.2707 second user time and 113.548 second system time

The end

Launcher Data 

Begin job on node200 at 2011-05-12 06:30:44
IDJOB=3347455
IDBENCH=82462
IDSOLVER=1808
FILE ID=node200/3347455-1305174644
RUNJOBID= node200-1305174644-15748
PBS_JOBID= 13282077
Free space on /tmp= 62048 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/jarvisalo/smtqfbv-aigs/smtlib-qfbv-aigs-countbits128-tseitin.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3347455-1305174644/watcher-3347455-1305174644 -o /tmp/evaluation-result-3347455-1305174644/solver-3347455-1305174644 -C 160000 -W 5100 -M 266338304  ppfolio HOME/instance-3347455-1305174644.cnf

TIME LIMIT= 160000 seconds
MEMORY LIMIT= 266338304 MiB
NBCORE= 32

MD5SUM BENCH= 47da9e46b00ffd3e0b0f453a6c3c9f38
RANDOM SEED=2008712161

node200.alineos.net Linux 2.6.18-194.el5 #1 SMP Fri Apr 2 14:58:14 EDT 2010

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 32
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 64
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 0
cpu cores	: 8
apicid		: 96
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 34
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 66
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 1
cpu cores	: 8
apicid		: 98
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 36
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 68
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 2
cpu cores	: 8
apicid		: 100
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.02
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.17
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 38
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 70
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3989.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 3
cpu cores	: 8
apicid		: 102
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 16
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 17
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 48
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 18
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 80
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 19
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 8
cpu cores	: 8
apicid		: 112
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 20
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 21
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 50
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 22
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 82
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 23
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 9
cpu cores	: 8
apicid		: 114
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.23
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 24
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 25
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 52
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 26
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 84
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.08
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 27
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 10
cpu cores	: 8
apicid		: 116
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 28
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 0
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 29
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 1
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 54
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 30
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 2
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 86
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.05
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]

processor	: 31
vendor_id	: GenuineIntel
cpu family	: 6
model		: 46
model name	: Intel(R) Xeon(R) CPU           X7550  @ 2.00GHz
stepping	: 6
cpu MHz		: 1995.049
cache size	: 18432 KB
physical id	: 3
siblings	: 8
core id		: 11
cpu cores	: 8
apicid		: 118
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr sse4_1 sse4_2 popcnt lahf_lm
bogomips	: 3990.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 44 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     264257624 kB
MemFree:      255742620 kB
Buffers:        425764 kB
Cached:        7686132 kB
SwapCached:          0 kB
Active:        7256420 kB
Inactive:       924496 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     264257624 kB
LowFree:      255742620 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           14504 kB
Writeback:           0 kB
AnonPages:       68536 kB
Mapped:          13376 kB
Slab:           248856 kB
PageTables:       4044 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  199240340 kB
Committed_AS:   186816 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296372 kB
VmallocChunk: 34359440603 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62036 MiB
End job on node200 at 2011-05-12 07:54:16