Trace number 3190856

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.26 1201.71

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v20000-c84000-S921718479-079-UNKNOWN.cnf
MD5SUMd523f5efa43fecaa5caf604137870a4e
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark139.522
Satisfiable
(Un)Satisfiability was proved
Number of variables20000
Number of clauses84000
Sum of the clauses size252000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 384000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3190856-1304038822/watcher-3190856-1304038822 -o /tmp/evaluation-result-3190856-1304038822/solver-3190856-1304038822 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3190856-1304038822.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.72 7.12 8.84 2/171 28255
/proc/meminfo: memFree=25629380/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18188 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) R 28253 28255 27036 0 -1 4194304 365 0 0 0 0 0 0 0 25 0 1 0 496298097 18624512 301 33554432000 4194304 4287625 140735377449216 18446744073709551615 47667095767232 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/28255/statm: 4547 308 263 23 0 57 0

[startup+0.056023 s]
/proc/loadavg: 4.72 7.12 8.84 2/171 28255
/proc/meminfo: memFree=25629380/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 521 0 0 0 0 0 0 0 25 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 2826088480819 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.06879 s]
/proc/loadavg: 4.72 7.12 8.84 2/171 28255
/proc/meminfo: memFree=25629380/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 23 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.16877 s]
/proc/loadavg: 4.72 7.12 8.84 2/171 28255
/proc/meminfo: memFree=25629380/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 23 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.20077 s]
/proc/loadavg: 4.72 7.12 8.84 2/171 28255
/proc/meminfo: memFree=25629380/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 23 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.5687 s]
/proc/loadavg: 4.72 7.12 8.84 2/171 28255
/proc/meminfo: memFree=25629380/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 23 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10642 s]
/proc/loadavg: 4.72 7.12 8.84 6/177 28261
/proc/meminfo: memFree=25521536/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
[pid=28257] ppid=28255 vsize=80032 CPUtime=3.04 cores=1
/proc/28257/stat : 28257 (cryptominisat) R 28255 28255 27036 0 -1 4202496 9143 0 0 0 302 2 0 0 25 0 1 0 496298097 81952768 7501 33554432000 4194304 4587354 140734006389296 18446744073709551615 4238294 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/28257/statm: 20008 7501 326 96 0 16570 0
[pid=28258] ppid=28255 vsize=33028 CPUtime=3.09 cores=5
/proc/28258/stat : 28258 (clasp) R 28255 28255 27036 0 -1 4202496 6547 0 0 0 308 1 0 0 25 0 1 0 496298097 33820672 5582 33554432000 4194304 4785740 140733496619872 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/28258/statm: 8257 5582 340 145 0 5302 0
[pid=28259] ppid=28255 vsize=459916 CPUtime=1.13 cores=7
/proc/28259/stat : 28259 (TNM) R 28255 28255 27036 0 -1 4202496 3487 0 0 0 113 0 0 0 25 0 1 0 496298097 470953984 3384 33554432000 134512640 134534564 4294714480 18446744073709551615 134530268 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28259/statm: 114979 3384 95 6 0 113645 0
[pid=28260] ppid=28255 vsize=11456 CPUtime=3.09 cores=3
/proc/28260/stat : 28260 (lingeling) R 28255 28255 27036 0 -1 4202496 3516 0 0 0 309 0 0 0 25 0 1 0 496298097 11730944 1923 33554432000 4194304 4352236 140734352049248 18446744073709551615 4328102 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/28260/statm: 2864 1923 127 39 0 1944 0
[pid=28261] ppid=28255 vsize=47952 CPUtime=1.92 cores=7
/proc/28261/stat : 28261 (march_hi) R 28255 28255 27036 0 -1 4202496 26261 0 0 0 189 3 0 0 21 0 1 0 496298097 49102848 9479 33554432000 4194304 4331988 140737013709904 18446744073709551615 4228998 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28261/statm: 11988 9479 173 34 0 10430 0
Current children cumulated CPU time (s) 12.27
Current children cumulated vsize (KiB) 650708

[startup+6.30083 s]
/proc/loadavg: 4.74 7.09 8.82 6/177 28261
/proc/meminfo: memFree=25490040/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
[pid=28257] ppid=28255 vsize=80032 CPUtime=6.24 cores=1
/proc/28257/stat : 28257 (cryptominisat) R 28255 28255 27036 0 -1 4202496 11253 0 0 0 622 2 0 0 25 0 1 0 496298097 81952768 9597 33554432000 4194304 4587354 140734006389296 18446744073709551615 220815933195 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/28257/statm: 20008 9597 326 96 0 16570 0
[pid=28258] ppid=28255 vsize=48012 CPUtime=6.29 cores=5
/proc/28258/stat : 28258 (clasp) R 28255 28255 27036 0 -1 4202496 10280 0 0 0 628 1 0 0 25 0 1 0 496298097 49164288 9315 33554432000 4194304 4785740 140733496619872 18446744073709551615 4562668 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/28258/statm: 12003 9315 340 145 0 9048 0
[pid=28259] ppid=28255 vsize=459916 CPUtime=2.73 cores=7
/proc/28259/stat : 28259 (TNM) R 28255 28255 27036 0 -1 4202496 3487 0 0 0 273 0 0 0 25 0 1 0 496298097 470953984 3384 33554432000 134512640 134534564 4294714480 18446744073709551615 134530158 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28259/statm: 114979 3384 95 6 0 113645 0
[pid=28260] ppid=28255 vsize=14776 CPUtime=6.29 cores=3
/proc/28260/stat : 28260 (lingeling) R 28255 28255 27036 0 -1 4202496 4453 0 0 0 629 0 0 0 25 0 1 0 496298097 15130624 2860 33554432000 4194304 4352236 140734352049248 18446744073709551615 4276744 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/28260/statm: 3694 2860 127 39 0 2774 0
[pid=28261] ppid=28255 vsize=51976 CPUtime=3.51 cores=7
/proc/28261/stat : 28261 (march_hi) R 28255 28255 27036 0 -1 4202496 27087 0 0 0 347 4 0 0 25 0 1 0 496298097 53223424 10305 33554432000 4194304 4331988 140737013709904 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28261/statm: 12994 10305 173 34 0 11436 0
Current children cumulated CPU time (s) 25.06
Current children cumulated vsize (KiB) 673036

[startup+12.7006 s]
/proc/loadavg: 4.76 7.05 8.80 6/177 28261
/proc/meminfo: memFree=25404380/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
[pid=28257] ppid=28255 vsize=108528 CPUtime=12.64 cores=1
/proc/28257/stat : 28257 (cryptominisat) R 28255 28255 27036 0 -1 4202496 34170 0 0 0 1257 7 0 0 25 0 1 0 496298097 111132672 9076 33554432000 4194304 4587354 140734006389296 18446744073709551615 4237665 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/28257/statm: 27132 9076 337 96 0 23694 0
[pid=28258] ppid=28255 vsize=62048 CPUtime=12.69 cores=5
/proc/28258/stat : 28258 (clasp) R 28255 28255 27036 0 -1 4202496 13750 0 0 0 1267 2 0 0 25 0 1 0 496298097 63537152 12785 33554432000 4194304 4785740 140733496619872 18446744073709551615 4552483 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/28258/statm: 15512 12785 340 145 0 12557 0
[pid=28259] ppid=28255 vsize=459916 CPUtime=5.91 cores=7
/proc/28259/stat : 28259 (TNM) R 28255 28255 27036 0 -1 4202496 3487 0 0 0 591 0 0 0 25 0 1 0 496298097 470953984 3384 33554432000 134512640 134534564 4294714480 18446744073709551615 134530614 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28259/statm: 114979 3384 95 6 0 113645 0
[pid=28260] ppid=28255 vsize=14776 CPUtime=12.69 cores=3
/proc/28260/stat : 28260 (lingeling) R 28255 28255 27036 0 -1 4202496 4453 0 0 0 1269 0 0 0 25 0 1 0 496298097 15130624 2860 33554432000 4194304 4352236 140734352049248 18446744073709551615 4328013 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/28260/statm: 3694 2860 127 39 0 2774 0
[pid=28261] ppid=28255 vsize=52768 CPUtime=6.7 cores=7
/proc/28261/stat : 28261 (march_hi) R 28255 28255 27036 0 -1 4202496 27299 0 0 0 666 4 0 0 25 0 1 0 496298097 54034432 10517 33554432000 4194304 4331988 140737013709904 18446744073709551615 4240141 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28261/statm: 13192 10517 173 34 0 11634 0
Current children cumulated CPU time (s) 50.63
Current children cumulated vsize (KiB) 716360

[startup+25.5013 s]
/proc/loadavg: 4.81 6.95 8.74 6/177 28261
/proc/meminfo: memFree=25471012/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
[pid=28257] ppid=28255 vsize=344856 CPUtime=25.44 cores=1
/proc/28257/stat : 28257 (cryptominisat) R 28255 28255 27036 0 -1 4202496 54901 0 0 0 2532 12 0 0 25 0 1 0 496298097 353132544 7367 33554432000 4194304 4587354 140734006389296 18446744073709551615 4243380 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/28257/statm: 86214 7367 337 96 0 82776 0
[pid=28258] ppid=28255 vsize=73032 CPUtime=25.49 cores=5
/proc/28258/stat : 28258 (clasp) R 28255 28255 27036 0 -1 4202496 16516 0 0 0 2546 3 0 0 25 0 1 0 496298097 74784768 15551 33554432000 4194304 4785740 140733496619872 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/28258/statm: 18258 15551 340 145 0 15303 0
[pid=28259] ppid=28255 vsize=459916 CPUtime=12.24 cores=7
/proc/28259/stat : 28259 (TNM) R 28255 28255 27036 0 -1 4202496 3487 0 0 0 1224 0 0 0 25 0 1 0 496298097 470953984 3384 33554432000 134512640 134534564 4294714480 18446744073709551615 134528913 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28259/statm: 114979 3384 95 6 0 113645 0
[pid=28260] ppid=28255 vsize=17900 CPUtime=25.49 cores=3
/proc/28260/stat : 28260 (lingeling) R 28255 28255 27036 0 -1 4202496 5234 0 0 0 2549 0 0 0 25 0 1 0 496298097 18329600 3641 33554432000 4194304 4352236 140734352049248 18446744073709551615 4327902 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/28260/statm: 4475 3641 127 39 0 3555 0
[pid=28261] ppid=28255 vsize=53432 CPUtime=13.1 cores=7
/proc/28261/stat : 28261 (march_hi) R 28255 28255 27036 0 -1 4202496 27468 0 0 0 1306 4 0 0 25 0 1 0 496298097 54714368 10686 33554432000 4194304 4331988 140737013709904 18446744073709551615 4263152 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28261/statm: 13358 10686 173 34 0 11800 0
Current children cumulated CPU time (s) 101.76
Current children cumulated vsize (KiB) 967460

[startup+51.1006 s]
/proc/loadavg: 5.01 6.82 8.65 6/177 28271
/proc/meminfo: memFree=25418252/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
[pid=28257] ppid=28255 vsize=66588 CPUtime=51.03 cores=1
/proc/28257/stat : 28257 (cryptominisat) R 28255 28255 27036 0 -1 4202496 108513 0 0 0 5081 22 0 0 25 0 1 0 496298097 68186112 12017 33554432000 4194304 4587354 140734006389296 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/28257/statm: 16647 12017 337 96 0 13209 0
[pid=28258] ppid=28255 vsize=106756 CPUtime=51.09 cores=5
/proc/28258/stat : 28258 (clasp) R 28255 28255 27036 0 -1 4202496 24887 0 0 0 5102 7 0 0 25 0 1 0 496298097 109318144 23922 33554432000 4194304 4785740 140733496619872 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/28258/statm: 26689 23922 340 145 0 23734 0
[pid=28259] ppid=28255 vsize=459916 CPUtime=25 cores=7
/proc/28259/stat : 28259 (TNM) R 28255 28255 27036 0 -1 4202496 3487 0 0 0 2500 0 0 0 25 0 1 0 496298097 470953984 3384 33554432000 134512640 134534564 4294714480 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28259/statm: 114979 3384 95 6 0 113645 0
[pid=28260] ppid=28255 vsize=17900 CPUtime=51.08 cores=3
/proc/28260/stat : 28260 (lingeling) R 28255 28255 27036 0 -1 4202496 5234 0 0 0 5108 0 0 0 25 0 1 0 496298097 18329600 3641 33554432000 4194304 4352236 140734352049248 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/28260/statm: 4475 3641 127 39 0 3555 0
[pid=28261] ppid=28255 vsize=54092 CPUtime=25.8 cores=7
/proc/28261/stat : 28261 (march_hi) R 28255 28255 27036 0 -1 4202496 27645 0 0 0 2576 4 0 0 25 0 1 0 496298097 55390208 10863 33554432000 4194304 4331988 140737013709904 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28261/statm: 13523 10863 173 34 0 11965 0
Current children cumulated CPU time (s) 204
Current children cumulated vsize (KiB) 723576

[startup+102.301 s]
/proc/loadavg: 5.07 6.56 8.46 6/177 28272
/proc/meminfo: memFree=25387960/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
[pid=28257] ppid=28255 vsize=345844 CPUtime=102.23 cores=1

################
# More data... #
################

/proc/28261/statm: 14282 11622 173 34 0 12724 0
Current children cumulated CPU time (s) 3524.35
Current children cumulated vsize (KiB) 1185940

[startup+942.301 s]
/proc/loadavg: 5.11 5.18 6.43 6/177 28295
/proc/meminfo: memFree=25203996/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
[pid=28257] ppid=28255 vsize=401464 CPUtime=942.27 cores=1
/proc/28257/stat : 28257 (cryptominisat) R 28255 28255 27036 0 -1 4202496 625251 0 0 0 93966 261 0 0 25 0 1 0 496298097 411099136 22801 33554432000 4194304 4587354 140734006389296 18446744073709551615 4238273 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/28257/statm: 100366 22801 337 96 0 96928 0
[pid=28258] ppid=28255 vsize=268680 CPUtime=942.31 cores=5
/proc/28258/stat : 28258 (clasp) R 28255 28255 27036 0 -1 4202496 64604 0 0 0 94213 18 0 0 25 0 1 0 496298097 275128320 63639 33554432000 4194304 4785740 140733496619872 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/28258/statm: 67170 63639 340 145 0 64215 0
[pid=28259] ppid=28255 vsize=459916 CPUtime=468.16 cores=7
/proc/28259/stat : 28259 (TNM) R 28255 28255 27036 0 -1 4202496 3487 0 0 0 46816 0 0 0 25 0 1 0 496298097 470953984 3384 33554432000 134512640 134534564 4294714480 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28259/statm: 114979 3384 95 6 0 113645 0
[pid=28260] ppid=28255 vsize=25776 CPUtime=942.31 cores=3
/proc/28260/stat : 28260 (lingeling) R 28255 28255 27036 0 -1 4202496 10275 0 0 0 94230 1 0 0 25 0 1 0 496298097 26394624 5610 33554432000 4194304 4352236 140734352049248 18446744073709551615 4207791 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/28260/statm: 6444 5610 127 39 0 5524 0
[pid=28261] ppid=28255 vsize=57260 CPUtime=468.99 cores=7
/proc/28261/stat : 28261 (march_hi) R 28255 28255 27036 0 -1 4202496 28421 0 0 0 46895 4 0 0 25 0 1 0 496298097 58634240 11639 33554432000 4194304 4331988 140737013709904 18446744073709551615 4211493 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28261/statm: 14315 11639 173 34 0 12757 0
Current children cumulated CPU time (s) 3764.04
Current children cumulated vsize (KiB) 1231420

[startup+1002.3 s]
/proc/loadavg: 5.11 5.16 6.35 6/177 28296
/proc/meminfo: memFree=25188840/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
[pid=28257] ppid=28255 vsize=360904 CPUtime=1002.27 cores=1
/proc/28257/stat : 28257 (cryptominisat) R 28255 28255 27036 0 -1 4202496 653952 0 0 0 99948 279 0 0 25 0 1 0 496298097 369565696 20767 33554432000 4194304 4587354 140734006389296 18446744073709551615 220815933195 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/28257/statm: 90226 20767 337 96 0 86788 0
[pid=28258] ppid=28255 vsize=291400 CPUtime=1002.32 cores=5
/proc/28258/stat : 28258 (clasp) R 28255 28255 27036 0 -1 4202496 70218 0 0 0 100212 20 0 0 25 0 1 0 496298097 298393600 69253 33554432000 4194304 4785740 140733496619872 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/28258/statm: 72850 69253 340 145 0 69895 0
[pid=28259] ppid=28255 vsize=459916 CPUtime=498 cores=7
/proc/28259/stat : 28259 (TNM) R 28255 28255 27036 0 -1 4202496 3487 0 0 0 49800 0 0 0 25 0 1 0 496298097 470953984 3384 33554432000 134512640 134534564 4294714480 18446744073709551615 134530632 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28259/statm: 114979 3384 95 6 0 113645 0
[pid=28260] ppid=28255 vsize=25776 CPUtime=1002.32 cores=3
/proc/28260/stat : 28260 (lingeling) R 28255 28255 27036 0 -1 4202496 10787 0 0 0 100231 1 0 0 25 0 1 0 496298097 26394624 5610 33554432000 4194304 4352236 140734352049248 18446744073709551615 4280999 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/28260/statm: 6444 5610 127 39 0 5524 0
[pid=28261] ppid=28255 vsize=57260 CPUtime=498.82 cores=7
/proc/28261/stat : 28261 (march_hi) R 28255 28255 27036 0 -1 4202496 28436 0 0 0 49878 4 0 0 25 0 1 0 496298097 58634240 11654 33554432000 4194304 4331988 140737013709904 18446744073709551615 4211515 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28261/statm: 14315 11654 173 34 0 12757 0
Current children cumulated CPU time (s) 4003.73
Current children cumulated vsize (KiB) 1213580

[startup+1062.3 s]
/proc/loadavg: 5.10 5.14 6.26 6/177 28298
/proc/meminfo: memFree=25186348/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
[pid=28257] ppid=28255 vsize=376280 CPUtime=1062.27 cores=1
/proc/28257/stat : 28257 (cryptominisat) R 28255 28255 27036 0 -1 4202496 682036 0 0 0 105932 295 0 0 25 0 1 0 496298097 385310720 17395 33554432000 4194304 4587354 140734006389296 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/28257/statm: 94070 17395 337 96 0 90632 0
[pid=28258] ppid=28255 vsize=306424 CPUtime=1062.33 cores=5
/proc/28258/stat : 28258 (clasp) R 28255 28255 27036 0 -1 4202496 73985 0 0 0 106211 22 0 0 25 0 1 0 496298097 313778176 73020 33554432000 4194304 4785740 140733496619872 18446744073709551615 4561965 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/28258/statm: 76606 73020 340 145 0 73651 0
[pid=28259] ppid=28255 vsize=459916 CPUtime=527.85 cores=7
/proc/28259/stat : 28259 (TNM) R 28255 28255 27036 0 -1 4202496 3487 0 0 0 52785 0 0 0 25 0 1 0 496298097 470953984 3384 33554432000 134512640 134534564 4294714480 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28259/statm: 114979 3384 95 6 0 113645 0
[pid=28260] ppid=28255 vsize=25776 CPUtime=1062.32 cores=3
/proc/28260/stat : 28260 (lingeling) R 28255 28255 27036 0 -1 4202496 11299 0 0 0 106231 1 0 0 25 0 1 0 496298097 26394624 5610 33554432000 4194304 4352236 140734352049248 18446744073709551615 4231009 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/28260/statm: 6444 5610 127 39 0 5524 0
[pid=28261] ppid=28255 vsize=57392 CPUtime=528.64 cores=7
/proc/28261/stat : 28261 (march_hi) R 28255 28255 27036 0 -1 4202496 28450 0 0 0 52860 4 0 0 25 0 1 0 496298097 58769408 11668 33554432000 4194304 4331988 140737013709904 18446744073709551615 4211525 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28261/statm: 14348 11668 173 34 0 12790 0
Current children cumulated CPU time (s) 4243.41
Current children cumulated vsize (KiB) 1244112

[startup+1122.3 s]
/proc/loadavg: 5.09 5.13 6.19 6/177 28300
/proc/meminfo: memFree=25146388/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
[pid=28257] ppid=28255 vsize=363620 CPUtime=1122.27 cores=1
/proc/28257/stat : 28257 (cryptominisat) R 28255 28255 27036 0 -1 4202496 708331 0 0 0 111914 313 0 0 25 0 1 0 496298097 372346880 27573 33554432000 4194304 4587354 140734006389296 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/28257/statm: 90905 27573 337 96 0 87467 0
[pid=28258] ppid=28255 vsize=306424 CPUtime=1122.32 cores=5
/proc/28258/stat : 28258 (clasp) R 28255 28255 27036 0 -1 4202496 73986 0 0 0 112210 22 0 0 25 0 1 0 496298097 313778176 73021 33554432000 4194304 4785740 140733496619872 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/28258/statm: 76606 73021 340 145 0 73651 0
[pid=28259] ppid=28255 vsize=459916 CPUtime=557.65 cores=7
/proc/28259/stat : 28259 (TNM) R 28255 28255 27036 0 -1 4202496 3487 0 0 0 55765 0 0 0 25 0 1 0 496298097 470953984 3384 33554432000 134512640 134534564 4294714480 18446744073709551615 3565880 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28259/statm: 114979 3384 95 6 0 113645 0
[pid=28260] ppid=28255 vsize=25776 CPUtime=1122.32 cores=3
/proc/28260/stat : 28260 (lingeling) R 28255 28255 27036 0 -1 4202496 11811 0 0 0 112231 1 0 0 25 0 1 0 496298097 26394624 5610 33554432000 4194304 4352236 140734352049248 18446744073709551615 4328119 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/28260/statm: 6444 5610 127 39 0 5524 0
[pid=28261] ppid=28255 vsize=57392 CPUtime=558.51 cores=7
/proc/28261/stat : 28261 (march_hi) R 28255 28255 27036 0 -1 4202496 28465 0 0 0 55847 4 0 0 25 0 1 0 496298097 58769408 11683 33554432000 4194304 4331988 140737013709904 18446744073709551615 4211487 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28261/statm: 14348 11683 173 34 0 12790 0
Current children cumulated CPU time (s) 4483.07
Current children cumulated vsize (KiB) 1231452

[startup+1182.31 s]
/proc/loadavg: 5.08 5.12 6.12 6/177 28301
/proc/meminfo: memFree=25159388/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
[pid=28257] ppid=28255 vsize=389048 CPUtime=1182.27 cores=1
/proc/28257/stat : 28257 (cryptominisat) R 28255 28255 27036 0 -1 4202496 736436 0 0 0 117895 332 0 0 25 0 1 0 496298097 398385152 22994 33554432000 4194304 4587354 140734006389296 18446744073709551615 4237684 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/28257/statm: 97262 22994 337 96 0 93824 0
[pid=28258] ppid=28255 vsize=311228 CPUtime=1182.33 cores=5
/proc/28258/stat : 28258 (clasp) R 28255 28255 27036 0 -1 4202496 75111 0 0 0 118211 22 0 0 25 0 1 0 496298097 318697472 74146 33554432000 4194304 4785740 140733496619872 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/28258/statm: 77807 74146 340 145 0 74852 0
[pid=28259] ppid=28255 vsize=459916 CPUtime=587.53 cores=7
/proc/28259/stat : 28259 (TNM) R 28255 28255 27036 0 -1 4202496 3487 0 0 0 58753 0 0 0 25 0 1 0 496298097 470953984 3384 33554432000 134512640 134534564 4294714480 18446744073709551615 134528504 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28259/statm: 114979 3384 95 6 0 113645 0
[pid=28260] ppid=28255 vsize=25776 CPUtime=1182.32 cores=3
/proc/28260/stat : 28260 (lingeling) R 28255 28255 27036 0 -1 4202496 12323 0 0 0 118231 1 0 0 25 0 1 0 496298097 26394624 5610 33554432000 4194304 4352236 140734352049248 18446744073709551615 4276719 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/28260/statm: 6444 5610 127 39 0 5524 0
[pid=28261] ppid=28255 vsize=57392 CPUtime=588.31 cores=7
/proc/28261/stat : 28261 (march_hi) R 28255 28255 27036 0 -1 4202496 28477 0 0 0 58827 4 0 0 25 0 1 0 496298097 58769408 11695 33554432000 4194304 4331988 140737013709904 18446744073709551615 4240514 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28261/statm: 14348 11695 173 34 0 12790 0
Current children cumulated CPU time (s) 4722.76
Current children cumulated vsize (KiB) 1261684



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 5.06 5.11 6.09 6/177 28302
/proc/meminfo: memFree=25190492/32951124 swapFree=67111524/67111528
[pid=28255] ppid=28253 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/28255/stat : 28255 (ppfolio) S 28253 28255 27036 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 496298097 18763776 390 33554432000 4194304 4287625 140735377449216 18446744073709551615 220816256527 0 0 4096 65536 4605247557508005887 0 0 17 1 0 0 0
/proc/28255/statm: 4581 390 341 23 0 91 0
[pid=28257] ppid=28255 vsize=360272 CPUtime=1201.68 cores=1
/proc/28257/stat : 28257 (cryptominisat) R 28255 28255 27036 0 -1 4202496 745340 0 0 0 119829 339 0 0 25 0 1 0 496298097 368918528 15183 33554432000 4194304 4587354 140734006389296 18446744073709551615 4250080 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/28257/statm: 90068 15183 337 96 0 86630 0
[pid=28258] ppid=28255 vsize=311228 CPUtime=1201.73 cores=5
/proc/28258/stat : 28258 (clasp) R 28255 28255 27036 0 -1 4202496 75111 0 0 0 120151 22 0 0 25 0 1 0 496298097 318697472 74146 33554432000 4194304 4785740 140733496619872 18446744073709551615 4304024 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/28258/statm: 77807 74146 340 145 0 74852 0
[pid=28259] ppid=28255 vsize=459916 CPUtime=597.14 cores=7
/proc/28259/stat : 28259 (TNM) R 28255 28255 27036 0 -1 4202496 3487 0 0 0 59714 0 0 0 25 0 1 0 496298097 470953984 3384 33554432000 134512640 134534564 4294714480 18446744073709551615 134530456 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28259/statm: 114979 3384 95 6 0 113645 0
[pid=28260] ppid=28255 vsize=25776 CPUtime=1201.72 cores=3
/proc/28260/stat : 28260 (lingeling) R 28255 28255 27036 0 -1 4202496 12323 0 0 0 120171 1 0 0 25 0 1 0 496298097 26394624 5610 33554432000 4194304 4352236 140734352049248 18446744073709551615 4328009 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/28260/statm: 6444 5610 127 39 0 5524 0
[pid=28261] ppid=28255 vsize=57524 CPUtime=597.99 cores=7
/proc/28261/stat : 28261 (march_hi) R 28255 28255 27036 0 -1 4202496 28482 0 0 0 59795 4 0 0 25 0 1 0 496298097 58904576 11700 33554432000 4194304 4331988 140737013709904 18446744073709551615 4299854 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/28261/statm: 14381 11700 173 34 0 12823 0
Current children cumulated CPU time (s) 4800.26
Current children cumulated vsize (KiB) 1233040

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28255 and gives
#  childrusage.ru_utime.tv_sec=3595
#  childrusage.ru_utime.tv_usec=115459
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=483470
# CPU time returned by wait4() is 3598.6
# while last known CPU time is 4800.26
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.26
CPU user time (s): 4796.6
CPU system time (s): 3.66
CPU usage (%): 399.452
Max. virtual memory (cumulated for all children) (KiB): 1580368

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3595.12
system time used= 3.48347
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 790157
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 269
involuntary context switches= 41181

runsolver used 1.84172 second user time and 4.70628 second system time

The end

Launcher Data 

Begin job on node147 at 2011-04-29 03:00:22
IDJOB=3190856
IDBENCH=82587
IDSOLVER=1612
FILE ID=node147/3190856-1304038822
RUNJOBID= node147-1304032794-27485
PBS_JOBID= 13170305
Free space on /tmp= 72656 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v20000-c84000-S921718479-079-UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3190856-1304038822/watcher-3190856-1304038822 -o /tmp/evaluation-result-3190856-1304038822/solver-3190856-1304038822 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3190856-1304038822.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d523f5efa43fecaa5caf604137870a4e
RANDOM SEED=987928143

node147.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.836
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      25629660 kB
Buffers:       1022000 kB
Cached:        5791228 kB
SwapCached:          4 kB
Active:        1266288 kB
Inactive:      5611100 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      25629660 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           11656 kB
Writeback:           0 kB
AnonPages:       64020 kB
Mapped:          14712 kB
Slab:           381176 kB
PageTables:       4048 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   188752 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72648 MiB
End job on node147 at 2011-04-29 03:20:26