Trace number 3259005

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.3 1201.71

General information on the benchmark

NameCRAFTED/rbsat/crafted/unforced/
rbsat-v2400c266431g6.cnf
MD5SUMd0bb6612a0c88017c970eb8fd1a4be9e
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3259005-1304034239/watcher-3259005-1304034239 -o /tmp/evaluation-result-3259005-1304034239/solver-3259005-1304034239 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3259005-1304034239.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.84 10.00 9.34 6/182 31896
/proc/meminfo: memFree=19066864/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) R 31894 31896 31281 0 -1 4202496 522 0 0 0 0 0 0 0 25 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0

[startup+0.221062 s]
/proc/loadavg: 9.84 10.00 9.34 6/182 31896
/proc/meminfo: memFree=19066864/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) R 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.301052 s]
/proc/loadavg: 9.84 10.00 9.34 6/182 31896
/proc/meminfo: memFree=19066864/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 24 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.401033 s]
/proc/loadavg: 9.84 10.00 9.34 6/182 31896
/proc/meminfo: memFree=19066864/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 24 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.70098 s]
/proc/loadavg: 9.84 10.00 9.34 6/182 31896
/proc/meminfo: memFree=19066864/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 21 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50084 s]
/proc/loadavg: 9.84 10.00 9.34 12/188 31902
/proc/meminfo: memFree=18952728/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
[pid=31897] ppid=31896 vsize=66688 CPUtime=1.49 cores=1
/proc/31897/stat : 31897 (cryptominisat) R 31896 31896 31281 0 -1 4202496 17554 0 0 0 148 1 0 0 25 0 1 0 515023696 68288512 11520 33554432000 4194304 4587354 140735509970880 18446744073709551615 4237464 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/31897/statm: 16672 11520 326 96 0 13234 0
[pid=31898] ppid=31896 vsize=32596 CPUtime=1.49 cores=5
/proc/31898/stat : 31898 (clasp) R 31896 31896 31281 0 -1 4202496 6628 0 0 0 148 1 0 0 25 0 1 0 515023696 33378304 5348 33554432000 4194304 4785740 140734046833328 18446744073709551615 4482824 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31898/statm: 8149 5348 316 145 0 5194 0
[pid=31899] ppid=31896 vsize=464404 CPUtime=0.71 cores=7
/proc/31899/stat : 31899 (TNM) R 31896 31896 31281 0 -1 4202496 4421 0 0 0 70 1 0 0 25 0 1 0 515023696 475549696 4318 33554432000 134512640 134534564 4292406768 18446744073709551615 134524469 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31899/statm: 116101 4318 91 6 0 114767 0
[pid=31900] ppid=31896 vsize=16664 CPUtime=1.48 cores=3
/proc/31900/stat : 31900 (lingeling) R 31896 31896 31281 0 -1 4202496 4161 0 0 0 148 0 0 0 25 0 1 0 515023696 17063936 3033 33554432000 4194304 4352236 140736905320448 18446744073709551615 4268080 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31900/statm: 4166 3033 124 39 0 3246 0
[pid=31901] ppid=31896 vsize=43228 CPUtime=0.77 cores=7
/proc/31901/stat : 31901 (march_hi) R 31896 31896 31281 0 -1 4202496 21411 0 0 0 74 3 0 0 25 0 1 0 515023696 44265472 4736 33554432000 4194304 4331988 140733624233984 18446744073709551615 4210400 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31901/statm: 10807 4736 170 34 0 9249 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 641904

[startup+3.10055 s]
/proc/loadavg: 9.84 10.00 9.34 12/188 31902
/proc/meminfo: memFree=18943312/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
[pid=31897] ppid=31896 vsize=2107504 CPUtime=3.09 cores=1
/proc/31897/stat : 31897 (cryptominisat) R 31896 31896 31281 0 -1 4202496 19703 0 0 0 307 2 0 0 25 0 1 0 515023696 2158084096 11953 33554432000 4194304 4587354 140735509970880 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/31897/statm: 526876 11953 331 96 0 523438 0
[pid=31898] ppid=31896 vsize=30564 CPUtime=3.09 cores=5
/proc/31898/stat : 31898 (clasp) R 31896 31896 31281 0 -1 4202496 6721 0 0 0 308 1 0 0 25 0 1 0 515023696 31297536 4920 33554432000 4194304 4785740 140734046833328 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31898/statm: 7641 4920 340 145 0 4686 0
[pid=31899] ppid=31896 vsize=464932 CPUtime=1.51 cores=7
/proc/31899/stat : 31899 (TNM) R 31896 31896 31281 0 -1 4202496 4570 0 0 0 150 1 0 0 25 0 1 0 515023696 476090368 4467 33554432000 134512640 134534564 4292406768 18446744073709551615 134527402 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31899/statm: 116233 4467 92 6 0 114899 0
[pid=31900] ppid=31896 vsize=21444 CPUtime=3.09 cores=3
/proc/31900/stat : 31900 (lingeling) R 31896 31896 31281 0 -1 4202496 5651 0 0 0 308 1 0 0 25 0 1 0 515023696 21958656 4523 33554432000 4194304 4352236 140736905320448 18446744073709551615 4276725 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31900/statm: 5361 4523 127 39 0 4441 0
[pid=31901] ppid=31896 vsize=43228 CPUtime=1.56 cores=7
/proc/31901/stat : 31901 (march_hi) R 31896 31896 31281 0 -1 4202496 21445 0 0 0 153 3 0 0 25 0 1 0 515023696 44265472 4770 33554432000 4194304 4331988 140733624233984 18446744073709551615 4228235 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31901/statm: 10807 4770 174 34 0 9249 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 2685996

[startup+6.30098 s]
/proc/loadavg: 9.85 10.00 9.34 12/188 31902
/proc/meminfo: memFree=18967368/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
[pid=31897] ppid=31896 vsize=2107504 CPUtime=6.29 cores=1
/proc/31897/stat : 31897 (cryptominisat) R 31896 31896 31281 0 -1 4202496 19877 0 0 0 627 2 0 0 25 0 1 0 515023696 2158084096 12125 33554432000 4194304 4587354 140735509970880 18446744073709551615 4421069 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/31897/statm: 526876 12125 337 96 0 523438 0
[pid=31898] ppid=31896 vsize=40084 CPUtime=6.29 cores=5
/proc/31898/stat : 31898 (clasp) R 31896 31896 31281 0 -1 4202496 9156 0 0 0 627 2 0 0 25 0 1 0 515023696 41046016 7355 33554432000 4194304 4785740 140734046833328 18446744073709551615 4548911 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31898/statm: 10021 7355 340 145 0 7066 0
[pid=31899] ppid=31896 vsize=470348 CPUtime=3.15 cores=7
/proc/31899/stat : 31899 (TNM) R 31896 31896 31281 0 -1 4202496 6385 0 0 0 314 1 0 0 25 0 1 0 515023696 481636352 6282 33554432000 134512640 134534564 4292406768 18446744073709551615 134525904 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31899/statm: 117587 6282 95 6 0 116253 0
[pid=31900] ppid=31896 vsize=26820 CPUtime=6.29 cores=3
/proc/31900/stat : 31900 (lingeling) R 31896 31896 31281 0 -1 4202496 6484 0 0 0 628 1 0 0 25 0 1 0 515023696 27463680 5356 33554432000 4194304 4352236 140736905320448 18446744073709551615 4328039 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31900/statm: 6705 5356 127 39 0 5785 0
[pid=31901] ppid=31896 vsize=43932 CPUtime=3.1 cores=7
/proc/31901/stat : 31901 (march_hi) R 31896 31896 31281 0 -1 4202496 21591 0 0 0 307 3 0 0 25 0 1 0 515023696 44986368 4916 33554432000 4194304 4331988 140733624233984 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31901/statm: 10983 4916 174 34 0 9425 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 2707012

[startup+12.7008 s]
/proc/loadavg: 9.87 10.00 9.34 12/188 31902
/proc/meminfo: memFree=18892744/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
[pid=31897] ppid=31896 vsize=2142112 CPUtime=12.69 cores=1
/proc/31897/stat : 31897 (cryptominisat) R 31896 31896 31281 0 -1 4202496 28082 0 0 0 1266 3 0 0 25 0 1 0 515023696 2193522688 20329 33554432000 4194304 4587354 140735509970880 18446744073709551615 4388356 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/31897/statm: 535528 20329 337 96 0 532090 0
[pid=31898] ppid=31896 vsize=55964 CPUtime=12.69 cores=5
/proc/31898/stat : 31898 (clasp) R 31896 31896 31281 0 -1 4202496 13118 0 0 0 1265 4 0 0 25 0 1 0 515023696 57307136 11317 33554432000 4194304 4785740 140734046833328 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31898/statm: 13991 11317 340 145 0 11036 0
[pid=31899] ppid=31896 vsize=470348 CPUtime=6.32 cores=7
/proc/31899/stat : 31899 (TNM) R 31896 31896 31281 0 -1 4202496 6385 0 0 0 631 1 0 0 25 0 1 0 515023696 481636352 6282 33554432000 134512640 134534564 4292406768 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31899/statm: 117587 6282 95 6 0 116253 0
[pid=31900] ppid=31896 vsize=30168 CPUtime=12.69 cores=3
/proc/31900/stat : 31900 (lingeling) R 31896 31896 31281 0 -1 4202496 7321 0 0 0 1268 1 0 0 25 0 1 0 515023696 30892032 6193 33554432000 4194304 4352236 140736905320448 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31900/statm: 7542 6193 127 39 0 6622 0
[pid=31901] ppid=31896 vsize=44204 CPUtime=6.3 cores=7
/proc/31901/stat : 31901 (march_hi) R 31896 31896 31281 0 -1 4202496 21671 0 0 0 627 3 0 0 25 0 1 0 515023696 45264896 4996 33554432000 4194304 4331988 140733624233984 18446744073709551615 4228226 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31901/statm: 11051 4996 174 34 0 9493 0
Current children cumulated CPU time (s) 50.69
Current children cumulated vsize (KiB) 2761120

[startup+25.5066 s]
/proc/loadavg: 9.97 10.02 9.36 11/188 31902
/proc/meminfo: memFree=18877948/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
[pid=31897] ppid=31896 vsize=2111004 CPUtime=25.49 cores=1
/proc/31897/stat : 31897 (cryptominisat) R 31896 31896 31281 0 -1 4202496 32816 0 0 0 2545 4 0 0 25 0 1 0 515023696 2161668096 22399 33554432000 4194304 4587354 140735509970880 18446744073709551615 4230195 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/31897/statm: 527751 22399 337 96 0 524313 0
[pid=31898] ppid=31896 vsize=79160 CPUtime=25.49 cores=5
/proc/31898/stat : 31898 (clasp) R 31896 31896 31281 0 -1 4202496 18808 0 0 0 2544 5 0 0 25 0 1 0 515023696 81059840 17007 33554432000 4194304 4785740 140734046833328 18446744073709551615 4287244 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31898/statm: 19790 17007 340 145 0 16835 0
[pid=31899] ppid=31896 vsize=470348 CPUtime=12.7 cores=7
/proc/31899/stat : 31899 (TNM) R 31896 31896 31281 0 -1 4202496 6385 0 0 0 1269 1 0 0 25 0 1 0 515023696 481636352 6282 33554432000 134512640 134534564 4292406768 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31899/statm: 117587 6282 95 6 0 116253 0
[pid=31900] ppid=31896 vsize=34716 CPUtime=25.49 cores=3
/proc/31900/stat : 31900 (lingeling) R 31896 31896 31281 0 -1 4202496 8458 0 0 0 2548 1 0 0 25 0 1 0 515023696 35549184 7330 33554432000 4194304 4352236 140736905320448 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31900/statm: 8679 7330 127 39 0 7759 0
[pid=31901] ppid=31896 vsize=44764 CPUtime=12.65 cores=7
/proc/31901/stat : 31901 (march_hi) R 31896 31896 31281 0 -1 4202496 21805 0 0 0 1262 3 0 0 25 0 1 0 515023696 45838336 5129 33554432000 4194304 4331988 140733624233984 18446744073709551615 4226483 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31901/statm: 11191 5129 174 34 0 9633 0
Current children cumulated CPU time (s) 101.82
Current children cumulated vsize (KiB) 2758316

[startup+51.101 s]
/proc/loadavg: 10.04 10.03 9.38 12/188 31903
/proc/meminfo: memFree=18841612/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
[pid=31897] ppid=31896 vsize=2123556 CPUtime=51.09 cores=1
/proc/31897/stat : 31897 (cryptominisat) R 31896 31896 31281 0 -1 4202496 49946 0 0 0 5103 6 0 0 25 0 1 0 515023696 2174521344 26296 33554432000 4194304 4587354 140735509970880 18446744073709551615 4236698 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/31897/statm: 530889 26296 337 96 0 527451 0
[pid=31898] ppid=31896 vsize=88572 CPUtime=51.09 cores=5
/proc/31898/stat : 31898 (clasp) R 31896 31896 31281 0 -1 4202496 21086 0 0 0 5102 7 0 0 25 0 1 0 515023696 90697728 19285 33554432000 4194304 4785740 140734046833328 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31898/statm: 22143 19285 340 145 0 19188 0
[pid=31899] ppid=31896 vsize=470348 CPUtime=25.41 cores=7
/proc/31899/stat : 31899 (TNM) R 31896 31896 31281 0 -1 4202496 6385 0 0 0 2540 1 0 0 25 0 1 0 515023696 481636352 6282 33554432000 134512640 134534564 4292406768 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31899/statm: 117587 6282 95 6 0 116253 0
[pid=31900] ppid=31896 vsize=41884 CPUtime=51.08 cores=3

################
# More data... #
################

/proc/31901/statm: 17119 10284 175 34 0 15561 0
Current children cumulated CPU time (s) 3764.07
Current children cumulated vsize (KiB) 3047516

[startup+1002.31 s]
/proc/loadavg: 10.12 10.13 9.85 11/188 32025
/proc/meminfo: memFree=18334924/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
[pid=31897] ppid=31896 vsize=2271360 CPUtime=1002.29 cores=1
/proc/31897/stat : 31897 (cryptominisat) R 31896 31896 31281 0 -1 4202496 312583 0 0 0 100110 119 0 0 25 0 1 0 515023696 2325872640 56410 33554432000 4194304 4587354 140735509970880 18446744073709551615 4244129 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/31897/statm: 567840 56410 337 96 0 564402 0
[pid=31898] ppid=31896 vsize=195644 CPUtime=1002.32 cores=5
/proc/31898/stat : 31898 (clasp) R 31896 31896 31281 0 -1 4202496 46689 0 0 0 100212 20 0 0 25 0 1 0 515023696 200339456 44888 33554432000 4194304 4785740 140734046833328 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31898/statm: 48911 44888 340 145 0 45956 0
[pid=31899] ppid=31896 vsize=470348 CPUtime=498.43 cores=7
/proc/31899/stat : 31899 (TNM) R 31896 31896 31281 0 -1 4202496 6385 0 0 0 49842 1 0 0 25 0 1 0 515023696 481636352 6282 33554432000 134512640 134534564 4292406768 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31899/statm: 117587 6282 95 6 0 116253 0
[pid=31900] ppid=31896 vsize=72620 CPUtime=1002.31 cores=3
/proc/31900/stat : 31900 (lingeling) R 31896 31896 31281 0 -1 4202496 169965 0 0 0 100210 21 0 0 25 0 1 0 515023696 74362880 17317 33554432000 4194304 4352236 140736905320448 18446744073709551615 4276618 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31900/statm: 18155 17317 127 39 0 17235 0
[pid=31901] ppid=31896 vsize=68476 CPUtime=498.41 cores=7
/proc/31901/stat : 31901 (march_hi) R 31896 31896 31281 0 -1 4202496 27166 0 0 0 49836 5 0 0 25 0 1 0 515023696 70119424 10489 33554432000 4194304 4331988 140733624233984 18446744073709551615 4210377 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31901/statm: 17119 10489 175 34 0 15561 0
Current children cumulated CPU time (s) 4003.76
Current children cumulated vsize (KiB) 3096772

[startup+1062.3 s]
/proc/loadavg: 10.16 10.14 9.86 11/188 32036
/proc/meminfo: memFree=18392724/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
[pid=31897] ppid=31896 vsize=2329888 CPUtime=1062.28 cores=1
/proc/31897/stat : 31897 (cryptominisat) R 31896 31896 31281 0 -1 4202496 331911 0 0 0 106098 130 0 0 25 0 1 0 515023696 2385805312 60738 33554432000 4194304 4587354 140735509970880 18446744073709551615 4238602 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/31897/statm: 582472 60738 337 96 0 579034 0
[pid=31898] ppid=31896 vsize=197620 CPUtime=1062.31 cores=5
/proc/31898/stat : 31898 (clasp) R 31896 31896 31281 0 -1 4202496 47137 0 0 0 106211 20 0 0 25 0 1 0 515023696 202362880 45336 33554432000 4194304 4785740 140734046833328 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31898/statm: 49405 45336 340 145 0 46450 0
[pid=31899] ppid=31896 vsize=470348 CPUtime=528.3 cores=7
/proc/31899/stat : 31899 (TNM) R 31896 31896 31281 0 -1 4202496 6385 0 0 0 52829 1 0 0 25 0 1 0 515023696 481636352 6282 33554432000 134512640 134534564 4292406768 18446744073709551615 134528295 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31899/statm: 117587 6282 95 6 0 116253 0
[pid=31900] ppid=31896 vsize=82868 CPUtime=1062.31 cores=3
/proc/31900/stat : 31900 (lingeling) R 31896 31896 31281 0 -1 4202496 186863 0 0 0 106208 23 0 0 25 0 1 0 515023696 84856832 19879 33554432000 4194304 4352236 140736905320448 18446744073709551615 4329060 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31900/statm: 20717 19879 127 39 0 19797 0
[pid=31901] ppid=31896 vsize=72508 CPUtime=528.22 cores=7
/proc/31901/stat : 31901 (march_hi) R 31896 31896 31281 0 -1 4202496 27388 0 0 0 52816 6 0 0 25 0 1 0 515023696 74248192 10711 33554432000 4194304 4331988 140733624233984 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31901/statm: 18127 10711 175 34 0 16569 0
Current children cumulated CPU time (s) 4243.42
Current children cumulated vsize (KiB) 3171556

[startup+1122.3 s]
/proc/loadavg: 10.18 10.14 9.88 11/188 32038
/proc/meminfo: memFree=18314104/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
[pid=31897] ppid=31896 vsize=2246496 CPUtime=1122.29 cores=1
/proc/31897/stat : 31897 (cryptominisat) R 31896 31896 31281 0 -1 4202496 348290 0 0 0 112089 140 0 0 25 0 1 0 515023696 2300411904 56410 33554432000 4194304 4587354 140735509970880 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/31897/statm: 561624 56410 337 96 0 558186 0
[pid=31898] ppid=31896 vsize=201324 CPUtime=1122.32 cores=5
/proc/31898/stat : 31898 (clasp) R 31896 31896 31281 0 -1 4202496 47977 0 0 0 112211 21 0 0 25 0 1 0 515023696 206155776 46176 33554432000 4194304 4785740 140734046833328 18446744073709551615 237278577290 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31898/statm: 50331 46176 340 145 0 47376 0
[pid=31899] ppid=31896 vsize=470348 CPUtime=558.12 cores=7
/proc/31899/stat : 31899 (TNM) R 31896 31896 31281 0 -1 4202496 6385 0 0 0 55811 1 0 0 25 0 1 0 515023696 481636352 6282 33554432000 134512640 134534564 4292406768 18446744073709551615 134530614 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31899/statm: 117587 6282 95 6 0 116253 0
[pid=31900] ppid=31896 vsize=91060 CPUtime=1122.32 cores=3
/proc/31900/stat : 31900 (lingeling) R 31896 31896 31281 0 -1 4202496 200175 0 0 0 112207 25 0 0 25 0 1 0 515023696 93245440 21927 33554432000 4194304 4352236 140736905320448 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31900/statm: 22765 21927 127 39 0 21845 0
[pid=31901] ppid=31896 vsize=78328 CPUtime=558.07 cores=7
/proc/31901/stat : 31901 (march_hi) R 31896 31896 31281 0 -1 4202496 27601 0 0 0 55801 6 0 0 25 0 1 0 515023696 80207872 10924 33554432000 4194304 4331988 140733624233984 18446744073709551615 4228235 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31901/statm: 19582 10924 175 34 0 18024 0
Current children cumulated CPU time (s) 4483.12
Current children cumulated vsize (KiB) 3105880

[startup+1182.3 s]
/proc/loadavg: 10.17 10.14 9.90 11/188 32039
/proc/meminfo: memFree=18191336/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
[pid=31897] ppid=31896 vsize=2246844 CPUtime=1182.29 cores=1
/proc/31897/stat : 31897 (cryptominisat) R 31896 31896 31281 0 -1 4202496 366865 0 0 0 118078 151 0 0 25 0 1 0 515023696 2300768256 58865 33554432000 4194304 4587354 140735509970880 18446744073709551615 4238591 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/31897/statm: 561711 58865 337 96 0 558273 0
[pid=31898] ppid=31896 vsize=202080 CPUtime=1182.32 cores=5
/proc/31898/stat : 31898 (clasp) R 31896 31896 31281 0 -1 4202496 48173 0 0 0 118211 21 0 0 25 0 1 0 515023696 206929920 46372 33554432000 4194304 4785740 140734046833328 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31898/statm: 50520 46372 340 145 0 47565 0
[pid=31899] ppid=31896 vsize=470348 CPUtime=587.96 cores=7
/proc/31899/stat : 31899 (TNM) R 31896 31896 31281 0 -1 4202496 6385 0 0 0 58795 1 0 0 25 0 1 0 515023696 481636352 6282 33554432000 134512640 134534564 4292406768 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31899/statm: 117587 6282 95 6 0 116253 0
[pid=31900] ppid=31896 vsize=101300 CPUtime=1182.31 cores=3
/proc/31900/stat : 31900 (lingeling) R 31896 31896 31281 0 -1 4202496 211951 0 0 0 118205 26 0 0 25 0 1 0 515023696 103731200 24487 33554432000 4194304 4352236 140736905320448 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31900/statm: 25325 24487 127 39 0 24405 0
[pid=31901] ppid=31896 vsize=78328 CPUtime=587.91 cores=7
/proc/31901/stat : 31901 (march_hi) R 31896 31896 31281 0 -1 4202496 27841 0 0 0 58785 6 0 0 25 0 1 0 515023696 80207872 11164 33554432000 4194304 4331988 140733624233984 18446744073709551615 4237192 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31901/statm: 19582 11164 175 34 0 18024 0
Current children cumulated CPU time (s) 4722.79
Current children cumulated vsize (KiB) 3117224



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 10.12 10.13 9.90 11/188 32042
/proc/meminfo: memFree=17926344/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
[pid=31897] ppid=31896 vsize=2246020 CPUtime=1201.69 cores=1
/proc/31897/stat : 31897 (cryptominisat) R 31896 31896 31281 0 -1 4202496 372885 0 0 0 120015 154 0 0 25 0 1 0 515023696 2299924480 59340 33554432000 4194304 4587354 140735509970880 18446744073709551615 237278576326 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/31897/statm: 561505 59340 337 96 0 558067 0
[pid=31898] ppid=31896 vsize=202808 CPUtime=1201.73 cores=5
/proc/31898/stat : 31898 (clasp) R 31896 31896 31281 0 -1 4202496 48328 0 0 0 120152 21 0 0 25 0 1 0 515023696 207675392 46527 33554432000 4194304 4785740 140734046833328 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31898/statm: 50702 46527 340 145 0 47747 0
[pid=31899] ppid=31896 vsize=470348 CPUtime=597.61 cores=7
/proc/31899/stat : 31899 (TNM) R 31896 31896 31281 0 -1 4202496 6385 0 0 0 59760 1 0 0 25 0 1 0 515023696 481636352 6282 33554432000 134512640 134534564 4292406768 18446744073709551615 134528275 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31899/statm: 117587 6282 95 6 0 116253 0
[pid=31900] ppid=31896 vsize=86964 CPUtime=1201.73 cores=3
/proc/31900/stat : 31900 (lingeling) R 31896 31896 31281 0 -1 4202496 212975 0 0 0 120146 27 0 0 25 0 1 0 515023696 89051136 20903 33554432000 4194304 4352236 140736905320448 18446744073709551615 4328059 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31900/statm: 21741 20903 127 39 0 20821 0
[pid=31901] ppid=31896 vsize=78328 CPUtime=597.54 cores=7
/proc/31901/stat : 31901 (march_hi) R 31896 31896 31281 0 -1 4202496 27895 0 0 0 59748 6 0 0 25 0 1 0 515023696 80207872 11218 33554432000 4194304 4331988 140733624233984 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31901/statm: 19582 11218 175 34 0 18024 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 3102792

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 10.12 10.13 9.90 11/188 32042
/proc/meminfo: memFree=17926344/32950904 swapFree=67082284/67111528
[pid=31896] ppid=31894 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/31896/stat : 31896 (ppfolio) S 31894 31896 31281 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 515023695 18763776 390 33554432000 4194304 4287625 140734440526368 18446744073709551615 237278899727 0 0 4096 65536 4397615919157739519 0 0 17 5 0 0 0
/proc/31896/statm: 4581 390 341 23 0 91 0
[pid=31897] ppid=31896 vsize=2246020 CPUtime=1201.69 cores=1
/proc/31897/stat : 31897 (cryptominisat) R 31896 31896 31281 0 -1 4202496 372885 0 0 0 120015 154 0 0 25 0 1 0 515023696 2299924480 59340 33554432000 4194304 4587354 140735509970880 18446744073709551615 237278576326 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/31897/statm: 561505 59340 337 96 0 558067 0
[pid=31898] ppid=31896 vsize=202808 CPUtime=1201.73 cores=5
/proc/31898/stat : 31898 (clasp) R 31896 31896 31281 0 -1 4202496 48328 0 0 0 120152 21 0 0 25 0 1 0 515023696 207675392 46527 33554432000 4194304 4785740 140734046833328 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/31898/statm: 50702 46527 340 145 0 47747 0
[pid=31899] ppid=31896 vsize=470348 CPUtime=597.61 cores=7
/proc/31899/stat : 31899 (TNM) R 31896 31896 31281 0 -1 4202496 6385 0 0 0 59760 1 0 0 25 0 1 0 515023696 481636352 6282 33554432000 134512640 134534564 4292406768 18446744073709551615 134528275 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31899/statm: 117587 6282 95 6 0 116253 0
[pid=31900] ppid=31896 vsize=86964 CPUtime=1201.73 cores=3
/proc/31900/stat : 31900 (lingeling) R 31896 31896 31281 0 -1 4202496 212975 0 0 0 120146 27 0 0 25 0 1 0 515023696 89051136 20903 33554432000 4194304 4352236 140736905320448 18446744073709551615 4328059 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/31900/statm: 21741 20903 127 39 0 20821 0
[pid=31901] ppid=31896 vsize=78328 CPUtime=597.54 cores=7
/proc/31901/stat : 31901 (march_hi) R 31896 31896 31281 0 -1 4202496 27895 0 0 0 59748 6 0 0 25 0 1 0 515023696 80207872 11218 33554432000 4194304 4331988 140733624233984 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/31901/statm: 19582 11218 175 34 0 18024 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 3102792

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 31896 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=1999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.003998
# while last known CPU time is 4800.3
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.3
CPU user time (s): 4798.21
CPU system time (s): 2.09
CPU usage (%): 399.454
Max. virtual memory (cumulated for all children) (KiB): 5194748

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.001999
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 523
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 335
involuntary context switches= 6

runsolver used 1.91971 second user time and 4.64429 second system time

The end

Launcher Data 

Begin job on node121 at 2011-04-29 01:43:59
IDJOB=3259005
IDBENCH=71471
IDSOLVER=1612
FILE ID=node121/3259005-1304034239
RUNJOBID= node121-1304032644-31667
PBS_JOBID= 13170331
Free space on /tmp= 72640 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/CRAFTED/rbsat/crafted/unforced/rbsat-v2400c266431g6.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3259005-1304034239/watcher-3259005-1304034239 -o /tmp/evaluation-result-3259005-1304034239/solver-3259005-1304034239 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3259005-1304034239.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d0bb6612a0c88017c970eb8fd1a4be9e
RANDOM SEED=781051124

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      19067144 kB
Buffers:       2177700 kB
Cached:       10198276 kB
SwapCached:       2776 kB
Active:       10053240 kB
Inactive:      3308036 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      19067144 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:           13644 kB
Writeback:          20 kB
AnonPages:      983260 kB
Mapped:          15756 kB
Slab:           455356 kB
PageTables:       7076 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:  5815964 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72604 MiB
End job on node121 at 2011-04-29 02:04:03