Trace number 3289030

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.3 1201.71

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-top22.cnf
MD5SUMe822739302a2d834ec9ddfe9fbd0caa2
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables55875
Number of clauses177646
Sum of the clauses size434144
Maximum clause length2255
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2108197
Number of clauses of size 368250
Number of clauses of size 4252
Number of clauses of size 520
Number of clauses of size over 5926

Solver Data

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3289030-1304080514/watcher-3289030-1304080514 -o /tmp/evaluation-result-3289030-1304080514/solver-3289030-1304080514 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3289030-1304080514.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.40 9.65 9.73 5/185 1258
/proc/meminfo: memFree=30367668/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) R 1256 1258 379 0 -1 4194304 468 0 0 0 0 0 0 0 25 0 1 0 519649325 18763776 388 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550357909 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/1258/statm: 4581 388 339 23 0 91 0

[startup+0.0733259 s]
/proc/loadavg: 9.40 9.65 9.73 5/185 1258
/proc/meminfo: memFree=30367668/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) R 1256 1258 379 0 -1 4202496 524 0 0 0 0 0 0 0 25 0 1 0 519649325 18763776 390 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/1258/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100322 s]
/proc/loadavg: 9.40 9.65 9.73 5/185 1258
/proc/meminfo: memFree=30367668/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) R 1256 1258 379 0 -1 4202496 524 0 0 0 0 0 0 0 25 0 1 0 519649325 18763776 390 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 0 0 0 17 5 0 0 0
/proc/1258/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300288 s]
/proc/loadavg: 9.40 9.65 9.73 5/185 1258
/proc/meminfo: memFree=30367668/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 25 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195386380386304 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.700215 s]
/proc/loadavg: 9.40 9.65 9.73 5/185 1258
/proc/meminfo: memFree=30367668/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 25 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195386380386304 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+1.50107 s]
/proc/loadavg: 9.40 9.65 9.73 10/190 1264
/proc/meminfo: memFree=30275596/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 16 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195738567704576 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
[pid=1259] ppid=1258 vsize=53124 CPUtime=1.49 cores=1
/proc/1259/stat : 1259 (cryptominisat) R 1258 1258 379 0 -1 4202496 7999 0 0 0 148 1 0 0 20 0 1 0 519649325 54398976 7814 33554432000 4194304 4587354 140737189444704 18446744073709551615 4367328 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1259/statm: 13281 7814 312 96 0 9843 0
[pid=1260] ppid=1258 vsize=42092 CPUtime=1.48 cores=5
/proc/1260/stat : 1260 (clasp) R 1258 1258 379 0 -1 4202496 10073 0 0 0 148 0 0 0 25 0 1 0 519649325 43102208 7685 33554432000 4194304 4785740 140736702262736 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1260/statm: 10523 7685 340 145 0 7568 0
[pid=1262] ppid=1258 vsize=17000 CPUtime=1.49 cores=3
/proc/1262/stat : 1262 (lingeling) R 1258 1258 379 0 -1 4202496 5219 0 0 0 149 0 0 0 25 0 1 0 519649325 17408000 3406 33554432000 4194304 4352236 140734665028944 18446744073709551615 4266119 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1262/statm: 4250 3406 121 39 0 3330 0
[pid=1263] ppid=1258 vsize=124344 CPUtime=1.45 cores=7
/proc/1263/stat : 1263 (march_hi) R 1258 1258 379 0 -1 4202496 65976 0 0 0 136 9 0 0 25 0 1 0 519649325 127328256 15134 33554432000 4194304 4331988 140735872607872 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1263/statm: 31086 15134 225 34 0 29528 0
Current children cumulated CPU time (s) 5.92
Current children cumulated vsize (KiB) 254884

[startup+3.10078 s]
/proc/loadavg: 9.29 9.62 9.72 9/190 1264
/proc/meminfo: memFree=30228788/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639368 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
[pid=1259] ppid=1258 vsize=74016 CPUtime=3.09 cores=1
/proc/1259/stat : 1259 (cryptominisat) R 1258 1258 379 0 -1 4202496 17062 0 0 0 307 2 0 0 25 0 1 0 519649325 75792384 13575 33554432000 4194304 4587354 140737189444704 18446744073709551615 4238736 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1259/statm: 18504 13575 330 96 0 15066 0
[pid=1260] ppid=1258 vsize=42092 CPUtime=3.09 cores=5
/proc/1260/stat : 1260 (clasp) R 1258 1258 379 0 -1 4202496 10133 0 0 0 308 1 0 0 25 0 1 0 519649325 43102208 7745 33554432000 4194304 4785740 140736702262736 18446744073709551615 4553027 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1260/statm: 10523 7745 340 145 0 7568 0
[pid=1262] ppid=1258 vsize=27632 CPUtime=3.08 cores=3
/proc/1262/stat : 1262 (lingeling) R 1258 1258 379 0 -1 4202496 7887 0 0 0 308 0 0 0 25 0 1 0 519649325 28295168 6074 33554432000 4194304 4352236 140734665028944 18446744073709551615 4297809 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1262/statm: 6908 6074 125 39 0 5988 0
[pid=1263] ppid=1258 vsize=126748 CPUtime=3.06 cores=7
/proc/1263/stat : 1263 (march_hi) R 1258 1258 379 0 -1 4202496 66829 0 0 0 296 10 0 0 25 0 1 0 519649325 129789952 15945 33554432000 4194304 4331988 140735872607872 18446744073709551615 4263246 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1263/statm: 31687 15945 186 34 0 30129 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 288812

[startup+6.3012 s]
/proc/loadavg: 9.29 9.62 9.72 9/190 1264
/proc/meminfo: memFree=30184260/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639368 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
[pid=1259] ppid=1258 vsize=111520 CPUtime=6.28 cores=1
/proc/1259/stat : 1259 (cryptominisat) R 1258 1258 379 0 -1 4202496 17827 0 0 0 626 2 0 0 25 0 1 0 519649325 114196480 14315 33554432000 4194304 4587354 140737189444704 18446744073709551615 4236455 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1259/statm: 27880 14315 333 96 0 24442 0
[pid=1260] ppid=1258 vsize=45992 CPUtime=6.28 cores=5
/proc/1260/stat : 1260 (clasp) R 1258 1258 379 0 -1 4202496 11091 0 0 0 627 1 0 0 25 0 1 0 519649325 47095808 8703 33554432000 4194304 4785740 140736702262736 18446744073709551615 4287022 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1260/statm: 11498 8703 340 145 0 8543 0
[pid=1262] ppid=1258 vsize=27632 CPUtime=6.29 cores=3
/proc/1262/stat : 1262 (lingeling) R 1258 1258 379 0 -1 4202496 7887 0 0 0 629 0 0 0 25 0 1 0 519649325 28295168 6074 33554432000 4194304 4352236 140734665028944 18446744073709551615 4302253 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1262/statm: 6908 6074 125 39 0 5988 0
[pid=1263] ppid=1258 vsize=133400 CPUtime=6.24 cores=7
/proc/1263/stat : 1263 (march_hi) R 1258 1258 379 0 -1 4202496 68837 0 0 0 614 10 0 0 25 0 1 0 519649325 136601600 17942 33554432000 4194304 4331988 140735872607872 18446744073709551615 4237130 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1263/statm: 33350 17942 175 34 0 31792 0
Current children cumulated CPU time (s) 25.1
Current children cumulated vsize (KiB) 336868

[startup+12.701 s]
/proc/loadavg: 9.09 9.56 9.71 10/190 1264
/proc/meminfo: memFree=30173688/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639368 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
[pid=1259] ppid=1258 vsize=114812 CPUtime=12.69 cores=1
/proc/1259/stat : 1259 (cryptominisat) R 1258 1258 379 0 -1 4202496 19460 0 0 0 1266 3 0 0 25 0 1 0 519649325 117567488 15933 33554432000 4194304 4587354 140737189444704 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1259/statm: 28703 15933 336 96 0 25265 0
[pid=1260] ppid=1258 vsize=51780 CPUtime=12.68 cores=5
/proc/1260/stat : 1260 (clasp) R 1258 1258 379 0 -1 4202496 12527 0 0 0 1266 2 0 0 25 0 1 0 519649325 53022720 10139 33554432000 4194304 4785740 140736702262736 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1260/statm: 12945 10139 340 145 0 9990 0
[pid=1262] ppid=1258 vsize=23400 CPUtime=12.68 cores=3
/proc/1262/stat : 1262 (lingeling) R 1258 1258 379 0 -1 4202496 7889 0 0 0 1268 0 0 0 25 0 1 0 519649325 23961600 5018 33554432000 4194304 4352236 140734665028944 18446744073709551615 4257381 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1262/statm: 5850 5018 127 39 0 4930 0
[pid=1263] ppid=1258 vsize=134208 CPUtime=12.6 cores=7
/proc/1263/stat : 1263 (march_hi) R 1258 1258 379 0 -1 4202496 69056 0 0 0 1250 10 0 0 25 0 1 0 519649325 137428992 18161 33554432000 4194304 4331988 140735872607872 18446744073709551615 4265452 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1263/statm: 33552 18161 175 34 0 31994 0
Current children cumulated CPU time (s) 50.66
Current children cumulated vsize (KiB) 342524

[startup+25.5007 s]
/proc/loadavg: 8.92 9.51 9.69 9/190 1264
/proc/meminfo: memFree=30155792/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639368 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
[pid=1259] ppid=1258 vsize=2132556 CPUtime=25.49 cores=1
/proc/1259/stat : 1259 (cryptominisat) R 1258 1258 379 0 -1 4202496 27904 0 0 0 2544 5 0 0 25 0 1 0 519649325 2183737344 16252 33554432000 4194304 4587354 140737189444704 18446744073709551615 4237665 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1259/statm: 533139 16252 336 96 0 529701 0
[pid=1260] ppid=1258 vsize=59744 CPUtime=25.48 cores=5
/proc/1260/stat : 1260 (clasp) R 1258 1258 379 0 -1 4202496 14432 0 0 0 2545 3 0 0 25 0 1 0 519649325 61177856 12044 33554432000 4194304 4785740 140736702262736 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1260/statm: 14936 12044 340 145 0 11981 0
[pid=1262] ppid=1258 vsize=23396 CPUtime=25.48 cores=3
/proc/1262/stat : 1262 (lingeling) R 1258 1258 379 0 -1 4202496 7889 0 0 0 2548 0 0 0 25 0 1 0 519649325 23957504 5017 33554432000 4194304 4352236 140734665028944 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1262/statm: 5849 5017 127 39 0 4929 0
[pid=1263] ppid=1258 vsize=135196 CPUtime=25.32 cores=7
/proc/1263/stat : 1263 (march_hi) R 1258 1258 379 0 -1 4202496 69294 0 0 0 2522 10 0 0 25 0 1 0 519649325 138440704 18399 33554432000 4194304 4331988 140735872607872 18446744073709551615 4228459 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1263/statm: 33799 18399 175 34 0 32241 0
Current children cumulated CPU time (s) 101.78
Current children cumulated vsize (KiB) 2369216

[startup+51.1011 s]
/proc/loadavg: 8.76 9.42 9.65 10/190 1265
/proc/meminfo: memFree=30125168/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639368 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
[pid=1259] ppid=1258 vsize=2120328 CPUtime=51.09 cores=1
/proc/1259/stat : 1259 (cryptominisat) R 1258 1258 379 0 -1 4202496 37851 0 0 0 5101 8 0 0 25 0 1 0 519649325 2171215872 18262 33554432000 4194304 4587354 140737189444704 18446744073709551615 4230288 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1259/statm: 530082 18262 336 96 0 526644 0
[pid=1260] ppid=1258 vsize=69100 CPUtime=51.09 cores=5
/proc/1260/stat : 1260 (clasp) R 1258 1258 379 0 -1 4202496 16734 0 0 0 5104 5 0 0 25 0 1 0 519649325 70758400 14346 33554432000 4194304 4785740 140736702262736 18446744073709551615 4552608 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1260/statm: 17275 14346 340 145 0 14320 0
[pid=1262] ppid=1258 vsize=23392 CPUtime=51.09 cores=3
/proc/1262/stat : 1262 (lingeling) R 1258 1258 379 0 -1 4202496 9937 0 0 0 5108 1 0 0 25 0 1 0 519649325 23953408 5016 33554432000 4194304 4352236 140734665028944 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1262/statm: 5848 5016 127 39 0 4928 0
[pid=1263] ppid=1258 vsize=136484 CPUtime=50.79 cores=7
/proc/1263/stat : 1263 (march_hi) R 1258 1258 379 0 -1 4202496 69614 0 0 0 5069 10 0 0 25 0 1 0 519649325 139759616 18719 33554432000 4194304 4331988 140735872607872 18446744073709551615 4237147 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1263/statm: 34121 18719 175 34 0 32563 0
Current children cumulated CPU time (s) 204.07
Current children cumulated vsize (KiB) 2367628

[startup+102.307 s]
/proc/loadavg: 8.46 9.21 9.56 10/190 1267
/proc/meminfo: memFree=30087440/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639368 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
[pid=1259] ppid=1258 vsize=2169616 CPUtime=102.29 cores=1
/proc/1259/stat : 1259 (cryptominisat) R 1258 1258 379 0 -1 4202496 43209 0 0 0 10221 8 0 0 25 0 1 0 519649325 2221686784 23613 33554432000 4194304 4587354 140737189444704 18446744073709551615 4238406 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1259/statm: 542404 23613 336 96 0 538966 0
[pid=1260] ppid=1258 vsize=87908 CPUtime=102.29 cores=5

################
# More data... #
################


[startup+942.3 s]
/proc/loadavg: 9.20 8.58 8.84 10/191 1322
/proc/meminfo: memFree=30202072/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639368 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
[pid=1259] ppid=1258 vsize=2229576 CPUtime=942.31 cores=1
/proc/1259/stat : 1259 (cryptominisat) R 1258 1258 379 0 -1 4202496 106897 0 0 0 94197 34 0 0 25 0 1 0 519649325 2283085824 36739 33554432000 4194304 4587354 140737189444704 18446744073709551615 4238668 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1259/statm: 557394 36739 336 96 0 553956 0
[pid=1260] ppid=1258 vsize=177720 CPUtime=942.31 cores=5
/proc/1260/stat : 1260 (clasp) R 1258 1258 379 0 -1 4202496 43011 0 0 0 94213 18 0 0 25 0 1 0 519649325 181985280 40623 33554432000 4194304 4785740 140736702262736 18446744073709551615 4553051 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1260/statm: 44430 40623 340 145 0 41475 0
[pid=1262] ppid=1258 vsize=58496 CPUtime=942.31 cores=3
/proc/1262/stat : 1262 (lingeling) R 1258 1258 379 0 -1 4202496 50714 0 0 0 94226 5 0 0 25 0 1 0 519649325 59899904 13792 33554432000 4194304 4352236 140734665028944 18446744073709551615 4328345 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1262/statm: 14624 13792 127 39 0 13704 0
[pid=1263] ppid=1258 vsize=144464 CPUtime=937.15 cores=7
/proc/1263/stat : 1263 (march_hi) R 1258 1258 379 0 -1 4202496 71478 0 0 0 93703 12 0 0 25 0 1 0 519649325 147931136 20583 33554432000 4194304 4331988 140735872607872 18446744073709551615 4265452 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1263/statm: 36116 20583 175 34 0 34558 0
Current children cumulated CPU time (s) 3764.09
Current children cumulated vsize (KiB) 2628580

[startup+1002.3 s]
/proc/loadavg: 9.32 8.72 8.87 10/191 1324
/proc/meminfo: memFree=30196692/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639368 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
[pid=1259] ppid=1258 vsize=2204312 CPUtime=1002.32 cores=1
/proc/1259/stat : 1259 (cryptominisat) R 1258 1258 379 0 -1 4202496 108845 0 0 0 100196 36 0 0 25 0 1 0 519649325 2257215488 33233 33554432000 4194304 4587354 140737189444704 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1259/statm: 551078 33233 336 96 0 547640 0
[pid=1260] ppid=1258 vsize=186460 CPUtime=1002.3 cores=5
/proc/1260/stat : 1260 (clasp) R 1258 1258 379 0 -1 4202496 45013 0 0 0 100212 18 0 0 25 0 1 0 519649325 190935040 42625 33554432000 4194304 4785740 140736702262736 18446744073709551615 4287050 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1260/statm: 46615 42625 340 145 0 43660 0
[pid=1262] ppid=1258 vsize=58496 CPUtime=1002.31 cores=3
/proc/1262/stat : 1262 (lingeling) R 1258 1258 379 0 -1 4202496 53786 0 0 0 100226 5 0 0 25 0 1 0 519649325 59899904 13792 33554432000 4194304 4352236 140734665028944 18446744073709551615 4207863 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1262/statm: 14624 13792 127 39 0 13704 0
[pid=1263] ppid=1258 vsize=144464 CPUtime=996.83 cores=7
/proc/1263/stat : 1263 (march_hi) R 1258 1258 379 0 -1 4202496 71540 0 0 0 99671 12 0 0 25 0 1 0 519649325 147931136 20645 33554432000 4194304 4331988 140735872607872 18446744073709551615 4284439 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1263/statm: 36116 20645 175 34 0 34558 0
Current children cumulated CPU time (s) 4003.77
Current children cumulated vsize (KiB) 2612056

[startup+1062.3 s]
/proc/loadavg: 9.41 8.83 8.89 10/191 1325
/proc/meminfo: memFree=30146308/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639368 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
[pid=1259] ppid=1258 vsize=2192224 CPUtime=1062.32 cores=1
/proc/1259/stat : 1259 (cryptominisat) R 1258 1258 379 0 -1 4202496 114548 0 0 0 106193 39 0 0 25 0 1 0 519649325 2244837376 33233 33554432000 4194304 4587354 140737189444704 18446744073709551615 4238435 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1259/statm: 548056 33233 336 96 0 544618 0
[pid=1260] ppid=1258 vsize=186888 CPUtime=1062.3 cores=5
/proc/1260/stat : 1260 (clasp) R 1258 1258 379 0 -1 4202496 45114 0 0 0 106212 18 0 0 25 0 1 0 519649325 191373312 42726 33554432000 4194304 4785740 140736702262736 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1260/statm: 46722 42726 340 145 0 43767 0
[pid=1262] ppid=1258 vsize=58496 CPUtime=1062.32 cores=3
/proc/1262/stat : 1262 (lingeling) R 1258 1258 379 0 -1 4202496 56858 0 0 0 106226 6 0 0 25 0 1 0 519649325 59899904 13792 33554432000 4194304 4352236 140734665028944 18446744073709551615 4329004 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1262/statm: 14624 13792 127 39 0 13704 0
[pid=1263] ppid=1258 vsize=144464 CPUtime=1056.5 cores=7
/proc/1263/stat : 1263 (march_hi) R 1258 1258 379 0 -1 4202496 71596 0 0 0 105638 12 0 0 25 0 1 0 519649325 147931136 20701 33554432000 4194304 4331988 140735872607872 18446744073709551615 4263253 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1263/statm: 36116 20701 175 34 0 34558 0
Current children cumulated CPU time (s) 4243.45
Current children cumulated vsize (KiB) 2600396

[startup+1122.3 s]
/proc/loadavg: 9.27 8.89 8.91 11/191 1327
/proc/meminfo: memFree=30148376/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639368 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
[pid=1259] ppid=1258 vsize=2265252 CPUtime=1122.32 cores=1
/proc/1259/stat : 1259 (cryptominisat) R 1258 1258 379 0 -1 4202496 115052 0 0 0 112193 39 0 0 25 0 1 0 519649325 2319618048 33233 33554432000 4194304 4587354 140737189444704 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1259/statm: 566313 33233 336 96 0 562875 0
[pid=1260] ppid=1258 vsize=191060 CPUtime=1122.31 cores=5
/proc/1260/stat : 1260 (clasp) R 1258 1258 379 0 -1 4202496 46055 0 0 0 112212 19 0 0 25 0 1 0 519649325 195645440 43667 33554432000 4194304 4785740 140736702262736 18446744073709551615 4553032 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1260/statm: 47765 43667 340 145 0 44810 0
[pid=1262] ppid=1258 vsize=59520 CPUtime=1122.32 cores=3
/proc/1262/stat : 1262 (lingeling) R 1258 1258 379 0 -1 4202496 58394 0 0 0 112226 6 0 0 25 0 1 0 519649325 60948480 14048 33554432000 4194304 4352236 140734665028944 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1262/statm: 14880 14048 127 39 0 13960 0
[pid=1263] ppid=1258 vsize=146320 CPUtime=1116.17 cores=7
/proc/1263/stat : 1263 (march_hi) R 1258 1258 379 0 -1 4202496 71657 0 0 0 111605 12 0 0 25 0 1 0 519649325 149831680 20762 33554432000 4194304 4331988 140735872607872 18446744073709551615 271549932653 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1263/statm: 36580 20762 175 34 0 35022 0
Current children cumulated CPU time (s) 4483.13
Current children cumulated vsize (KiB) 2680476

[startup+1182.3 s]
/proc/loadavg: 9.31 8.95 8.93 10/191 1328
/proc/meminfo: memFree=30131708/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639368 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
[pid=1259] ppid=1258 vsize=2207936 CPUtime=1182.32 cores=1
/proc/1259/stat : 1259 (cryptominisat) R 1258 1258 379 0 -1 4202496 120604 0 0 0 118190 42 0 0 25 0 1 0 519649325 2260926464 33262 33554432000 4194304 4587354 140737189444704 18446744073709551615 4238273 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1259/statm: 551984 33262 336 96 0 548546 0
[pid=1260] ppid=1258 vsize=194236 CPUtime=1182.31 cores=5
/proc/1260/stat : 1260 (clasp) R 1258 1258 379 0 -1 4202496 46765 0 0 0 118212 19 0 0 25 0 1 0 519649325 198897664 44377 33554432000 4194304 4785740 140736702262736 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1260/statm: 48559 44377 340 145 0 45604 0
[pid=1262] ppid=1258 vsize=60544 CPUtime=1182.32 cores=3
/proc/1262/stat : 1262 (lingeling) R 1258 1258 379 0 -1 4202496 59162 0 0 0 118226 6 0 0 25 0 1 0 519649325 61997056 14304 33554432000 4194304 4352236 140734665028944 18446744073709551615 4327902 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1262/statm: 15136 14304 127 39 0 14216 0
[pid=1263] ppid=1258 vsize=146320 CPUtime=1175.85 cores=7
/proc/1263/stat : 1263 (march_hi) R 1258 1258 379 0 -1 4202496 71711 0 0 0 117573 12 0 0 25 0 1 0 519649325 149831680 20816 33554432000 4194304 4331988 140735872607872 18446744073709551615 4265701 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1263/statm: 36580 20816 175 34 0 35022 0
Current children cumulated CPU time (s) 4722.81
Current children cumulated vsize (KiB) 2627360



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 9.22 8.96 8.93 10/191 1329
/proc/meminfo: memFree=30141732/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639368 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
[pid=1259] ppid=1258 vsize=2209408 CPUtime=1201.72 cores=1
/proc/1259/stat : 1259 (cryptominisat) R 1258 1258 379 0 -1 4202496 120989 0 0 0 120130 42 0 0 25 0 1 0 519649325 2262433792 33262 33554432000 4194304 4587354 140737189444704 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1259/statm: 552352 33262 336 96 0 548914 0
[pid=1260] ppid=1258 vsize=194820 CPUtime=1201.71 cores=5
/proc/1260/stat : 1260 (clasp) R 1258 1258 379 0 -1 4202496 46920 0 0 0 120152 19 0 0 25 0 1 0 519649325 199495680 44532 33554432000 4194304 4785740 140736702262736 18446744073709551615 4286919 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1260/statm: 48705 44532 340 145 0 45750 0
[pid=1262] ppid=1258 vsize=58496 CPUtime=1201.72 cores=3
/proc/1262/stat : 1262 (lingeling) R 1258 1258 379 0 -1 4202496 59162 0 0 0 120166 6 0 0 25 0 1 0 519649325 59899904 13792 33554432000 4194304 4352236 140734665028944 18446744073709551615 4328095 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1262/statm: 14624 13792 127 39 0 13704 0
[pid=1263] ppid=1258 vsize=146320 CPUtime=1195.14 cores=7
/proc/1263/stat : 1263 (march_hi) R 1258 1258 379 0 -1 4202496 71731 0 0 0 119502 12 0 0 25 0 1 0 519649325 149831680 20836 33554432000 4194304 4331988 140735872607872 18446744073709551615 4287504 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1263/statm: 36580 20836 175 34 0 35022 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 2627368

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1201.7 s]
/proc/loadavg: 9.22 8.96 8.93 10/191 1329
/proc/meminfo: memFree=30141732/32951124 swapFree=67111344/67111528
[pid=1258] ppid=1256 vsize=18324 CPUtime=0.01 cores=1,3,5,7
/proc/1258/stat : 1258 (ppfolio) S 1256 1258 379 0 -1 4202496 525 1196 0 0 0 0 0 1 15 0 1 0 519649325 18763776 391 33554432000 4194304 4287625 140735598187248 18446744073709551615 271550557711 0 0 4096 65536 9224195742862639368 0 0 17 5 0 0 0
/proc/1258/statm: 4581 391 342 23 0 91 0
[pid=1259] ppid=1258 vsize=2209408 CPUtime=1201.72 cores=1
/proc/1259/stat : 1259 (cryptominisat) R 1258 1258 379 0 -1 4202496 120989 0 0 0 120130 42 0 0 25 0 1 0 519649325 2262433792 33262 33554432000 4194304 4587354 140737189444704 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/1259/statm: 552352 33262 336 96 0 548914 0
[pid=1260] ppid=1258 vsize=194820 CPUtime=1201.71 cores=5
/proc/1260/stat : 1260 (clasp) R 1258 1258 379 0 -1 4202496 46920 0 0 0 120152 19 0 0 25 0 1 0 519649325 199495680 44532 33554432000 4194304 4785740 140736702262736 18446744073709551615 4286919 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/1260/statm: 48705 44532 340 145 0 45750 0
[pid=1262] ppid=1258 vsize=58496 CPUtime=1201.72 cores=3
/proc/1262/stat : 1262 (lingeling) R 1258 1258 379 0 -1 4202496 59162 0 0 0 120166 6 0 0 25 0 1 0 519649325 59899904 13792 33554432000 4194304 4352236 140734665028944 18446744073709551615 4328095 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/1262/statm: 14624 13792 127 39 0 13704 0
[pid=1263] ppid=1258 vsize=146320 CPUtime=1195.14 cores=7
/proc/1263/stat : 1263 (march_hi) R 1258 1258 379 0 -1 4202496 71731 0 0 0 119502 12 0 0 25 0 1 0 519649325 149831680 20836 33554432000 4194304 4331988 140735872607872 18446744073709551615 4287504 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/1263/statm: 36580 20836 175 34 0 35022 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 2627368

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1258 and gives
#  childrusage.ru_utime.tv_sec=1201
#  childrusage.ru_utime.tv_usec=680316
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=89986
# CPU time returned by wait4() is 1201.77
# while last known CPU time is 4800.3
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.3
CPU user time (s): 4799.5
CPU system time (s): 0.8
CPU usage (%): 399.455
Max. virtual memory (cumulated for all children) (KiB): 4722480

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1201.68
system time used= 0.089986
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 60884
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 290
involuntary context switches= 2048

runsolver used 1.88371 second user time and 4.68029 second system time

The end

Launcher Data

Begin job on node133 at 2011-04-29 14:35:14
IDJOB=3289030
IDBENCH=83113
IDSOLVER=1612
FILE ID=node133/3289030-1304080514
RUNJOBID= node133-1304077694-398
PBS_JOBID= 13170511
Free space on /tmp= 71876 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-top22.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3289030-1304080514/watcher-3289030-1304080514 -o /tmp/evaluation-result-3289030-1304080514/solver-3289030-1304080514 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3289030-1304080514.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e822739302a2d834ec9ddfe9fbd0caa2
RANDOM SEED=1052642381

node133.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 6741.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.834
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30367948 kB
Buffers:        737540 kB
Cached:         982752 kB
SwapCached:        124 kB
Active:        1057084 kB
Inactive:      1167612 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30367948 kB
SwapTotal:    67111528 kB
SwapFree:     67111344 kB
Dirty:           13240 kB
Writeback:           0 kB
AnonPages:      504504 kB
Mapped:          16352 kB
Slab:           294364 kB
PageTables:       5956 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   977464 kB
VmallocTotal: 34359738367 kB
VmallocUsed:     33868 kB
VmallocChunk: 34359703231 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71868 MiB
End job on node133 at 2011-04-29 14:55:18