Trace number 3289537

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1300.01 1300.01

General information on the benchmark

Nameapplication/fuhs/slp-synthesis-AES/
slp-synthesis-aes-top30.cnf
MD5SUM31142839684b7824419884a35a31fc88
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark111.102
Satisfiable
(Un)Satisfiability was proved
Number of variables101451
Number of clauses323566
Sum of the clauses size791464
Maximum clause length3667
Minimum clause length1
Number of clauses of size 11
Number of clauses of size 2195809
Number of clauses of size 3125762
Number of clauses of size 4464
Number of clauses of size 528
Number of clauses of size over 51502

Solver Data

0.00/0.01	This is pico-portfolio, a naive parallel portfolio
0.00/0.01	Copyright (C) 2011 Olivier Roussel
0.00/0.01	Using 1 processing units
0.00/0.01	This portfolio uses the following solvers:
0.00/0.01	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.01	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.01	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.01	Starting cryptominisat 2.7.1 on core(s) 5
0.00/0.01	Starting clasp 1.3.6 on core(s) 5
0.00/0.01	Starting TNM 2009 on core(s) 5

Verifier Data

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3289537-1303774566/watcher-3289537-1303774566 -o /tmp/evaluation-result-3289537-1303774566/solver-3289537-1303774566 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3289537-1303774566.cnf 

running on 2 cores: 5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.70 2.58 3.05 6/189 12431
/proc/meminfo: memFree=20808044/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=11800 CPUtime=0 cores=5,7
/proc/12431/stat : 12431 (runsolver) R 12429 12431 11530 0 -1 4202560 41 0 0 0 0 0 0 0 21 0 1 0 489056347 12083200 52 33554432000 4194304 5434984 140735647937776 18446744073709551615 4881607 0 2147483391 4096 24578 0 0 0 17 7 0 0 0
/proc/12431/statm: 2950 52 31 303 0 2644 0

[startup+0.088538 s]
/proc/loadavg: 1.70 2.58 3.05 6/189 12431
/proc/meminfo: memFree=20808044/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 500 0 0 0 0 0 0 0 23 0 1 0 489056347 18763776 394 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 0 0 0 17 7 0 0 0
/proc/12431/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100533 s]
/proc/loadavg: 1.70 2.58 3.05 6/189 12431
/proc/meminfo: memFree=20808044/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 23 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 32767 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.300497 s]
/proc/loadavg: 1.70 2.58 3.05 6/189 12431
/proc/meminfo: memFree=20808044/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 22 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 2802957955870228480 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+0.700427 s]
/proc/loadavg: 1.70 2.58 3.05 6/189 12431
/proc/meminfo: memFree=20808044/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 22 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 2802957955870228480 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
Current children cumulated CPU time (s) 0.01
Current children cumulated vsize (KiB) 18324

[startup+1.50029 s]
/proc/loadavg: 1.70 2.58 3.05 11/200 12448
/proc/meminfo: memFree=20651600/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 22 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 2802957955870228480 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=58264 CPUtime=0.74 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 9531 0 0 0 73 1 0 0 25 0 1 0 489056348 59662336 9220 33554432000 4194304 4587354 140734912418624 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 14566 9220 306 96 0 11128 0
[pid=12434] ppid=12431 vsize=69796 CPUtime=0.71 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 16652 0 0 0 69 2 0 0 25 0 1 0 489056348 71471104 14402 33554432000 4194304 4785740 140733717515728 18446744073709551615 4495610 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 17449 14402 319 145 0 14494 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 146384

[startup+3.101 s]
/proc/loadavg: 1.70 2.58 3.05 11/200 12448
/proc/meminfo: memFree=20627660/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 17 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=76608 CPUtime=1.54 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 14048 0 0 0 152 2 0 0 25 0 1 0 489056348 78446592 13737 33554432000 4194304 4587354 140734912418624 18446744073709551615 4421069 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 19152 13737 312 96 0 15714 0
[pid=12434] ppid=12431 vsize=67200 CPUtime=1.51 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 17600 0 0 0 149 2 0 0 25 0 1 0 489056348 68812800 13764 33554432000 4194304 4785740 140733717515728 18446744073709551615 4319144 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 16800 13764 340 145 0 13845 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 162132

[startup+6.30043 s]
/proc/loadavg: 2.45 2.71 3.09 11/200 12448
/proc/meminfo: memFree=20572740/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 17 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=76976 CPUtime=3.14 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 14160 0 0 0 312 2 0 0 25 0 1 0 489056348 78823424 13849 33554432000 4194304 4587354 140734912418624 18446744073709551615 4421100 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 19244 13849 324 96 0 15806 0
[pid=12434] ppid=12431 vsize=67200 CPUtime=3.11 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 17600 0 0 0 309 2 0 0 25 0 1 0 489056348 68812800 13764 33554432000 4194304 4785740 140733717515728 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 16800 13764 340 145 0 13845 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 162500

[startup+12.7003 s]
/proc/loadavg: 3.05 2.84 3.13 11/200 12448
/proc/meminfo: memFree=20517244/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=151880 CPUtime=6.35 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 30212 0 0 0 630 5 0 0 25 0 1 0 489056348 155525120 24413 33554432000 4194304 4587354 140734912418624 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 37970 24413 330 96 0 34532 0
[pid=12434] ppid=12431 vsize=68136 CPUtime=6.31 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 17867 0 0 0 629 2 0 0 25 0 1 0 489056348 69771264 14031 33554432000 4194304 4785740 140733717515728 18446744073709551615 4327320 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 17034 14031 340 145 0 14079 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 238340

[startup+25.501 s]
/proc/loadavg: 4.59 3.19 3.24 11/200 12449
/proc/meminfo: memFree=20452280/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=151880 CPUtime=12.75 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 30795 0 0 0 1270 5 0 0 25 0 1 0 489056348 155525120 24979 33554432000 4194304 4587354 140734912418624 18446744073709551615 4449056 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 37970 24979 336 96 0 34532 0
[pid=12434] ppid=12431 vsize=76264 CPUtime=12.72 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 19867 0 0 0 1269 3 0 0 25 0 1 0 489056348 78094336 16031 33554432000 4194304 4785740 140733717515728 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 19066 16031 340 145 0 16111 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 246468

[startup+51.1005 s]
/proc/loadavg: 6.44 3.73 3.42 11/200 12450
/proc/meminfo: memFree=20384940/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=2116436 CPUtime=25.55 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 36648 0 0 0 2549 6 0 0 25 0 1 0 489056348 2167230464 25997 33554432000 4194304 4587354 140734912418624 18446744073709551615 4237639 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 529109 25997 336 96 0 525671 0
[pid=12434] ppid=12431 vsize=89132 CPUtime=25.52 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 22996 0 0 0 2548 4 0 0 25 0 1 0 489056348 91271168 19160 33554432000 4194304 4785740 140733717515728 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 22283 19160 340 145 0 19328 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 2223892

[startup+102.307 s]
/proc/loadavg: 8.45 4.70 3.76 11/200 12451
/proc/meminfo: memFree=20331108/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=2155548 CPUtime=51.16 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 51513 0 0 0 5107 9 0 0 25 0 1 0 489056348 2207281152 29424 33554432000 4194304 4587354 140734912418624 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 538887 29424 336 96 0 535449 0
[pid=12434] ppid=12431 vsize=101764 CPUtime=51.1 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 26074 0 0 0 5106 4 0 0 25 0 1 0 489056348 104206336 22238 33554432000 4194304 4785740 140733717515728 18446744073709551615 4552662 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 25441 22238 340 145 0 22486 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 2275636

[startup+162.301 s]
/proc/loadavg: 9.55 5.69 4.16 11/200 12452
/proc/meminfo: memFree=20246520/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=2145740 CPUtime=81.16 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 58218 0 0 0 8106 10 0 0 25 0 1 0 489056348 2197237760 32202 33554432000 4194304 4587354 140734912418624 18446744073709551615 4238406 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 536435 32202 336 96 0 532997 0
[pid=12434] ppid=12431 vsize=116420 CPUtime=81.11 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 29688 0 0 0 8105 6 0 0 25 0 1 0 489056348 119214080 25852 33554432000 4194304 4785740 140733717515728 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 29105 25852 340 145 0 26150 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 2280484

[startup+222.301 s]
/proc/loadavg: 9.83 6.47 4.52 11/200 12454
/proc/meminfo: memFree=20220328/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=2177904 CPUtime=111.16 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 62363 0 0 0 11105 11 0 0 25 0 1 0 489056348 2230173696 32228 33554432000 4194304 4587354 140734912418624 18446744073709551615 4237681 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 544476 32228 336 96 0 541038 0
[pid=12434] ppid=12431 vsize=121864 CPUtime=111.1 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 30902 0 0 0 11104 6 0 0 25 0 1 0 489056348 124788736 27066 33554432000 4194304 4785740 140733717515728 18446744073709551615 4546275 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 30466 27066 340 145 0 27511 0
Current children cumulated CPU time (s) 222.27
Current children cumulated vsize (KiB) 2318092

[startup+282.3 s]

################
# More data... #
################

/proc/meminfo: memFree=19997316/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=155744 CPUtime=381.18 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 97425 0 0 0 38097 21 0 0 25 0 1 0 489056348 159481856 34193 33554432000 4194304 4587354 140734912418624 18446744073709551615 4243419 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 38936 34193 336 96 0 35498 0
[pid=12434] ppid=12431 vsize=179624 CPUtime=381.1 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 44853 0 0 0 38098 12 0 0 25 0 1 0 489056348 183934976 41017 33554432000 4194304 4785740 140733717515728 18446744073709551615 237278576151 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 44906 41017 340 145 0 41951 0
Current children cumulated CPU time (s) 762.29
Current children cumulated vsize (KiB) 353692

[startup+822.3 s]
/proc/loadavg: 10.02 9.54 7.12 11/200 12470
/proc/meminfo: memFree=19978312/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=2154092 CPUtime=411.18 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 103929 0 0 0 41095 23 0 0 25 0 1 0 489056348 2205790208 34194 33554432000 4194304 4587354 140734912418624 18446744073709551615 4238763 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 538523 34194 336 96 0 535085 0
[pid=12434] ppid=12431 vsize=183384 CPUtime=411.11 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 45747 0 0 0 41098 13 0 0 25 0 1 0 489056348 187785216 41911 33554432000 4194304 4785740 140733717515728 18446744073709551615 4553046 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 45846 41911 340 145 0 42891 0
Current children cumulated CPU time (s) 822.3
Current children cumulated vsize (KiB) 2355800

[startup+882.301 s]
/proc/loadavg: 10.01 9.62 7.30 11/200 12472
/proc/meminfo: memFree=19974192/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=2160460 CPUtime=441.17 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 111065 0 0 0 44092 25 0 0 25 0 1 0 489056348 2212311040 34629 33554432000 4194304 4587354 140734912418624 18446744073709551615 4239572 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 540115 34629 336 96 0 536677 0
[pid=12434] ppid=12431 vsize=183528 CPUtime=441.11 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 45779 0 0 0 44098 13 0 0 25 0 1 0 489056348 187932672 41943 33554432000 4194304 4785740 140733717515728 18446744073709551615 4309555 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 45882 41943 340 145 0 42927 0
Current children cumulated CPU time (s) 882.29
Current children cumulated vsize (KiB) 2362312

[startup+942.301 s]
/proc/loadavg: 10.00 9.69 7.47 11/200 12473
/proc/meminfo: memFree=19927420/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=270528 CPUtime=471.17 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 117827 0 0 0 47090 27 0 0 25 0 1 0 489056348 277020672 40612 33554432000 4194304 4587354 140734912418624 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 67632 40612 336 96 0 64194 0
[pid=12434] ppid=12431 vsize=190568 CPUtime=471.12 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 47507 0 0 0 47099 13 0 0 25 0 1 0 489056348 195141632 43671 33554432000 4194304 4785740 140733717515728 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 47642 43671 340 145 0 44687 0
Current children cumulated CPU time (s) 942.3
Current children cumulated vsize (KiB) 479420

[startup+1002.3 s]
/proc/loadavg: 10.00 9.74 7.62 11/200 12475
/proc/meminfo: memFree=19906936/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=2155332 CPUtime=501.16 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 124647 0 0 0 50087 29 0 0 25 0 1 0 489056348 2207059968 34629 33554432000 4194304 4587354 140734912418624 18446744073709551615 4237661 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 538833 34629 336 96 0 535395 0
[pid=12434] ppid=12431 vsize=208724 CPUtime=501.12 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 51921 0 0 0 50096 16 0 0 25 0 1 0 489056348 213733376 48085 33554432000 4194304 4785740 140733717515728 18446744073709551615 4286953 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 52181 48085 340 145 0 49226 0
Current children cumulated CPU time (s) 1002.29
Current children cumulated vsize (KiB) 2382380

[startup+1062.3 s]
/proc/loadavg: 10.09 9.82 7.78 11/200 12476
/proc/meminfo: memFree=19876536/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=2191648 CPUtime=531.16 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 135527 0 0 0 53083 33 0 0 25 0 1 0 489056348 2244247552 38011 33554432000 4194304 4587354 140734912418624 18446744073709551615 4238499 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 547912 38011 336 96 0 544474 0
[pid=12434] ppid=12431 vsize=211748 CPUtime=531.13 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 52668 0 0 0 53097 16 0 0 25 0 1 0 489056348 216829952 48832 33554432000 4194304 4785740 140733717515728 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 52937 48832 340 145 0 49982 0
Current children cumulated CPU time (s) 1062.3
Current children cumulated vsize (KiB) 2421720

[startup+1122.3 s]
/proc/loadavg: 10.03 9.85 7.91 11/200 12478
/proc/meminfo: memFree=19866712/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=2299488 CPUtime=561.15 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 138842 0 0 0 56081 34 0 0 25 0 1 0 489056348 2354675712 34675 33554432000 4194304 4587354 140734912418624 18446744073709551615 4237661 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 574872 34675 336 96 0 571434 0
[pid=12434] ppid=12431 vsize=220696 CPUtime=561.12 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 54811 0 0 0 56095 17 0 0 25 0 1 0 489056348 225992704 50975 33554432000 4194304 4785740 140733717515728 18446744073709551615 237278577278 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 55174 50975 340 145 0 52219 0
Current children cumulated CPU time (s) 1122.28
Current children cumulated vsize (KiB) 2538508

[startup+1182.3 s]
/proc/loadavg: 10.01 9.87 8.04 11/200 12480
/proc/meminfo: memFree=19855400/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=180112 CPUtime=591.16 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 150752 0 0 0 59078 38 0 0 25 0 1 0 489056348 184434688 38509 33554432000 4194304 4587354 140734912418624 18446744073709551615 4243448 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 45028 38509 336 96 0 41590 0
[pid=12434] ppid=12431 vsize=220696 CPUtime=591.12 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 54817 0 0 0 59095 17 0 0 25 0 1 0 489056348 225992704 50981 33554432000 4194304 4785740 140733717515728 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 55174 50981 340 145 0 52219 0
Current children cumulated CPU time (s) 1182.29
Current children cumulated vsize (KiB) 419132

[startup+1242.3 s]
/proc/loadavg: 10.00 9.89 8.16 11/200 12481
/proc/meminfo: memFree=19833304/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=2168448 CPUtime=621.17 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 153711 0 0 0 62077 40 0 0 25 0 1 0 489056348 2220490752 34629 33554432000 4194304 4587354 140734912418624 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 542112 34629 336 96 0 538674 0
[pid=12434] ppid=12431 vsize=222996 CPUtime=621.12 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 55318 0 0 0 62094 18 0 0 25 0 1 0 489056348 228347904 51482 33554432000 4194304 4785740 140733717515728 18446744073709551615 4286953 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 55749 51482 340 145 0 52794 0
Current children cumulated CPU time (s) 1242.3
Current children cumulated vsize (KiB) 2409768



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 9.85 9.89 8.27 6/192 12485
/proc/meminfo: memFree=20323648/32950904 swapFree=67082284/67111528
[pid=12431] ppid=12429 vsize=18324 CPUtime=0.01 cores=5,7
/proc/12431/stat : 12431 (ppfolio) S 12429 12431 11530 0 -1 4202496 501 1193 0 0 0 0 0 1 15 0 1 0 489056347 18763776 395 33554432000 4194304 4287625 140733467824096 18446744073709551615 237278899727 0 0 4096 65536 4294934788 0 0 17 7 0 0 0
/proc/12431/statm: 4581 395 346 23 0 91 0
[pid=12433] ppid=12431 vsize=2153196 CPUtime=650.04 cores=5
/proc/12433/stat : 12433 (cryptominisat) R 12431 12431 11530 0 -1 4202496 162093 0 0 0 64961 43 0 0 25 0 1 0 489056348 2204872704 34629 33554432000 4194304 4587354 140734912418624 18446744073709551615 4238593 0 0 4096 2 0 0 0 17 5 0 0 0
/proc/12433/statm: 538299 34629 336 96 0 534861 0
[pid=12434] ppid=12431 vsize=223484 CPUtime=649.96 cores=5
/proc/12434/stat : 12434 (clasp) R 12431 12431 11530 0 -1 4202496 55420 0 0 0 64978 18 0 0 25 0 1 0 489056348 228847616 51584 33554432000 4194304 4785740 140733717515728 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/12434/statm: 55871 51584 340 145 0 52916 0
Current children cumulated CPU time (s) 1300.01
Current children cumulated vsize (KiB) 2395004

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 12431 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=2999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=17997
# CPU time returned by wait4() is 0.020996
# while last known CPU time is 1300.01
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 1300.01
CPU user time (s): 1299.39
CPU system time (s): 0.62
CPU usage (%): 99.9998
Max. virtual memory (cumulated for all children) (KiB): 4440304

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.002999
system time used= 0.017997
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1694
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 262
involuntary context switches= 7

runsolver used 2.16567 second user time and 4.94325 second system time

The end

Launcher Data

Begin job on node121 at 2011-04-26 01:36:06
IDJOB=3289537
IDBENCH=83126
IDSOLVER=1613
FILE ID=node121/3289537-1303774566
RUNJOBID= node121-1303774563-12396
PBS_JOBID= 13157167
Free space on /tmp= 72056 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/application/fuhs/slp-synthesis-AES/slp-synthesis-aes-top30.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3289537-1303774566/watcher-3289537-1303774566 -o /tmp/evaluation-result-3289537-1303774566/solver-3289537-1303774566 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3289537-1303774566.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= 31142839684b7824419884a35a31fc88
RANDOM SEED=656487809

node121.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.63
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.84
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.817
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950904 kB
MemFree:      20808820 kB
Buffers:       2148332 kB
Cached:        9375012 kB
SwapCached:       2776 kB
Active:        8646692 kB
Inactive:      2983724 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950904 kB
LowFree:      20808820 kB
SwapTotal:    67111528 kB
SwapFree:     67082284 kB
Dirty:           43084 kB
Writeback:           0 kB
AnonPages:      104876 kB
Mapped:          15732 kB
Slab:           446412 kB
PageTables:       5708 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586980 kB
Committed_AS:   766716 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72060 MiB
End job on node121 at 2011-04-26 01:57:48