Trace number 3258742

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 1300.02 1300.01

General information on the benchmark

NameCRAFTED/rbsat/random/
forced/rbsat-v2640c305320gyes3.cnf
MD5SUMd6877629cc818d7e31dc245fb95f0588
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2640
Number of clauses305320
Sum of the clauses size613120
Maximum clause length33
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2305240
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 580

Solver Data 

0.00/0.01	This is pico-portfolio, a naive parallel portfolio
0.00/0.01	Copyright (C) 2011 Olivier Roussel
0.00/0.01	Using 1 processing units
0.00/0.01	This portfolio uses the following solvers:
0.00/0.01	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.01	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.01	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.01	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.01	Starting clasp 1.3.6 on core(s) 1
0.00/0.01	Starting TNM 2009 on core(s) 1

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3258742-1303476168/watcher-3258742-1303476168 -o /tmp/evaluation-result-3258742-1303476168/solver-3258742-1303476168 -C 2400 -W 1300 -M 7680 ppfolio --nbcore=1 HOME/instance-3258742-1303476168.cnf 

running on 2 cores: 1,3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 7864320 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 7915520 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 12.00 11.89 9.96 5/188 2373
/proc/meminfo: memFree=17565900/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=11800 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (runsolver) R 2371 2373 1007 0 -1 4202560 41 0 0 0 0 0 0 0 20 0 1 0 537847354 12083200 52 33554432000 4194304 5434984 140736381097104 18446744073709551615 4881607 0 2147483391 4096 24578 0 0 0 17 3 0 0 0
/proc/2373/statm: 2950 52 31 303 0 2644 0

[startup+0.078437 s]
/proc/loadavg: 12.00 11.89 9.96 5/188 2373
/proc/meminfo: memFree=17565900/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 22 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211478081714257920 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100439 s]
/proc/loadavg: 12.00 11.89 9.96 5/188 2373
/proc/meminfo: memFree=17565900/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 22 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211478081714257920 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300396 s]
/proc/loadavg: 12.00 11.89 9.96 5/188 2373
/proc/meminfo: memFree=17565900/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 20 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211478219153211392 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700321 s]
/proc/loadavg: 12.00 11.89 9.96 5/188 2373
/proc/meminfo: memFree=17565900/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 17 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211479043786932224 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50118 s]
/proc/loadavg: 11.68 11.83 9.95 10/199 2435
/proc/meminfo: memFree=17465072/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 17 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211479043786932224 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=62788 CPUtime=0.43 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 10299 0 0 0 42 1 0 0 22 0 1 0 537847355 64294912 10185 33554432000 4194304 4587354 140734667145808 18446744073709551615 4388350 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 15697 10185 314 96 0 12259 0
[pid=2376] ppid=2373 vsize=30912 CPUtime=0.49 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 6317 0 0 0 48 1 0 0 23 0 1 0 537847355 31653888 5034 33554432000 4194304 4785740 140735093628336 18446744073709551615 4496219 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 7728 5034 315 145 0 4773 0
[pid=2377] ppid=2373 vsize=466252 CPUtime=0.54 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 5031 0 0 0 54 0 0 0 25 0 1 0 537847355 477442048 4928 33554432000 134512640 134534564 4286955696 18446744073709551615 134524752 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 116563 4928 91 6 0 115229 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 578276

[startup+3.10088 s]
/proc/loadavg: 11.68 11.83 9.95 13/202 2438
/proc/meminfo: memFree=17337848/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211479456103792640 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=71484 CPUtime=0.99 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 16382 0 0 0 97 2 0 0 25 0 1 0 537847355 73199616 12289 33554432000 4194304 4587354 140734667145808 18446744073709551615 4244609 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 17871 12289 326 96 0 14433 0
[pid=2376] ppid=2373 vsize=31968 CPUtime=1.04 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 6593 0 0 0 103 1 0 0 25 0 1 0 537847355 32735232 5310 33554432000 4194304 4785740 140735093628336 18446744073709551615 4482856 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 7992 5310 317 145 0 5037 0
[pid=2377] ppid=2373 vsize=466252 CPUtime=1.04 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 5031 0 0 0 104 0 0 0 25 0 1 0 537847355 477442048 4928 33554432000 134512640 134534564 4286955696 18446744073709551615 134524500 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 116563 4928 91 6 0 115229 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 588028

[startup+6.30029 s]
/proc/loadavg: 11.68 11.83 9.95 13/202 2438
/proc/meminfo: memFree=17292256/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211479730981699584 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=71484 CPUtime=2.03 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 17252 0 0 0 201 2 0 0 25 0 1 0 537847355 73199616 13146 33554432000 4194304 4587354 140734667145808 18446744073709551615 260020092606 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 17871 13146 326 96 0 14433 0
[pid=2376] ppid=2373 vsize=32512 CPUtime=2.09 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 7332 0 0 0 208 1 0 0 25 0 1 0 537847355 33292288 5452 33554432000 4194304 4785740 140735093628336 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 8128 5452 341 145 0 5173 0
[pid=2377] ppid=2373 vsize=468628 CPUtime=2.14 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 7210 0 0 0 213 1 0 0 25 0 1 0 537847355 479875072 7107 33554432000 134512640 134534564 4286955696 18446744073709551615 134526088 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 117157 7107 95 6 0 115823 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 590948

[startup+12.7011 s]
/proc/loadavg: 11.73 11.83 9.97 13/202 2438
/proc/meminfo: memFree=17277104/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211479043786932224 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=381292 CPUtime=4.19 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 19314 0 0 0 416 3 0 0 25 0 1 0 537847355 390443008 13319 33554432000 4194304 4587354 140734667145808 18446744073709551615 4365232 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 95323 13319 337 96 0 91885 0
[pid=2376] ppid=2373 vsize=32512 CPUtime=4.24 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 7332 0 0 0 423 1 0 0 25 0 1 0 537847355 33292288 5452 33554432000 4194304 4785740 140735093628336 18446744073709551615 4546275 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 8128 5452 341 145 0 5173 0
[pid=2377] ppid=2373 vsize=472456 CPUtime=4.24 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 7211 0 0 0 423 1 0 0 25 0 1 0 537847355 483794944 7108 33554432000 134512640 134534564 4286955696 18446744073709551615 134530538 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 118114 7108 95 6 0 116780 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 904584

[startup+25.5008 s]
/proc/loadavg: 11.77 11.83 9.99 13/202 2439
/proc/meminfo: memFree=17208288/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211479456103792640 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=396404 CPUtime=8.43 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 22922 0 0 0 840 3 0 0 25 0 1 0 537847355 405917696 16926 33554432000 4194304 4587354 140734667145808 18446744073709551615 4365216 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 99101 16926 337 96 0 95663 0
[pid=2376] ppid=2373 vsize=46652 CPUtime=8.49 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 10833 0 0 0 848 1 0 0 25 0 1 0 537847355 47771648 8953 33554432000 4194304 4785740 140735093628336 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 11663 8953 341 145 0 8708 0
[pid=2377] ppid=2373 vsize=472456 CPUtime=8.54 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 7211 0 0 0 853 1 0 0 25 0 1 0 537847355 483794944 7108 33554432000 134512640 134534564 4286955696 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 118114 7108 95 6 0 116780 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 933836

[startup+51.1011 s]
/proc/loadavg: 11.85 11.85 10.05 13/202 2440
/proc/meminfo: memFree=17107964/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211479181225885696 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=388944 CPUtime=16.99 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 28680 0 0 0 1695 4 0 0 25 0 1 0 537847355 398278656 19794 33554432000 4194304 4587354 140734667145808 18446744073709551615 4364452 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 97236 19794 337 96 0 93798 0
[pid=2376] ppid=2373 vsize=69340 CPUtime=17.03 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 16529 0 0 0 1700 3 0 0 25 0 1 0 537847355 71004160 14649 33554432000 4194304 4785740 140735093628336 18446744073709551615 4553411 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 17335 14649 341 145 0 14380 0
[pid=2377] ppid=2373 vsize=472456 CPUtime=17.04 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 7211 0 0 0 1703 1 0 0 25 0 1 0 537847355 483794944 7108 33554432000 134512640 134534564 4286955696 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 118114 7108 95 6 0 116780 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 949064

[startup+102.308 s]
/proc/loadavg: 11.94 11.87 10.16 13/202 2472
/proc/meminfo: memFree=17168876/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211478081714257920 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=425544 CPUtime=34.05 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 37466 0 0 0 3400 5 0 0 25 0 1 0 537847355 435757056 25744 33554432000 4194304 4587354 140734667145808 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 106386 25744 337 96 0 102948 0
[pid=2376] ppid=2373 vsize=87184 CPUtime=34.09 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 20891 0 0 0 3404 5 0 0 25 0 1 0 537847355 89276416 19011 33554432000 4194304 4785740 140735093628336 18446744073709551615 4287030 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 21796 19011 341 145 0 18841 0
[pid=2377] ppid=2373 vsize=472456 CPUtime=34.14 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 7211 0 0 0 3413 1 0 0 25 0 1 0 537847355 483794944 7108 33554432000 134512640 134534564 4286955696 18446744073709551615 134530593 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 118114 7108 95 6 0 116780 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1003508

[startup+162.301 s]
/proc/loadavg: 11.98 11.89 10.27 13/202 2473
/proc/meminfo: memFree=17135240/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211478356592164864 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=408948 CPUtime=54.05 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 44556 0 0 0 5399 6 0 0 25 0 1 0 537847355 418762752 27027 33554432000 4194304 4587354 140734667145808 18446744073709551615 4237436 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 102237 27027 337 96 0 98799 0
[pid=2376] ppid=2373 vsize=96864 CPUtime=54.09 cores=1

################
# More data... #
################

/proc/2377/statm: 118114 7108 95 6 0 116780 0
Current children cumulated CPU time (s) 822.29
Current children cumulated vsize (KiB) 1138848

[startup+882.301 s]
/proc/loadavg: 9.01 9.45 9.82 10/193 2510
/proc/meminfo: memFree=16905120/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211478906347978752 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=514444 CPUtime=294.05 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 118357 0 0 0 29386 19 0 0 25 0 1 0 537847355 526790656 47332 33554432000 4194304 4587354 140734667145808 18446744073709551615 4244134 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 128611 47332 337 96 0 125173 0
[pid=2376] ppid=2373 vsize=156300 CPUtime=294.14 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 37668 0 0 0 29404 10 0 0 25 0 1 0 537847355 160051200 35788 33554432000 4194304 4785740 140735093628336 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 39075 35788 341 145 0 36120 0
[pid=2377] ppid=2373 vsize=472456 CPUtime=294.1 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 7211 0 0 0 29409 1 0 0 25 0 1 0 537847355 483794944 7108 33554432000 134512640 134534564 4286955696 18446744073709551615 134530582 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 118114 7108 95 6 0 116780 0
Current children cumulated CPU time (s) 882.29
Current children cumulated vsize (KiB) 1161524

[startup+942.301 s]
/proc/loadavg: 9.00 9.36 9.77 10/193 2511
/proc/meminfo: memFree=16890680/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211479043786932224 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=488312 CPUtime=314.04 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 123906 0 0 0 31384 20 0 0 25 0 1 0 537847355 500031488 45997 33554432000 4194304 4587354 140734667145808 18446744073709551615 4238683 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 122078 45997 337 96 0 118640 0
[pid=2376] ppid=2373 vsize=159984 CPUtime=314.15 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 38476 0 0 0 31404 11 0 0 25 0 1 0 537847355 163823616 36596 33554432000 4194304 4785740 140735093628336 18446744073709551615 4287038 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 39996 36596 341 145 0 37041 0
[pid=2377] ppid=2373 vsize=472456 CPUtime=314.11 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 7211 0 0 0 31410 1 0 0 25 0 1 0 537847355 483794944 7108 33554432000 134512640 134534564 4286955696 18446744073709551615 134528523 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 118114 7108 95 6 0 116780 0
Current children cumulated CPU time (s) 942.3
Current children cumulated vsize (KiB) 1139076

[startup+1002.3 s]
/proc/loadavg: 9.05 9.31 9.72 10/193 2513
/proc/meminfo: memFree=16861760/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211478494031118336 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=488152 CPUtime=334.04 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 129175 0 0 0 33383 21 0 0 25 0 1 0 537847355 499867648 48999 33554432000 4194304 4587354 140734667145808 18446744073709551615 4238671 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 122038 48999 337 96 0 118600 0
[pid=2376] ppid=2373 vsize=161636 CPUtime=334.14 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 38853 0 0 0 33403 11 0 0 25 0 1 0 537847355 165515264 36973 33554432000 4194304 4785740 140735093628336 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 40409 36973 341 145 0 37454 0
[pid=2377] ppid=2373 vsize=472456 CPUtime=334.12 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 7211 0 0 0 33411 1 0 0 25 0 1 0 537847355 483794944 7108 33554432000 134512640 134534564 4286955696 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 118114 7108 95 6 0 116780 0
Current children cumulated CPU time (s) 1002.3
Current children cumulated vsize (KiB) 1140568

[startup+1062.3 s]
/proc/loadavg: 9.02 9.25 9.68 10/193 2514
/proc/meminfo: memFree=16838776/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211479043786932224 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=500616 CPUtime=354.04 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 136073 0 0 0 35382 22 0 0 25 0 1 0 537847355 512630784 50837 33554432000 4194304 4587354 140734667145808 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 125154 50837 337 96 0 121716 0
[pid=2376] ppid=2373 vsize=170608 CPUtime=354.14 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 41045 0 0 0 35402 12 0 0 25 0 1 0 537847355 174702592 39165 33554432000 4194304 4785740 140735093628336 18446744073709551615 4309545 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 42652 39165 341 145 0 39697 0
[pid=2377] ppid=2373 vsize=472456 CPUtime=354.12 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 7211 0 0 0 35411 1 0 0 25 0 1 0 537847355 483794944 7108 33554432000 134512640 134534564 4286955696 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 118114 7108 95 6 0 116780 0
Current children cumulated CPU time (s) 1062.3
Current children cumulated vsize (KiB) 1162004

[startup+1122.3 s]
/proc/loadavg: 9.00 9.20 9.63 10/193 2525
/proc/meminfo: memFree=16843452/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211479181225885696 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=512436 CPUtime=374.03 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 142039 0 0 0 37380 23 0 0 25 0 1 0 537847355 524734464 48731 33554432000 4194304 4587354 140734667145808 18446744073709551615 4238406 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 128109 48731 337 96 0 124671 0
[pid=2376] ppid=2373 vsize=171048 CPUtime=374.13 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 41157 0 0 0 37401 12 0 0 25 0 1 0 537847355 175153152 39277 33554432000 4194304 4785740 140735093628336 18446744073709551615 4287244 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 42762 39277 341 145 0 39807 0
[pid=2377] ppid=2373 vsize=472456 CPUtime=374.13 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 7211 0 0 0 37412 1 0 0 25 0 1 0 537847355 483794944 7108 33554432000 134512640 134534564 4286955696 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 118114 7108 95 6 0 116780 0
Current children cumulated CPU time (s) 1122.29
Current children cumulated vsize (KiB) 1174264

[startup+1182.3 s]
/proc/loadavg: 9.00 9.16 9.59 10/193 2527
/proc/meminfo: memFree=16833836/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211479318664839168 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=498804 CPUtime=394.03 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 148480 0 0 0 39378 25 0 0 25 0 1 0 537847355 510775296 49636 33554432000 4194304 4587354 140734667145808 18446744073709551615 4238418 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 124701 49636 337 96 0 121263 0
[pid=2376] ppid=2373 vsize=173892 CPUtime=394.13 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 41773 0 0 0 39401 12 0 0 25 0 1 0 537847355 178065408 39893 33554432000 4194304 4785740 140735093628336 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 43473 39893 341 145 0 40518 0
[pid=2377] ppid=2373 vsize=472456 CPUtime=394.14 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 7211 0 0 0 39413 1 0 0 25 0 1 0 537847355 483794944 7108 33554432000 134512640 134534564 4286955696 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 118114 7108 95 6 0 116780 0
Current children cumulated CPU time (s) 1182.3
Current children cumulated vsize (KiB) 1163476

[startup+1242.3 s]
/proc/loadavg: 9.00 9.13 9.55 10/193 2528
/proc/meminfo: memFree=16800072/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211479456103792640 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=504140 CPUtime=414.02 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 155606 0 0 0 41376 26 0 0 25 0 1 0 537847355 516239360 50814 33554432000 4194304 4587354 140734667145808 18446744073709551615 4238600 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 126035 50814 337 96 0 122597 0
[pid=2376] ppid=2373 vsize=176500 CPUtime=414.13 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 42344 0 0 0 41401 12 0 0 25 0 1 0 537847355 180736000 40464 33554432000 4194304 4785740 140735093628336 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 44125 40464 341 145 0 41170 0
[pid=2377] ppid=2373 vsize=472456 CPUtime=414.15 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 7211 0 0 0 41414 1 0 0 25 0 1 0 537847355 483794944 7108 33554432000 134512640 134534564 4286955696 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 118114 7108 95 6 0 116780 0
Current children cumulated CPU time (s) 1242.3
Current children cumulated vsize (KiB) 1171420



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+1300 s]
/proc/loadavg: 9.00 9.11 9.52 10/193 2530
/proc/meminfo: memFree=16807332/32951124 swapFree=67111528/67111528
[pid=2373] ppid=2371 vsize=18324 CPUtime=0 cores=1,3
/proc/2373/stat : 2373 (ppfolio) S 2371 2373 1007 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 537847354 18763776 394 33554432000 4194304 4287625 140733579363216 18446744073709551615 260020416015 0 0 4096 65536 17211479593542746112 0 0 17 3 0 0 0
/proc/2373/statm: 4581 394 345 23 0 91 0
[pid=2375] ppid=2373 vsize=487228 CPUtime=433.31 cores=1
/proc/2375/stat : 2375 (cryptominisat) R 2373 2373 1007 0 -1 4202496 162331 0 0 0 43303 28 0 0 25 0 1 0 537847355 498921472 51392 33554432000 4194304 4587354 140734667145808 18446744073709551615 4238421 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/2375/statm: 121807 51392 337 96 0 118369 0
[pid=2376] ppid=2373 vsize=184856 CPUtime=433.33 cores=1
/proc/2376/stat : 2376 (clasp) R 2373 2373 1007 0 -1 4202496 44358 0 0 0 43320 13 0 0 25 0 1 0 537847355 189292544 42478 33554432000 4194304 4785740 140735093628336 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 1 0 0 0
/proc/2376/statm: 46214 42478 341 145 0 43259 0
[pid=2377] ppid=2373 vsize=472456 CPUtime=433.38 cores=1
/proc/2377/stat : 2377 (TNM) R 2373 2373 1007 0 -1 4202496 7211 0 0 0 43337 1 0 0 25 0 1 0 537847355 483794944 7108 33554432000 134512640 134534564 4286955696 18446744073709551615 134530573 0 0 4096 0 0 0 0 17 1 0 0 0
/proc/2377/statm: 118114 7108 95 6 0 116780 0
Current children cumulated CPU time (s) 1300.02
Current children cumulated vsize (KiB) 1162864

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 2373 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=3999
# CPU time returned by wait4() is 0.004998
# while last known CPU time is 1300.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1300.01
CPU time (s): 1300.02
CPU user time (s): 1299.6
CPU system time (s): 0.42
CPU usage (%): 100
Max. virtual memory (cumulated for all children) (KiB): 1465404

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.003999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 500
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 249
involuntary context switches= 5

runsolver used 2.04069 second user time and 5.06423 second system time

The end

Launcher Data 

Begin job on node110 at 2011-04-22 14:42:48
IDJOB=3258742
IDBENCH=71423
IDSOLVER=1613
FILE ID=node110/3258742-1303476168
RUNJOBID= node110-1303474864-2213
PBS_JOBID= 13107186
Free space on /tmp= 71668 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT09/CRAFTED/rbsat/random/forced/rbsat-v2640c305320gyes3.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3258742-1303476168/watcher-3258742-1303476168 -o /tmp/evaluation-result-3258742-1303476168/solver-3258742-1303476168 -C 2400 -W 1300 -M 7680  ppfolio --nbcore=1 HOME/instance-3258742-1303476168.cnf

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 7680 MiB
NBCORE= 2

MD5SUM BENCH= d6877629cc818d7e31dc245fb95f0588
RANDOM SEED=766922576

node110.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.66
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.830
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      17566180 kB
Buffers:       1266264 kB
Cached:       13247920 kB
SwapCached:          0 kB
Active:        7204244 kB
Inactive:      7631004 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      17566180 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           14020 kB
Writeback:           0 kB
AnonPages:      320788 kB
Mapped:          16440 kB
Slab:           483116 kB
PageTables:       6024 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:  1956928 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71672 MiB
End job on node110 at 2011-04-22 15:04:30