Trace number 3219934

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio seq? (TO) 4999.91 5000.05

General information on the benchmark

Namerandom/large/
unif-k3-r4.2-v50000-c210000-S517749870-003-UNKNOWN.cnf
MD5SUM4033245e3bd21ace8cfcd57089ff73c5
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark1493.62
Satisfiable
(Un)Satisfiability was proved
Number of variables50000
Number of clauses210000
Sum of the clauses size630000
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 3210000
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 1 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.00	Starting clasp 1.3.6 on core(s) 0
0.00/0.00	Starting TNM 2009 on core(s) 0

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3219934-1303262254/watcher-3219934-1303262254 -o /tmp/evaluation-result-3219934-1303262254/solver-3219934-1303262254 -C 5000 -W 5000 -M 15500 ppfolio --nbcore=1 HOME/instance-3219934-1303262254.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 5030 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 5000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 5.00 5.00 4.85 4/179 15031
/proc/meminfo: memFree=15352000/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 499 0 0 0 0 0 0 0 25 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 4606936407368237316 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0

[startup+0.022235 s]
/proc/loadavg: 5.00 5.00 4.85 4/179 15031
/proc/meminfo: memFree=15352000/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 499 0 0 0 0 0 0 0 25 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 4606936407368237316 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.101222 s]
/proc/loadavg: 5.00 5.00 4.85 4/179 15031
/proc/meminfo: memFree=15352000/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 499 0 0 0 0 0 0 0 25 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 4606936407368237316 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.301187 s]
/proc/loadavg: 5.00 5.00 4.85 4/179 15031
/proc/meminfo: memFree=15352000/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 24 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715562094836842496 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.701107 s]
/proc/loadavg: 5.00 5.00 4.85 4/179 15031
/proc/meminfo: memFree=15352000/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 20 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 0 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50096 s]
/proc/loadavg: 5.00 5.00 4.85 6/183 15035
/proc/meminfo: memFree=15279800/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715562919470563328 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=62288 CPUtime=0.49 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 11470 0 0 0 48 1 0 0 25 0 1 0 516456098 63782912 10751 33554432000 4194304 4587354 140736422988592 18446744073709551615 231895148897 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 15572 10751 312 96 0 12134 0
[pid=15033] ppid=15031 vsize=43596 CPUtime=0.44 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 9619 0 0 0 43 1 0 0 25 0 1 0 516456098 44642304 7797 33554432000 4194304 4785740 140733962067392 18446744073709551615 4503516 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 10899 7797 320 145 0 7944 0
[pid=15034] ppid=15031 vsize=466780 CPUtime=0.53 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 5019 0 0 0 53 0 0 0 25 0 1 0 516456098 477982720 4916 33554432000 134512640 134534564 4287798416 18446744073709551615 134524508 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 116695 4916 91 6 0 115361 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 590988

[startup+3.10066 s]
/proc/loadavg: 5.00 5.00 4.85 6/183 15036
/proc/meminfo: memFree=15232556/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715563331787423744 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=71960 CPUtime=0.99 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 16480 0 0 0 97 2 0 0 25 0 1 0 516456098 73687040 12515 33554432000 4194304 4587354 140736422988592 18446744073709551615 4237467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 17990 12515 325 96 0 14552 0
[pid=15033] ppid=15031 vsize=39400 CPUtime=0.97 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 9706 0 0 0 96 1 0 0 25 0 1 0 516456098 40345600 6984 33554432000 4194304 4785740 140733962067392 18446744073709551615 4553022 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 9850 6984 340 145 0 6895 0
[pid=15034] ppid=15031 vsize=472060 CPUtime=1.12 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 8337 0 0 0 111 1 0 0 25 0 1 0 516456098 483389440 8234 33554432000 134512640 134534564 4287798416 18446744073709551615 134525871 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 601744

[startup+6.30106 s]
/proc/loadavg: 5.00 5.00 4.85 6/183 15036
/proc/meminfo: memFree=15239624/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715563331787423744 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=109464 CPUtime=2.09 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 17376 0 0 0 207 2 0 0 25 0 1 0 516456098 112091136 13409 33554432000 4194304 4587354 140736422988592 18446744073709551615 4243610 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 27366 13409 326 96 0 23928 0
[pid=15033] ppid=15031 vsize=39400 CPUtime=2.04 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 9707 0 0 0 203 1 0 0 25 0 1 0 516456098 40345600 6985 33554432000 4194304 4785740 140733962067392 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 9850 6985 340 145 0 6895 0
[pid=15034] ppid=15031 vsize=472060 CPUtime=2.14 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 8337 0 0 0 213 1 0 0 25 0 1 0 516456098 483389440 8234 33554432000 134512640 134534564 4287798416 18446744073709551615 134530701 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 639248

[startup+12.7008 s]
/proc/loadavg: 5.00 5.00 4.85 6/183 15036
/proc/meminfo: memFree=15229368/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715563469226377216 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=109464 CPUtime=4.19 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 18725 0 0 0 417 2 0 0 25 0 1 0 516456098 112091136 14755 33554432000 4194304 4587354 140736422988592 18446744073709551615 4242461 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 27366 14755 326 96 0 23928 0
[pid=15033] ppid=15031 vsize=43540 CPUtime=4.16 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 10828 0 0 0 415 1 0 0 25 0 1 0 516456098 44584960 8106 33554432000 4194304 4785740 140733962067392 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 10885 8106 340 145 0 7930 0
[pid=15034] ppid=15031 vsize=472060 CPUtime=4.32 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 8337 0 0 0 431 1 0 0 25 0 1 0 516456098 483389440 8234 33554432000 134512640 134534564 4287798416 18446744073709551615 134530339 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 643388

[startup+25.5004 s]
/proc/loadavg: 5.00 5.00 4.85 6/183 15036
/proc/meminfo: memFree=15200600/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715563744104284160 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=109464 CPUtime=8.49 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 21226 0 0 0 846 3 0 0 25 0 1 0 516456098 112091136 17251 33554432000 4194304 4587354 140736422988592 18446744073709551615 4238947 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 27366 17251 326 96 0 23928 0
[pid=15033] ppid=15031 vsize=60868 CPUtime=8.44 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 15151 0 0 0 842 2 0 0 25 0 1 0 516456098 62328832 12429 33554432000 4194304 4785740 140733962067392 18446744073709551615 4287019 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 15217 12429 340 145 0 12262 0
[pid=15034] ppid=15031 vsize=472060 CPUtime=8.54 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 8337 0 0 0 853 1 0 0 25 0 1 0 516456098 483389440 8234 33554432000 134512640 134534564 4287798416 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 660716

[startup+51.1006 s]
/proc/loadavg: 5.00 5.00 4.85 6/183 15037
/proc/meminfo: memFree=15173460/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715562094836842496 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=162868 CPUtime=16.99 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 28808 0 0 0 1694 5 0 0 25 0 1 0 516456098 166776832 16698 33554432000 4194304 4587354 140736422988592 18446744073709551615 4248752 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 40717 16698 331 96 0 37279 0
[pid=15033] ppid=15031 vsize=90892 CPUtime=16.97 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 22641 0 0 0 1693 4 0 0 25 0 1 0 516456098 93073408 19919 33554432000 4194304 4785740 140733962067392 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 22723 19919 340 145 0 19768 0
[pid=15034] ppid=15031 vsize=472060 CPUtime=17.11 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 8337 0 0 0 1710 1 0 0 25 0 1 0 516456098 483389440 8234 33554432000 134512640 134534564 4287798416 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 744144

[startup+102.307 s]
/proc/loadavg: 5.00 5.00 4.86 6/183 15038
/proc/meminfo: memFree=15051428/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715563744104284160 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=148888 CPUtime=34.09 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 78878 0 0 0 3396 13 0 0 25 0 1 0 516456098 152461312 30869 33554432000 4194304 4587354 140736422988592 18446744073709551615 231895148306 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 37222 30869 337 96 0 33784 0
[pid=15033] ppid=15031 vsize=154168 CPUtime=34.03 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 38286 0 0 0 3396 7 0 0 25 0 1 0 516456098 157868032 35564 33554432000 4194304 4785740 140733962067392 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 38542 35564 340 145 0 35587 0
[pid=15034] ppid=15031 vsize=472060 CPUtime=34.15 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 8337 0 0 0 3414 1 0 0 25 0 1 0 516456098 483389440 8234 33554432000 134512640 134534564 4287798416 18446744073709551615 134528979 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 793440

[startup+162.301 s]
/proc/loadavg: 5.04 5.01 4.87 6/183 15040
/proc/meminfo: memFree=15040488/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715562507153702912 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=1870148 CPUtime=54.09 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 102633 0 0 0 5392 17 0 0 25 0 1 0 516456098 1915031552 24658 33554432000 4194304 4587354 140736422988592 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 467537 24658 337 96 0 464099 0
[pid=15033] ppid=15031 vsize=189668 CPUtime=54.03 cores=0

################
# More data... #
################

/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 4542.22
Current children cumulated vsize (KiB) 3065052

[startup+4602.3 s]
/proc/loadavg: 5.01 5.01 5.01 6/183 15701
/proc/meminfo: memFree=14536496/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715563331787423744 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=1906612 CPUtime=1534.06 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 913860 0 0 0 153217 189 0 0 25 0 1 0 516456098 1952370688 45240 33554432000 4194304 4587354 140736422988592 18446744073709551615 4236673 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 476653 45240 337 96 0 473215 0
[pid=15033] ppid=15031 vsize=668056 CPUtime=1534.01 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 164257 0 0 0 153362 39 0 0 25 0 1 0 516456098 684089344 161535 33554432000 4194304 4785740 140733962067392 18446744073709551615 4303984 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 167014 161535 340 145 0 164059 0
[pid=15034] ppid=15031 vsize=472060 CPUtime=1534.15 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 8337 0 0 0 153412 3 0 0 25 0 1 0 516456098 483389440 8234 33554432000 134512640 134534564 4287798416 18446744073709551615 134530606 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 4602.22
Current children cumulated vsize (KiB) 3065052

[startup+4662.3 s]
/proc/loadavg: 5.00 5.00 5.00 6/183 15703
/proc/meminfo: memFree=14580240/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715563331787423744 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=1892392 CPUtime=1554.06 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 920124 0 0 0 155215 191 0 0 25 0 1 0 516456098 1937809408 34095 33554432000 4194304 4587354 140736422988592 18446744073709551615 4243937 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 473098 34095 337 96 0 469660 0
[pid=15033] ppid=15031 vsize=668056 CPUtime=1554 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 164257 0 0 0 155361 39 0 0 25 0 1 0 516456098 684089344 161535 33554432000 4194304 4785740 140733962067392 18446744073709551615 4549040 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 167014 161535 340 145 0 164059 0
[pid=15034] ppid=15031 vsize=472060 CPUtime=1554.15 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 8337 0 0 0 155412 3 0 0 25 0 1 0 516456098 483389440 8234 33554432000 134512640 134534564 4287798416 18446744073709551615 134530126 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 4662.21
Current children cumulated vsize (KiB) 3050832

[startup+4722.31 s]
/proc/loadavg: 5.00 5.00 5.00 6/183 15704
/proc/meminfo: memFree=14545324/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715563331787423744 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=1892392 CPUtime=1574.06 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 928756 0 0 0 157213 193 0 0 25 0 1 0 516456098 1937809408 42686 33554432000 4194304 4587354 140736422988592 18446744073709551615 4238271 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 473098 42686 337 96 0 469660 0
[pid=15033] ppid=15031 vsize=668056 CPUtime=1574 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 164258 0 0 0 157361 39 0 0 25 0 1 0 516456098 684089344 161536 33554432000 4194304 4785740 140733962067392 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 167014 161536 340 145 0 164059 0
[pid=15034] ppid=15031 vsize=472060 CPUtime=1574.16 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 8337 0 0 0 157413 3 0 0 25 0 1 0 516456098 483389440 8234 33554432000 134512640 134534564 4287798416 18446744073709551615 134526111 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 4722.22
Current children cumulated vsize (KiB) 3050832

[startup+4782.3 s]
/proc/loadavg: 5.00 5.00 5.00 6/183 15706
/proc/meminfo: memFree=14591420/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715563331787423744 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=1958376 CPUtime=1594.05 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 934839 0 0 0 159210 195 0 0 25 0 1 0 516456098 2005377024 30984 33554432000 4194304 4587354 140736422988592 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 489594 30984 337 96 0 486156 0
[pid=15033] ppid=15031 vsize=668484 CPUtime=1594 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 164360 0 0 0 159360 40 0 0 25 0 1 0 516456098 684527616 161638 33554432000 4194304 4785740 140733962067392 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 167121 161638 340 145 0 164166 0
[pid=15034] ppid=15031 vsize=472060 CPUtime=1594.15 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 8337 0 0 0 159412 3 0 0 25 0 1 0 516456098 483389440 8234 33554432000 134512640 134534564 4287798416 18446744073709551615 134528511 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 4782.2
Current children cumulated vsize (KiB) 3117244

[startup+4842.3 s]
/proc/loadavg: 5.00 5.00 5.00 6/183 15708
/proc/meminfo: memFree=14541632/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715563331787423744 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=1958376 CPUtime=1614.05 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 943677 0 0 0 161208 197 0 0 25 0 1 0 516456098 2005377024 39795 33554432000 4194304 4587354 140736422988592 18446744073709551615 231895187089 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 489594 39795 337 96 0 486156 0
[pid=15033] ppid=15031 vsize=681848 CPUtime=1614 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 167693 0 0 0 161359 41 0 0 25 0 1 0 516456098 698212352 164971 33554432000 4194304 4785740 140733962067392 18446744073709551615 4287158 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 170462 164971 340 145 0 167507 0
[pid=15034] ppid=15031 vsize=472060 CPUtime=1614.16 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 8337 0 0 0 161413 3 0 0 25 0 1 0 516456098 483389440 8234 33554432000 134512640 134534564 4287798416 18446744073709551615 134528708 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 4842.21
Current children cumulated vsize (KiB) 3130608

[startup+4902.3 s]
/proc/loadavg: 5.06 5.02 5.00 6/183 15712
/proc/meminfo: memFree=14584856/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715563469226377216 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=1907412 CPUtime=1634.05 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 950685 0 0 0 163206 199 0 0 25 0 1 0 516456098 1953189888 28811 33554432000 4194304 4587354 140736422988592 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 476853 28811 337 96 0 473415 0
[pid=15033] ppid=15031 vsize=681848 CPUtime=1634 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 167694 0 0 0 163359 41 0 0 25 0 1 0 516456098 698212352 164972 33554432000 4194304 4785740 140733962067392 18446744073709551615 4287017 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 170462 164972 340 145 0 167507 0
[pid=15034] ppid=15031 vsize=472060 CPUtime=1634.16 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 8337 0 0 0 163413 3 0 0 25 0 1 0 516456098 483389440 8234 33554432000 134512640 134534564 4287798416 18446744073709551615 134528877 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 4902.21
Current children cumulated vsize (KiB) 3079644

[startup+4962.3 s]
/proc/loadavg: 5.02 5.01 5.00 6/183 15714
/proc/meminfo: memFree=14554992/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715563469226377216 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=1907412 CPUtime=1654.04 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 958220 0 0 0 165204 200 0 0 25 0 1 0 516456098 1953189888 36320 33554432000 4194304 4587354 140736422988592 18446744073709551615 4238658 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 476853 36320 337 96 0 473415 0
[pid=15033] ppid=15031 vsize=681848 CPUtime=1654 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 167719 0 0 0 165359 41 0 0 25 0 1 0 516456098 698212352 164997 33554432000 4194304 4785740 140733962067392 18446744073709551615 4287143 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 170462 164997 340 145 0 167507 0
[pid=15034] ppid=15031 vsize=472060 CPUtime=1654.16 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 8337 0 0 0 165413 3 0 0 25 0 1 0 516456098 483389440 8234 33554432000 134512640 134534564 4287798416 18446744073709551615 134528511 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 4962.2
Current children cumulated vsize (KiB) 3079644



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+5000 s]
/proc/loadavg: 5.01 5.01 5.00 7/183 15715
/proc/meminfo: memFree=14532268/32950928 swapFree=67111528/67111528
[pid=15031] ppid=15029 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/15031/stat : 15031 (ppfolio) S 15029 15031 14779 0 -1 4202496 500 0 0 0 0 0 0 0 15 0 1 0 516456098 18763776 394 33554432000 4194304 4287625 140733302179808 18446744073709551615 231895510543 0 0 4096 65536 9715563469226377216 0 0 17 4 0 0 0
/proc/15031/statm: 4581 394 345 23 0 91 0
[pid=15032] ppid=15031 vsize=1907412 CPUtime=1666.64 cores=0
/proc/15032/stat : 15032 (cryptominisat) R 15031 15031 14779 0 -1 4202496 963505 0 0 0 166462 202 0 0 25 0 1 0 516456098 1953189888 41583 33554432000 4194304 4587354 140736422988592 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/15032/statm: 476853 41583 337 96 0 473415 0
[pid=15033] ppid=15031 vsize=682572 CPUtime=1666.59 cores=0
/proc/15033/stat : 15033 (clasp) R 15031 15031 14779 0 -1 4202496 167856 0 0 0 166618 41 0 0 25 0 1 0 516456098 698953728 165134 33554432000 4194304 4785740 140733962067392 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 0 0 0 0
/proc/15033/statm: 170643 165134 340 145 0 167688 0
[pid=15034] ppid=15031 vsize=472060 CPUtime=1666.68 cores=0
/proc/15034/stat : 15034 (TNM) R 15031 15031 14779 0 -1 4202496 8337 0 0 0 166665 3 0 0 25 0 1 0 516456098 483389440 8234 33554432000 134512640 134534564 4287798416 18446744073709551615 134530701 0 0 4096 0 0 0 0 17 0 0 0 0
/proc/15034/statm: 118015 8234 95 6 0 116681 0
Current children cumulated CPU time (s) 4999.91
Current children cumulated vsize (KiB) 3080368

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 15031 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=2999
# CPU time returned by wait4() is 0.003998
# while last known CPU time is 4999.91
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 5000.05
CPU time (s): 4999.91
CPU user time (s): 4997.45
CPU system time (s): 2.46
CPU usage (%): 99.9972
Max. virtual memory (cumulated for all children) (KiB): 4849484

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 500
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 246
involuntary context switches= 4

runsolver used 8.99663 second user time and 18.2842 second system time

The end

Launcher Data 

Begin job on node114 at 2011-04-20 03:17:34
IDJOB=3219934
IDBENCH=82672
IDSOLVER=1639
FILE ID=node114/3219934-1303262254
RUNJOBID= node114-1303259274-14797
PBS_JOBID= 13049510
Free space on /tmp= 71672 MiB

SOLVER NAME= ppfolio seq
BENCH NAME= SAT11/random/large/unif-k3-r4.2-v50000-c210000-S517749870-003-UNKNOWN.cnf
COMMAND LINE= ppfolio --nbcore=1 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3219934-1303262254/watcher-3219934-1303262254 -o /tmp/evaluation-result-3219934-1303262254/solver-3219934-1303262254 -C 5000 -W 5000 -M 15500  ppfolio --nbcore=1 HOME/instance-3219934-1303262254.cnf

TIME LIMIT= 5000 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 4033245e3bd21ace8cfcd57089ff73c5
RANDOM SEED=2114075977

node114.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.848
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      15352164 kB
Buffers:        735456 kB
Cached:       16302100 kB
SwapCached:          0 kB
Active:        7894496 kB
Inactive:      9335264 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      15352164 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           14384 kB
Writeback:           0 kB
AnonPages:      192192 kB
Mapped:          16084 kB
Slab:           305952 kB
PageTables:       5352 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   799908 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71660 MiB
End job on node114 at 2011-04-20 04:40:56