Trace number 3191368

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.26 1201.71

General information on the benchmark

Namerandom/medium/
unif-k3-r4.26-v550-c2343-S591042619-090.UNKNOWN.cnf
MD5SUM58de0b27915a7db672b276faaed6cfd0
Bench CategoryRANDOM (random instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables550
Number of clauses2343
Sum of the clauses size7029
Maximum clause length3
Minimum clause length3
Number of clauses of size 10
Number of clauses of size 20
Number of clauses of size 32343
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3191368-1304079565/watcher-3191368-1304079565 -o /tmp/evaluation-result-3191368-1304079565/solver-3191368-1304079565 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3191368-1304079565.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.11 8.60 7.60 7/182 32627
/proc/meminfo: memFree=31310964/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) S 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 13742057105492279295 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0

[startup+0.118128 s]
/proc/loadavg: 9.11 8.60 7.60 7/182 32627
/proc/meminfo: memFree=31310964/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) R 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.200113 s]
/proc/loadavg: 9.11 8.60 7.60 7/182 32627
/proc/meminfo: memFree=31310964/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) R 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 25 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300096 s]
/proc/loadavg: 9.11 8.60 7.60 7/182 32627
/proc/meminfo: memFree=31310964/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) R 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 24 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.701026 s]
/proc/loadavg: 9.11 8.60 7.60 7/182 32627
/proc/meminfo: memFree=31310964/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) S 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 20 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 13742057105492279295 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50089 s]
/proc/loadavg: 9.11 8.60 7.60 11/188 32633
/proc/meminfo: memFree=31304496/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) S 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 13742057105492279295 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
[pid=32628] ppid=32627 vsize=812788 CPUtime=1.49 cores=1
/proc/32628/stat : 32628 (cryptominisat) R 32627 32627 32278 0 -1 4202496 3783 0 0 0 149 0 0 0 25 0 1 0 519555249 832294912 2559 33554432000 4194304 4587354 140734523438240 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/32628/statm: 203197 2559 337 96 0 199759 0
[pid=32629] ppid=32627 vsize=14284 CPUtime=1.49 cores=5
/proc/32629/stat : 32629 (clasp) R 32627 32627 32278 0 -1 4202496 1045 0 0 0 149 0 0 0 25 0 1 0 519555249 14626816 931 33554432000 4194304 4785740 140734116631536 18446744073709551615 4286919 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/32629/statm: 3571 931 340 145 0 616 0
[pid=32630] ppid=32627 vsize=455960 CPUtime=0.74 cores=7
/proc/32630/stat : 32630 (TNM) R 32627 32627 32278 0 -1 4202496 345 0 0 0 74 0 0 0 25 0 1 0 519555249 466903040 241 33554432000 134512640 134534564 4293044880 18446744073709551615 134528687 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32630/statm: 113990 241 95 6 0 112656 0
[pid=32631] ppid=32627 vsize=6596 CPUtime=1.49 cores=3
/proc/32631/stat : 32631 (lingeling) R 32627 32627 32278 0 -1 4202496 1081 0 0 0 149 0 0 0 25 0 1 0 519555249 6754304 846 33554432000 4194304 4352236 140735600000752 18446744073709551615 4278548 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/32631/statm: 1649 846 127 39 0 729 0
[pid=32632] ppid=32627 vsize=7964 CPUtime=0.73 cores=7
/proc/32632/stat : 32632 (march_hi) R 32627 32627 32278 0 -1 4202496 615 0 0 0 73 0 0 0 25 0 1 0 519555249 8155136 507 33554432000 4194304 4331988 140736433538816 18446744073709551615 4228896 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32632/statm: 1991 507 172 34 0 433 0
Current children cumulated CPU time (s) 5.94
Current children cumulated vsize (KiB) 1315916

[startup+3.10061 s]
/proc/loadavg: 9.18 8.62 7.61 12/188 32633
/proc/meminfo: memFree=31296188/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) S 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 13742057105492279295 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
[pid=32628] ppid=32627 vsize=816332 CPUtime=3.09 cores=1
/proc/32628/stat : 32628 (cryptominisat) R 32627 32627 32278 0 -1 4202496 5648 0 0 0 309 0 0 0 25 0 1 0 519555249 835923968 3517 33554432000 4194304 4587354 140734523438240 18446744073709551615 4238282 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/32628/statm: 204083 3517 337 96 0 200645 0
[pid=32629] ppid=32627 vsize=14976 CPUtime=3.09 cores=5
/proc/32629/stat : 32629 (clasp) R 32627 32627 32278 0 -1 4202496 1220 0 0 0 309 0 0 0 25 0 1 0 519555249 15335424 1106 33554432000 4194304 4785740 140734116631536 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/32629/statm: 3744 1106 341 145 0 789 0
[pid=32630] ppid=32627 vsize=455960 CPUtime=1.56 cores=7
/proc/32630/stat : 32630 (TNM) R 32627 32627 32278 0 -1 4202496 345 0 0 0 156 0 0 0 25 0 1 0 519555249 466903040 241 33554432000 134512640 134534564 4293044880 18446744073709551615 134528661 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32630/statm: 113990 241 95 6 0 112656 0
[pid=32631] ppid=32627 vsize=6468 CPUtime=3.09 cores=3
/proc/32631/stat : 32631 (lingeling) R 32627 32627 32278 0 -1 4202496 1145 0 0 0 309 0 0 0 25 0 1 0 519555249 6623232 814 33554432000 4194304 4352236 140735600000752 18446744073709551615 4207767 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/32631/statm: 1617 814 127 39 0 697 0
[pid=32632] ppid=32627 vsize=8132 CPUtime=1.51 cores=7
/proc/32632/stat : 32632 (march_hi) R 32627 32627 32278 0 -1 4202496 647 0 0 0 151 0 0 0 25 0 1 0 519555249 8327168 539 33554432000 4194304 4331988 140736433538816 18446744073709551615 4226479 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32632/statm: 2033 539 173 34 0 475 0
Current children cumulated CPU time (s) 12.34
Current children cumulated vsize (KiB) 1320192

[startup+6.30104 s]
/proc/loadavg: 9.18 8.62 7.61 11/188 32633
/proc/meminfo: memFree=31288724/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) S 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 13742057105492279295 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
[pid=32628] ppid=32627 vsize=816628 CPUtime=6.28 cores=1
/proc/32628/stat : 32628 (cryptominisat) R 32627 32627 32278 0 -1 4202496 7602 0 0 0 628 0 0 0 25 0 1 0 519555249 836227072 3801 33554432000 4194304 4587354 140734523438240 18446744073709551615 4242702 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/32628/statm: 204157 3801 337 96 0 200719 0
[pid=32629] ppid=32627 vsize=16348 CPUtime=6.29 cores=5
/proc/32629/stat : 32629 (clasp) R 32627 32627 32278 0 -1 4202496 1534 0 0 0 629 0 0 0 25 0 1 0 519555249 16740352 1420 33554432000 4194304 4785740 140734116631536 18446744073709551615 235594533819 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/32629/statm: 4087 1420 341 145 0 1132 0
[pid=32630] ppid=32627 vsize=455960 CPUtime=3.15 cores=7
/proc/32630/stat : 32630 (TNM) R 32627 32627 32278 0 -1 4202496 345 0 0 0 315 0 0 0 25 0 1 0 519555249 466903040 241 33554432000 134512640 134534564 4293044880 18446744073709551615 134529031 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32630/statm: 113990 241 95 6 0 112656 0
[pid=32631] ppid=32627 vsize=8008 CPUtime=6.29 cores=3
/proc/32631/stat : 32631 (lingeling) R 32627 32627 32278 0 -1 4202496 2170 0 0 0 629 0 0 0 25 0 1 0 519555249 8200192 1199 33554432000 4194304 4352236 140735600000752 18446744073709551615 4328075 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/32631/statm: 2002 1199 127 39 0 1082 0
[pid=32632] ppid=32627 vsize=8764 CPUtime=3.11 cores=7
/proc/32632/stat : 32632 (march_hi) R 32627 32627 32278 0 -1 4202496 726 0 0 0 311 0 0 0 25 0 1 0 519555249 8974336 618 33554432000 4194304 4331988 140736433538816 18446744073709551615 4263238 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32632/statm: 2191 618 173 34 0 633 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 1324032

[startup+12.7009 s]
/proc/loadavg: 9.45 8.70 7.65 12/188 32633
/proc/meminfo: memFree=31287748/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) S 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 13742057105492279295 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
[pid=32628] ppid=32627 vsize=819520 CPUtime=12.69 cores=1
/proc/32628/stat : 32628 (cryptominisat) R 32627 32627 32278 0 -1 4202496 11805 0 0 0 1268 1 0 0 25 0 1 0 519555249 839188480 4292 33554432000 4194304 4587354 140734523438240 18446744073709551615 4238431 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/32628/statm: 204880 4292 337 96 0 201442 0
[pid=32629] ppid=32627 vsize=17976 CPUtime=12.69 cores=5
/proc/32629/stat : 32629 (clasp) R 32627 32627 32278 0 -1 4202496 1944 0 0 0 1269 0 0 0 25 0 1 0 519555249 18407424 1830 33554432000 4194304 4785740 140734116631536 18446744073709551615 4287058 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/32629/statm: 4494 1830 341 145 0 1539 0
[pid=32630] ppid=32627 vsize=455960 CPUtime=6.34 cores=7
/proc/32630/stat : 32630 (TNM) R 32627 32627 32278 0 -1 4202496 345 0 0 0 634 0 0 0 25 0 1 0 519555249 466903040 241 33554432000 134512640 134534564 4293044880 18446744073709551615 134529838 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32630/statm: 113990 241 95 6 0 112656 0
[pid=32631] ppid=32627 vsize=8396 CPUtime=12.69 cores=3
/proc/32631/stat : 32631 (lingeling) R 32627 32627 32278 0 -1 4202496 3483 0 0 0 1269 0 0 0 25 0 1 0 519555249 8597504 1296 33554432000 4194304 4352236 140735600000752 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/32631/statm: 2099 1296 127 39 0 1179 0
[pid=32632] ppid=32627 vsize=9104 CPUtime=6.27 cores=7
/proc/32632/stat : 32632 (march_hi) R 32627 32627 32278 0 -1 4202496 843 0 0 0 627 0 0 0 25 0 1 0 519555249 9322496 735 33554432000 4194304 4331988 140736433538816 18446744073709551615 4226407 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32632/statm: 2276 735 173 34 0 718 0
Current children cumulated CPU time (s) 50.68
Current children cumulated vsize (KiB) 1329280

[startup+25.5007 s]
/proc/loadavg: 9.61 8.76 7.68 12/188 32633
/proc/meminfo: memFree=31270044/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) S 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 13742057105492279295 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
[pid=32628] ppid=32627 vsize=825184 CPUtime=25.48 cores=1
/proc/32628/stat : 32628 (cryptominisat) R 32627 32627 32278 0 -1 4202496 17959 0 0 0 2546 2 0 0 25 0 1 0 519555249 844988416 5796 33554432000 4194304 4587354 140734523438240 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/32628/statm: 206296 5796 337 96 0 202858 0
[pid=32629] ppid=32627 vsize=19692 CPUtime=25.49 cores=5
/proc/32629/stat : 32629 (clasp) R 32627 32627 32278 0 -1 4202496 2347 0 0 0 2549 0 0 0 25 0 1 0 519555249 20164608 2233 33554432000 4194304 4785740 140734116631536 18446744073709551615 4287104 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/32629/statm: 4923 2233 341 145 0 1968 0
[pid=32630] ppid=32627 vsize=455960 CPUtime=12.74 cores=7
/proc/32630/stat : 32630 (TNM) R 32627 32627 32278 0 -1 4202496 345 0 0 0 1274 0 0 0 25 0 1 0 519555249 466903040 241 33554432000 134512640 134534564 4293044880 18446744073709551615 134530664 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32630/statm: 113990 241 95 6 0 112656 0
[pid=32631] ppid=32627 vsize=9040 CPUtime=25.49 cores=3
/proc/32631/stat : 32631 (lingeling) R 32627 32627 32278 0 -1 4202496 6556 0 0 0 2549 0 0 0 25 0 1 0 519555249 9256960 1457 33554432000 4194304 4352236 140735600000752 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/32631/statm: 2260 1457 127 39 0 1340 0
[pid=32632] ppid=32627 vsize=10760 CPUtime=12.6 cores=7
/proc/32632/stat : 32632 (march_hi) R 32627 32627 32278 0 -1 4202496 1150 0 0 0 1260 0 0 0 25 0 1 0 519555249 11018240 1011 33554432000 4194304 4331988 140736433538816 18446744073709551615 4229629 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32632/statm: 2690 1011 173 34 0 1132 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 1338960

[startup+51.1012 s]
/proc/loadavg: 9.74 8.86 7.74 12/188 32634
/proc/meminfo: memFree=31250404/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) S 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 13742057105492279295 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
[pid=32628] ppid=32627 vsize=848928 CPUtime=51.09 cores=1
/proc/32628/stat : 32628 (cryptominisat) R 32627 32627 32278 0 -1 4202496 26917 0 0 0 5105 4 0 0 25 0 1 0 519555249 869302272 8881 33554432000 4194304 4587354 140734523438240 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/32628/statm: 212232 8881 337 96 0 208794 0
[pid=32629] ppid=32627 vsize=22196 CPUtime=51.08 cores=5
/proc/32629/stat : 32629 (clasp) R 32627 32627 32278 0 -1 4202496 2943 0 0 0 5108 0 0 0 25 0 1 0 519555249 22728704 2829 33554432000 4194304 4785740 140734116631536 18446744073709551615 4538972 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/32629/statm: 5549 2829 341 145 0 2594 0
[pid=32630] ppid=32627 vsize=455960 CPUtime=25.5 cores=7
/proc/32630/stat : 32630 (TNM) R 32627 32627 32278 0 -1 4202496 345 0 0 0 2550 0 0 0 25 0 1 0 519555249 466903040 241 33554432000 134512640 134534564 4293044880 18446744073709551615 134530669 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32630/statm: 113990 241 95 6 0 112656 0
[pid=32631] ppid=32627 vsize=12884 CPUtime=51.09 cores=3

################
# More data... #
################

/proc/32632/statm: 20857 14320 173 34 0 19299 0
Current children cumulated CPU time (s) 3524.4
Current children cumulated vsize (KiB) 1500388

[startup+942.301 s]
/proc/loadavg: 10.14 10.10 9.22 12/188 32691
/proc/meminfo: memFree=31018240/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) S 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 13742057105492279295 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
[pid=32628] ppid=32627 vsize=884664 CPUtime=942.3 cores=1
/proc/32628/stat : 32628 (cryptominisat) R 32627 32627 32278 0 -1 4202496 134565 0 0 0 94179 51 0 0 25 0 1 0 519555249 905895936 18828 33554432000 4194304 4587354 140734523438240 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/32628/statm: 221166 18828 337 96 0 217728 0
[pid=32629] ppid=32627 vsize=40768 CPUtime=942.3 cores=5
/proc/32629/stat : 32629 (clasp) R 32627 32627 32278 0 -1 4202496 7202 0 0 0 94229 1 0 0 25 0 1 0 519555249 41746432 7088 33554432000 4194304 4785740 140734116631536 18446744073709551615 4287038 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/32629/statm: 10192 7088 341 145 0 7237 0
[pid=32630] ppid=32627 vsize=455960 CPUtime=468.67 cores=7
/proc/32630/stat : 32630 (TNM) R 32627 32627 32278 0 -1 4202496 345 0 0 0 46867 0 0 0 25 0 1 0 519555249 466903040 241 33554432000 134512640 134534564 4293044880 18446744073709551615 134530728 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32630/statm: 113990 241 95 6 0 112656 0
[pid=32631] ppid=32627 vsize=31192 CPUtime=942.31 cores=3
/proc/32631/stat : 32631 (lingeling) R 32627 32627 32278 0 -1 4202496 85822 0 0 0 94222 9 0 0 25 0 1 0 519555249 31940608 6995 33554432000 4194304 4352236 140735600000752 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/32631/statm: 7798 6995 127 39 0 6878 0
[pid=32632] ppid=32627 vsize=83428 CPUtime=468.47 cores=7
/proc/32632/stat : 32632 (march_hi) R 32627 32627 32278 0 -1 4202496 15339 0 0 0 46837 10 0 0 25 0 1 0 519555249 85430272 15200 33554432000 4194304 4331988 140736433538816 18446744073709551615 4229471 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32632/statm: 20857 15200 173 34 0 19299 0
Current children cumulated CPU time (s) 3764.05
Current children cumulated vsize (KiB) 1514336

[startup+1002.3 s]
/proc/loadavg: 10.13 10.11 9.28 12/188 32692
/proc/meminfo: memFree=30990396/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) S 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 13742057105492279295 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
[pid=32628] ppid=32627 vsize=884780 CPUtime=1002.3 cores=1
/proc/32628/stat : 32628 (cryptominisat) R 32627 32627 32278 0 -1 4202496 138610 0 0 0 100177 53 0 0 25 0 1 0 519555249 906014720 19013 33554432000 4194304 4587354 140734523438240 18446744073709551615 4238593 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/32628/statm: 221195 19013 337 96 0 217757 0
[pid=32629] ppid=32627 vsize=41356 CPUtime=1002.3 cores=5
/proc/32629/stat : 32629 (clasp) R 32627 32627 32278 0 -1 4202496 7348 0 0 0 100229 1 0 0 25 0 1 0 519555249 42348544 7234 33554432000 4194304 4785740 140734116631536 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/32629/statm: 10339 7234 341 145 0 7384 0
[pid=32630] ppid=32627 vsize=455960 CPUtime=498.48 cores=7
/proc/32630/stat : 32630 (TNM) R 32627 32627 32278 0 -1 4202496 345 0 0 0 49848 0 0 0 25 0 1 0 519555249 466903040 241 33554432000 134512640 134534564 4293044880 18446744073709551615 134528497 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32630/statm: 113990 241 95 6 0 112656 0
[pid=32631] ppid=32627 vsize=35544 CPUtime=1002.32 cores=3
/proc/32631/stat : 32631 (lingeling) R 32627 32627 32278 0 -1 4202496 90334 0 0 0 100222 10 0 0 25 0 1 0 519555249 36397056 8083 33554432000 4194304 4352236 140735600000752 18446744073709551615 4328100 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/32631/statm: 8886 8083 127 39 0 7966 0
[pid=32632] ppid=32627 vsize=83428 CPUtime=498.32 cores=7
/proc/32632/stat : 32632 (march_hi) R 32627 32627 32278 0 -1 4202496 16227 0 0 0 49822 10 0 0 25 0 1 0 519555249 85430272 16088 33554432000 4194304 4331988 140736433538816 18446744073709551615 4226450 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32632/statm: 20857 16088 173 34 0 19299 0
Current children cumulated CPU time (s) 4003.72
Current children cumulated vsize (KiB) 1519392

[startup+1062.3 s]
/proc/loadavg: 10.13 10.12 9.33 12/188 32694
/proc/meminfo: memFree=30977568/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) S 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 13742057105492279295 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
[pid=32628] ppid=32627 vsize=883064 CPUtime=1062.3 cores=1
/proc/32628/stat : 32628 (cryptominisat) R 32627 32627 32278 0 -1 4202496 144377 0 0 0 106175 55 0 0 25 0 1 0 519555249 904257536 20852 33554432000 4194304 4587354 140734523438240 18446744073709551615 4357665 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/32628/statm: 220766 20852 337 96 0 217328 0
[pid=32629] ppid=32627 vsize=41684 CPUtime=1062.3 cores=5
/proc/32629/stat : 32629 (clasp) R 32627 32627 32278 0 -1 4202496 7440 0 0 0 106229 1 0 0 25 0 1 0 519555249 42684416 7326 33554432000 4194304 4785740 140734116631536 18446744073709551615 4291944 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/32629/statm: 10421 7326 341 145 0 7466 0
[pid=32630] ppid=32627 vsize=455960 CPUtime=528.36 cores=7
/proc/32630/stat : 32630 (TNM) R 32627 32627 32278 0 -1 4202496 345 0 0 0 52836 0 0 0 25 0 1 0 519555249 466903040 241 33554432000 134512640 134534564 4293044880 18446744073709551615 134528906 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32630/statm: 113990 241 95 6 0 112656 0
[pid=32631] ppid=32627 vsize=23000 CPUtime=1062.31 cores=3
/proc/32631/stat : 32631 (lingeling) R 32627 32627 32278 0 -1 4202496 91998 0 0 0 106221 10 0 0 25 0 1 0 519555249 23552000 4947 33554432000 4194304 4352236 140735600000752 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/32631/statm: 5750 4947 127 39 0 4830 0
[pid=32632] ppid=32627 vsize=83428 CPUtime=528.12 cores=7
/proc/32632/stat : 32632 (march_hi) R 32627 32627 32278 0 -1 4202496 17099 0 0 0 52801 11 0 0 25 0 1 0 519555249 85430272 16960 33554432000 4194304 4331988 140736433538816 18446744073709551615 4229572 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32632/statm: 20857 16960 173 34 0 19299 0
Current children cumulated CPU time (s) 4243.39
Current children cumulated vsize (KiB) 1505460

[startup+1122.3 s]
/proc/loadavg: 10.16 10.14 9.39 12/188 32696
/proc/meminfo: memFree=30950096/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) S 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 13742057105492279295 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
[pid=32628] ppid=32627 vsize=894144 CPUtime=1122.31 cores=1
/proc/32628/stat : 32628 (cryptominisat) R 32627 32627 32278 0 -1 4202496 149275 0 0 0 112174 57 0 0 25 0 1 0 519555249 915603456 21637 33554432000 4194304 4587354 140734523438240 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/32628/statm: 223536 21637 337 96 0 220098 0
[pid=32629] ppid=32627 vsize=42188 CPUtime=1122.31 cores=5
/proc/32629/stat : 32629 (clasp) R 32627 32627 32278 0 -1 4202496 7529 0 0 0 112230 1 0 0 25 0 1 0 519555249 43200512 7415 33554432000 4194304 4785740 140734116631536 18446744073709551615 4550319 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/32629/statm: 10547 7415 341 145 0 7592 0
[pid=32630] ppid=32627 vsize=455960 CPUtime=558.16 cores=7
/proc/32630/stat : 32630 (TNM) R 32627 32627 32278 0 -1 4202496 345 0 0 0 55816 0 0 0 25 0 1 0 519555249 466903040 241 33554432000 134512640 134534564 4293044880 18446744073709551615 134530820 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32630/statm: 113990 241 95 6 0 112656 0
[pid=32631] ppid=32627 vsize=36696 CPUtime=1122.31 cores=3
/proc/32631/stat : 32631 (lingeling) R 32627 32627 32278 0 -1 4202496 96798 0 0 0 112221 10 0 0 25 0 1 0 519555249 37576704 8371 33554432000 4194304 4352236 140735600000752 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/32631/statm: 9174 8371 127 39 0 8254 0
[pid=32632] ppid=32627 vsize=83428 CPUtime=557.99 cores=7
/proc/32632/stat : 32632 (march_hi) R 32627 32627 32278 0 -1 4202496 17964 0 0 0 55788 11 0 0 25 0 1 0 519555249 85430272 17825 33554432000 4194304 4331988 140736433538816 18446744073709551615 4226479 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32632/statm: 20857 17825 173 34 0 19299 0
Current children cumulated CPU time (s) 4483.08
Current children cumulated vsize (KiB) 1530740

[startup+1182.3 s]
/proc/loadavg: 10.14 10.14 9.43 12/188 32697
/proc/meminfo: memFree=30970244/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) S 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 13742057105492279295 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
[pid=32628] ppid=32627 vsize=887112 CPUtime=1182.3 cores=1
/proc/32628/stat : 32628 (cryptominisat) R 32627 32627 32278 0 -1 4202496 152040 0 0 0 118172 58 0 0 25 0 1 0 519555249 908402688 20413 33554432000 4194304 4587354 140734523438240 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/32628/statm: 221778 20413 337 96 0 218340 0
[pid=32629] ppid=32627 vsize=42636 CPUtime=1182.31 cores=5
/proc/32629/stat : 32629 (clasp) R 32627 32627 32278 0 -1 4202496 7646 0 0 0 118230 1 0 0 25 0 1 0 519555249 43659264 7532 33554432000 4194304 4785740 140734116631536 18446744073709551615 4287104 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/32629/statm: 10659 7532 341 145 0 7704 0
[pid=32630] ppid=32627 vsize=455960 CPUtime=588.01 cores=7
/proc/32630/stat : 32630 (TNM) R 32627 32627 32278 0 -1 4202496 345 0 0 0 58801 0 0 0 25 0 1 0 519555249 466903040 241 33554432000 134512640 134534564 4293044880 18446744073709551615 134528628 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32630/statm: 113990 241 95 6 0 112656 0
[pid=32631] ppid=32627 vsize=24792 CPUtime=1182.32 cores=3
/proc/32631/stat : 32631 (lingeling) R 32627 32627 32278 0 -1 4202496 98622 0 0 0 118221 11 0 0 25 0 1 0 519555249 25387008 5395 33554432000 4194304 4352236 140735600000752 18446744073709551615 4328194 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/32631/statm: 6198 5395 127 39 0 5278 0
[pid=32632] ppid=32627 vsize=83428 CPUtime=587.81 cores=7
/proc/32632/stat : 32632 (march_hi) R 32627 32627 32278 0 -1 4202496 18823 0 0 0 58769 12 0 0 25 0 1 0 519555249 85430272 18684 33554432000 4194304 4331988 140736433538816 18446744073709551615 4265283 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32632/statm: 20857 18684 173 34 0 19299 0
Current children cumulated CPU time (s) 4722.75
Current children cumulated vsize (KiB) 1512252



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 10.27 10.17 9.46 11/188 32698
/proc/meminfo: memFree=30922844/32950928 swapFree=67111404/67111528
[pid=32627] ppid=32625 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/32627/stat : 32627 (ppfolio) S 32625 32627 32278 0 -1 4202496 523 0 0 0 0 0 0 0 15 0 1 0 519555249 18763776 390 33554432000 4194304 4287625 140735897741104 18446744073709551615 235594886671 0 0 4096 65536 13742057105492279295 0 0 17 1 0 0 0
/proc/32627/statm: 4581 390 341 23 0 91 0
[pid=32628] ppid=32627 vsize=891268 CPUtime=1201.71 cores=1
/proc/32628/stat : 32628 (cryptominisat) R 32627 32627 32278 0 -1 4202496 154928 0 0 0 120112 59 0 0 25 0 1 0 519555249 912658432 23059 33554432000 4194304 4587354 140734523438240 18446744073709551615 4238690 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/32628/statm: 222817 23059 337 96 0 219379 0
[pid=32629] ppid=32627 vsize=42928 CPUtime=1201.71 cores=5
/proc/32629/stat : 32629 (clasp) R 32627 32627 32278 0 -1 4202496 7702 0 0 0 120170 1 0 0 25 0 1 0 519555249 43958272 7588 33554432000 4194304 4785740 140734116631536 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/32629/statm: 10732 7588 341 145 0 7777 0
[pid=32630] ppid=32627 vsize=455960 CPUtime=597.65 cores=7
/proc/32630/stat : 32630 (TNM) R 32627 32627 32278 0 -1 4202496 345 0 0 0 59765 0 0 0 25 0 1 0 519555249 466903040 241 33554432000 134512640 134534564 4293044880 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32630/statm: 113990 241 95 6 0 112656 0
[pid=32631] ppid=32627 vsize=36696 CPUtime=1201.72 cores=3
/proc/32631/stat : 32631 (lingeling) R 32627 32627 32278 0 -1 4202496 101598 0 0 0 120161 11 0 0 25 0 1 0 519555249 37576704 8371 33554432000 4194304 4352236 140735600000752 18446744073709551615 4329149 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/32631/statm: 9174 8371 127 39 0 8254 0
[pid=32632] ppid=32627 vsize=83428 CPUtime=597.47 cores=7
/proc/32632/stat : 32632 (march_hi) R 32627 32627 32278 0 -1 4202496 19110 0 0 0 59734 13 0 0 25 0 1 0 519555249 85430272 18971 33554432000 4194304 4331988 140736433538816 18446744073709551615 4229586 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/32632/statm: 20857 18971 173 34 0 19299 0
Current children cumulated CPU time (s) 4800.26
Current children cumulated vsize (KiB) 1528604

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 32627 and gives
#  childrusage.ru_utime.tv_sec=3598
#  childrusage.ru_utime.tv_usec=331970
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=281957
# CPU time returned by wait4() is 3598.61
# while last known CPU time is 4800.26
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.26
CPU user time (s): 4799.42
CPU system time (s): 0.84
CPU usage (%): 399.451
Max. virtual memory (cumulated for all children) (KiB): 2300140

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 3598.33
system time used= 0.281957
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 129296
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 527
involuntary context switches= 37803

runsolver used 1.87971 second user time and 4.68429 second system time

The end

Launcher Data 

Begin job on node120 at 2011-04-29 14:19:25
IDJOB=3191368
IDBENCH=83099
IDSOLVER=1612
FILE ID=node120/3191368-1304079565
RUNJOBID= node120-1304078919-32297
PBS_JOBID= 13170527
Free space on /tmp= 72064 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/random/medium/unif-k3-r4.26-v550-c2343-S591042619-090.UNKNOWN.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3191368-1304079565/watcher-3191368-1304079565 -o /tmp/evaluation-result-3191368-1304079565/solver-3191368-1304079565 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3191368-1304079565.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 58de0b27915a7db672b276faaed6cfd0
RANDOM SEED=1573727527

node120.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.07
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      31311244 kB
Buffers:        460244 kB
Cached:         610212 kB
SwapCached:          8 kB
Active:         559536 kB
Inactive:       721440 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      31311244 kB
SwapTotal:    67111528 kB
SwapFree:     67111404 kB
Dirty:           10128 kB
Writeback:           0 kB
AnonPages:      209964 kB
Mapped:          16920 kB
Slab:           296156 kB
PageTables:       5344 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  2341748 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72056 MiB
End job on node120 at 2011-04-29 14:39:29