Trace number 3257773

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.3 1201.71

General information on the benchmark

NameCRAFTED/rbsat/random/unforced/
rbsat-v2400c266431g10.cnf
MD5SUM885d1d8595262b8f0aa94d123211b47c
Bench CategoryCRAFTED (crafted instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2400
Number of clauses266431
Sum of the clauses size535112
Maximum clause length32
Minimum clause length2
Number of clauses of size 10
Number of clauses of size 2266356
Number of clauses of size 30
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 575

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3257773-1304033925/watcher-3257773-1304033925 -o /tmp/evaluation-result-3257773-1304033925/solver-3257773-1304033925 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3257773-1304033925.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.41 9.92 9.31 3/173 23306
/proc/meminfo: memFree=26393460/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) R 23304 23306 22773 0 -1 4202496 523 0 0 0 0 0 0 0 24 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0

[startup+0.113702 s]
/proc/loadavg: 9.41 9.92 9.31 3/173 23306
/proc/meminfo: memFree=26393460/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 24 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.200687 s]
/proc/loadavg: 9.41 9.92 9.31 3/173 23306
/proc/meminfo: memFree=26393460/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) R 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 24 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300671 s]
/proc/loadavg: 9.41 9.92 9.31 3/173 23306
/proc/meminfo: memFree=26393460/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 24 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700597 s]
/proc/loadavg: 9.41 9.92 9.31 3/173 23306
/proc/meminfo: memFree=26393460/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 19 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50046 s]
/proc/loadavg: 9.41 9.92 9.31 11/188 23322
/proc/meminfo: memFree=26248308/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
[pid=23307] ppid=23306 vsize=66224 CPUtime=1.49 cores=1
/proc/23307/stat : 23307 (cryptominisat) R 23306 23306 22773 0 -1 4202496 16375 0 0 0 147 2 0 0 25 0 1 0 514990453 67813376 11363 33554432000 4194304 4587354 140734661410816 18446744073709551615 4238525 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/23307/statm: 16556 11363 326 96 0 13118 0
[pid=23308] ppid=23306 vsize=32144 CPUtime=1.48 cores=5
/proc/23308/stat : 23308 (clasp) R 23306 23306 22773 0 -1 4202496 6511 0 0 0 148 0 0 0 20 0 1 0 514990453 32915456 5230 33554432000 4194304 4785740 140737016245440 18446744073709551615 4495610 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/23308/statm: 8036 5230 316 145 0 5081 0
[pid=23309] ppid=23306 vsize=464404 CPUtime=0.76 cores=7
/proc/23309/stat : 23309 (TNM) R 23306 23306 22773 0 -1 4202496 4422 0 0 0 76 0 0 0 25 0 1 0 514990453 475549696 4318 33554432000 134512640 134534564 4289983952 18446744073709551615 134524508 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23309/statm: 116101 4318 91 6 0 114767 0
[pid=23310] ppid=23306 vsize=16664 CPUtime=1.49 cores=3
/proc/23310/stat : 23310 (lingeling) R 23306 23306 22773 0 -1 4202496 4162 0 0 0 149 0 0 0 20 0 1 0 514990453 17063936 3033 33554432000 4194304 4352236 140735646712064 18446744073709551615 4273772 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/23310/statm: 4166 3033 124 39 0 3246 0
[pid=23311] ppid=23306 vsize=41924 CPUtime=0.7 cores=7
/proc/23311/stat : 23311 (march_hi) R 23306 23306 22773 0 -1 4202496 17884 0 0 0 68 2 0 0 25 0 1 0 514990453 42930176 4443 33554432000 4194304 4331988 140733309921056 18446744073709551615 4251979 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23311/statm: 10481 4443 160 34 0 8923 0
Current children cumulated CPU time (s) 5.92
Current children cumulated vsize (KiB) 639684

[startup+3.10118 s]
/proc/loadavg: 9.41 9.92 9.31 11/188 23322
/proc/meminfo: memFree=26227260/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
[pid=23307] ppid=23306 vsize=741552 CPUtime=3.09 cores=1
/proc/23307/stat : 23307 (cryptominisat) R 23306 23306 22773 0 -1 4202496 18319 0 0 0 306 3 0 0 25 0 1 0 514990453 759349248 11695 33554432000 4194304 4587354 140734661410816 18446744073709551615 4238883 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/23307/statm: 185388 11695 331 96 0 181950 0
[pid=23308] ppid=23306 vsize=30016 CPUtime=3.09 cores=5
/proc/23308/stat : 23308 (clasp) R 23306 23306 22773 0 -1 4202496 6596 0 0 0 309 0 0 0 25 0 1 0 514990453 30736384 4794 33554432000 4194304 4785740 140737016245440 18446744073709551615 4287172 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/23308/statm: 7504 4794 340 145 0 4549 0
[pid=23309] ppid=23306 vsize=466516 CPUtime=1.56 cores=7
/proc/23309/stat : 23309 (TNM) R 23306 23306 22773 0 -1 4202496 6331 0 0 0 156 0 0 0 25 0 1 0 514990453 477712384 6227 33554432000 134512640 134534564 4289983952 18446744073709551615 134525961 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23309/statm: 116629 6227 95 6 0 115295 0
[pid=23310] ppid=23306 vsize=21236 CPUtime=3.09 cores=3
/proc/23310/stat : 23310 (lingeling) R 23306 23306 22773 0 -1 4202496 5600 0 0 0 309 0 0 0 25 0 1 0 514990453 21745664 4471 33554432000 4194304 4352236 140735646712064 18446744073709551615 4329279 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/23310/statm: 5309 4471 127 39 0 4389 0
[pid=23311] ppid=23306 vsize=43264 CPUtime=1.5 cores=7
/proc/23311/stat : 23311 (march_hi) R 23306 23306 22773 0 -1 4202496 20248 0 0 0 148 2 0 0 25 0 1 0 514990453 44302336 4803 33554432000 4194304 4331988 140733309921056 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23311/statm: 10816 4803 175 34 0 9258 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 1320908

[startup+6.30062 s]
/proc/loadavg: 9.45 9.93 9.31 11/188 23323
/proc/meminfo: memFree=26192292/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
[pid=23307] ppid=23306 vsize=754700 CPUtime=6.29 cores=1
/proc/23307/stat : 23307 (cryptominisat) R 23306 23306 22773 0 -1 4202496 20488 0 0 0 626 3 0 0 25 0 1 0 514990453 772812800 13861 33554432000 4194304 4587354 140734661410816 18446744073709551615 4365356 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/23307/statm: 188675 13861 337 96 0 185237 0
[pid=23308] ppid=23306 vsize=37884 CPUtime=6.29 cores=5
/proc/23308/stat : 23308 (clasp) R 23306 23306 22773 0 -1 4202496 8622 0 0 0 628 1 0 0 25 0 1 0 514990453 38793216 6820 33554432000 4194304 4785740 140737016245440 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/23308/statm: 9471 6820 340 145 0 6516 0
[pid=23309] ppid=23306 vsize=470348 CPUtime=3.14 cores=7
/proc/23309/stat : 23309 (TNM) R 23306 23306 22773 0 -1 4202496 6332 0 0 0 314 0 0 0 25 0 1 0 514990453 481636352 6228 33554432000 134512640 134534564 4289983952 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23309/statm: 117587 6228 95 6 0 116253 0
[pid=23310] ppid=23306 vsize=26612 CPUtime=6.28 cores=3
/proc/23310/stat : 23310 (lingeling) R 23306 23306 22773 0 -1 4202496 6433 0 0 0 628 0 0 0 25 0 1 0 514990453 27250688 5304 33554432000 4194304 4352236 140735646712064 18446744073709551615 4328026 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/23310/statm: 6653 5304 127 39 0 5733 0
[pid=23311] ppid=23306 vsize=43660 CPUtime=3.1 cores=7
/proc/23311/stat : 23311 (march_hi) R 23306 23306 22773 0 -1 4202496 20348 0 0 0 308 2 0 0 25 0 1 0 514990453 44707840 4903 33554432000 4194304 4331988 140733309921056 18446744073709551615 4226400 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23311/statm: 10915 4903 175 34 0 9357 0
Current children cumulated CPU time (s) 25.1
Current children cumulated vsize (KiB) 1351528

[startup+12.7005 s]
/proc/loadavg: 9.50 9.93 9.31 11/188 23323
/proc/meminfo: memFree=26117280/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
[pid=23307] ppid=23306 vsize=771164 CPUtime=12.69 cores=1
/proc/23307/stat : 23307 (cryptominisat) R 23306 23306 22773 0 -1 4202496 25327 0 0 0 1265 4 0 0 25 0 1 0 514990453 789671936 18697 33554432000 4194304 4587354 140734661410816 18446744073709551615 4230266 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/23307/statm: 192791 18697 337 96 0 189353 0
[pid=23308] ppid=23306 vsize=54932 CPUtime=12.69 cores=5
/proc/23308/stat : 23308 (clasp) R 23306 23306 22773 0 -1 4202496 12785 0 0 0 1266 3 0 0 25 0 1 0 514990453 56250368 10983 33554432000 4194304 4785740 140737016245440 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/23308/statm: 13733 10983 340 145 0 10778 0
[pid=23309] ppid=23306 vsize=470348 CPUtime=6.34 cores=7
/proc/23309/stat : 23309 (TNM) R 23306 23306 22773 0 -1 4202496 6332 0 0 0 634 0 0 0 25 0 1 0 514990453 481636352 6228 33554432000 134512640 134534564 4289983952 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23309/statm: 117587 6228 95 6 0 116253 0
[pid=23310] ppid=23306 vsize=26612 CPUtime=12.68 cores=3
/proc/23310/stat : 23310 (lingeling) R 23306 23306 22773 0 -1 4202496 6805 0 0 0 1268 0 0 0 25 0 1 0 514990453 27250688 5676 33554432000 4194304 4352236 140735646712064 18446744073709551615 4328308 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/23310/statm: 6653 5676 127 39 0 5733 0
[pid=23311] ppid=23306 vsize=43980 CPUtime=6.27 cores=7
/proc/23311/stat : 23311 (march_hi) R 23306 23306 22773 0 -1 4202496 20425 0 0 0 625 2 0 0 25 0 1 0 514990453 45035520 4979 33554432000 4194304 4331988 140733309921056 18446744073709551615 4226443 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23311/statm: 10995 4979 175 34 0 9437 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 1385360

[startup+25.5013 s]
/proc/loadavg: 9.69 9.95 9.33 11/188 23323
/proc/meminfo: memFree=26067400/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
[pid=23307] ppid=23306 vsize=756864 CPUtime=25.49 cores=1
/proc/23307/stat : 23307 (cryptominisat) R 23306 23306 22773 0 -1 4202496 30531 0 0 0 2544 5 0 0 25 0 1 0 514990453 775028736 21428 33554432000 4194304 4587354 140734661410816 18446744073709551615 4237470 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/23307/statm: 189216 21428 337 96 0 185778 0
[pid=23308] ppid=23306 vsize=78364 CPUtime=25.49 cores=5
/proc/23308/stat : 23308 (clasp) R 23306 23306 22773 0 -1 4202496 18619 0 0 0 2543 6 0 0 25 0 1 0 514990453 80244736 16817 33554432000 4194304 4785740 140737016245440 18446744073709551615 228244006665 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/23308/statm: 19591 16817 340 145 0 16636 0
[pid=23309] ppid=23306 vsize=470348 CPUtime=12.73 cores=7
/proc/23309/stat : 23309 (TNM) R 23306 23306 22773 0 -1 4202496 6332 0 0 0 1273 0 0 0 25 0 1 0 514990453 481636352 6228 33554432000 134512640 134534564 4289983952 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23309/statm: 117587 6228 95 6 0 116253 0
[pid=23310] ppid=23306 vsize=32508 CPUtime=25.48 cores=3
/proc/23310/stat : 23310 (lingeling) R 23306 23306 22773 0 -1 4202496 8418 0 0 0 2548 0 0 0 25 0 1 0 514990453 33288192 7289 33554432000 4194304 4352236 140735646712064 18446744073709551615 4328392 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/23310/statm: 8127 7289 127 39 0 7207 0
[pid=23311] ppid=23306 vsize=44624 CPUtime=12.6 cores=7
/proc/23311/stat : 23311 (march_hi) R 23306 23306 22773 0 -1 4202496 20566 0 0 0 1258 2 0 0 25 0 1 0 514990453 45694976 5120 33554432000 4194304 4331988 140733309921056 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23311/statm: 11156 5120 176 34 0 9598 0
Current children cumulated CPU time (s) 101.79
Current children cumulated vsize (KiB) 1401032

[startup+51.1008 s]
/proc/loadavg: 9.86 9.97 9.35 11/188 23324
/proc/meminfo: memFree=26024824/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
[pid=23307] ppid=23306 vsize=754440 CPUtime=51.09 cores=1
/proc/23307/stat : 23307 (cryptominisat) R 23306 23306 22773 0 -1 4202496 45174 0 0 0 5102 7 0 0 25 0 1 0 514990453 772546560 23513 33554432000 4194304 4587354 140734661410816 18446744073709551615 4238622 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/23307/statm: 188610 23513 337 96 0 185172 0
[pid=23308] ppid=23306 vsize=80276 CPUtime=51.08 cores=5
/proc/23308/stat : 23308 (clasp) R 23306 23306 22773 0 -1 4202496 19073 0 0 0 5102 6 0 0 25 0 1 0 514990453 82202624 17271 33554432000 4194304 4785740 140737016245440 18446744073709551615 228244009669 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/23308/statm: 20069 17271 340 145 0 17114 0
[pid=23309] ppid=23306 vsize=470348 CPUtime=25.43 cores=7
/proc/23309/stat : 23309 (TNM) R 23306 23306 22773 0 -1 4202496 6332 0 0 0 2543 0 0 0 25 0 1 0 514990453 481636352 6228 33554432000 134512640 134534564 4289983952 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23309/statm: 117587 6228 95 6 0 116253 0
[pid=23310] ppid=23306 vsize=37168 CPUtime=51.09 cores=3

################
# More data... #
################

/proc/23311/statm: 17506 10169 175 34 0 15948 0
Current children cumulated CPU time (s) 3524.4
Current children cumulated vsize (KiB) 1652268

[startup+942.301 s]
/proc/loadavg: 10.18 10.18 9.85 11/188 23379
/proc/meminfo: memFree=25362980/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
[pid=23307] ppid=23306 vsize=802568 CPUtime=942.31 cores=1
/proc/23307/stat : 23307 (cryptominisat) R 23306 23306 22773 0 -1 4202496 242498 0 0 0 94123 108 0 0 25 0 1 0 514990453 821829632 32765 33554432000 4194304 4587354 140734661410816 18446744073709551615 4238467 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/23307/statm: 200642 32765 337 96 0 197204 0
[pid=23308] ppid=23306 vsize=192264 CPUtime=942.28 cores=5
/proc/23308/stat : 23308 (clasp) R 23306 23306 22773 0 -1 4202496 45830 0 0 0 94212 16 0 0 25 0 1 0 514990453 196878336 44028 33554432000 4194304 4785740 140737016245440 18446744073709551615 4287055 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/23308/statm: 48066 44028 340 145 0 45111 0
[pid=23309] ppid=23306 vsize=470348 CPUtime=468.63 cores=7
/proc/23309/stat : 23309 (TNM) R 23306 23306 22773 0 -1 4202496 6332 0 0 0 46863 0 0 0 25 0 1 0 514990453 481636352 6228 33554432000 134512640 134534564 4289983952 18446744073709551615 134528957 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23309/statm: 117587 6228 95 6 0 116253 0
[pid=23310] ppid=23306 vsize=80368 CPUtime=942.31 cores=3
/proc/23310/stat : 23310 (lingeling) R 23306 23306 22773 0 -1 4202496 108447 0 0 0 94218 13 0 0 25 0 1 0 514990453 82296832 19254 33554432000 4194304 4352236 140735646712064 18446744073709551615 4329202 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/23310/statm: 20092 19254 127 39 0 19172 0
[pid=23311] ppid=23306 vsize=70024 CPUtime=468.53 cores=7
/proc/23311/stat : 23311 (march_hi) R 23306 23306 22773 0 -1 4202496 25868 0 0 0 46847 6 0 0 25 0 1 0 514990453 71704576 10420 33554432000 4194304 4331988 140733309921056 18446744073709551615 4246748 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23311/statm: 17506 10420 175 34 0 15948 0
Current children cumulated CPU time (s) 3764.06
Current children cumulated vsize (KiB) 1633896

[startup+1002.3 s]
/proc/loadavg: 10.13 10.16 9.86 11/188 23381
/proc/meminfo: memFree=25306156/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
[pid=23307] ppid=23306 vsize=842872 CPUtime=1002.3 cores=1
/proc/23307/stat : 23307 (cryptominisat) R 23306 23306 22773 0 -1 4202496 275298 0 0 0 100114 116 0 0 25 0 1 0 514990453 863100928 46816 33554432000 4194304 4587354 140734661410816 18446744073709551615 4238512 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/23307/statm: 210718 46816 337 96 0 207280 0
[pid=23308] ppid=23306 vsize=209836 CPUtime=1002.29 cores=5
/proc/23308/stat : 23308 (clasp) R 23306 23306 22773 0 -1 4202496 50166 0 0 0 100210 19 0 0 25 0 1 0 514990453 214872064 48364 33554432000 4194304 4785740 140737016245440 18446744073709551615 4287028 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/23308/statm: 52459 48364 340 145 0 49504 0
[pid=23309] ppid=23306 vsize=470348 CPUtime=498.46 cores=7
/proc/23309/stat : 23309 (TNM) R 23306 23306 22773 0 -1 4202496 6332 0 0 0 49846 0 0 0 25 0 1 0 514990453 481636352 6228 33554432000 134512640 134534564 4289983952 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23309/statm: 117587 6228 95 6 0 116253 0
[pid=23310] ppid=23306 vsize=74228 CPUtime=1002.31 cores=3
/proc/23310/stat : 23310 (lingeling) R 23306 23306 22773 0 -1 4202496 119712 0 0 0 100217 14 0 0 25 0 1 0 514990453 76009472 17751 33554432000 4194304 4352236 140735646712064 18446744073709551615 4235629 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/23310/statm: 18557 17751 127 39 0 17637 0
[pid=23311] ppid=23306 vsize=70024 CPUtime=498.37 cores=7
/proc/23311/stat : 23311 (march_hi) R 23306 23306 22773 0 -1 4202496 26149 0 0 0 49831 6 0 0 25 0 1 0 514990453 71704576 10701 33554432000 4194304 4331988 140733309921056 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23311/statm: 17506 10701 175 34 0 15948 0
Current children cumulated CPU time (s) 4003.73
Current children cumulated vsize (KiB) 1685632

[startup+1062.3 s]
/proc/loadavg: 10.14 10.16 9.87 11/188 23383
/proc/meminfo: memFree=25283308/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
[pid=23307] ppid=23306 vsize=857544 CPUtime=1062.31 cores=1
/proc/23307/stat : 23307 (cryptominisat) R 23306 23306 22773 0 -1 4202496 290077 0 0 0 106105 126 0 0 25 0 1 0 514990453 878125056 45417 33554432000 4194304 4587354 140734661410816 18446744073709551615 4237665 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/23307/statm: 214386 45417 337 96 0 210948 0
[pid=23308] ppid=23306 vsize=215036 CPUtime=1062.29 cores=5
/proc/23308/stat : 23308 (clasp) R 23306 23306 22773 0 -1 4202496 51370 0 0 0 106210 19 0 0 25 0 1 0 514990453 220196864 49568 33554432000 4194304 4785740 140737016245440 18446744073709551615 4287058 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/23308/statm: 53759 49568 340 145 0 50804 0
[pid=23309] ppid=23306 vsize=470348 CPUtime=528.28 cores=7
/proc/23309/stat : 23309 (TNM) R 23306 23306 22773 0 -1 4202496 6332 0 0 0 52828 0 0 0 25 0 1 0 514990453 481636352 6228 33554432000 134512640 134534564 4289983952 18446744073709551615 134530360 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23309/statm: 117587 6228 95 6 0 116253 0
[pid=23310] ppid=23306 vsize=72180 CPUtime=1062.31 cores=3
/proc/23310/stat : 23310 (lingeling) R 23306 23306 22773 0 -1 4202496 129952 0 0 0 106215 16 0 0 25 0 1 0 514990453 73912320 17239 33554432000 4194304 4352236 140735646712064 18446744073709551615 4207805 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/23310/statm: 18045 17239 127 39 0 17125 0
[pid=23311] ppid=23306 vsize=75844 CPUtime=528.22 cores=7
/proc/23311/stat : 23311 (march_hi) R 23306 23306 22773 0 -1 4202496 26376 0 0 0 52816 6 0 0 25 0 1 0 514990453 77664256 10928 33554432000 4194304 4331988 140733309921056 18446744073709551615 4228226 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23311/statm: 18961 10928 175 34 0 17403 0
Current children cumulated CPU time (s) 4243.41
Current children cumulated vsize (KiB) 1709276

[startup+1122.3 s]
/proc/loadavg: 10.15 10.16 9.89 11/188 23384
/proc/meminfo: memFree=25280924/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
[pid=23307] ppid=23306 vsize=854548 CPUtime=1122.31 cores=1
/proc/23307/stat : 23307 (cryptominisat) R 23306 23306 22773 0 -1 4202496 303635 0 0 0 112097 134 0 0 25 0 1 0 514990453 875057152 46312 33554432000 4194304 4587354 140734661410816 18446744073709551615 4248785 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/23307/statm: 213637 46312 337 96 0 210199 0
[pid=23308] ppid=23306 vsize=219920 CPUtime=1122.29 cores=5
/proc/23308/stat : 23308 (clasp) R 23306 23306 22773 0 -1 4202496 52509 0 0 0 112210 19 0 0 25 0 1 0 514990453 225198080 50707 33554432000 4194304 4785740 140737016245440 18446744073709551615 4286912 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/23308/statm: 54980 50707 340 145 0 52025 0
[pid=23309] ppid=23306 vsize=470348 CPUtime=558.15 cores=7
/proc/23309/stat : 23309 (TNM) R 23306 23306 22773 0 -1 4202496 6332 0 0 0 55815 0 0 0 25 0 1 0 514990453 481636352 6228 33554432000 134512640 134534564 4289983952 18446744073709551615 134530339 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23309/statm: 117587 6228 95 6 0 116253 0
[pid=23310] ppid=23306 vsize=86516 CPUtime=1122.32 cores=3
/proc/23310/stat : 23310 (lingeling) R 23306 23306 22773 0 -1 4202496 141216 0 0 0 112214 18 0 0 25 0 1 0 514990453 88592384 20823 33554432000 4194304 4352236 140735646712064 18446744073709551615 4328550 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/23310/statm: 21629 20823 127 39 0 20709 0
[pid=23311] ppid=23306 vsize=75844 CPUtime=558.03 cores=7
/proc/23311/stat : 23311 (march_hi) R 23306 23306 22773 0 -1 4202496 26605 0 0 0 55796 7 0 0 25 0 1 0 514990453 77664256 11157 33554432000 4194304 4331988 140733309921056 18446744073709551615 4228235 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23311/statm: 18961 11157 175 34 0 17403 0
Current children cumulated CPU time (s) 4483.1
Current children cumulated vsize (KiB) 1725500

[startup+1182.3 s]
/proc/loadavg: 10.13 10.16 9.91 11/188 23386
/proc/meminfo: memFree=25263660/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
[pid=23307] ppid=23306 vsize=854892 CPUtime=1182.31 cores=1
/proc/23307/stat : 23307 (cryptominisat) R 23306 23306 22773 0 -1 4202496 318561 0 0 0 118088 143 0 0 25 0 1 0 514990453 875409408 48254 33554432000 4194304 4587354 140734661410816 18446744073709551615 4236329 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/23307/statm: 213723 48254 337 96 0 210285 0
[pid=23308] ppid=23306 vsize=227700 CPUtime=1182.29 cores=5
/proc/23308/stat : 23308 (clasp) R 23306 23306 22773 0 -1 4202496 54296 0 0 0 118209 20 0 0 25 0 1 0 514990453 233164800 52494 33554432000 4194304 4785740 140737016245440 18446744073709551615 4553402 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/23308/statm: 56925 52494 340 145 0 53970 0
[pid=23309] ppid=23306 vsize=470348 CPUtime=587.95 cores=7
/proc/23309/stat : 23309 (TNM) R 23306 23306 22773 0 -1 4202496 6332 0 0 0 58795 0 0 0 25 0 1 0 514990453 481636352 6228 33554432000 134512640 134534564 4289983952 18446744073709551615 134529632 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23309/statm: 117587 6228 95 6 0 116253 0
[pid=23310] ppid=23306 vsize=74228 CPUtime=1182.31 cores=3
/proc/23310/stat : 23310 (lingeling) R 23306 23306 22773 0 -1 4202496 149920 0 0 0 118212 19 0 0 25 0 1 0 514990453 76009472 17751 33554432000 4194304 4352236 140735646712064 18446744073709551615 4328109 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/23310/statm: 18557 17751 127 39 0 17637 0
[pid=23311] ppid=23306 vsize=75844 CPUtime=587.91 cores=7
/proc/23311/stat : 23311 (march_hi) R 23306 23306 22773 0 -1 4202496 26880 0 0 0 58784 7 0 0 25 0 1 0 514990453 77664256 11432 33554432000 4194304 4331988 140733309921056 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23311/statm: 18961 11432 175 34 0 17403 0
Current children cumulated CPU time (s) 4722.77
Current children cumulated vsize (KiB) 1721336



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 10.25 10.18 9.92 12/188 23386
/proc/meminfo: memFree=25254468/32951124 swapFree=67111364/67111528
[pid=23306] ppid=23304 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/23306/stat : 23306 (ppfolio) S 23304 23306 22773 0 -1 4202496 524 0 0 0 0 0 0 0 15 0 1 0 514990452 18763776 390 33554432000 4194304 4287625 140735023518768 18446744073709551615 228244368911 0 0 4096 65536 4444631448678301695 0 0 17 1 0 0 0
/proc/23306/statm: 4581 390 341 23 0 91 0
[pid=23307] ppid=23306 vsize=837848 CPUtime=1201.72 cores=1
/proc/23307/stat : 23307 (cryptominisat) R 23306 23306 22773 0 -1 4202496 323329 0 0 0 120027 145 0 0 25 0 1 0 514990453 857956352 48626 33554432000 4194304 4587354 140734661410816 18446744073709551615 4238611 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/23307/statm: 209462 48626 337 96 0 206024 0
[pid=23308] ppid=23306 vsize=227888 CPUtime=1201.7 cores=5
/proc/23308/stat : 23308 (clasp) R 23306 23306 22773 0 -1 4202496 54341 0 0 0 120150 20 0 0 25 0 1 0 514990453 233357312 52539 33554432000 4194304 4785740 140737016245440 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/23308/statm: 56972 52539 340 145 0 54017 0
[pid=23309] ppid=23306 vsize=470348 CPUtime=597.64 cores=7
/proc/23309/stat : 23309 (TNM) R 23306 23306 22773 0 -1 4202496 6332 0 0 0 59764 0 0 0 25 0 1 0 514990453 481636352 6228 33554432000 134512640 134534564 4289983952 18446744073709551615 134528730 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23309/statm: 117587 6228 95 6 0 116253 0
[pid=23310] ppid=23306 vsize=74228 CPUtime=1201.72 cores=3
/proc/23310/stat : 23310 (lingeling) R 23306 23306 22773 0 -1 4202496 154016 0 0 0 120153 19 0 0 25 0 1 0 514990453 76009472 17751 33554432000 4194304 4352236 140735646712064 18446744073709551615 4329086 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/23310/statm: 18557 17751 127 39 0 17637 0
[pid=23311] ppid=23306 vsize=75844 CPUtime=597.52 cores=7
/proc/23311/stat : 23311 (march_hi) R 23306 23306 22773 0 -1 4202496 26935 0 0 0 59745 7 0 0 25 0 1 0 514990453 77664256 11487 33554432000 4194304 4331988 140733309921056 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/23311/statm: 18961 11487 175 34 0 17403 0
Current children cumulated CPU time (s) 4800.3
Current children cumulated vsize (KiB) 1704480

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23306 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=4999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.006998
# while last known CPU time is 4800.3
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.3
CPU user time (s): 4798.39
CPU system time (s): 1.91
CPU usage (%): 399.455
Max. virtual memory (cumulated for all children) (KiB): 2401680

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.004999
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 524
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 348
involuntary context switches= 6

runsolver used 1.74373 second user time and 4.82027 second system time

The end

Launcher Data 

Begin job on node136 at 2011-04-29 01:38:45
IDJOB=3257773
IDBENCH=71270
IDSOLVER=1612
FILE ID=node136/3257773-1304033925
RUNJOBID= node136-1304032720-23162
PBS_JOBID= 13170316
Free space on /tmp= 72332 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/CRAFTED/rbsat/random/unforced/rbsat-v2400c266431g10.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3257773-1304033925/watcher-3257773-1304033925 -o /tmp/evaluation-result-3257773-1304033925/solver-3257773-1304033925 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3257773-1304033925.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 885d1d8595262b8f0aa94d123211b47c
RANDOM SEED=1338255092

node136.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.809
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      26395104 kB
Buffers:       1046712 kB
Cached:        4894136 kB
SwapCached:        100 kB
Active:         653180 kB
Inactive:      5351808 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      26395104 kB
SwapTotal:    67111528 kB
SwapFree:     67111364 kB
Dirty:           17104 kB
Writeback:          56 kB
AnonPages:       63860 kB
Mapped:          14748 kB
Slab:           485896 kB
PageTables:       4536 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   188644 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72308 MiB
End job on node136 at 2011-04-29 01:58:49