Trace number 3282590

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.21 1201.71

General information on the benchmark

NameAPPLICATIONS/crypto/
md5gen/gus-md5-12.cnf
MD5SUM0621e557bffdc18ca509447665adecda
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables69553
Number of clauses226752
Sum of the clauses size587624
Maximum clause length3
Minimum clause length1
Number of clauses of size 1129
Number of clauses of size 292374
Number of clauses of size 3134249
Number of clauses of size 40
Number of clauses of size 50
Number of clauses of size over 50

Solver Data 

0.00/0.00	This is pico-portfolio, a naive parallel portfolio
0.00/0.00	Copyright (C) 2011 Olivier Roussel
0.00/0.00	Using 4 processing units
0.00/0.00	This portfolio uses the following solvers:
0.00/0.00	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.00	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.00	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.00	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.00	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.00	Starting cryptominisat 2.7.1 on core(s) 1
0.00/0.00	Starting clasp 1.3.6 on core(s) 5
0.00/0.00	Starting TNM 2009 on core(s) 7
0.00/0.00	Starting lingeling 276-6264d55-100731 on core(s) 3
0.00/0.00	Starting march_hi 2009 on core(s) 7

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3282590-1304032879/watcher-3282590-1304032879 -o /tmp/evaluation-result-3282590-1304032879/solver-3282590-1304032879 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3282590-1304032879.cnf 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.79 4.16 5.37 9/182 17497
/proc/meminfo: memFree=12772028/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) R 17495 17497 16932 0 -1 4202496 520 0 0 0 0 0 0 0 22 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0

[startup+0.120204 s]
/proc/loadavg: 3.79 4.16 5.37 9/182 17497
/proc/meminfo: memFree=12772028/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) R 17495 17497 16932 0 -1 4202496 520 0 0 0 0 0 0 0 22 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.20019 s]
/proc/loadavg: 3.79 4.16 5.37 9/182 17497
/proc/meminfo: memFree=12772028/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) R 17495 17497 16932 0 -1 4202496 520 0 0 0 0 0 0 0 22 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300174 s]
/proc/loadavg: 3.79 4.16 5.37 9/182 17497
/proc/meminfo: memFree=12772028/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) R 17495 17497 16932 0 -1 4202496 520 0 0 0 0 0 0 0 22 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.701095 s]
/proc/loadavg: 3.79 4.16 5.37 9/182 17497
/proc/meminfo: memFree=12772028/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) R 17495 17497 16932 0 -1 4202496 520 0 0 0 0 0 0 0 22 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 0 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.50095 s]
/proc/loadavg: 3.79 4.16 5.37 11/188 17503
/proc/meminfo: memFree=12539972/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) S 17495 17497 16932 0 -1 4202496 521 0 0 0 0 0 0 0 19 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 4408944462336622591 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
[pid=17498] ppid=17497 vsize=134164 CPUtime=1.49 cores=1
/proc/17498/stat : 17498 (cryptominisat) R 17497 17497 16932 0 -1 4202496 23846 0 0 0 145 4 0 0 20 0 1 0 593518597 137383936 18508 33554432000 4194304 4587354 140737055266192 18446744073709551615 4237661 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/17498/statm: 33541 18508 333 96 0 30103 0
[pid=17499] ppid=17497 vsize=56656 CPUtime=1.49 cores=5
/proc/17499/stat : 17499 (clasp) R 17497 17497 16932 0 -1 4202496 14336 0 0 0 147 2 0 0 25 0 1 0 593518597 58015744 11240 33554432000 4194304 4785740 140734934978432 18446744073709551615 4536814 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/17499/statm: 14164 11240 340 145 0 11209 0
[pid=17500] ppid=17497 vsize=468364 CPUtime=0.78 cores=7
/proc/17500/stat : 17500 (TNM) R 17497 17497 16932 0 -1 4202496 8034 0 0 0 77 1 0 0 25 0 1 0 593518597 479604736 7931 33554432000 134512640 134534564 4287985808 18446744073709551615 134529953 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17500/statm: 117091 7931 95 6 0 115757 0
[pid=17501] ppid=17497 vsize=24740 CPUtime=1.49 cores=3
/proc/17501/stat : 17501 (lingeling) R 17497 17497 16932 0 -1 4202496 8996 0 0 0 148 1 0 0 25 0 1 0 593518597 25333760 5350 33554432000 4194304 4352236 140736169188864 18446744073709551615 4227407 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17501/statm: 6185 5350 125 39 0 5265 0
[pid=17502] ppid=17497 vsize=42556 CPUtime=0.7 cores=7
/proc/17502/stat : 17502 (march_hi) R 17497 17497 16932 0 -1 4202496 32235 0 0 0 65 5 0 0 25 0 1 0 593518597 43577344 7141 33554432000 4194304 4331988 140736845673568 18446744073709551615 4222704 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17502/statm: 10639 7141 149 34 0 9081 0
Current children cumulated CPU time (s) 5.95
Current children cumulated vsize (KiB) 744804

[startup+3.10064 s]
/proc/loadavg: 3.79 4.16 5.37 11/188 17503
/proc/meminfo: memFree=12523976/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) S 17495 17497 16932 0 -1 4202496 522 0 0 0 0 0 0 0 18 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 4408944462336622591 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
[pid=17498] ppid=17497 vsize=134164 CPUtime=3.09 cores=1
/proc/17498/stat : 17498 (cryptominisat) R 17497 17497 16932 0 -1 4202496 23860 0 0 0 305 4 0 0 25 0 1 0 593518597 137383936 18522 33554432000 4194304 4587354 140737055266192 18446744073709551615 4239225 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/17498/statm: 33541 18522 333 96 0 30103 0
[pid=17499] ppid=17497 vsize=56656 CPUtime=3.09 cores=5
/proc/17499/stat : 17499 (clasp) R 17497 17497 16932 0 -1 4202496 14336 0 0 0 307 2 0 0 25 0 1 0 593518597 58015744 11240 33554432000 4194304 4785740 140734934978432 18446744073709551615 4550467 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/17499/statm: 14164 11240 340 145 0 11209 0
[pid=17500] ppid=17497 vsize=472200 CPUtime=1.57 cores=7
/proc/17500/stat : 17500 (TNM) R 17497 17497 16932 0 -1 4202496 8035 0 0 0 156 1 0 0 25 0 1 0 593518597 483532800 7932 33554432000 134512640 134534564 4287985808 18446744073709551615 134528659 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17500/statm: 118050 7932 95 6 0 116716 0
[pid=17501] ppid=17497 vsize=32932 CPUtime=3.09 cores=3
/proc/17501/stat : 17501 (lingeling) R 17497 17497 16932 0 -1 4202496 11045 0 0 0 308 1 0 0 25 0 1 0 593518597 33722368 7399 33554432000 4194304 4352236 140736169188864 18446744073709551615 4228407 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17501/statm: 8233 7399 125 39 0 7313 0
[pid=17502] ppid=17497 vsize=134920 CPUtime=1.49 cores=7
/proc/17502/stat : 17502 (march_hi) R 17497 17497 16932 0 -1 4202496 63412 0 0 0 140 9 0 0 25 0 1 0 593518597 138158080 15275 33554432000 4194304 4331988 140736845673568 18446744073709551615 4237064 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17502/statm: 33730 15275 196 34 0 32172 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 849196

[startup+6.30104 s]
/proc/loadavg: 4.28 4.25 5.39 11/188 17503
/proc/meminfo: memFree=12480004/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) S 17495 17497 16932 0 -1 4202496 522 0 0 0 0 0 0 0 18 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 4408944462336622591 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
[pid=17498] ppid=17497 vsize=134164 CPUtime=6.29 cores=1
/proc/17498/stat : 17498 (cryptominisat) R 17497 17497 16932 0 -1 4202496 24024 0 0 0 625 4 0 0 25 0 1 0 593518597 137383936 18683 33554432000 4194304 4587354 140737055266192 18446744073709551615 4237963 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/17498/statm: 33541 18683 334 96 0 30103 0
[pid=17499] ppid=17497 vsize=56656 CPUtime=6.29 cores=5
/proc/17499/stat : 17499 (clasp) R 17497 17497 16932 0 -1 4202496 14336 0 0 0 627 2 0 0 25 0 1 0 593518597 58015744 11240 33554432000 4194304 4785740 140734934978432 18446744073709551615 4553003 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/17499/statm: 14164 11240 340 145 0 11209 0
[pid=17500] ppid=17497 vsize=472200 CPUtime=3.16 cores=7
/proc/17500/stat : 17500 (TNM) R 17497 17497 16932 0 -1 4202496 8035 0 0 0 315 1 0 0 25 0 1 0 593518597 483532800 7932 33554432000 134512640 134534564 4287985808 18446744073709551615 134529080 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17500/statm: 118050 7932 95 6 0 116716 0
[pid=17501] ppid=17497 vsize=32780 CPUtime=6.29 cores=3
/proc/17501/stat : 17501 (lingeling) R 17497 17497 16932 0 -1 4202496 11047 0 0 0 628 1 0 0 25 0 1 0 593518597 33566720 7363 33554432000 4194304 4352236 140736169188864 18446744073709551615 4278833 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17501/statm: 8195 7363 127 39 0 7275 0
[pid=17502] ppid=17497 vsize=141884 CPUtime=3.09 cores=7
/proc/17502/stat : 17502 (march_hi) R 17497 17497 16932 0 -1 4202496 65073 0 0 0 300 9 0 0 25 0 1 0 593518597 145289216 16913 33554432000 4194304 4331988 140736845673568 18446744073709551615 4237136 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17502/statm: 35471 16913 173 34 0 33913 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 856008

[startup+12.7008 s]
/proc/loadavg: 4.74 4.35 5.42 11/188 17503
/proc/meminfo: memFree=12458072/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) S 17495 17497 16932 0 -1 4202496 522 0 0 0 0 0 0 0 18 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 4408944462336622591 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
[pid=17498] ppid=17497 vsize=134164 CPUtime=12.69 cores=1
/proc/17498/stat : 17498 (cryptominisat) R 17497 17497 16932 0 -1 4202496 24470 0 0 0 1265 4 0 0 25 0 1 0 593518597 137383936 19125 33554432000 4194304 4587354 140737055266192 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/17498/statm: 33541 19125 334 96 0 30103 0
[pid=17499] ppid=17497 vsize=58020 CPUtime=12.68 cores=5
/proc/17499/stat : 17499 (clasp) R 17497 17497 16932 0 -1 4202496 14771 0 0 0 1266 2 0 0 25 0 1 0 593518597 59412480 11675 33554432000 4194304 4785740 140734934978432 18446744073709551615 4552550 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/17499/statm: 14505 11675 340 145 0 11550 0
[pid=17500] ppid=17497 vsize=472200 CPUtime=6.32 cores=7
/proc/17500/stat : 17500 (TNM) R 17497 17497 16932 0 -1 4202496 8035 0 0 0 631 1 0 0 25 0 1 0 593518597 483532800 7932 33554432000 134512640 134534564 4287985808 18446744073709551615 134528523 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17500/statm: 118050 7932 95 6 0 116716 0
[pid=17501] ppid=17497 vsize=32780 CPUtime=12.69 cores=3
/proc/17501/stat : 17501 (lingeling) R 17497 17497 16932 0 -1 4202496 11047 0 0 0 1268 1 0 0 25 0 1 0 593518597 33566720 7363 33554432000 4194304 4352236 140736169188864 18446744073709551615 4280999 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17501/statm: 8195 7363 127 39 0 7275 0
[pid=17502] ppid=17497 vsize=145816 CPUtime=6.29 cores=7
/proc/17502/stat : 17502 (march_hi) R 17497 17497 16932 0 -1 4202496 65937 0 0 0 619 10 0 0 25 0 1 0 593518597 149315584 17777 33554432000 4194304 4331988 140736845673568 18446744073709551615 4265452 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17502/statm: 36454 17777 173 34 0 34896 0
Current children cumulated CPU time (s) 50.67
Current children cumulated vsize (KiB) 861304

[startup+25.5004 s]
/proc/loadavg: 5.90 4.63 5.49 11/188 17503
/proc/meminfo: memFree=12432660/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) S 17495 17497 16932 0 -1 4202496 522 0 0 0 0 0 0 0 18 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 4408944462336622591 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
[pid=17498] ppid=17497 vsize=134164 CPUtime=25.49 cores=1
/proc/17498/stat : 17498 (cryptominisat) R 17497 17497 16932 0 -1 4202496 25309 0 0 0 2545 4 0 0 25 0 1 0 593518597 137383936 19957 33554432000 4194304 4587354 140737055266192 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/17498/statm: 33541 19957 334 96 0 30103 0
[pid=17499] ppid=17497 vsize=60428 CPUtime=25.48 cores=5
/proc/17499/stat : 17499 (clasp) R 17497 17497 16932 0 -1 4202496 15378 0 0 0 2546 2 0 0 25 0 1 0 593518597 61878272 12282 33554432000 4194304 4785740 140734934978432 18446744073709551615 4287008 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/17499/statm: 15107 12282 340 145 0 12152 0
[pid=17500] ppid=17497 vsize=472200 CPUtime=12.7 cores=7
/proc/17500/stat : 17500 (TNM) R 17497 17497 16932 0 -1 4202496 8035 0 0 0 1269 1 0 0 25 0 1 0 593518597 483532800 7932 33554432000 134512640 134534564 4287985808 18446744073709551615 134530551 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17500/statm: 118050 7932 95 6 0 116716 0
[pid=17501] ppid=17497 vsize=32780 CPUtime=25.49 cores=3
/proc/17501/stat : 17501 (lingeling) R 17497 17497 16932 0 -1 4202496 11047 0 0 0 2548 1 0 0 25 0 1 0 593518597 33566720 7363 33554432000 4194304 4352236 140736169188864 18446744073709551615 4278623 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17501/statm: 8195 7363 127 39 0 7275 0
[pid=17502] ppid=17497 vsize=146060 CPUtime=12.64 cores=7
/proc/17502/stat : 17502 (march_hi) R 17497 17497 16932 0 -1 4202496 65971 0 0 0 1254 10 0 0 25 0 1 0 593518597 149565440 17811 33554432000 4194304 4331988 140736845673568 18446744073709551615 4299872 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17502/statm: 36515 17811 173 34 0 34957 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 863956

[startup+51.1006 s]
/proc/loadavg: 7.36 5.07 5.62 11/188 17504
/proc/meminfo: memFree=12404684/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) S 17495 17497 16932 0 -1 4202496 522 0 0 0 0 0 0 0 16 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 4408944462336622591 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
[pid=17498] ppid=17497 vsize=1735580 CPUtime=51.09 cores=1
/proc/17498/stat : 17498 (cryptominisat) R 17497 17497 16932 0 -1 4202496 29003 0 0 0 5103 6 0 0 25 0 1 0 593518597 1777233920 18850 33554432000 4194304 4587354 140737055266192 18446744073709551615 4238314 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/17498/statm: 433895 18850 337 96 0 430457 0
[pid=17499] ppid=17497 vsize=67580 CPUtime=51.08 cores=5
/proc/17499/stat : 17499 (clasp) R 17497 17497 16932 0 -1 4202496 17150 0 0 0 5105 3 0 0 25 0 1 0 593518597 69201920 14054 33554432000 4194304 4785740 140734934978432 18446744073709551615 4550348 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/17499/statm: 16895 14054 340 145 0 13940 0
[pid=17500] ppid=17497 vsize=472200 CPUtime=25.42 cores=7
/proc/17500/stat : 17500 (TNM) R 17497 17497 16932 0 -1 4202496 8035 0 0 0 2541 1 0 0 25 0 1 0 593518597 483532800 7932 33554432000 134512640 134534564 4287985808 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17500/statm: 118050 7932 95 6 0 116716 0
[pid=17501] ppid=17497 vsize=32780 CPUtime=51.09 cores=3

################
# More data... #
################

/proc/17502/statm: 38179 19303 173 34 0 36621 0
Current children cumulated CPU time (s) 3524.38
Current children cumulated vsize (KiB) 2663080

[startup+942.3 s]
/proc/loadavg: 10.18 9.93 8.42 11/188 17560
/proc/meminfo: memFree=12103068/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) S 17495 17497 16932 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 4408944462336622591 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
[pid=17498] ppid=17497 vsize=171280 CPUtime=942.32 cores=1
/proc/17498/stat : 17498 (cryptominisat) R 17497 17497 16932 0 -1 4202496 103553 0 0 0 94200 32 0 0 25 0 1 0 593518597 175390720 34735 33554432000 4194304 4587354 140737055266192 18446744073709551615 4239000 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/17498/statm: 42820 34735 340 96 0 39382 0
[pid=17499] ppid=17497 vsize=143400 CPUtime=942.23 cores=5
/proc/17499/stat : 17499 (clasp) R 17497 17497 16932 0 -1 4202496 35946 0 0 0 94209 14 0 0 25 0 1 0 593518597 146841600 32850 33554432000 4194304 4785740 140734934978432 18446744073709551615 4309555 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/17499/statm: 35850 32850 340 145 0 32895 0
[pid=17500] ppid=17497 vsize=472200 CPUtime=468.63 cores=7
/proc/17500/stat : 17500 (TNM) R 17497 17497 16932 0 -1 4202496 8035 0 0 0 46862 1 0 0 25 0 1 0 593518597 483532800 7932 33554432000 134512640 134534564 4287985808 18446744073709551615 134528737 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17500/statm: 118050 7932 95 6 0 116716 0
[pid=17501] ppid=17497 vsize=41276 CPUtime=942.29 cores=3
/proc/17501/stat : 17501 (lingeling) R 17497 17497 16932 0 -1 4202496 13171 0 0 0 94228 1 0 0 25 0 1 0 593518597 42266624 9487 33554432000 4194304 4352236 140736169188864 18446744073709551615 4278664 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17501/statm: 10319 9487 127 39 0 9399 0
[pid=17502] ppid=17497 vsize=152716 CPUtime=468.54 cores=7
/proc/17502/stat : 17502 (march_hi) R 17497 17497 16932 0 -1 4202496 67542 0 0 0 46843 11 0 0 25 0 1 0 593518597 156381184 19382 33554432000 4194304 4331988 140736845673568 18446744073709551615 4228546 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17502/statm: 38179 19382 173 34 0 36621 0
Current children cumulated CPU time (s) 3764.01
Current children cumulated vsize (KiB) 999196

[startup+1002.3 s]
/proc/loadavg: 10.17 9.97 8.53 11/188 17561
/proc/meminfo: memFree=12105128/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) S 17495 17497 16932 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 4408944462336622591 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
[pid=17498] ppid=17497 vsize=171280 CPUtime=1002.32 cores=1
/proc/17498/stat : 17498 (cryptominisat) R 17497 17497 16932 0 -1 4202496 104005 0 0 0 100200 32 0 0 25 0 1 0 593518597 175390720 35163 33554432000 4194304 4587354 140737055266192 18446744073709551615 4238571 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/17498/statm: 42820 35163 340 96 0 39382 0
[pid=17499] ppid=17497 vsize=146176 CPUtime=1002.22 cores=5
/proc/17499/stat : 17499 (clasp) R 17497 17497 16932 0 -1 4202496 36658 0 0 0 100207 15 0 0 25 0 1 0 593518597 149684224 33562 33554432000 4194304 4785740 140734934978432 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/17499/statm: 36544 33562 340 145 0 33589 0
[pid=17500] ppid=17497 vsize=472200 CPUtime=498.43 cores=7
/proc/17500/stat : 17500 (TNM) R 17497 17497 16932 0 -1 4202496 8035 0 0 0 49842 1 0 0 25 0 1 0 593518597 483532800 7932 33554432000 134512640 134534564 4287985808 18446744073709551615 134528273 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17500/statm: 118050 7932 95 6 0 116716 0
[pid=17501] ppid=17497 vsize=41276 CPUtime=1002.29 cores=3
/proc/17501/stat : 17501 (lingeling) R 17497 17497 16932 0 -1 4202496 13171 0 0 0 100228 1 0 0 25 0 1 0 593518597 42266624 9487 33554432000 4194304 4352236 140736169188864 18446744073709551615 4281245 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17501/statm: 10319 9487 127 39 0 9399 0
[pid=17502] ppid=17497 vsize=152716 CPUtime=498.42 cores=7
/proc/17502/stat : 17502 (march_hi) R 17497 17497 16932 0 -1 4202496 67619 0 0 0 49831 11 0 0 25 0 1 0 593518597 156381184 19459 33554432000 4194304 4331988 140736845673568 18446744073709551615 256415052081 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17502/statm: 38179 19459 173 34 0 36621 0
Current children cumulated CPU time (s) 4003.68
Current children cumulated vsize (KiB) 1001972

[startup+1062.3 s]
/proc/loadavg: 10.20 10.02 8.63 12/189 17566
/proc/meminfo: memFree=12072712/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) S 17495 17497 16932 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 4408944462336622591 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
[pid=17498] ppid=17497 vsize=1827364 CPUtime=1062.32 cores=1
/proc/17498/stat : 17498 (cryptominisat) R 17497 17497 16932 0 -1 4202496 104805 0 0 0 106199 33 0 0 25 0 1 0 593518597 1871220736 35946 33554432000 4194304 4587354 140737055266192 18446744073709551615 4238323 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/17498/statm: 456841 35946 340 96 0 453403 0
[pid=17499] ppid=17497 vsize=146176 CPUtime=1062.22 cores=5
/proc/17499/stat : 17499 (clasp) R 17497 17497 16932 0 -1 4202496 36660 0 0 0 106207 15 0 0 25 0 1 0 593518597 149684224 33564 33554432000 4194304 4785740 140734934978432 18446744073709551615 4553409 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/17499/statm: 36544 33564 340 145 0 33589 0
[pid=17500] ppid=17497 vsize=472200 CPUtime=528.31 cores=7
/proc/17500/stat : 17500 (TNM) R 17497 17497 16932 0 -1 4202496 8035 0 0 0 52830 1 0 0 25 0 1 0 593518597 483532800 7932 33554432000 134512640 134534564 4287985808 18446744073709551615 134528523 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17500/statm: 118050 7932 95 6 0 116716 0
[pid=17501] ppid=17497 vsize=41276 CPUtime=1062.29 cores=3
/proc/17501/stat : 17501 (lingeling) R 17497 17497 16932 0 -1 4202496 13171 0 0 0 106228 1 0 0 25 0 1 0 593518597 42266624 9487 33554432000 4194304 4352236 140736169188864 18446744073709551615 4280969 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17501/statm: 10319 9487 127 39 0 9399 0
[pid=17502] ppid=17497 vsize=155304 CPUtime=528.21 cores=7
/proc/17502/stat : 17502 (march_hi) R 17497 17497 16932 0 -1 4202496 67696 0 0 0 52810 11 0 0 25 0 1 0 593518597 159031296 19536 33554432000 4194304 4331988 140736845673568 18446744073709551615 4298303 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17502/statm: 38826 19536 173 34 0 37268 0
Current children cumulated CPU time (s) 4243.35
Current children cumulated vsize (KiB) 2660644

[startup+1122.3 s]
/proc/loadavg: 10.26 10.08 8.74 11/188 17568
/proc/meminfo: memFree=12075728/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) S 17495 17497 16932 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 4408944462336622591 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
[pid=17498] ppid=17497 vsize=1827364 CPUtime=1122.33 cores=1
/proc/17498/stat : 17498 (cryptominisat) R 17497 17497 16932 0 -1 4202496 105357 0 0 0 112199 34 0 0 25 0 1 0 593518597 1871220736 36489 33554432000 4194304 4587354 140737055266192 18446744073709551615 4238463 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/17498/statm: 456841 36489 340 96 0 453403 0
[pid=17499] ppid=17497 vsize=146780 CPUtime=1122.22 cores=5
/proc/17499/stat : 17499 (clasp) R 17497 17497 16932 0 -1 4202496 36775 0 0 0 112207 15 0 0 25 0 1 0 593518597 150302720 33679 33554432000 4194304 4785740 140734934978432 18446744073709551615 4287241 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/17499/statm: 36695 33679 340 145 0 33740 0
[pid=17500] ppid=17497 vsize=472200 CPUtime=558.12 cores=7
/proc/17500/stat : 17500 (TNM) R 17497 17497 16932 0 -1 4202496 8035 0 0 0 55811 1 0 0 25 0 1 0 593518597 483532800 7932 33554432000 134512640 134534564 4287985808 18446744073709551615 134530307 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17500/statm: 118050 7932 95 6 0 116716 0
[pid=17501] ppid=17497 vsize=41276 CPUtime=1122.29 cores=3
/proc/17501/stat : 17501 (lingeling) R 17497 17497 16932 0 -1 4202496 13171 0 0 0 112228 1 0 0 25 0 1 0 593518597 42266624 9487 33554432000 4194304 4352236 140736169188864 18446744073709551615 4278717 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17501/statm: 10319 9487 127 39 0 9399 0
[pid=17502] ppid=17497 vsize=155304 CPUtime=558.08 cores=7
/proc/17502/stat : 17502 (march_hi) R 17497 17497 16932 0 -1 4202496 67775 0 0 0 55797 11 0 0 25 0 1 0 593518597 159031296 19615 33554432000 4194304 4331988 140736845673568 18446744073709551615 4226440 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17502/statm: 38826 19615 173 34 0 37268 0
Current children cumulated CPU time (s) 4483.04
Current children cumulated vsize (KiB) 2661248

[startup+1182.3 s]
/proc/loadavg: 10.29 10.13 8.84 11/188 17569
/proc/meminfo: memFree=12079552/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) S 17495 17497 16932 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 4408944462336622591 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
[pid=17498] ppid=17497 vsize=1898848 CPUtime=1182.32 cores=1
/proc/17498/stat : 17498 (cryptominisat) R 17497 17497 16932 0 -1 4202496 105897 0 0 0 118198 34 0 0 25 0 1 0 593518597 1944420352 37021 33554432000 4194304 4587354 140737055266192 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/17498/statm: 474712 37021 340 96 0 471274 0
[pid=17499] ppid=17497 vsize=146780 CPUtime=1182.21 cores=5
/proc/17499/stat : 17499 (clasp) R 17497 17497 16932 0 -1 4202496 36780 0 0 0 118206 15 0 0 25 0 1 0 593518597 150302720 33684 33554432000 4194304 4785740 140734934978432 18446744073709551615 4287204 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/17499/statm: 36695 33684 340 145 0 33740 0
[pid=17500] ppid=17497 vsize=472200 CPUtime=587.97 cores=7
/proc/17500/stat : 17500 (TNM) R 17497 17497 16932 0 -1 4202496 8035 0 0 0 58796 1 0 0 25 0 1 0 593518597 483532800 7932 33554432000 134512640 134534564 4287985808 18446744073709551615 134529765 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17500/statm: 118050 7932 95 6 0 116716 0
[pid=17501] ppid=17497 vsize=41276 CPUtime=1182.29 cores=3
/proc/17501/stat : 17501 (lingeling) R 17497 17497 16932 0 -1 4202496 13171 0 0 0 118228 1 0 0 25 0 1 0 593518597 42266624 9487 33554432000 4194304 4352236 140736169188864 18446744073709551615 4281088 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17501/statm: 10319 9487 127 39 0 9399 0
[pid=17502] ppid=17497 vsize=155304 CPUtime=587.9 cores=7
/proc/17502/stat : 17502 (march_hi) R 17497 17497 16932 0 -1 4202496 67858 0 0 0 58779 11 0 0 25 0 1 0 593518597 159031296 19698 33554432000 4194304 4331988 140736845673568 18446744073709551615 4309352 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17502/statm: 38826 19698 173 34 0 37268 0
Current children cumulated CPU time (s) 4722.69
Current children cumulated vsize (KiB) 2732732



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.7 s]
/proc/loadavg: 10.21 10.12 8.86 11/188 17570
/proc/meminfo: memFree=12070000/32950928 swapFree=67111524/67111528
[pid=17497] ppid=17495 vsize=18324 CPUtime=0 cores=1,3,5,7
/proc/17497/stat : 17497 (ppfolio) S 17495 17497 16932 0 -1 4202496 522 0 0 0 0 0 0 0 15 0 1 0 593518597 18763776 389 33554432000 4194304 4287625 140733744488560 18446744073709551615 256415411727 0 0 4096 65536 4408944462336622591 0 0 17 1 0 0 0
/proc/17497/statm: 4581 389 341 23 0 91 0
[pid=17498] ppid=17497 vsize=1898848 CPUtime=1201.73 cores=1
/proc/17498/stat : 17498 (cryptominisat) R 17497 17497 16932 0 -1 4202496 106427 0 0 0 120138 35 0 0 25 0 1 0 593518597 1944420352 37546 33554432000 4194304 4587354 140737055266192 18446744073709551615 4237679 0 0 4096 2 0 0 0 17 1 0 0 0
/proc/17498/statm: 474712 37546 340 96 0 471274 0
[pid=17499] ppid=17497 vsize=146780 CPUtime=1201.62 cores=5
/proc/17499/stat : 17499 (clasp) R 17497 17497 16932 0 -1 4202496 36781 0 0 0 120147 15 0 0 25 0 1 0 593518597 150302720 33685 33554432000 4194304 4785740 140734934978432 18446744073709551615 4550931 0 0 4096 16386 0 0 0 17 5 0 0 0
/proc/17499/statm: 36695 33685 340 145 0 33740 0
[pid=17500] ppid=17497 vsize=472200 CPUtime=597.61 cores=7
/proc/17500/stat : 17500 (TNM) R 17497 17497 16932 0 -1 4202496 8035 0 0 0 59760 1 0 0 25 0 1 0 593518597 483532800 7932 33554432000 134512640 134534564 4287985808 18446744073709551615 134528726 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17500/statm: 118050 7932 95 6 0 116716 0
[pid=17501] ppid=17497 vsize=41276 CPUtime=1201.7 cores=3
/proc/17501/stat : 17501 (lingeling) R 17497 17497 16932 0 -1 4202496 13171 0 0 0 120169 1 0 0 25 0 1 0 593518597 42266624 9487 33554432000 4194304 4352236 140736169188864 18446744073709551615 4278667 0 0 4096 17506 0 0 0 17 3 0 0 0
/proc/17501/statm: 10319 9487 127 39 0 9399 0
[pid=17502] ppid=17497 vsize=155304 CPUtime=597.55 cores=7
/proc/17502/stat : 17502 (march_hi) R 17497 17497 16932 0 -1 4202496 67885 0 0 0 59744 11 0 0 25 0 1 0 593518597 159031296 19725 33554432000 4194304 4331988 140736845673568 18446744073709551615 4263238 0 0 4096 0 0 0 0 17 7 0 0 0
/proc/17502/statm: 38826 19725 173 34 0 37268 0
Current children cumulated CPU time (s) 4800.21
Current children cumulated vsize (KiB) 2732732

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 17497 and gives
#  childrusage.ru_utime.tv_sec=1799
#  childrusage.ru_utime.tv_usec=143488
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=146977
# CPU time returned by wait4() is 1799.29
# while last known CPU time is 4800.21
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.71
CPU time (s): 4800.21
CPU user time (s): 4799.58
CPU system time (s): 0.63
CPU usage (%): 399.447
Max. virtual memory (cumulated for all children) (KiB): 4418840

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.14
system time used= 0.146977
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 81580
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 147
involuntary context switches= 14246

runsolver used 1.91271 second user time and 4.65029 second system time

The end

Launcher Data 

Begin job on node115 at 2011-04-29 01:21:19
IDJOB=3282590
IDBENCH=70829
IDSOLVER=1612
FILE ID=node115/3282590-1304032879
RUNJOBID= node115-1304032879-17473
PBS_JOBID= 13170337
Free space on /tmp= 72720 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT09/APPLICATIONS/crypto/md5gen/gus-md5-12.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3282590-1304032879/watcher-3282590-1304032879 -o /tmp/evaluation-result-3282590-1304032879/solver-3282590-1304032879 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3282590-1304032879.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 0621e557bffdc18ca509447665adecda
RANDOM SEED=1121271155

node115.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.62
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.15
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.77
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.811
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      12772308 kB
Buffers:       2314488 kB
Cached:       17221536 kB
SwapCached:          4 kB
Active:        7616948 kB
Inactive:     12004412 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      12772308 kB
SwapTotal:    67111528 kB
SwapFree:     67111524 kB
Dirty:           24524 kB
Writeback:           0 kB
AnonPages:       84668 kB
Mapped:          16052 kB
Slab:           492692 kB
PageTables:       4732 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:   682944 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 72708 MiB
End job on node115 at 2011-04-29 01:41:23