Trace number 3285534

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
ppfolio par? (TO) 4800.18 1201.91

General information on the benchmark

Nameapplication/rintanen/SATPlanning/
transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf
MD5SUM48f03e5fbe31fc85b9a464480fc8aa5a
Bench CategoryAPPLICATION (applications instances)
Best result obtained on this benchmarkSAT
Best CPU time to get the best result obtained on this benchmark752.735
Satisfiable
(Un)Satisfiability was proved
Number of variables1575206
Number of clauses8464620
Sum of the clauses size20118920
Maximum clause length982
Minimum clause length1
Number of clauses of size 1720
Number of clauses of size 28393300
Number of clauses of size 3400
Number of clauses of size 41600
Number of clauses of size 54000
Number of clauses of size over 564600

Solver Data 

0.00/0.80	This is pico-portfolio, a naive parallel portfolio
0.00/0.80	Copyright (C) 2011 Olivier Roussel
0.00/0.80	Using 4 processing units
0.00/0.80	This portfolio uses the following solvers:
0.00/0.80	[1] cryptominisat 2.7.1 (Mate Soos)
0.00/0.80	[2] clasp 1.3.6 (Martin Gebser, Benjamin Kaufmann, and Torsten Schaub)
0.00/0.80	[3] TNM 2009 (Wanxia Wei and Chu Min Li)
0.00/0.80	[4] lingeling 276-6264d55-100731 (Armin Biere)
0.00/0.80	[5] march_hi 2009 (Marijn Heule and Hans Van Maaren)
0.00/0.80	Starting cryptominisat 2.7.1 on core(s) 0
0.00/0.80	Starting clasp 1.3.6 on core(s) 4
0.00/0.80	Starting TNM 2009 on core(s) 6
0.00/0.80	Starting lingeling 276-6264d55-100731 on core(s) 2
0.00/0.80	Starting march_hi 2009 on core(s) 6
0.00/0.80

Verifier Data 

ERROR: Unexpected answer ! (SATISFIABLE/UNSATISFIABLE expected)
Got answer: <no 's ' line found>

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.0 (svn: 935)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3285534-1304035203/watcher-3285534-1304035203 -o /tmp/evaluation-result-3285534-1304035203/solver-3285534-1304035203 -C 4800 -W 1300 -M 15500 ppfolio HOME/instance-3285534-1304035203.cnf 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 4800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 4830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1300 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 7.59 7.74 7.70 6/182 22384
/proc/meminfo: memFree=16360268/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) R 22382 22384 20430 0 -1 4202496 522 0 0 0 0 0 0 0 24 0 1 0 515117477 18763776 390 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/22384/statm: 4581 390 341 23 0 91 0

[startup+0.0442691 s]
/proc/loadavg: 7.59 7.74 7.70 6/182 22384
/proc/meminfo: memFree=16360268/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) R 22382 22384 20430 0 -1 4202496 522 0 0 0 0 0 0 0 24 0 1 0 515117477 18763776 390 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 0 0 0 17 2 0 0 0
/proc/22384/statm: 4581 390 341 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.100258 s]
/proc/loadavg: 7.59 7.74 7.70 6/182 22384
/proc/meminfo: memFree=16360268/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 0 0 0 0 24 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195386380386304 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.300215 s]
/proc/loadavg: 7.59 7.74 7.70 6/182 22384
/proc/meminfo: memFree=16360268/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 0 0 0 0 24 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195386380386304 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+0.700137 s]
/proc/loadavg: 7.59 7.74 7.70 6/182 22384
/proc/meminfo: memFree=16360268/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 0 0 0 0 24 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195386380386304 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+1.70593 s]
/proc/loadavg: 7.59 7.74 7.70 6/182 22384
/proc/meminfo: memFree=16360268/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 0 0 0 0 24 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195386380386304 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 18324

[startup+3.10666 s]
/proc/loadavg: 7.86 7.80 7.72 10/187 22390
/proc/meminfo: memFree=14698888/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 0 0 0 0 24 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195386380386304 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
[pid=22385] ppid=22384 vsize=774568 CPUtime=3.1 cores=0
/proc/22385/stat : 22385 (cryptominisat) R 22384 22384 20430 0 -1 4202496 178295 0 0 0 284 26 0 0 25 0 1 0 515117477 793157632 176084 33554432000 4194304 4587354 140737324282432 18446744073709551615 4299570 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/22385/statm: 193642 176085 288 96 0 190204 0
[pid=22386] ppid=22384 vsize=357304 CPUtime=3.09 cores=4
/proc/22386/stat : 22386 (clasp) R 22384 22384 20430 0 -1 4202496 127390 0 0 0 287 22 0 0 25 0 1 0 515117477 365879296 84593 33554432000 4194304 4785740 140734785858032 18446744073709551615 4416830 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/22386/statm: 89326 84593 321 145 0 86371 0
[pid=22388] ppid=22384 vsize=211336 CPUtime=3.07 cores=2
/proc/22388/stat : 22388 (lingeling) R 22384 22384 20430 0 -1 4202496 52215 0 0 0 293 14 0 0 25 0 1 0 515117477 216408064 52002 33554432000 4194304 4352236 140737125204192 18446744073709551615 254500691712 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/22388/statm: 52834 52002 101 39 0 51914 0
[pid=22389] ppid=22384 vsize=439944 CPUtime=3.07 cores=6
/proc/22389/stat : 22389 (march_hi) R 22384 22384 20430 0 -1 4194304 104040 0 0 0 291 16 0 0 25 0 1 0 515117477 450502656 103935 33554432000 4194304 4331988 140737312367056 18446744073709551615 254500095725 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/22389/statm: 109986 103935 113 34 0 108428 0
Current children cumulated CPU time (s) 12.33
Current children cumulated vsize (KiB) 1801476

[startup+6.30102 s]
/proc/loadavg: 7.95 7.81 7.72 10/187 22390
/proc/meminfo: memFree=13982044/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195742862639364 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
[pid=22385] ppid=22384 vsize=1106548 CPUtime=6.29 cores=0
/proc/22385/stat : 22385 (cryptominisat) R 22384 22384 20430 0 -1 4202496 251151 0 0 0 594 35 0 0 25 0 1 0 515117477 1133105152 248940 33554432000 4194304 4587354 140737324282432 18446744073709551615 4365236 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/22385/statm: 276637 248940 310 96 0 273199 0
[pid=22386] ppid=22384 vsize=369072 CPUtime=6.3 cores=4
/proc/22386/stat : 22386 (clasp) R 22384 22384 20430 0 -1 4202496 131050 0 0 0 607 23 0 0 25 0 1 0 515117477 377929728 88253 33554432000 4194304 4785740 140734785858032 18446744073709551615 4319153 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/22386/statm: 92268 88253 329 145 0 89313 0
[pid=22388] ppid=22384 vsize=266708 CPUtime=6.27 cores=2
/proc/22388/stat : 22388 (lingeling) R 22384 22384 20430 0 -1 4202496 98032 0 0 0 607 20 0 0 25 0 1 0 515117477 273108992 65828 33554432000 4194304 4352236 140737125204192 18446744073709551615 4261656 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/22388/statm: 66677 65828 116 39 0 65757 0
[pid=22389] ppid=22384 vsize=1067640 CPUtime=6.26 cores=6
/proc/22389/stat : 22389 (march_hi) R 22384 22384 20430 0 -1 4194304 182871 0 0 0 597 29 0 0 25 0 1 0 515117477 1093263360 182764 33554432000 4194304 4331988 140737312367056 18446744073709551615 4256848 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/22389/statm: 266910 182764 116 34 0 265352 0
Current children cumulated CPU time (s) 25.12
Current children cumulated vsize (KiB) 2828292

[startup+12.7007 s]
/proc/loadavg: 8.04 7.83 7.73 10/187 22390
/proc/meminfo: memFree=13624824/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195742862639364 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
[pid=22385] ppid=22384 vsize=1063524 CPUtime=12.68 cores=0
/proc/22385/stat : 22385 (cryptominisat) R 22384 22384 20430 0 -1 4202496 252041 0 0 0 1233 35 0 0 25 0 1 0 515117477 1089048576 237523 33554432000 4194304 4587354 140737324282432 18446744073709551615 4410462 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/22385/statm: 265881 237523 320 96 0 262443 0
[pid=22386] ppid=22384 vsize=386460 CPUtime=12.69 cores=4
/proc/22386/stat : 22386 (clasp) R 22384 22384 20430 0 -1 4202496 135372 0 0 0 1245 24 0 0 25 0 1 0 515117477 395735040 92575 33554432000 4194304 4785740 140734785858032 18446744073709551615 4319109 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/22386/statm: 96615 92575 336 145 0 93660 0
[pid=22388] ppid=22384 vsize=283908 CPUtime=12.66 cores=2
/proc/22388/stat : 22388 (lingeling) R 22384 22384 20430 0 -1 4202496 176698 0 0 0 1237 29 0 0 25 0 1 0 515117477 290721792 70133 33554432000 4194304 4352236 140737125204192 18446744073709551615 4283883 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/22388/statm: 70977 70133 121 39 0 70057 0
[pid=22389] ppid=22384 vsize=1346652 CPUtime=12.62 cores=6
/proc/22389/stat : 22389 (march_hi) R 22384 22384 20430 0 -1 4194304 380878 0 0 0 1210 52 0 0 25 0 1 0 515117477 1378971648 251859 33554432000 4194304 4331988 140737312367056 18446744073709551615 4252174 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/22389/statm: 336663 251859 128 34 0 335105 0
Current children cumulated CPU time (s) 50.65
Current children cumulated vsize (KiB) 3098868

[startup+25.5012 s]
/proc/loadavg: 8.18 7.87 7.74 10/187 22391
/proc/meminfo: memFree=13811624/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195738567704576 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
[pid=22385] ppid=22384 vsize=1069132 CPUtime=25.49 cores=0
/proc/22385/stat : 22385 (cryptominisat) R 22384 22384 20430 0 -1 4202496 263232 0 0 0 2512 37 0 0 25 0 1 0 515117477 1094791168 245635 33554432000 4194304 4587354 140737324282432 18446744073709551615 4236668 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/22385/statm: 267283 245635 324 96 0 263845 0
[pid=22386] ppid=22384 vsize=414728 CPUtime=25.49 cores=4
/proc/22386/stat : 22386 (clasp) R 22384 22384 20430 0 -1 4202496 142427 0 0 0 2524 25 0 0 25 0 1 0 515117477 424681472 99630 33554432000 4194304 4785740 140734785858032 18446744073709551615 4544151 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/22386/statm: 103682 99630 336 145 0 100727 0
[pid=22388] ppid=22384 vsize=284516 CPUtime=25.46 cores=2
/proc/22388/stat : 22388 (lingeling) R 22384 22384 20430 0 -1 4202496 176859 0 0 0 2517 29 0 0 25 0 1 0 515117477 291344384 70294 33554432000 4194304 4352236 140737125204192 18446744073709551615 4212061 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/22388/statm: 71129 70294 125 39 0 70209 0
[pid=22389] ppid=22384 vsize=1060736 CPUtime=25.36 cores=6
/proc/22389/stat : 22389 (march_hi) R 22384 22384 20430 0 -1 4194304 573569 0 0 0 2458 78 0 0 25 0 1 0 515117477 1086193664 181084 33554432000 4194304 4331988 140737312367056 18446744073709551615 254500349680 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/22389/statm: 265184 181084 129 34 0 263626 0
Current children cumulated CPU time (s) 101.8
Current children cumulated vsize (KiB) 2847436

[startup+51.1011 s]
/proc/loadavg: 8.60 7.99 7.79 10/187 22391
/proc/meminfo: memFree=13236184/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195742862639364 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
[pid=22385] ppid=22384 vsize=1219136 CPUtime=51.09 cores=0
/proc/22385/stat : 22385 (cryptominisat) R 22384 22384 20430 0 -1 4202496 273031 0 0 0 5069 40 0 0 25 0 1 0 515117477 1248395264 255429 33554432000 4194304 4587354 140737324282432 18446744073709551615 4236508 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/22385/statm: 304784 255429 324 96 0 301346 0
[pid=22386] ppid=22384 vsize=470872 CPUtime=51.08 cores=4
/proc/22386/stat : 22386 (clasp) R 22384 22384 20430 0 -1 4202496 156480 0 0 0 5079 29 0 0 25 0 1 0 515117477 482172928 113683 33554432000 4194304 4785740 140734785858032 18446744073709551615 4290633 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/22386/statm: 117718 113683 336 145 0 114763 0
[pid=22388] ppid=22384 vsize=308220 CPUtime=51.07 cores=2
/proc/22388/stat : 22388 (lingeling) R 22384 22384 20430 0 -1 4202496 194747 0 0 0 5076 31 0 0 25 0 1 0 515117477 315617280 76223 33554432000 4194304 4352236 140737125204192 18446744073709551615 4208062 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/22388/statm: 77055 76223 127 39 0 76135 0
[pid=22389] ppid=22384 vsize=1103316 CPUtime=50.82 cores=6
/proc/22389/stat : 22389 (march_hi) R 22384 22384 20430 0 -1 4194304 1186746 0 0 0 4922 160 0 0 25 0 1 0 515117477 1129795584 191729 33554432000 4194304 4331988 140737312367056 18446744073709551615 4256823 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/22389/statm: 275829 191729 129 34 0 274271 0
Current children cumulated CPU time (s) 204.06
Current children cumulated vsize (KiB) 3119868

[startup+102.301 s]
/proc/loadavg: 8.95 8.19 7.86 10/187 22402
/proc/meminfo: memFree=12776932/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 0 0 0 0 15 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195742862639364 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
[pid=22385] ppid=22384 vsize=1219136 CPUtime=102.29 cores=0
/proc/22385/stat : 22385 (cryptominisat) R 22384 22384 20430 0 -1 4202496 294738 0 0 0 10184 45 0 0 25 0 1 0 515117477 1248395264 277126 33554432000 4194304 4587354 140737324282432 18446744073709551615 4236832 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/22385/statm: 304784 277126 324 96 0 301346 0
[pid=22386] ppid=22384 vsize=552296 CPUtime=102.28 cores=4
/proc/22386/stat : 22386 (clasp) R 22384 22384 20430 0 -1 4202496 176834 0 0 0 10195 33 0 0 25 0 1 0 515117477 565551104 134037 33554432000 4194304 4785740 140734785858032 18446744073709551615 4290651 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/22386/statm: 138074 134037 336 145 0 135119 0
[pid=22388] ppid=22384 vsize=318920 CPUtime=102.26 cores=2
/proc/22388/stat : 22388 (lingeling) R 22384 22384 20430 0 -1 4202496 212584 0 0 0 10193 33 0 0 25 0 1 0 515117477 326574080 78898 33554432000 4194304 4352236 140737125204192 18446744073709551615 4208032 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/22388/statm: 79730 78898 127 39 0 78810 0
[pid=22389] ppid=22384 vsize=1342952 CPUtime=101.73 cores=6
/proc/22389/stat : 22389 (march_hi) R 22384 22384 20430 0 -1 4194304 2306586 0 0 0 9860 313 0 0 25 0 1 0 515117477 1375182848 251320 33554432000 4194304 4331988 140737312367056 18446744073709551615 4252174 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/22389/statm: 335738 251320 129 34 0 334180 0
Current children cumulated CPU time (s) 408.56
Current children cumulated vsize (KiB) 3451628

[startup+162.301 s]

################
# More data... #
################


[startup+882.3 s]
/proc/loadavg: 9.24 9.13 8.61 10/187 22426
/proc/meminfo: memFree=10989160/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0.11 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 2 9 0 0 15 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195742862639364 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
[pid=22385] ppid=22384 vsize=1325600 CPUtime=882.18 cores=0
/proc/22385/stat : 22385 (cryptominisat) R 22384 22384 20430 0 -1 4202496 41163778 0 0 0 82793 5425 0 0 25 0 1 0 515117477 1357414400 261659 33554432000 4194304 4587354 140737324282432 18446744073709551615 4503096 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/22385/statm: 331400 261659 332 96 0 327962 0
[pid=22386] ppid=22384 vsize=975496 CPUtime=882.24 cores=4
/proc/22386/stat : 22386 (clasp) R 22384 22384 20430 0 -1 4202496 282581 0 0 0 88164 60 0 0 25 0 1 0 515117477 998907904 239784 33554432000 4194304 4785740 140734785858032 18446744073709551615 4290595 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/22386/statm: 243874 239784 336 145 0 240919 0
[pid=22388] ppid=22384 vsize=343852 CPUtime=881.45 cores=2
/proc/22388/stat : 22388 (lingeling) R 22384 22384 20430 0 -1 4202496 386715 0 0 0 88086 59 0 0 25 0 1 0 515117477 352104448 85131 33554432000 4194304 4352236 140737125204192 18446744073709551615 4233914 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/22388/statm: 85963 85131 127 39 0 85043 0
[pid=22389] ppid=22384 vsize=3480488 CPUtime=877.5 cores=6
/proc/22389/stat : 22389 (march_hi) R 22384 22384 20430 0 -1 4202496 3563570 0 0 0 87268 482 0 0 25 0 1 0 515117477 3564019712 409898 33554432000 4194304 4331988 140737312367056 18446744073709551615 4228270 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/22389/statm: 870122 409898 177 34 0 868564 0
Current children cumulated CPU time (s) 3523.48
Current children cumulated vsize (KiB) 6143760

[startup+942.3 s]
/proc/loadavg: 9.23 9.14 8.64 10/187 22427
/proc/meminfo: memFree=10750732/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0.12 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 2 10 0 0 15 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195742862639364 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
[pid=22385] ppid=22384 vsize=1350224 CPUtime=942.18 cores=0
/proc/22385/stat : 22385 (cryptominisat) R 22384 22384 20430 0 -1 4202496 44573849 0 0 0 88352 5866 0 0 25 0 1 0 515117477 1382629376 262673 33554432000 4194304 4587354 140737324282432 18446744073709551615 4423566 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/22385/statm: 337556 262686 332 96 0 334118 0
[pid=22386] ppid=22384 vsize=1001096 CPUtime=942.23 cores=4
/proc/22386/stat : 22386 (clasp) R 22384 22384 20430 0 -1 4202496 289000 0 0 0 94161 62 0 0 25 0 1 0 515117477 1025122304 246203 33554432000 4194304 4785740 140734785858032 18446744073709551615 4290595 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/22386/statm: 250274 246203 336 145 0 247319 0
[pid=22388] ppid=22384 vsize=343852 CPUtime=941.43 cores=2
/proc/22388/stat : 22388 (lingeling) R 22384 22384 20430 0 -1 4202496 386715 0 0 0 94084 59 0 0 25 0 1 0 515117477 352104448 85131 33554432000 4194304 4352236 140737125204192 18446744073709551615 4207645 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/22388/statm: 85963 85131 127 39 0 85043 0
[pid=22389] ppid=22384 vsize=3480656 CPUtime=937.18 cores=6
/proc/22389/stat : 22389 (march_hi) R 22384 22384 20430 0 -1 4202496 3563639 0 0 0 93236 482 0 0 25 0 1 0 515117477 3564191744 409967 33554432000 4194304 4331988 140737312367056 18446744073709551615 4228307 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/22389/statm: 870164 409967 177 34 0 868606 0
Current children cumulated CPU time (s) 3763.14
Current children cumulated vsize (KiB) 6194152

[startup+1002.3 s]
/proc/loadavg: 9.15 9.13 8.67 10/187 22429
/proc/meminfo: memFree=10806044/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0.13 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 2 11 0 0 15 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195742862639364 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
[pid=22385] ppid=22384 vsize=1245628 CPUtime=1002.18 cores=0
/proc/22385/stat : 22385 (cryptominisat) R 22384 22384 20430 0 -1 4202496 47820349 0 0 0 93926 6292 0 0 25 0 1 0 515117477 1275523072 247811 33554432000 4194304 4587354 140737324282432 18446744073709551615 254500389333 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/22385/statm: 311407 247811 332 96 0 307969 0
[pid=22386] ppid=22384 vsize=1019732 CPUtime=1002.23 cores=4
/proc/22386/stat : 22386 (clasp) R 22384 22384 20430 0 -1 4202496 293677 0 0 0 100159 64 0 0 25 0 1 0 515117477 1044205568 250880 33554432000 4194304 4785740 140734785858032 18446744073709551615 4290576 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/22386/statm: 254933 250880 336 145 0 251978 0
[pid=22388] ppid=22384 vsize=352296 CPUtime=1001.43 cores=2
/proc/22388/stat : 22388 (lingeling) R 22384 22384 20430 0 -1 4202496 388826 0 0 0 100084 59 0 0 25 0 1 0 515117477 360751104 87242 33554432000 4194304 4352236 140737125204192 18446744073709551615 4280960 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/22388/statm: 88074 87242 127 39 0 87154 0
[pid=22389] ppid=22384 vsize=3480656 CPUtime=996.85 cores=6
/proc/22389/stat : 22389 (march_hi) R 22384 22384 20430 0 -1 4202496 3563660 0 0 0 99203 482 0 0 25 0 1 0 515117477 3564191744 409988 33554432000 4194304 4331988 140737312367056 18446744073709551615 4228302 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/22389/statm: 870164 409988 177 34 0 868606 0
Current children cumulated CPU time (s) 4002.82
Current children cumulated vsize (KiB) 6116636

[startup+1062.3 s]
/proc/loadavg: 9.18 9.13 8.70 10/187 22430
/proc/meminfo: memFree=10731288/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0.13 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 2 11 0 0 15 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195742862639364 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
[pid=22385] ppid=22384 vsize=1300996 CPUtime=1062.19 cores=0
/proc/22385/stat : 22385 (cryptominisat) R 22384 22384 20430 0 -1 4202496 51014025 0 0 0 99497 6722 0 0 25 0 1 0 515117477 1332219904 260118 33554432000 4194304 4587354 140737324282432 18446744073709551615 4507576 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/22385/statm: 325249 260118 332 96 0 321811 0
[pid=22386] ppid=22384 vsize=1053420 CPUtime=1062.23 cores=4
/proc/22386/stat : 22386 (clasp) R 22384 22384 20430 0 -1 4202496 301958 0 0 0 106157 66 0 0 25 0 1 0 515117477 1078702080 259161 33554432000 4194304 4785740 140734785858032 18446744073709551615 4290592 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/22386/statm: 263355 259161 336 145 0 260400 0
[pid=22388] ppid=22384 vsize=352144 CPUtime=1061.43 cores=2
/proc/22388/stat : 22388 (lingeling) R 22384 22384 20430 0 -1 4202496 421595 0 0 0 106079 64 0 0 25 0 1 0 515117477 360595456 87204 33554432000 4194304 4352236 140737125204192 18446744073709551615 4207908 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/22388/statm: 88036 87204 127 39 0 87116 0
[pid=22389] ppid=22384 vsize=3481756 CPUtime=1056.53 cores=6
/proc/22389/stat : 22389 (march_hi) R 22384 22384 20430 0 -1 4202496 3564112 0 0 0 105171 482 0 0 25 0 1 0 515117477 3565318144 410440 33554432000 4194304 4331988 140737312367056 18446744073709551615 4228307 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/22389/statm: 870439 410440 177 34 0 868881 0
Current children cumulated CPU time (s) 4242.51
Current children cumulated vsize (KiB) 6206640

[startup+1122.3 s]
/proc/loadavg: 9.24 9.15 8.73 10/187 22497
/proc/meminfo: memFree=14055536/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0.14 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 2 12 0 0 15 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195742862639364 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
[pid=22385] ppid=22384 vsize=1300996 CPUtime=1122.19 cores=0
/proc/22385/stat : 22385 (cryptominisat) R 22384 22384 20430 0 -1 4202496 54343077 0 0 0 105068 7151 0 0 25 0 1 0 515117477 1332219904 260118 33554432000 4194304 4587354 140737324282432 18446744073709551615 4503123 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/22385/statm: 325249 260118 332 96 0 321811 0
[pid=22386] ppid=22384 vsize=1055716 CPUtime=1122.22 cores=4
/proc/22386/stat : 22386 (clasp) R 22384 22384 20430 0 -1 4202496 302561 0 0 0 112155 67 0 0 25 0 1 0 515117477 1081053184 259764 33554432000 4194304 4785740 140734785858032 18446744073709551615 4290633 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/22386/statm: 263929 259764 336 145 0 260974 0
[pid=22388] ppid=22384 vsize=330708 CPUtime=1121.41 cores=2
/proc/22388/stat : 22388 (lingeling) R 22384 22384 20430 0 -1 4202496 431687 0 0 0 112075 66 0 0 25 0 1 0 515117477 338644992 81845 33554432000 4194304 4352236 140737125204192 18446744073709551615 4208256 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/22388/statm: 82677 81845 127 39 0 81757 0
[pid=22389] ppid=22384 vsize=3483256 CPUtime=1116.21 cores=6
/proc/22389/stat : 22389 (march_hi) R 22384 22384 20430 0 -1 4202496 3564472 0 0 0 111138 483 0 0 25 0 1 0 515117477 3566854144 410800 33554432000 4194304 4331988 140737312367056 18446744073709551615 4228247 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/22389/statm: 870814 410800 177 34 0 869256 0
Current children cumulated CPU time (s) 4482.17
Current children cumulated vsize (KiB) 6189000

[startup+1182.31 s]
/proc/loadavg: 9.14 9.14 8.75 10/187 22499
/proc/meminfo: memFree=13902236/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0.14 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 2 12 0 0 15 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195742862639364 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
[pid=22385] ppid=22384 vsize=1245628 CPUtime=1182.19 cores=0
/proc/22385/stat : 22385 (cryptominisat) R 22384 22384 20430 0 -1 4202496 57764430 0 0 0 110629 7590 0 0 25 0 1 0 515117477 1275523072 247811 33554432000 4194304 4587354 140737324282432 18446744073709551615 4264457 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/22385/statm: 311407 247811 332 96 0 307969 0
[pid=22386] ppid=22384 vsize=1074184 CPUtime=1182.22 cores=4
/proc/22386/stat : 22386 (clasp) R 22384 22384 20430 0 -1 4202496 307159 0 0 0 118154 68 0 0 25 0 1 0 515117477 1099964416 264362 33554432000 4194304 4785740 140734785858032 18446744073709551615 4290592 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/22386/statm: 268546 264362 336 145 0 265591 0
[pid=22388] ppid=22384 vsize=330708 CPUtime=1181.41 cores=2
/proc/22388/stat : 22388 (lingeling) R 22384 22384 20430 0 -1 4202496 431687 0 0 0 118075 66 0 0 25 0 1 0 515117477 338644992 81845 33554432000 4194304 4352236 140737125204192 18446744073709551615 4208789 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/22388/statm: 82677 81845 127 39 0 81757 0
[pid=22389] ppid=22384 vsize=3483848 CPUtime=1175.88 cores=6
/proc/22389/stat : 22389 (march_hi) R 22384 22384 20430 0 -1 4202496 3564754 0 0 0 117105 483 0 0 25 0 1 0 515117477 3567460352 411082 33554432000 4194304 4331988 140737312367056 18446744073709551615 4263258 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/22389/statm: 870962 411082 177 34 0 869404 0
Current children cumulated CPU time (s) 4721.84
Current children cumulated vsize (KiB) 6152692



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1201.9 s]
/proc/loadavg: 9.17 9.14 8.76 10/187 22499
/proc/meminfo: memFree=14010860/32950928 swapFree=67111528/67111528
[pid=22384] ppid=22382 vsize=18324 CPUtime=0.16 cores=0,2,4,6
/proc/22384/stat : 22384 (ppfolio) S 22382 22384 20430 0 -1 4202496 525 214 0 0 3 13 0 0 15 0 1 0 515117477 18763776 391 33554432000 4194304 4287625 140734223759280 18446744073709551615 254500711951 0 0 4096 65536 9224195742862639364 0 0 17 2 0 0 0
/proc/22384/statm: 4581 391 342 23 0 91 0
[pid=22385] ppid=22384 vsize=1245628 CPUtime=1201.8 cores=0
/proc/22385/stat : 22385 (cryptominisat) R 22384 22384 20430 0 -1 4202496 58902832 0 0 0 112451 7729 0 0 25 0 1 0 515117477 1275523072 247811 33554432000 4194304 4587354 140737324282432 18446744073709551615 254500389228 0 0 4096 2 0 0 0 17 0 0 0 0
/proc/22385/statm: 311407 247811 332 96 0 307969 0
[pid=22386] ppid=22384 vsize=1078684 CPUtime=1201.83 cores=4
/proc/22386/stat : 22386 (clasp) R 22384 22384 20430 0 -1 4202496 308308 0 0 0 120114 69 0 0 25 0 1 0 515117477 1104572416 265511 33554432000 4194304 4785740 140734785858032 18446744073709551615 4290607 0 0 4096 16386 0 0 0 17 4 0 0 0
/proc/22386/statm: 269671 265511 336 145 0 266716 0
[pid=22388] ppid=22384 vsize=330708 CPUtime=1201.01 cores=2
/proc/22388/stat : 22388 (lingeling) R 22384 22384 20430 0 -1 4202496 431687 0 0 0 120035 66 0 0 25 0 1 0 515117477 338644992 81845 33554432000 4194304 4352236 140737125204192 18446744073709551615 4207645 0 0 4096 17506 0 0 0 17 2 0 0 0
/proc/22388/statm: 82677 81845 127 39 0 81757 0
[pid=22389] ppid=22384 vsize=3483848 CPUtime=1195.38 cores=6
/proc/22389/stat : 22389 (march_hi) R 22384 22384 20430 0 -1 4202496 3564767 0 0 0 119055 483 0 0 25 0 1 0 515117477 3567460352 411095 33554432000 4194304 4331988 140737312367056 18446744073709551615 4228243 0 0 4096 0 0 0 0 17 6 0 0 0
/proc/22389/statm: 870962 411095 177 34 0 869404 0
Current children cumulated CPU time (s) 4800.18
Current children cumulated vsize (KiB) 6157192

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 22384 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=30995
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=133979
# CPU time returned by wait4() is 0.164974
# while last known CPU time is 4800.18
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1201.91
CPU time (s): 4800.18
CPU user time (s): 4716.58
CPU system time (s): 83.6
CPU usage (%): 399.378
Max. virtual memory (cumulated for all children) (KiB): 6369320

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.030995
system time used= 0.133979
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 739
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16834
involuntary context switches= 9

runsolver used 1.76273 second user time and 4.80127 second system time

The end

Launcher Data 

Begin job on node149 at 2011-04-29 02:00:08
IDJOB=3285534
IDBENCH=82388
IDSOLVER=1612
FILE ID=node149/3285534-1304035203
RUNJOBID= node149-1304035109-22324
PBS_JOBID= 13170303
Free space on /tmp= 71740 MiB

SOLVER NAME= ppfolio par
BENCH NAME= SAT11/application/rintanen/SATPlanning/transport-transport-city-sequential-35nodes-1000size-4degree-100mindistance-4trucks-14packages-2008seed.050-SAT.cnf
COMMAND LINE= ppfolio BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3285534-1304035203/watcher-3285534-1304035203 -o /tmp/evaluation-result-3285534-1304035203/solver-3285534-1304035203 -C 4800 -W 1300 -M 15500  ppfolio HOME/instance-3285534-1304035203.cnf

TIME LIMIT= 4800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 48f03e5fbe31fc85b9a464480fc8aa5a
RANDOM SEED=2063032444

node149.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.806
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      16360424 kB
Buffers:       2218600 kB
Cached:       12000892 kB
SwapCached:          0 kB
Active:        7835536 kB
Inactive:      8199304 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      16360424 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:          181056 kB
Writeback:           0 kB
AnonPages:     1814484 kB
Mapped:          16756 kB
Slab:           488356 kB
PageTables:       8704 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  2570416 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 71744 MiB
End job on node149 at 2011-04-29 02:20:12