Trace number 3696132

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb2sat 2012-05-19? (TO) 1800.08 1801.22

General information on the benchmark

Name/OPT-BIGINT-LIN/zahidi/Base/
normalized-minisat100_4_32_6.opb
MD5SUMf19aad2da4bea8b48e35d4e26f93e3de
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark5657601
Best CPU time to get the best result obtained on this benchmark1800.41
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables20200
Total number of constraints30206
Number of constraints which are clauses200
Number of constraints which are cardinality constraints (but not clauses)6
Number of constraints which are nor clauses,nor cardinality constraints30000
Minimum length of a constraint2
Maximum length of a constraint4950
Number of terms in the objective function 19900
Biggest coefficient in the objective function 150568768
Number of bits for the biggest coefficient in the objective function 28
Sum of the numbers in the objective function 176505017008
Number of bits of the sum of numbers in the objective function 38
Biggest number in a constraint 150568768
Number of bits of the biggest number in a constraint 28
Biggest sum of numbers in a constraint 176505017008
Number of bits of the biggest sum of numbers38
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

3.87/3.99	c model valid
3.87/3.99	c current solution ok
6.44/6.62	o 109570343
6.44/6.62	c current bound: 54785221
6.44/6.62	c fallback to adder encoding
35.26/35.44	c model valid
35.26/35.44	c current solution ok
35.31/35.53	o 47212317
35.31/35.53	c current bound: 23606208
35.31/35.53	c fallback to adder encoding
244.23/245.06	c model valid
244.23/245.06	c current solution ok
244.30/245.14	o 11678623
244.30/245.14	c current bound: 5839361
244.30/245.14	c fallback to adder encoding
1800.08/1801.21	c error: unexpected solver exit code
1800.08/1801.21	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3696132-1338154802/watcher-3696132-1338154802 -o /tmp/evaluation-result-3696132-1338154802/solver-3696132-1338154802 -C 1800 -W 1900 -M 15500 HOME/runPb2sat.sh HOME/instance-3696132-1338154802.opb 37681876 HOME HOME 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.01 2.00 3/180 7987
/proc/meminfo: memFree=27909560/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0

[startup+0.0199481 s]
/proc/loadavg: 2.02 2.01 2.00 3/180 7987
/proc/meminfo: memFree=27909560/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100139 s]
/proc/loadavg: 2.02 2.01 2.00 3/180 7987
/proc/meminfo: memFree=27909560/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300139 s]
/proc/loadavg: 2.02 2.01 2.00 3/180 7987
/proc/meminfo: memFree=27909560/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700163 s]
/proc/loadavg: 2.02 2.01 2.00 3/180 7987
/proc/meminfo: memFree=27909560/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50026 s]
/proc/loadavg: 2.02 2.01 2.00 3/184 7991
/proc/meminfo: memFree=27739800/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=64772 CPUtime=0.79 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 10933 0 0 0 73 6 0 0 20 0 1 0 281606200 66326528 15314 33554432000 4194304 5873084 140736117130784 140736117127208 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/7988/statm: 16193 15314 169 410 0 15775 0
[pid=7990] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7990/stat : 7990 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 281606280 9367552 267 33554432000 4194304 5064252 140733930894512 140733930893424 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/7990/statm: 2287 267 226 213 0 72 0
[pid=7991] ppid=7990 vsize=179248 CPUtime=0.69 cores=1,3,5,7
/proc/7991/stat : 7991 (glucose_static) R 7990 7987 5701 0 -1 4202496 35648 0 0 0 62 7 0 0 20 0 1 0 281606280 183549952 41876 33554432000 4194304 4896791 140736957333376 140736956282472 4224684 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/7991/statm: 44812 41876 76 172 0 44638 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 262316

[startup+3.10035 s]
/proc/loadavg: 2.02 2.01 2.00 3/183 7991
/proc/meminfo: memFree=27649060/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=64772 CPUtime=0.79 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 10933 0 0 0 73 6 0 0 20 0 1 0 281606200 66326528 15314 33554432000 4194304 5873084 140736117130784 140736117127208 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/7988/statm: 16193 15314 169 410 0 15775 0
[pid=7990] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7990/stat : 7990 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 281606280 9367552 267 33554432000 4194304 5064252 140733930894512 140733930893424 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/7990/statm: 2287 267 226 213 0 72 0
[pid=7991] ppid=7990 vsize=180832 CPUtime=2.29 cores=1,3,5,7
/proc/7991/stat : 7991 (glucose_static) R 7990 7987 5701 0 -1 4202496 36049 0 0 0 222 7 0 0 20 0 1 0 281606280 185171968 42277 33554432000 4194304 4896791 140736957333376 140736957330680 4225008 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/7991/statm: 45208 42277 77 172 0 45034 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 263900

[startup+6.3002 s]
/proc/loadavg: 2.02 2.01 2.00 3/181 7991
/proc/meminfo: memFree=27782192/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=80152 CPUtime=6.17 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) R 7987 7987 5701 0 -1 4202496 12583 37159 0 0 124 186 298 9 20 0 1 0 281606200 82075648 18722 33554432000 4194304 5873084 140736117130784 140736117126216 5127520 0 0 4096 0 0 0 0 17 1 0 0 10 0 0
/proc/7988/statm: 20038 18722 177 410 0 19620 0
Current children cumulated CPU time (s) 6.17
Current children cumulated vsize (KiB) 89300

[startup+12.7003 s]
/proc/loadavg: 2.10 2.02 2.01 3/184 7995
/proc/meminfo: memFree=26810652/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=381680 CPUtime=9.66 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 22064 37673 0 0 408 246 298 14 20 0 1 0 281606200 390840320 79121 33554432000 4194304 5873084 140736117130784 140736117124600 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 10 0 0
/proc/7988/statm: 95420 79121 184 410 0 95002 0
[pid=7994] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7994/stat : 7994 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 595 0 0 0 0 0 0 0 20 0 1 0 281607179 9367552 266 33554432000 4194304 5064252 140735857795456 140735857794368 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/7994/statm: 2287 266 226 213 0 72 0
[pid=7995] ppid=7994 vsize=699244 CPUtime=2.9 cores=1,3,5,7
/proc/7995/stat : 7995 (glucose_static) R 7994 7987 5701 0 -1 4202496 90059 0 0 0 266 24 0 0 20 0 1 0 281607179 716025856 157350 33554432000 4194304 4896791 140735172514528 140735172512232 4208930 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/7995/statm: 174811 157351 72 172 0 174637 0
Current children cumulated CPU time (s) 12.56
Current children cumulated vsize (KiB) 1099220

[startup+25.5004 s]
/proc/loadavg: 2.15 2.04 2.01 3/184 8040
/proc/meminfo: memFree=26473372/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=381680 CPUtime=9.66 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 22064 37673 0 0 408 246 298 14 20 0 1 0 281606200 390840320 79121 33554432000 4194304 5873084 140736117130784 140736117124600 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 10 0 0
/proc/7988/statm: 95420 79121 184 410 0 95002 0
[pid=7994] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7994/stat : 7994 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 595 0 0 0 0 0 0 0 20 0 1 0 281607179 9367552 266 33554432000 4194304 5064252 140735857795456 140735857794368 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/7994/statm: 2287 266 226 213 0 72 0
[pid=7995] ppid=7994 vsize=639128 CPUtime=15.69 cores=1,3,5,7
/proc/7995/stat : 7995 (glucose_static) R 7994 7987 5701 0 -1 4202496 98453 0 0 0 1541 28 0 0 20 0 1 0 281607179 654467072 151835 33554432000 4194304 4896791 140735172514528 140735172511736 4205455 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/7995/statm: 159782 151835 78 172 0 159608 0
Current children cumulated CPU time (s) 25.35
Current children cumulated vsize (KiB) 1039104

[startup+51.1003 s]
/proc/loadavg: 2.18 2.05 2.01 3/184 8043
/proc/meminfo: memFree=26438172/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=401304 CPUtime=38.11 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 38161 138613 0 0 666 278 2812 55 20 0 1 0 281606200 410935296 76859 33554432000 4194304 5873084 140736117130784 140736117124600 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 69 0 0
/proc/7988/statm: 100326 76859 184 410 0 99908 0
[pid=8042] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/8042/stat : 8042 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 281610084 9367552 266 33554432000 4194304 5064252 140734982732592 140734982731504 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/8042/statm: 2287 266 226 213 0 72 0
[pid=8043] ppid=8042 vsize=612192 CPUtime=12.24 cores=1,3,5,7
/proc/8043/stat : 8043 (glucose_static) R 8042 7987 5701 0 -1 4202496 90158 0 0 0 1198 26 0 0 20 0 1 0 281610084 626884608 133999 33554432000 4194304 4896791 140736640117504 140736640114648 4223862 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/8043/statm: 153048 133999 78 172 0 152874 0
Current children cumulated CPU time (s) 50.35
Current children cumulated vsize (KiB) 1031792

[startup+102.307 s]
/proc/loadavg: 2.07 2.04 2.01 3/183 8049
/proc/meminfo: memFree=26501872/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=401304 CPUtime=38.11 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 38161 138613 0 0 666 278 2812 55 20 0 1 0 281606200 410935296 76859 33554432000 4194304 5873084 140736117130784 140736117124600 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 69 0 0
/proc/7988/statm: 100326 76859 184 410 0 99908 0
[pid=8042] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/8042/stat : 8042 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 281610084 9367552 266 33554432000 4194304 5064252 140734982732592 140734982731504 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/8042/statm: 2287 266 226 213 0 72 0
[pid=8043] ppid=8042 vsize=615580 CPUtime=63.44 cores=1,3,5,7
/proc/8043/stat : 8043 (glucose_static) R 8042 7987 5701 0 -1 4202496 95420 0 0 0 6317 27 0 0 20 0 1 0 281610084 630353920 135688 33554432000 4194304 4896791 140736640117504 140736640115016 4225029 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/8043/statm: 153895 135688 78 172 0 153721 0
Current children cumulated CPU time (s) 101.55
Current children cumulated vsize (KiB) 1035180

[startup+162.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/183 8049
/proc/meminfo: memFree=26520528/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=401304 CPUtime=38.11 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 38161 138613 0 0 666 278 2812 55 20 0 1 0 281606200 410935296 76859 33554432000 4194304 5873084 140736117130784 140736117124600 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 69 0 0
/proc/7988/statm: 100326 76859 184 410 0 99908 0
[pid=8042] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/8042/stat : 8042 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 281610084 9367552 266 33554432000 4194304 5064252 140734982732592 140734982731504 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/8042/statm: 2287 266 226 213 0 72 0
[pid=8043] ppid=8042 vsize=617376 CPUtime=123.43 cores=1,3,5,7
/proc/8043/stat : 8043 (glucose_static) R 8042 7987 5701 0 -1 4202496 100318 0 0 0 12314 29 0 0 20 0 1 0 281610084 632193024 137958 33554432000 4194304 4896791 140736640117504 140736640114648 4203856 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/8043/statm: 154344 137958 78 172 0 154170 0
Current children cumulated CPU time (s) 161.54

################
# More data... #
################

/proc/8052/stat : 8052 (glucose_static) R 8051 7987 5701 0 -1 4202496 117941 0 0 0 111424 66 0 0 20 0 1 0 281630911 643751936 131770 33554432000 4194304 4896791 140735644327024 140735644324552 4224983 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/8052/statm: 157166 131770 78 172 0 156992 0
Current children cumulated CPU time (s) 1361.25
Current children cumulated vsize (KiB) 917192

[startup+1422.31 s]
/proc/loadavg: 2.03 2.01 2.00 3/183 8102
/proc/meminfo: memFree=26686304/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=270232 CPUtime=246.35 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 52131 246096 0 0 858 300 23378 99 20 0 1 0 281606200 276717568 65083 33554432000 4194304 5873084 140736117130784 140736117124600 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 69 0 0
/proc/7988/statm: 67558 65083 184 410 0 67140 0
[pid=8051] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/8051/stat : 8051 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 281630911 9367552 266 33554432000 4194304 5064252 140735862223760 140735862222672 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/8051/statm: 2287 266 226 213 0 72 0
[pid=8052] ppid=8051 vsize=628760 CPUtime=1174.89 cores=1,3,5,7
/proc/8052/stat : 8052 (glucose_static) R 8051 7987 5701 0 -1 4202496 119120 0 0 0 117423 66 0 0 20 0 1 0 281630911 643850240 132822 33554432000 4194304 4896791 140735644327024 140735644324536 4225029 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/8052/statm: 157190 132822 78 172 0 157016 0
Current children cumulated CPU time (s) 1421.24
Current children cumulated vsize (KiB) 917288

[startup+1482.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/183 8102
/proc/meminfo: memFree=26667628/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=270232 CPUtime=246.35 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 52131 246096 0 0 858 300 23378 99 20 0 1 0 281606200 276717568 65083 33554432000 4194304 5873084 140736117130784 140736117124600 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 69 0 0
/proc/7988/statm: 67558 65083 184 410 0 67140 0
[pid=8051] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/8051/stat : 8051 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 281630911 9367552 266 33554432000 4194304 5064252 140735862223760 140735862222672 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/8051/statm: 2287 266 226 213 0 72 0
[pid=8052] ppid=8051 vsize=629196 CPUtime=1234.88 cores=1,3,5,7
/proc/8052/stat : 8052 (glucose_static) R 8051 7987 5701 0 -1 4202496 119211 0 0 0 123422 66 0 0 20 0 1 0 281630911 644296704 133935 33554432000 4194304 4896791 140735644327024 140735644324232 4224706 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/8052/statm: 157299 133935 78 172 0 157125 0
Current children cumulated CPU time (s) 1481.23
Current children cumulated vsize (KiB) 917724

[startup+1542.3 s]
/proc/loadavg: 2.04 2.02 2.00 3/183 8103
/proc/meminfo: memFree=26677968/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=270232 CPUtime=246.35 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 52131 246096 0 0 858 300 23378 99 20 0 1 0 281606200 276717568 65083 33554432000 4194304 5873084 140736117130784 140736117124600 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 69 0 0
/proc/7988/statm: 67558 65083 184 410 0 67140 0
[pid=8051] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/8051/stat : 8051 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 281630911 9367552 266 33554432000 4194304 5064252 140735862223760 140735862222672 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/8051/statm: 2287 266 226 213 0 72 0
[pid=8052] ppid=8051 vsize=629432 CPUtime=1294.87 cores=1,3,5,7
/proc/8052/stat : 8052 (glucose_static) R 8051 7987 5701 0 -1 4202496 124049 0 0 0 129420 67 0 0 20 0 1 0 281630911 644538368 134526 33554432000 4194304 4896791 140735644327024 140735644324664 4225029 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/8052/statm: 157358 134526 78 172 0 157184 0
Current children cumulated CPU time (s) 1541.22
Current children cumulated vsize (KiB) 917960

[startup+1602.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/183 8103
/proc/meminfo: memFree=26655200/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=270232 CPUtime=246.35 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 52131 246096 0 0 858 300 23378 99 20 0 1 0 281606200 276717568 65083 33554432000 4194304 5873084 140736117130784 140736117124600 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 69 0 0
/proc/7988/statm: 67558 65083 184 410 0 67140 0
[pid=8051] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/8051/stat : 8051 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 281630911 9367552 266 33554432000 4194304 5064252 140735862223760 140735862222672 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/8051/statm: 2287 266 226 213 0 72 0
[pid=8052] ppid=8051 vsize=629772 CPUtime=1354.86 cores=1,3,5,7
/proc/8052/stat : 8052 (glucose_static) R 8051 7987 5701 0 -1 4202496 126606 0 0 0 135418 68 0 0 20 0 1 0 281630911 644886528 135623 33554432000 4194304 4896791 140735644327024 140735644324232 4224684 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/8052/statm: 157443 135623 78 172 0 157269 0
Current children cumulated CPU time (s) 1601.21
Current children cumulated vsize (KiB) 918300

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 8103
/proc/meminfo: memFree=26687212/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=270232 CPUtime=246.35 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 52131 246096 0 0 858 300 23378 99 20 0 1 0 281606200 276717568 65083 33554432000 4194304 5873084 140736117130784 140736117124600 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 69 0 0
/proc/7988/statm: 67558 65083 184 410 0 67140 0
[pid=8051] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/8051/stat : 8051 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 281630911 9367552 266 33554432000 4194304 5064252 140735862223760 140735862222672 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/8051/statm: 2287 266 226 213 0 72 0
[pid=8052] ppid=8051 vsize=549428 CPUtime=1414.85 cores=1,3,5,7
/proc/8052/stat : 8052 (glucose_static) R 8051 7987 5701 0 -1 4202496 129674 0 0 0 141414 71 0 0 20 0 1 0 281630911 562614272 123946 33554432000 4194304 4896791 140735644327024 140735644324552 4224983 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/8052/statm: 137357 123946 78 172 0 137183 0
Current children cumulated CPU time (s) 1661.2
Current children cumulated vsize (KiB) 837956

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 8103
/proc/meminfo: memFree=26701844/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=270232 CPUtime=246.35 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 52131 246096 0 0 858 300 23378 99 20 0 1 0 281606200 276717568 65083 33554432000 4194304 5873084 140736117130784 140736117124600 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 69 0 0
/proc/7988/statm: 67558 65083 184 410 0 67140 0
[pid=8051] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/8051/stat : 8051 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 281630911 9367552 266 33554432000 4194304 5064252 140735862223760 140735862222672 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/8051/statm: 2287 266 226 213 0 72 0
[pid=8052] ppid=8051 vsize=549952 CPUtime=1474.84 cores=1,3,5,7
/proc/8052/stat : 8052 (glucose_static) R 8051 7987 5701 0 -1 4202496 130951 0 0 0 147413 71 0 0 20 0 1 0 281630911 563150848 126632 33554432000 4194304 4896791 140735644327024 140735644324232 4225029 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/8052/statm: 137488 126632 78 172 0 137314 0
Current children cumulated CPU time (s) 1721.19
Current children cumulated vsize (KiB) 838480

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 8103
/proc/meminfo: memFree=26677460/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=270232 CPUtime=246.35 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 52131 246096 0 0 858 300 23378 99 20 0 1 0 281606200 276717568 65083 33554432000 4194304 5873084 140736117130784 140736117124600 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 69 0 0
/proc/7988/statm: 67558 65083 184 410 0 67140 0
[pid=8051] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/8051/stat : 8051 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 281630911 9367552 266 33554432000 4194304 5064252 140735862223760 140735862222672 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/8051/statm: 2287 266 226 213 0 72 0
[pid=8052] ppid=8051 vsize=550180 CPUtime=1534.83 cores=1,3,5,7
/proc/8052/stat : 8052 (glucose_static) R 8051 7987 5701 0 -1 4202496 133339 0 0 0 153411 72 0 0 20 0 1 0 281630911 563384320 128231 33554432000 4194304 4896791 140735644327024 140735644324168 4224983 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/8052/statm: 137545 128231 78 172 0 137371 0
Current children cumulated CPU time (s) 1781.18
Current children cumulated vsize (KiB) 838708



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1801.2 s]
/proc/loadavg: 2.00 2.00 2.00 3/184 8106
/proc/meminfo: memFree=26665840/32873648 swapFree=6864/6864
[pid=7987] ppid=7985 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/7987/stat : 7987 (runPb2sat.sh) S 7985 7987 5701 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 281606200 9367552 275 33554432000 4194304 5064252 140736889192480 140736889191392 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/7987/statm: 2287 275 233 213 0 72 0
[pid=7988] ppid=7987 vsize=270232 CPUtime=246.35 cores=1,3,5,7
/proc/7988/stat : 7988 (pb2sat) S 7987 7987 5701 0 -1 4202496 52131 246096 0 0 858 300 23378 99 20 0 1 0 281606200 276717568 65083 33554432000 4194304 5873084 140736117130784 140736117124600 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 69 0 0
/proc/7988/statm: 67558 65083 184 410 0 67140 0
[pid=8051] ppid=7988 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/8051/stat : 8051 (satsolver.sh) S 7988 7987 5701 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 281630911 9367552 266 33554432000 4194304 5064252 140735862223760 140735862222672 226084152910 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/8051/statm: 2287 266 226 213 0 72 0
[pid=8052] ppid=8051 vsize=550276 CPUtime=1553.73 cores=1,3,5,7
/proc/8052/stat : 8052 (glucose_static) R 8051 7987 5701 0 -1 4202496 133367 0 0 0 155301 72 0 0 20 0 1 0 281630911 563482624 128258 33554432000 4194304 4896791 140735644327024 140735644324552 4224684 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/8052/statm: 137569 128258 78 172 0 137395 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 838804

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 7987 and gives
#  childrusage.ru_utime.tv_sec=242
#  childrusage.ru_utime.tv_usec=375153
#  childrusage.ru_stime.tv_sec=4
#  childrusage.ru_stime.tv_usec=5391
# CPU time returned by wait4() is 246.381
# while last known CPU time is 1800.08
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1801.22
CPU time (s): 1800.08
CPU user time (s): 1795.37
CPU system time (s): 4.71
CPU usage (%): 99.9369
Max. virtual memory (cumulated for all children) (KiB): 1231272

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 242.375
system time used= 4.00539
maximum resident set size= 755360
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 299204
page faults= 0
swaps= 0
block input operations= 0
block output operations= 1339512
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 43
involuntary context switches= 327

runsolver used 3.35249 second user time and 8.92864 second system time

The end

Launcher Data 

Begin job on node120 at 2012-05-27 23:40:02
IDJOB=3696132
IDBENCH=92726
IDSOLVER=2274
FILE ID=node120/3696132-1338154802
RUNJOBID= node120-1338124133-5718
PBS_JOBID= 14624508
Free space on /tmp= 71632 MiB

SOLVER NAME= pb2sat 2012-05-19
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/zahidi/Base/normalized-minisat100_4_32_6.opb
COMMAND LINE= DIR/runPb2sat.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3696132-1338154802/watcher-3696132-1338154802 -o /tmp/evaluation-result-3696132-1338154802/solver-3696132-1338154802 -C 1800 -W 1900 -M 15500  HOME/runPb2sat.sh HOME/instance-3696132-1338154802.opb 37681876 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= f19aad2da4bea8b48e35d4e26f93e3de
RANDOM SEED=37681876

node120.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.456
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        27909824 kB
Buffers:          342316 kB
Cached:          3615400 kB
SwapCached:          636 kB
Active:          1019276 kB
Inactive:        3112484 kB
Active(anon):     162740 kB
Inactive(anon):    12532 kB
Active(file):     856536 kB
Inactive(file):  3099952 kB
Unevictable:        6864 kB
Mlocked:            6864 kB
SwapTotal:      67108856 kB
SwapFree:       67107896 kB
Dirty:             10136 kB
Writeback:             0 kB
AnonPages:        389864 kB
Mapped:            15140 kB
Shmem:               120 kB
Slab:             691188 kB
SReclaimable:     135600 kB
SUnreclaim:       555588 kB
KernelStack:        1528 kB
PageTables:         4504 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     303692 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:    266240 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71400 MiB
End job on node120 at 2012-05-28 00:10:03