Trace number 3694919

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pb2satCp2 2012-05-19? (TO) 1800.02 1802.12

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/
manquiho/golomb-rulers/normalized-OGR_11.opb
MD5SUM5946eb43fefc6e626d35d99afd3eec42
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark72
Best CPU time to get the best result obtained on this benchmark1800.02
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 75
Optimality of the best value was proved NO
Number of variables1287
Total number of constraints2430
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints2430
Minimum length of a constraint14
Maximum length of a constraint29
Number of terms in the objective function 7
Biggest coefficient in the objective function 64
Number of bits for the biggest coefficient in the objective function 7
Sum of the numbers in the objective function 127
Number of bits of the sum of numbers in the objective function 7
Biggest number in a constraint 128
Number of bits of the biggest number in a constraint 8
Biggest sum of numbers in a constraint 749
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

38.48/38.50	c model valid
38.48/38.50	c current solution ok
42.13/42.31	o 114
88.16/88.23	c model valid
88.16/88.23	c current solution ok
88.19/88.38	o 112
104.23/104.35	c model valid
104.23/104.35	c current solution ok
104.35/104.49	o 111
132.32/132.47	c model valid
132.32/132.47	c current solution ok
132.43/132.62	o 110
170.14/170.24	c model valid
170.14/170.24	c current solution ok
170.18/170.39	o 108
196.90/197.08	c model valid
196.90/197.08	c current solution ok
197.01/197.22	o 104
229.92/230.01	c model valid
229.92/230.01	c current solution ok
229.93/230.15	o 103
384.05/384.24	c model valid
384.05/384.24	c current solution ok
384.09/384.39	o 101
494.01/494.21	c model valid
494.01/494.21	c current solution ok
494.02/494.35	o 98
618.47/618.79	c model valid
618.47/618.79	c current solution ok
618.57/618.93	o 97
767.72/768.02	c model valid
767.72/768.02	c current solution ok
767.75/768.16	o 92
977.24/977.64	c model valid
977.24/977.64	c current solution ok
977.29/977.79	o 91
999.71/1000.56	c model valid
999.71/1000.56	c current solution ok
999.78/1000.70	o 89
1276.64/1277.56	c model valid
1276.64/1277.56	c current solution ok
1276.70/1277.71	o 84
1800.02/1802.11	c error: unexpected solver exit code
1800.02/1802.11	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3694919-1338067796/watcher-3694919-1338067796 -o /tmp/evaluation-result-3694919-1338067796/solver-3694919-1338067796 -C 1800 -W 1900 -M 15500 HOME/runPb2satCp2.sh HOME/instance-3694919-1338067796.opb 499529944 HOME HOME 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.03 2.02 2.09 3/179 30001
/proc/meminfo: memFree=29795340/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0

[startup+0.014461 s]
/proc/loadavg: 2.03 2.02 2.09 3/179 30001
/proc/meminfo: memFree=29795340/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100225 s]
/proc/loadavg: 2.03 2.02 2.09 3/179 30001
/proc/meminfo: memFree=29795340/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.30022 s]
/proc/loadavg: 2.03 2.02 2.09 3/179 30001
/proc/meminfo: memFree=29795340/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700241 s]
/proc/loadavg: 2.03 2.02 2.09 3/179 30001
/proc/meminfo: memFree=29795340/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50023 s]
/proc/loadavg: 2.03 2.02 2.09 3/181 30003
/proc/meminfo: memFree=29778608/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=35748 CPUtime=1.49 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) R 30001 30001 28113 0 -1 4202496 3187 0 0 0 148 1 0 0 20 0 1 0 272903965 36605952 5745 33554432000 4194304 5873084 140736737426128 140736737423496 4779713 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/30002/statm: 8937 5745 146 410 0 8519 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 44896

[startup+3.10023 s]
/proc/loadavg: 2.03 2.02 2.09 3/181 30003
/proc/meminfo: memFree=29763644/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=69216 CPUtime=3.09 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) R 30001 30001 28113 0 -1 4202496 3885 0 0 0 307 2 0 0 20 0 1 0 272903965 70877184 11492 33554432000 4194304 5873084 140736737426128 140736737423496 4779538 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/30002/statm: 17304 11492 146 410 0 16886 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 78364

[startup+6.30046 s]
/proc/loadavg: 2.03 2.02 2.09 3/184 30008
/proc/meminfo: memFree=29511628/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=162612 CPUtime=4.57 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) S 30001 30001 28113 0 -1 4202496 12166 0 0 0 440 17 0 0 20 0 1 0 272903965 166514688 26695 33554432000 4194304 5873084 140736737426128 140736737422552 5124602 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30002/statm: 40653 26695 162 410 0 40235 0
[pid=30007] ppid=30002 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30007/stat : 30007 (satsolver.sh) S 30002 30001 28113 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 272904423 9367552 267 33554432000 4194304 5064252 140734752474528 140734752473440 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30007/statm: 2287 267 226 213 0 72 0
[pid=30008] ppid=30007 vsize=259316 CPUtime=1.71 cores=1,3,5,7
/proc/30008/stat : 30008 (glucose_static) R 30007 30001 28113 0 -1 4202496 31367 0 0 0 161 10 0 0 20 0 1 0 272904423 265539584 49840 33554432000 4194304 4896791 140734444615344 140734444612776 4224983 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30008/statm: 64829 49840 76 172 0 64655 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 440224

[startup+12.7005 s]
/proc/loadavg: 2.02 2.02 2.08 3/184 30008
/proc/meminfo: memFree=29389008/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=162612 CPUtime=4.57 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) S 30001 30001 28113 0 -1 4202496 12166 0 0 0 440 17 0 0 20 0 1 0 272903965 166514688 26695 33554432000 4194304 5873084 140736737426128 140736737422552 5124602 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30002/statm: 40653 26695 162 410 0 40235 0
[pid=30007] ppid=30002 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30007/stat : 30007 (satsolver.sh) S 30002 30001 28113 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 272904423 9367552 267 33554432000 4194304 5064252 140734752474528 140734752473440 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30007/statm: 2287 267 226 213 0 72 0
[pid=30008] ppid=30007 vsize=285252 CPUtime=8.11 cores=1,3,5,7
/proc/30008/stat : 30008 (glucose_static) R 30007 30001 28113 0 -1 4202496 36905 0 0 0 800 11 0 0 20 0 1 0 272904423 292098048 55301 33554432000 4194304 4896791 140734444615344 140734444612776 4225029 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30008/statm: 71313 55301 78 172 0 71139 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 466160

[startup+25.5005 s]
/proc/loadavg: 2.02 2.02 2.08 3/184 30008
/proc/meminfo: memFree=29384576/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=162612 CPUtime=4.57 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) S 30001 30001 28113 0 -1 4202496 12166 0 0 0 440 17 0 0 20 0 1 0 272903965 166514688 26695 33554432000 4194304 5873084 140736737426128 140736737422552 5124602 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30002/statm: 40653 26695 162 410 0 40235 0
[pid=30007] ppid=30002 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30007/stat : 30007 (satsolver.sh) S 30002 30001 28113 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 272904423 9367552 267 33554432000 4194304 5064252 140734752474528 140734752473440 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30007/statm: 2287 267 226 213 0 72 0
[pid=30008] ppid=30007 vsize=291056 CPUtime=20.91 cores=1,3,5,7
/proc/30008/stat : 30008 (glucose_static) R 30007 30001 28113 0 -1 4202496 38227 0 0 0 2079 12 0 0 20 0 1 0 272904423 298041344 56623 33554432000 4194304 4896791 140734444615344 140734444612776 4225029 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30008/statm: 72764 56623 78 172 0 72590 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 471964

[startup+51.1005 s]
/proc/loadavg: 2.15 2.04 2.09 3/184 30011
/proc/meminfo: memFree=29301176/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=172852 CPUtime=42.29 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) S 30001 30001 28113 0 -1 4202496 14273 40693 0 0 511 317 3372 29 20 0 1 0 272903965 177000448 29265 33554432000 4194304 5873084 140736737426128 140736737419944 5124602 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30002/statm: 43213 29265 173 410 0 42795 0
[pid=30010] ppid=30002 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30010/stat : 30010 (satsolver.sh) S 30002 30001 28113 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 272908196 9367552 267 33554432000 4194304 5064252 140735499056192 140735499055104 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30010/statm: 2287 267 226 213 0 72 0
[pid=30011] ppid=30010 vsize=284548 CPUtime=8.78 cores=1,3,5,7
/proc/30011/stat : 30011 (glucose_static) R 30010 30001 28113 0 -1 4202496 36279 0 0 0 868 10 0 0 20 0 1 0 272908196 291377152 55691 33554432000 4194304 4896791 140735566610464 140735566607896 4225517 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30011/statm: 71137 55691 78 172 0 70963 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 475696

[startup+102.307 s]
/proc/loadavg: 2.06 2.03 2.09 3/183 30014
/proc/meminfo: memFree=29285792/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=176948 CPUtime=88.33 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) S 30001 30001 28113 0 -1 4202496 16147 80738 0 0 515 317 7944 57 20 0 1 0 272903965 181194752 30290 33554432000 4194304 5873084 140736737426128 140736737419944 5124602 0 65536 4102 0 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/30002/statm: 44237 30290 173 410 0 43819 0
[pid=30013] ppid=30002 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30013/stat : 30013 (satsolver.sh) S 30002 30001 28113 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 272912803 9367552 267 33554432000 4194304 5064252 140733837931952 140733837930864 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30013/statm: 2287 267 226 213 0 72 0
[pid=30014] ppid=30013 vsize=291260 CPUtime=13.91 cores=1,3,5,7
/proc/30014/stat : 30014 (glucose_static) R 30013 30001 28113 0 -1 4202496 38531 0 0 0 1379 12 0 0 20 0 1 0 272912803 298250240 57875 33554432000 4194304 4896791 140735781339008 140735781336440 4224921 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/30014/statm: 72815 57875 78 172 0 72641 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 486504

[startup+162.3 s]
/proc/loadavg: 2.07 2.04 2.09 3/182 30020
/proc/meminfo: memFree=29283504/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=176948 CPUtime=132.57 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) S 30001 30001 28113 0 -1 4202496 19893 162347 0 0 525 319 12296 117 20 0 1 0 272903965 181194752 30290 33554432000 4194304 5873084 140736737426128 140736737419944 5124602 0 65536 4102 0 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/30002/statm: 44237 30290 173 410 0 43819 0
[pid=30019] ppid=30002 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30019/stat : 30019 (satsolver.sh) S 30002 30001 28113 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 272917227 9367552 267 33554432000 4194304 5064252 140735449605904 140735449604816 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30019/statm: 2287 267 226 213 0 72 0
[pid=30020] ppid=30019 vsize=295548 CPUtime=29.66 cores=1,3,5,7
/proc/30020/stat : 30020 (glucose_static) R 30019 30001 28113 0 -1 4202496 39384 0 0 0 2953 13 0 0 20 0 1 0 272917227 302641152 58759 33554432000 4194304 4896791 140733273793824 140733273791080 4224980 0 0 4096 0 0 0 0 17 1 0 0 0 0 0
/proc/30020/statm: 73887 58759 78 172 0 73713 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 490792

[startup+222.3 s]
/proc/loadavg: 2.11 2.06 2.09 3/183 30027
/proc/meminfo: memFree=29289620/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

/proc/30062/stat : 30062 (glucose_static) R 30061 30001 28113 0 -1 4202496 40547 0 0 0 14331 16 0 0 20 0 1 0 273031772 306626560 60306 33554432000 4194304 4896791 140733809509504 140733809506936 4223862 0 0 4096 0 0 0 0 17 3 0 0 73 0 0
/proc/30062/statm: 74860 60306 78 172 0 74686 0
Current children cumulated CPU time (s) 1420.32
Current children cumulated vsize (KiB) 494684

[startup+1482.3 s]
/proc/loadavg: 2.00 2.02 2.04 3/183 30222
/proc/meminfo: memFree=29541640/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=176948 CPUtime=1276.85 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) S 30001 30001 28113 0 -1 4202496 39247 578148 0 0 573 324 126363 425 20 0 1 0 272903965 181194752 30290 33554432000 4194304 5873084 140736737426128 140736737419944 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 40 0 0
/proc/30002/statm: 44237 30290 173 410 0 43819 0
[pid=30061] ppid=30002 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30061/stat : 30061 (satsolver.sh) S 30002 30001 28113 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 273031772 9367552 267 33554432000 4194304 5064252 140736510215232 140736510214144 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/30061/statm: 2287 267 226 213 0 72 0
[pid=30062] ppid=30061 vsize=300672 CPUtime=203.45 cores=1,3,5,7
/proc/30062/stat : 30062 (glucose_static) R 30061 30001 28113 0 -1 4202496 40829 0 0 0 20329 16 0 0 20 0 1 0 273031772 307888128 60588 33554432000 4194304 4896791 140733809509504 140733809506936 4224983 0 0 4096 0 0 0 0 17 3 0 0 73 0 0
/proc/30062/statm: 75168 60588 78 172 0 74994 0
Current children cumulated CPU time (s) 1480.3
Current children cumulated vsize (KiB) 495916

[startup+1542.3 s]
/proc/loadavg: 2.05 2.03 2.04 3/183 30222
/proc/meminfo: memFree=29532904/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=176948 CPUtime=1276.85 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) S 30001 30001 28113 0 -1 4202496 39247 578148 0 0 573 324 126363 425 20 0 1 0 272903965 181194752 30290 33554432000 4194304 5873084 140736737426128 140736737419944 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 40 0 0
/proc/30002/statm: 44237 30290 173 410 0 43819 0
[pid=30061] ppid=30002 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30061/stat : 30061 (satsolver.sh) S 30002 30001 28113 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 273031772 9367552 267 33554432000 4194304 5064252 140736510215232 140736510214144 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/30061/statm: 2287 267 226 213 0 72 0
[pid=30062] ppid=30061 vsize=302808 CPUtime=263.42 cores=1,3,5,7
/proc/30062/stat : 30062 (glucose_static) R 30061 30001 28113 0 -1 4202496 41251 0 0 0 26326 16 0 0 20 0 1 0 273031772 310075392 61524 33554432000 4194304 4896791 140733809509504 140733809506936 4224960 0 0 4096 0 0 0 0 17 3 0 0 73 0 0
/proc/30062/statm: 75702 61524 78 172 0 75528 0
Current children cumulated CPU time (s) 1540.27
Current children cumulated vsize (KiB) 498052

[startup+1602.3 s]
/proc/loadavg: 2.02 2.02 2.04 3/183 30222
/proc/meminfo: memFree=29524792/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=176948 CPUtime=1276.85 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) S 30001 30001 28113 0 -1 4202496 39247 578148 0 0 573 324 126363 425 20 0 1 0 272903965 181194752 30290 33554432000 4194304 5873084 140736737426128 140736737419944 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 40 0 0
/proc/30002/statm: 44237 30290 173 410 0 43819 0
[pid=30061] ppid=30002 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30061/stat : 30061 (satsolver.sh) S 30002 30001 28113 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 273031772 9367552 267 33554432000 4194304 5064252 140736510215232 140736510214144 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/30061/statm: 2287 267 226 213 0 72 0
[pid=30062] ppid=30061 vsize=303716 CPUtime=323.4 cores=1,3,5,7
/proc/30062/stat : 30062 (glucose_static) R 30061 30001 28113 0 -1 4202496 41477 0 0 0 32324 16 0 0 20 0 1 0 273031772 311005184 62244 33554432000 4194304 4896791 140733809509504 140733809506760 4225029 0 0 4096 0 0 0 0 17 3 0 0 73 0 0
/proc/30062/statm: 75929 62244 78 172 0 75755 0
Current children cumulated CPU time (s) 1600.25
Current children cumulated vsize (KiB) 498960

[startup+1662.3 s]
/proc/loadavg: 2.00 2.02 2.03 3/183 30222
/proc/meminfo: memFree=29518576/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=176948 CPUtime=1276.85 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) S 30001 30001 28113 0 -1 4202496 39247 578148 0 0 573 324 126363 425 20 0 1 0 272903965 181194752 30290 33554432000 4194304 5873084 140736737426128 140736737419944 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 40 0 0
/proc/30002/statm: 44237 30290 173 410 0 43819 0
[pid=30061] ppid=30002 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30061/stat : 30061 (satsolver.sh) S 30002 30001 28113 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 273031772 9367552 267 33554432000 4194304 5064252 140736510215232 140736510214144 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/30061/statm: 2287 267 226 213 0 72 0
[pid=30062] ppid=30061 vsize=303980 CPUtime=383.38 cores=1,3,5,7
/proc/30062/stat : 30062 (glucose_static) R 30061 30001 28113 0 -1 4202496 41529 0 0 0 38322 16 0 0 20 0 1 0 273031772 311275520 62622 33554432000 4194304 4896791 140733809509504 140733809506760 4224684 0 0 4096 0 0 0 0 17 3 0 0 73 0 0
/proc/30062/statm: 75995 62622 78 172 0 75821 0
Current children cumulated CPU time (s) 1660.23
Current children cumulated vsize (KiB) 499224

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/183 30223
/proc/meminfo: memFree=29514020/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=176948 CPUtime=1276.85 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) S 30001 30001 28113 0 -1 4202496 39247 578148 0 0 573 324 126363 425 20 0 1 0 272903965 181194752 30290 33554432000 4194304 5873084 140736737426128 140736737419944 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 40 0 0
/proc/30002/statm: 44237 30290 173 410 0 43819 0
[pid=30061] ppid=30002 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30061/stat : 30061 (satsolver.sh) S 30002 30001 28113 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 273031772 9367552 267 33554432000 4194304 5064252 140736510215232 140736510214144 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/30061/statm: 2287 267 226 213 0 72 0
[pid=30062] ppid=30061 vsize=305052 CPUtime=443.38 cores=1,3,5,7
/proc/30062/stat : 30062 (glucose_static) R 30061 30001 28113 0 -1 4202496 41745 0 0 0 44321 17 0 0 20 0 1 0 273031772 312373248 63349 33554432000 4194304 4896791 140733809509504 140733809505240 4225445 0 0 4096 0 0 0 0 17 3 0 0 73 0 0
/proc/30062/statm: 76263 63349 78 172 0 76089 0
Current children cumulated CPU time (s) 1720.23
Current children cumulated vsize (KiB) 500296

[startup+1782.3 s]
/proc/loadavg: 2.05 2.02 2.02 3/183 30223
/proc/meminfo: memFree=29500168/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=176948 CPUtime=1276.85 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) S 30001 30001 28113 0 -1 4202496 39247 578148 0 0 573 324 126363 425 20 0 1 0 272903965 181194752 30290 33554432000 4194304 5873084 140736737426128 140736737419944 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 40 0 0
/proc/30002/statm: 44237 30290 173 410 0 43819 0
[pid=30061] ppid=30002 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30061/stat : 30061 (satsolver.sh) S 30002 30001 28113 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 273031772 9367552 267 33554432000 4194304 5064252 140736510215232 140736510214144 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/30061/statm: 2287 267 226 213 0 72 0
[pid=30062] ppid=30061 vsize=305244 CPUtime=503.37 cores=1,3,5,7
/proc/30062/stat : 30062 (glucose_static) R 30061 30001 28113 0 -1 4202496 41830 0 0 0 50320 17 0 0 20 0 1 0 273031772 312569856 63945 33554432000 4194304 4896791 140733809509504 140733809506936 4225029 0 0 4096 0 0 0 0 17 3 0 0 73 0 0
/proc/30062/statm: 76311 63945 78 172 0 76137 0
Current children cumulated CPU time (s) 1780.22
Current children cumulated vsize (KiB) 500488



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1802.1 s]
/proc/loadavg: 2.03 2.02 2.02 3/183 30223
/proc/meminfo: memFree=29499596/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=176948 CPUtime=1276.85 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) S 30001 30001 28113 0 -1 4202496 39247 578148 0 0 573 324 126363 425 20 0 1 0 272903965 181194752 30290 33554432000 4194304 5873084 140736737426128 140736737419944 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 40 0 0
/proc/30002/statm: 44237 30290 173 410 0 43819 0
[pid=30061] ppid=30002 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30061/stat : 30061 (satsolver.sh) S 30002 30001 28113 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 273031772 9367552 267 33554432000 4194304 5064252 140736510215232 140736510214144 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/30061/statm: 2287 267 226 213 0 72 0
[pid=30062] ppid=30061 vsize=305436 CPUtime=523.17 cores=1,3,5,7
/proc/30062/stat : 30062 (glucose_static) R 30061 30001 28113 0 -1 4202496 41879 0 0 0 52300 17 0 0 20 0 1 0 273031772 312766464 63994 33554432000 4194304 4896791 140733809509504 140733809506760 4225038 0 0 4096 0 0 0 0 17 3 0 0 73 0 0
/proc/30062/statm: 76359 63994 78 172 0 76185 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 500680

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1802.1 s]
/proc/loadavg: 2.03 2.02 2.02 3/183 30223
/proc/meminfo: memFree=29499596/32873844 swapFree=7628/7628
[pid=30001] ppid=29999 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30001/stat : 30001 (runPb2satCp2.sh) S 29999 30001 28113 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 272903965 9367552 275 33554432000 4194304 5064252 140736558944320 140736558943232 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30001/statm: 2287 275 233 213 0 72 0
[pid=30002] ppid=30001 vsize=176948 CPUtime=1276.85 cores=1,3,5,7
/proc/30002/stat : 30002 (pb2sat) S 30001 30001 28113 0 -1 4202496 39247 578148 0 0 573 324 126363 425 20 0 1 0 272903965 181194752 30290 33554432000 4194304 5873084 140736737426128 140736737419944 5124602 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 40 0 0
/proc/30002/statm: 44237 30290 173 410 0 43819 0
[pid=30061] ppid=30002 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30061/stat : 30061 (satsolver.sh) S 30002 30001 28113 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 273031772 9367552 267 33554432000 4194304 5064252 140736510215232 140736510214144 254750123598 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/30061/statm: 2287 267 226 213 0 72 0
[pid=30062] ppid=30061 vsize=305436 CPUtime=523.17 cores=1,3,5,7
/proc/30062/stat : 30062 (glucose_static) R 30061 30001 28113 0 -1 4202496 41879 0 0 0 52300 17 0 0 20 0 1 0 273031772 312766464 63994 33554432000 4194304 4896791 140733809509504 140733809506760 4225038 0 0 4096 0 0 0 0 17 3 0 0 73 0 0
/proc/30062/statm: 76359 63994 78 172 0 76185 0
Current children cumulated CPU time (s) 1800.02
Current children cumulated vsize (KiB) 500680

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 30001 and gives
#  childrusage.ru_utime.tv_sec=1269
#  childrusage.ru_utime.tv_usec=372026
#  childrusage.ru_stime.tv_sec=7
#  childrusage.ru_stime.tv_usec=503859
# CPU time returned by wait4() is 1276.88
# while last known CPU time is 1800.02
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1802.12
CPU time (s): 1800.02
CPU user time (s): 1792.36
CPU system time (s): 7.66
CPU usage (%): 99.8836
Max. virtual memory (cumulated for all children) (KiB): 500680

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1269.37
system time used= 7.50386
maximum resident set size= 248492
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 618373
page faults= 0
swaps= 0
block input operations= 0
block output operations= 2523392
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 419
involuntary context switches= 1572

runsolver used 3.71344 second user time and 8.99963 second system time

The end

Launcher Data 

Begin job on node145 at 2012-05-26 23:29:56
IDJOB=3694919
IDBENCH=2643
IDSOLVER=2273
FILE ID=node145/3694919-1338067796
RUNJOBID= node145-1338052957-28130
PBS_JOBID= 14624410
Free space on /tmp= 71404 MiB

SOLVER NAME= pb2satCp2 2012-05-19
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/golomb-rulers/normalized-OGR_11.opb
COMMAND LINE= DIR/runPb2satCp2.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3694919-1338067796/watcher-3694919-1338067796 -o /tmp/evaluation-result-3694919-1338067796/solver-3694919-1338067796 -C 1800 -W 1900 -M 15500  HOME/runPb2satCp2.sh HOME/instance-3694919-1338067796.opb 499529944 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5946eb43fefc6e626d35d99afd3eec42
RANDOM SEED=499529944

node145.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.29
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5313.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.149
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        29795340 kB
Buffers:          261208 kB
Cached:          1770456 kB
SwapCached:            0 kB
Active:           944164 kB
Inactive:        1329644 kB
Active(anon):     231296 kB
Inactive(anon):    12884 kB
Active(file):     712868 kB
Inactive(file):  1316760 kB
Unevictable:        7628 kB
Mlocked:            7628 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:              8960 kB
Writeback:             0 kB
AnonPages:        249448 kB
Mapped:            14924 kB
Shmem:               200 kB
Slab:             663884 kB
SReclaimable:     105428 kB
SUnreclaim:       558456 kB
KernelStack:        1480 kB
PageTables:         4624 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     380332 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71300 MiB
End job on node145 at 2012-05-26 23:59:58