Trace number 3700653

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
npSolver 1.0? (TO) 1800.06 1800.42

General information on the benchmark

NameOPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb5-0.01-1.opb
MD5SUM75dfb21288b1ca28adfaa843050a46da
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark57026
Best CPU time to get the best result obtained on this benchmark1800.78
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables208381
Total number of constraints1695597
Number of constraints which are clauses1695597
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint579
Number of terms in the objective function 18980
Biggest coefficient in the objective function 581
Number of bits for the biggest coefficient in the objective function 10
Sum of the numbers in the objective function 10690980
Number of bits of the sum of numbers in the objective function 24
Biggest number in a constraint 581
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 10690980
Number of bits of the biggest sum of numbers24
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

4.89/4.96	c run usual solver
11.36/11.40	c model valid
11.36/11.40	c current solution ok
12.36/12.43	o 277285
12.36/12.43	c current bound: 138642
12.36/12.43	c fallback to adder encoding
1800.06/1800.41	c error: unexpected solver exit code
1800.06/1800.41	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3700653-1338148438/watcher-3700653-1338148438 -o /tmp/evaluation-result-3700653-1338148438/solver-3700653-1338148438 -C 1800 -W 1900 -M 15500 HOME/npSolver-pbo.sh HOME/instance-3700653-1338148438.opb 441003009 HOME HOME 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.01 2.04 2.00 2/179 30205
/proc/meminfo: memFree=30132600/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0

[startup+0.0708489 s]
/proc/loadavg: 2.01 2.04 2.00 2/179 30205
/proc/meminfo: memFree=30132600/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100265 s]
/proc/loadavg: 2.01 2.04 2.00 2/179 30205
/proc/meminfo: memFree=30132600/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.30023 s]
/proc/loadavg: 2.01 2.04 2.00 2/179 30205
/proc/meminfo: memFree=30132600/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700244 s]
/proc/loadavg: 2.01 2.04 2.00 2/179 30205
/proc/meminfo: memFree=30132600/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50031 s]
/proc/loadavg: 2.01 2.04 2.00 3/181 30207
/proc/meminfo: memFree=30120424/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=19900 CPUtime=1.49 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) R 30205 30205 27402 0 -1 4202496 3095 0 0 0 148 1 0 0 20 0 1 0 280969515 20377600 3066 33554432000 4194304 5992684 140737169476224 140737169471960 5179600 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 4975 3066 145 440 0 4531 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 29048

[startup+3.10027 s]
/proc/loadavg: 2.09 2.05 2.01 3/181 30207
/proc/meminfo: memFree=30109728/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=37208 CPUtime=3.08 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) R 30205 30205 27402 0 -1 4202496 3848 0 0 0 306 2 0 0 20 0 1 0 280969515 38100992 5855 33554432000 4194304 5992684 140737169476224 140737169472344 5179600 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 9302 5855 145 440 0 8858 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 46356

[startup+6.30044 s]
/proc/loadavg: 2.09 2.05 2.01 3/183 30209
/proc/meminfo: memFree=29982152/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=92240 CPUtime=4.98 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) S 30205 30205 27402 0 -1 4202496 10919 0 0 0 484 14 0 0 20 0 1 0 280969515 94453760 16560 33554432000 4194304 5992684 140737169476224 140737169470256 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 23060 16560 164 440 0 22616 0
[pid=30208] ppid=30206 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30208/stat : 30208 (cp2_pre.sh) S 30206 30205 27402 0 -1 4202496 607 0 0 0 0 0 0 0 20 0 1 0 280970014 9367552 276 33554432000 4194304 5064252 140733972675776 140733972674480 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30208/statm: 2287 276 234 213 0 72 0
[pid=30209] ppid=30208 vsize=223044 CPUtime=1.29 cores=1,3,5,7
/proc/30209/stat : 30209 (coprocessor) R 30208 30205 27402 0 -1 4202496 34113 0 0 0 122 7 0 0 20 0 1 0 280970014 228397056 49615 33554432000 4194304 6586260 140735840308496 140735840304696 4502370 0 0 4096 8404994 0 0 0 17 5 0 0 0 0 0
/proc/30209/statm: 55761 49615 170 584 0 55173 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 333580

[startup+12.7004 s]
/proc/loadavg: 2.08 2.05 2.00 3/181 30216
/proc/meminfo: memFree=30017512/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=143416 CPUtime=12.67 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) R 30205 30205 27402 0 -1 4202496 17951 63120 0 0 742 95 363 67 20 0 1 0 280969515 146857984 29372 33554432000 4194304 5992684 140737169476224 140737169469096 4523485 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 35854 29372 180 440 0 35410 0
Current children cumulated CPU time (s) 12.67
Current children cumulated vsize (KiB) 152564

[startup+25.5005 s]
/proc/loadavg: 2.06 2.05 2.00 3/183 30220
/proc/meminfo: memFree=29367048/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=241724 CPUtime=14.5 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) S 30205 30205 27402 0 -1 4202496 19930 63120 0 0 900 120 363 67 20 0 1 0 280969515 247525376 53952 33554432000 4194304 5992684 140737169476224 140737169468544 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 60431 53952 181 440 0 59987 0
[pid=30218] ppid=30206 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30218/stat : 30218 (satsolver.sh) S 30206 30205 27402 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 280970966 9367552 267 33554432000 4194304 5064252 140734050080144 140734050079056 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30218/statm: 2287 267 226 213 0 72 0
[pid=30219] ppid=30218 vsize=451252 CPUtime=10.97 cores=1,3,5,7
/proc/30219/stat : 30219 (glucose) R 30218 30205 27402 0 -1 4202496 66203 0 0 0 1075 22 0 0 20 0 1 0 280970967 462082048 93575 33554432000 4194304 5208918 140737156944544 140737156942392 4229319 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30219/statm: 112813 93575 105 248 0 112562 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 711272

[startup+51.1005 s]
/proc/loadavg: 2.04 2.04 2.00 3/183 30220
/proc/meminfo: memFree=29374808/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=241724 CPUtime=14.5 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) S 30205 30205 27402 0 -1 4202496 19930 63120 0 0 900 120 363 67 20 0 1 0 280969515 247525376 53952 33554432000 4194304 5992684 140737169476224 140737169468544 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 60431 53952 181 440 0 59987 0
[pid=30218] ppid=30206 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30218/stat : 30218 (satsolver.sh) S 30206 30205 27402 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 280970966 9367552 267 33554432000 4194304 5064252 140734050080144 140734050079056 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30218/statm: 2287 267 226 213 0 72 0
[pid=30219] ppid=30218 vsize=453204 CPUtime=36.56 cores=1,3,5,7
/proc/30219/stat : 30219 (glucose) R 30218 30205 27402 0 -1 4202496 66669 0 0 0 3634 22 0 0 20 0 1 0 280970967 464080896 95574 33554432000 4194304 5208918 140737156944544 140737156942392 4229095 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30219/statm: 113301 95574 105 248 0 113050 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 713224

[startup+102.301 s]
/proc/loadavg: 2.01 2.03 2.00 3/183 30220
/proc/meminfo: memFree=29351484/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=241724 CPUtime=14.5 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) S 30205 30205 27402 0 -1 4202496 19930 63120 0 0 900 120 363 67 20 0 1 0 280969515 247525376 53952 33554432000 4194304 5992684 140737169476224 140737169468544 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 60431 53952 181 440 0 59987 0
[pid=30218] ppid=30206 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30218/stat : 30218 (satsolver.sh) S 30206 30205 27402 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 280970966 9367552 267 33554432000 4194304 5064252 140734050080144 140734050079056 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30218/statm: 2287 267 226 213 0 72 0
[pid=30219] ppid=30218 vsize=407980 CPUtime=87.76 cores=1,3,5,7
/proc/30219/stat : 30219 (glucose) R 30218 30205 27402 0 -1 4202496 67958 0 0 0 8752 24 0 0 20 0 1 0 280970967 417771520 94530 33554432000 4194304 5208918 140737156944544 140737156942392 4211553 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30219/statm: 101995 94530 105 248 0 101744 0
Current children cumulated CPU time (s) 102.26
Current children cumulated vsize (KiB) 668000

[startup+162.3 s]
/proc/loadavg: 2.00 2.03 2.00 3/183 30272
/proc/meminfo: memFree=30231712/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=241724 CPUtime=14.5 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) S 30205 30205 27402 0 -1 4202496 19930 63120 0 0 900 120 363 67 20 0 1 0 280969515 247525376 53952 33554432000 4194304 5992684 140737169476224 140737169468544 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 60431 53952 181 440 0 59987 0
[pid=30218] ppid=30206 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30218/stat : 30218 (satsolver.sh) S 30206 30205 27402 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 280970966 9367552 267 33554432000 4194304 5064252 140734050080144 140734050079056 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30218/statm: 2287 267 226 213 0 72 0
[pid=30219] ppid=30218 vsize=468328 CPUtime=147.74 cores=1,3,5,7
/proc/30219/stat : 30219 (glucose) R 30218 30205 27402 0 -1 4202496 71248 0 0 0 14745 29 0 0 20 0 1 0 280970967 479567872 100995 33554432000 4194304 5208918 140737156944544 140737156942392 4211147 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30219/statm: 117082 100995 105 248 0 116831 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 728348

[startup+222.307 s]
/proc/loadavg: 2.00 2.02 2.00 3/183 30279
/proc/meminfo: memFree=30174704/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=241724 CPUtime=14.5 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) S 30205 30205 27402 0 -1 4202496 19930 63120 0 0 900 120 363 67 20 0 1 0 280969515 247525376 53952 33554432000 4194304 5992684 140737169476224 140737169468544 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 60431 53952 181 440 0 59987 0
[pid=30218] ppid=30206 vsize=9148 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

/proc/30219/stat : 30219 (glucose) R 30218 30205 27402 0 -1 4202496 116130 0 0 0 140604 148 0 0 20 0 1 0 280970967 704163840 151668 33554432000 4194304 5208918 140737156944544 140737156942392 4211553 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30219/statm: 171915 151668 105 248 0 171664 0
Current children cumulated CPU time (s) 1422.02
Current children cumulated vsize (KiB) 947680

[startup+1482.3 s]
/proc/loadavg: 1.00 1.06 1.40 2/174 30800
/proc/meminfo: memFree=30257360/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=241724 CPUtime=14.5 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) S 30205 30205 27402 0 -1 4202496 19930 63120 0 0 900 120 363 67 20 0 1 0 280969515 247525376 53952 33554432000 4194304 5992684 140737169476224 140737169468544 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 60431 53952 181 440 0 59987 0
[pid=30218] ppid=30206 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30218/stat : 30218 (satsolver.sh) S 30206 30205 27402 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 280970966 9367552 267 33554432000 4194304 5064252 140734050080144 140734050079056 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30218/statm: 2287 267 226 213 0 72 0
[pid=30219] ppid=30218 vsize=691108 CPUtime=1467.5 cores=1,3,5,7
/proc/30219/stat : 30219 (glucose) R 30218 30205 27402 0 -1 4202496 118078 0 0 0 146592 158 0 0 20 0 1 0 280970967 707694592 146846 33554432000 4194304 5208918 140737156944544 140737156942296 4211553 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30219/statm: 172777 146846 105 248 0 172526 0
Current children cumulated CPU time (s) 1482
Current children cumulated vsize (KiB) 951128

[startup+1542.31 s]
/proc/loadavg: 1.00 1.05 1.36 2/174 30800
/proc/meminfo: memFree=30254816/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=241724 CPUtime=14.5 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) S 30205 30205 27402 0 -1 4202496 19930 63120 0 0 900 120 363 67 20 0 1 0 280969515 247525376 53952 33554432000 4194304 5992684 140737169476224 140737169468544 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 60431 53952 181 440 0 59987 0
[pid=30218] ppid=30206 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30218/stat : 30218 (satsolver.sh) S 30206 30205 27402 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 280970966 9367552 267 33554432000 4194304 5064252 140734050080144 140734050079056 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30218/statm: 2287 267 226 213 0 72 0
[pid=30219] ppid=30218 vsize=695736 CPUtime=1527.5 cores=1,3,5,7
/proc/30219/stat : 30219 (glucose) R 30218 30205 27402 0 -1 4202496 120350 0 0 0 152582 168 0 0 20 0 1 0 280970967 712433664 147460 33554432000 4194304 5208918 140737156944544 140737156942696 4211553 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30219/statm: 173934 147460 105 248 0 173683 0
Current children cumulated CPU time (s) 1542
Current children cumulated vsize (KiB) 955756

[startup+1602.3 s]
/proc/loadavg: 1.00 1.04 1.34 2/175 30804
/proc/meminfo: memFree=30227192/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=241724 CPUtime=14.5 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) S 30205 30205 27402 0 -1 4202496 19930 63120 0 0 900 120 363 67 20 0 1 0 280969515 247525376 53952 33554432000 4194304 5992684 140737169476224 140737169468544 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 60431 53952 181 440 0 59987 0
[pid=30218] ppid=30206 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30218/stat : 30218 (satsolver.sh) S 30206 30205 27402 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 280970966 9367552 267 33554432000 4194304 5064252 140734050080144 140734050079056 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30218/statm: 2287 267 226 213 0 72 0
[pid=30219] ppid=30218 vsize=698904 CPUtime=1587.48 cores=1,3,5,7
/proc/30219/stat : 30219 (glucose) R 30218 30205 27402 0 -1 4202496 121701 0 0 0 158574 174 0 0 20 0 1 0 280970967 715677696 154886 33554432000 4194304 5208918 140737156944544 140737156942392 4211732 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30219/statm: 174726 154886 105 248 0 174475 0
Current children cumulated CPU time (s) 1601.98
Current children cumulated vsize (KiB) 958924

[startup+1662.3 s]
/proc/loadavg: 1.00 1.03 1.32 2/174 30804
/proc/meminfo: memFree=30246996/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=241724 CPUtime=14.5 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) S 30205 30205 27402 0 -1 4202496 19930 63120 0 0 900 120 363 67 20 0 1 0 280969515 247525376 53952 33554432000 4194304 5992684 140737169476224 140737169468544 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 60431 53952 181 440 0 59987 0
[pid=30218] ppid=30206 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30218/stat : 30218 (satsolver.sh) S 30206 30205 27402 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 280970966 9367552 267 33554432000 4194304 5064252 140734050080144 140734050079056 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30218/statm: 2287 267 226 213 0 72 0
[pid=30219] ppid=30218 vsize=702004 CPUtime=1647.48 cores=1,3,5,7
/proc/30219/stat : 30219 (glucose) R 30218 30205 27402 0 -1 4202496 123559 0 0 0 164564 184 0 0 20 0 1 0 280970967 718852096 149467 33554432000 4194304 5208918 140737156944544 140737156940248 4229365 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30219/statm: 175501 149467 105 248 0 175250 0
Current children cumulated CPU time (s) 1661.98
Current children cumulated vsize (KiB) 962024

[startup+1722.3 s]
/proc/loadavg: 1.00 1.02 1.30 2/174 30804
/proc/meminfo: memFree=30226640/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=241724 CPUtime=14.5 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) S 30205 30205 27402 0 -1 4202496 19930 63120 0 0 900 120 363 67 20 0 1 0 280969515 247525376 53952 33554432000 4194304 5992684 140737169476224 140737169468544 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 60431 53952 181 440 0 59987 0
[pid=30218] ppid=30206 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30218/stat : 30218 (satsolver.sh) S 30206 30205 27402 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 280970966 9367552 267 33554432000 4194304 5064252 140734050080144 140734050079056 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30218/statm: 2287 267 226 213 0 72 0
[pid=30219] ppid=30218 vsize=706124 CPUtime=1707.46 cores=1,3,5,7
/proc/30219/stat : 30219 (glucose) R 30218 30205 27402 0 -1 4202496 124763 0 0 0 170558 188 0 0 20 0 1 0 280970967 723070976 155247 33554432000 4194304 5208918 140737156944544 140737156942392 4229760 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30219/statm: 176531 155247 105 248 0 176280 0
Current children cumulated CPU time (s) 1721.96
Current children cumulated vsize (KiB) 966144

[startup+1782.3 s]
/proc/loadavg: 1.00 1.01 1.27 2/174 30804
/proc/meminfo: memFree=30225704/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=241724 CPUtime=14.5 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) S 30205 30205 27402 0 -1 4202496 19930 63120 0 0 900 120 363 67 20 0 1 0 280969515 247525376 53952 33554432000 4194304 5992684 140737169476224 140737169468544 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 60431 53952 181 440 0 59987 0
[pid=30218] ppid=30206 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30218/stat : 30218 (satsolver.sh) S 30206 30205 27402 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 280970966 9367552 267 33554432000 4194304 5064252 140734050080144 140734050079056 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30218/statm: 2287 267 226 213 0 72 0
[pid=30219] ppid=30218 vsize=713332 CPUtime=1767.46 cores=1,3,5,7
/proc/30219/stat : 30219 (glucose) R 30218 30205 27402 0 -1 4202496 127210 0 0 0 176551 195 0 0 20 0 1 0 280970967 730451968 154744 33554432000 4194304 5208918 140737156944544 140737156942392 4229365 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30219/statm: 178333 154744 105 248 0 178082 0
Current children cumulated CPU time (s) 1781.96
Current children cumulated vsize (KiB) 973352



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 1.00 1.01 1.27 2/174 30804
/proc/meminfo: memFree=30205768/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=241724 CPUtime=14.5 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) S 30205 30205 27402 0 -1 4202496 19930 63120 0 0 900 120 363 67 20 0 1 0 280969515 247525376 53952 33554432000 4194304 5992684 140737169476224 140737169468544 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 60431 53952 181 440 0 59987 0
[pid=30218] ppid=30206 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30218/stat : 30218 (satsolver.sh) S 30206 30205 27402 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 280970966 9367552 267 33554432000 4194304 5064252 140734050080144 140734050079056 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30218/statm: 2287 267 226 213 0 72 0
[pid=30219] ppid=30218 vsize=714008 CPUtime=1785.56 cores=1,3,5,7
/proc/30219/stat : 30219 (glucose) R 30218 30205 27402 0 -1 4202496 127395 0 0 0 178361 195 0 0 20 0 1 0 280970967 731144192 159671 33554432000 4194304 5208918 140737156944544 140737156942392 4228997 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30219/statm: 178502 159671 105 248 0 178251 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 974028

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1800.4 s]
/proc/loadavg: 1.00 1.01 1.27 2/174 30804
/proc/meminfo: memFree=30205768/32873844 swapFree=7624/7624
[pid=30205] ppid=30203 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30205/stat : 30205 (npSolver-pbo.sh) S 30203 30205 27402 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 280969514 9367552 275 33554432000 4194304 5064252 140733224892320 140733224891232 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/30205/statm: 2287 275 233 213 0 72 0
[pid=30206] ppid=30205 vsize=241724 CPUtime=14.5 cores=1,3,5,7
/proc/30206/stat : 30206 (npSolver-pbo) S 30205 30205 27402 0 -1 4202496 19930 63120 0 0 900 120 363 67 20 0 1 0 280969515 247525376 53952 33554432000 4194304 5992684 140737169476224 140737169468544 5175646 0 65536 4102 0 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/30206/statm: 60431 53952 181 440 0 59987 0
[pid=30218] ppid=30206 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/30218/stat : 30218 (satsolver.sh) S 30206 30205 27402 0 -1 4202496 599 0 0 0 0 0 0 0 20 0 1 0 280970966 9367552 267 33554432000 4194304 5064252 140734050080144 140734050079056 214369461838 0 65536 4100 65538 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/30218/statm: 2287 267 226 213 0 72 0
[pid=30219] ppid=30218 vsize=714008 CPUtime=1785.56 cores=1,3,5,7
/proc/30219/stat : 30219 (glucose) R 30218 30205 27402 0 -1 4202496 127395 0 0 0 178361 195 0 0 20 0 1 0 280970967 731144192 159671 33554432000 4194304 5208918 140737156944544 140737156942392 4228997 0 0 4096 0 0 0 0 17 5 0 0 0 0 0
/proc/30219/statm: 178502 159671 105 248 0 178251 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 974028

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 30205 and gives
#  childrusage.ru_utime.tv_sec=12
#  childrusage.ru_utime.tv_usec=641078
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=883713
# CPU time returned by wait4() is 14.5248
# while last known CPU time is 1800.06
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.42
CPU time (s): 1800.06
CPU user time (s): 1796.24
CPU system time (s): 3.82
CPU usage (%): 99.9801
Max. virtual memory (cumulated for all children) (KiB): 1184300

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 12.6411
system time used= 1.88371
maximum resident set size= 346016
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 84029
page faults= 0
swaps= 0
block input operations= 0
block output operations= 418160
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 667
involuntary context switches= 37

runsolver used 3.37449 second user time and 8.96264 second system time

The end

Launcher Data 

Begin job on node130 at 2012-05-27 21:53:59
IDJOB=3700653
IDBENCH=92871
IDSOLVER=2277
FILE ID=node130/3700653-1338148438
RUNJOBID= node130-1338122171-27419
PBS_JOBID= 14624483
Free space on /tmp= 71192 MiB

SOLVER NAME= npSolver 1.0
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/graca/normalized-ped2.G.recomb5-0.01-1.opb
COMMAND LINE= DIR/npSolver-pbo.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3700653-1338148438/watcher-3700653-1338148438 -o /tmp/evaluation-result-3700653-1338148438/solver-3700653-1338148438 -C 1800 -W 1900 -M 15500  HOME/npSolver-pbo.sh HOME/instance-3700653-1338148438.opb 441003009 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 75dfb21288b1ca28adfaa843050a46da
RANDOM SEED=441003009

node130.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.875
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5228.98
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        30132980 kB
Buffers:          295288 kB
Cached:           748620 kB
SwapCached:         4512 kB
Active:          1831248 kB
Inactive:          71108 kB
Active(anon):     847540 kB
Inactive(anon):    10248 kB
Active(file):     983708 kB
Inactive(file):    60860 kB
Unevictable:        7624 kB
Mlocked:            7624 kB
SwapTotal:      67108856 kB
SwapFree:       67099912 kB
Dirty:             61928 kB
Writeback:             0 kB
AnonPages:        863864 kB
Mapped:            12792 kB
Shmem:                 8 kB
Slab:             694568 kB
SReclaimable:     136096 kB
SUnreclaim:       558472 kB
KernelStack:        1472 kB
PageTables:         5872 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    1090248 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    724992 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71268 MiB
End job on node130 at 2012-05-27 22:24:00