Trace number 3750101

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
npSolver 1.0 (fixed)? (TO) 1800.01 1800.61

General information on the benchmark

Name/OPT-BIGINT-LIN/zahidi/Base/
normalized-minisat85_4_27_7.opb
MD5SUMc97ea0ca4046b53674ada05533ed4cde
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark7290551
Best CPU time to get the best result obtained on this benchmark1800.09
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables14620
Total number of constraints21851
Number of constraints which are clauses170
Number of constraints which are cardinality constraints (but not clauses)6
Number of constraints which are nor clauses,nor cardinality constraints21675
Minimum length of a constraint2
Maximum length of a constraint3570
Number of terms in the objective function 14365
Biggest coefficient in the objective function 153990656
Number of bits for the biggest coefficient in the objective function 28
Sum of the numbers in the objective function 153911476473
Number of bits of the sum of numbers in the objective function 38
Biggest number in a constraint 153990656
Number of bits of the biggest number in a constraint 28
Biggest sum of numbers in a constraint 153911476473
Number of bits of the biggest sum of numbers38
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.09	c old isEQ: 0, new EQ is 1
1.19/1.23	c run usual solver
10.66/10.80	c model valid
10.66/10.80	c current solution ok
13.96/14.28	o 50557291
13.96/14.28	c current bound: 25278688
13.96/14.28	c fallback to adder encoding
122.45/122.72	c model valid
122.45/122.72	c current solution ok
122.45/122.79	o 18081959
122.45/122.79	c current bound: 9041022
122.45/122.79	c fallback to adder encoding
1800.01/1800.61	c error: unexpected solver exit code
1800.01/1800.61	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3750101-1339181147/watcher-3750101-1339181147 -o /tmp/evaluation-result-3750101-1339181147/solver-3750101-1339181147 -C 1800 -W 1900 -M 15500 HOME/npSolver-pbo.sh HOME/instance-3750101-1339181147.opb 362253413 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.14 1.72 1.90 2/173 28452
/proc/meminfo: memFree=29192448/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0

[startup+0.0714849 s]
/proc/loadavg: 1.14 1.72 1.90 2/173 28452
/proc/meminfo: memFree=29192448/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100201 s]
/proc/loadavg: 1.14 1.72 1.90 2/173 28452
/proc/meminfo: memFree=29192448/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300143 s]
/proc/loadavg: 1.14 1.72 1.90 2/173 28452
/proc/meminfo: memFree=29192448/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700159 s]
/proc/loadavg: 1.14 1.72 1.90 2/173 28452
/proc/meminfo: memFree=29192448/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.5002 s]
/proc/loadavg: 1.14 1.72 1.90 3/179 28458
/proc/meminfo: memFree=28992544/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=85484 CPUtime=1.25 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 8484 0 0 0 108 17 0 0 20 0 1 0 384240177 87535616 20072 33554432000 4194304 6004724 140735708050000 140735708044048 5186782 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/28455/statm: 21371 20072 171 442 0 20925 0
Current children cumulated CPU time (s) 1.25
Current children cumulated vsize (KiB) 94632

[startup+3.10027 s]
/proc/loadavg: 1.37 1.76 1.91 3/183 28462
/proc/meminfo: memFree=28439040/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=85484 CPUtime=1.25 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 8484 0 0 0 108 17 0 0 20 0 1 0 384240177 87535616 20072 33554432000 4194304 6004724 140735708050000 140735708044048 5186782 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/28455/statm: 21371 20072 171 442 0 20925 0
[pid=28459] ppid=28455 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28459/stat : 28459 (cp2_pre.sh) S 28455 28452 27509 0 -1 4202496 607 0 0 0 0 0 0 0 20 0 1 0 384240304 9367552 277 33554432000 4194304 5064252 140734540816560 140734540815264 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/28459/statm: 2287 277 234 213 0 72 0
[pid=28460] ppid=28459 vsize=361736 CPUtime=1.82 cores=0,2,4,6
/proc/28460/stat : 28460 (coprocessor) R 28459 28452 27509 0 -1 4202496 41913 0 0 0 171 11 0 0 20 0 1 0 384240304 370417664 81347 33554432000 4194304 6586260 140734744239312 140734744235576 5511711 0 0 4096 8404994 0 0 0 17 4 0 0 0 0 0
/proc/28460/statm: 90434 81347 166 584 0 89846 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 465516

[startup+6.30038 s]
/proc/loadavg: 1.37 1.76 1.91 3/183 28462
/proc/meminfo: memFree=28031912/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=85484 CPUtime=1.25 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 8484 0 0 0 108 17 0 0 20 0 1 0 384240177 87535616 20072 33554432000 4194304 6004724 140735708050000 140735708044048 5186782 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/28455/statm: 21371 20072 171 442 0 20925 0
[pid=28459] ppid=28455 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28459/stat : 28459 (cp2_pre.sh) S 28455 28452 27509 0 -1 4202496 607 0 0 0 0 0 0 0 20 0 1 0 384240304 9367552 277 33554432000 4194304 5064252 140734540816560 140734540815264 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/28459/statm: 2287 277 234 213 0 72 0
[pid=28460] ppid=28459 vsize=451108 CPUtime=5.02 cores=0,2,4,6
/proc/28460/stat : 28460 (coprocessor) R 28459 28452 27509 0 -1 4202496 58505 0 0 0 465 37 0 0 20 0 1 0 384240304 461934592 109544 33554432000 4194304 6586260 140734744239312 140734744235064 5732496 0 0 4096 8404994 0 0 0 17 4 0 0 0 0 0
/proc/28460/statm: 112777 109544 204 584 0 112189 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 554888

[startup+12.7002 s]
/proc/loadavg: 1.62 1.80 1.92 3/179 28476
/proc/meminfo: memFree=28935824/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=92608 CPUtime=12.45 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) R 28452 28452 27509 0 -1 4202496 11128 100671 0 0 135 177 879 54 20 0 1 0 384240177 94830592 21336 33554432000 4194304 6004724 140735708050000 140735708044200 5190832 0 0 4096 0 0 0 0 17 0 0 0 10 0 0
/proc/28455/statm: 23152 21336 177 442 0 22706 0
Current children cumulated CPU time (s) 12.45
Current children cumulated vsize (KiB) 101756

[startup+25.5004 s]
/proc/loadavg: 1.68 1.80 1.92 3/183 28482
/proc/meminfo: memFree=27513892/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=220112 CPUtime=15.92 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 17276 101184 0 0 313 341 879 59 20 0 1 0 384240177 225394688 50237 33554432000 4194304 6004724 140735708050000 140735708042352 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 10 0 0
/proc/28455/statm: 55028 50237 180 442 0 54582 0
[pid=28479] ppid=28455 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28479/stat : 28479 (satsolver.sh) S 28455 28452 27509 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 384241793 9367552 267 33554432000 4194304 5064252 140737380554464 140737380553376 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/28479/statm: 2287 267 226 213 0 72 0
[pid=28480] ppid=28479 vsize=510140 CPUtime=9.32 cores=0,2,4,6
/proc/28480/stat : 28480 (glucose) R 28479 28452 27509 0 -1 4202496 73557 0 0 0 912 20 0 0 20 0 1 0 384241793 522383360 104916 33554432000 4194304 5208918 140735541583136 140735541580968 4229319 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/28480/statm: 127535 104916 104 248 0 127284 0
Current children cumulated CPU time (s) 25.24
Current children cumulated vsize (KiB) 748548

[startup+51.1004 s]
/proc/loadavg: 1.79 1.82 1.92 3/183 28482
/proc/meminfo: memFree=27440216/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=220112 CPUtime=15.92 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 17276 101184 0 0 313 341 879 59 20 0 1 0 384240177 225394688 50237 33554432000 4194304 6004724 140735708050000 140735708042352 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 10 0 0
/proc/28455/statm: 55028 50237 180 442 0 54582 0
[pid=28479] ppid=28455 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28479/stat : 28479 (satsolver.sh) S 28455 28452 27509 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 384241793 9367552 267 33554432000 4194304 5064252 140737380554464 140737380553376 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/28479/statm: 2287 267 226 213 0 72 0
[pid=28480] ppid=28479 vsize=514304 CPUtime=34.92 cores=0,2,4,6
/proc/28480/stat : 28480 (glucose) R 28479 28452 27509 0 -1 4202496 74002 0 0 0 3471 21 0 0 20 0 1 0 384241793 526647296 108427 33554432000 4194304 5208918 140735541583136 140735541580968 4212392 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/28480/statm: 128576 108427 104 248 0 128325 0
Current children cumulated CPU time (s) 50.84
Current children cumulated vsize (KiB) 752712

[startup+102.3 s]
/proc/loadavg: 1.91 1.85 1.92 3/182 28482
/proc/meminfo: memFree=27432848/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=220112 CPUtime=15.92 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 17276 101184 0 0 313 341 879 59 20 0 1 0 384240177 225394688 50237 33554432000 4194304 6004724 140735708050000 140735708042352 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 10 0 0
/proc/28455/statm: 55028 50237 180 442 0 54582 0
[pid=28479] ppid=28455 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28479/stat : 28479 (satsolver.sh) S 28455 28452 27509 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 384241793 9367552 267 33554432000 4194304 5064252 140737380554464 140737380553376 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/28479/statm: 2287 267 226 213 0 72 0
[pid=28480] ppid=28479 vsize=514304 CPUtime=86.12 cores=0,2,4,6
/proc/28480/stat : 28480 (glucose) R 28479 28452 27509 0 -1 4202496 74262 0 0 0 8591 21 0 0 20 0 1 0 384241793 526647296 110206 33554432000 4194304 5208918 140735541583136 140735541580968 4229319 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/28480/statm: 128576 110206 104 248 0 128325 0
Current children cumulated CPU time (s) 102.04
Current children cumulated vsize (KiB) 752712

[startup+162.3 s]
/proc/loadavg: 1.97 1.87 1.92 3/183 28490
/proc/meminfo: memFree=27375688/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=218496 CPUtime=124.02 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 24657 184150 0 0 452 358 11460 132 20 0 1 0 384240177 223739904 44202 33554432000 4194304 6004724 140735708050000 140735708042352 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 10 0 0
/proc/28455/statm: 54624 44202 181 442 0 54178 0
[pid=28489] ppid=28455 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28489/stat : 28489 (satsolver.sh) S 28455 28452 27509 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 384252605 9367552 267 33554432000 4194304 5064252 140733495815776 140733495814688 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/28489/statm: 2287 267 226 213 0 72 0
[pid=28490] ppid=28489 vsize=521548 CPUtime=38 cores=0,2,4,6
/proc/28490/stat : 28490 (glucose) R 28489 28452 27509 0 -1 4202496 71048 0 0 0 3771 29 0 0 20 0 1 0 384252605 534065152 110556 33554432000 4194304 5208918 140733489402176 140733489400328 4215313 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/28490/statm: 130387 110556 104 248 0 130136 0
Current children cumulated CPU time (s) 162.02
Current children cumulated vsize (KiB) 758340

[startup+222.307 s]
/proc/loadavg: 1.99 1.89 1.92 3/183 28490
/proc/meminfo: memFree=27378268/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6

################
# More data... #
################

/proc/28490/stat : 28490 (glucose) R 28489 28452 27509 0 -1 4202496 90309 0 0 0 129691 84 0 0 20 0 1 0 384252605 695402496 151669 33554432000 4194304 5208918 140733489402176 140733489400328 4211744 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/28490/statm: 169776 151669 105 248 0 169525 0
Current children cumulated CPU time (s) 1421.77
Current children cumulated vsize (KiB) 915896

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/184 28540
/proc/meminfo: memFree=27534492/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=218496 CPUtime=124.02 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 24657 184150 0 0 452 358 11460 132 20 0 1 0 384240177 223739904 44202 33554432000 4194304 6004724 140735708050000 140735708042352 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 10 0 0
/proc/28455/statm: 54624 44202 181 442 0 54178 0
[pid=28489] ppid=28455 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28489/stat : 28489 (satsolver.sh) S 28455 28452 27509 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 384252605 9367552 267 33554432000 4194304 5064252 140733495815776 140733495814688 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/28489/statm: 2287 267 226 213 0 72 0
[pid=28490] ppid=28489 vsize=465456 CPUtime=1357.74 cores=0,2,4,6
/proc/28490/stat : 28490 (glucose) R 28489 28452 27509 0 -1 4202496 90879 0 0 0 135687 87 0 0 20 0 1 0 384252605 476626944 111612 33554432000 4194304 5208918 140733489402176 140733489400264 4211744 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/28490/statm: 116364 111612 105 248 0 116113 0
Current children cumulated CPU time (s) 1481.76
Current children cumulated vsize (KiB) 702248

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 1.94 3/183 28540
/proc/meminfo: memFree=27567724/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=218496 CPUtime=124.02 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 24657 184150 0 0 452 358 11460 132 20 0 1 0 384240177 223739904 44202 33554432000 4194304 6004724 140735708050000 140735708042352 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 10 0 0
/proc/28455/statm: 54624 44202 181 442 0 54178 0
[pid=28489] ppid=28455 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28489/stat : 28489 (satsolver.sh) S 28455 28452 27509 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 384252605 9367552 267 33554432000 4194304 5064252 140733495815776 140733495814688 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/28489/statm: 2287 267 226 213 0 72 0
[pid=28490] ppid=28489 vsize=546844 CPUtime=1417.74 cores=0,2,4,6
/proc/28490/stat : 28490 (glucose) R 28489 28452 27509 0 -1 4202496 91564 0 0 0 141685 89 0 0 20 0 1 0 384252605 559968256 114852 33554432000 4194304 5208918 140733489402176 140733489400328 4211851 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/28490/statm: 136711 114852 105 248 0 136460 0
Current children cumulated CPU time (s) 1541.76
Current children cumulated vsize (KiB) 783636

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/183 28540
/proc/meminfo: memFree=27486448/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=218496 CPUtime=124.02 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 24657 184150 0 0 452 358 11460 132 20 0 1 0 384240177 223739904 44202 33554432000 4194304 6004724 140735708050000 140735708042352 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 10 0 0
/proc/28455/statm: 54624 44202 181 442 0 54178 0
[pid=28489] ppid=28455 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28489/stat : 28489 (satsolver.sh) S 28455 28452 27509 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 384252605 9367552 267 33554432000 4194304 5064252 140733495815776 140733495814688 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/28489/statm: 2287 267 226 213 0 72 0
[pid=28490] ppid=28489 vsize=546844 CPUtime=1477.73 cores=0,2,4,6
/proc/28490/stat : 28490 (glucose) R 28489 28452 27509 0 -1 4202496 91571 0 0 0 147684 89 0 0 20 0 1 0 384252605 559968256 118436 33554432000 4194304 5208918 140733489402176 140733489400328 4211623 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/28490/statm: 136711 118436 105 248 0 136460 0
Current children cumulated CPU time (s) 1601.75
Current children cumulated vsize (KiB) 783636

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/183 28541
/proc/meminfo: memFree=27609960/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=218496 CPUtime=124.02 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 24657 184150 0 0 452 358 11460 132 20 0 1 0 384240177 223739904 44202 33554432000 4194304 6004724 140735708050000 140735708042352 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 10 0 0
/proc/28455/statm: 54624 44202 181 442 0 54178 0
[pid=28489] ppid=28455 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28489/stat : 28489 (satsolver.sh) S 28455 28452 27509 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 384252605 9367552 267 33554432000 4194304 5064252 140733495815776 140733495814688 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/28489/statm: 2287 267 226 213 0 72 0
[pid=28490] ppid=28489 vsize=546844 CPUtime=1537.71 cores=0,2,4,6
/proc/28490/stat : 28490 (glucose) R 28489 28452 27509 0 -1 4202496 91577 0 0 0 153682 89 0 0 20 0 1 0 384252605 559968256 121508 33554432000 4194304 5208918 140733489402176 140733489400328 4211553 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/28490/statm: 136711 121508 105 248 0 136460 0
Current children cumulated CPU time (s) 1661.73
Current children cumulated vsize (KiB) 783636

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/183 28541
/proc/meminfo: memFree=27625376/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=218496 CPUtime=124.02 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 24657 184150 0 0 452 358 11460 132 20 0 1 0 384240177 223739904 44202 33554432000 4194304 6004724 140735708050000 140735708042352 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 10 0 0
/proc/28455/statm: 54624 44202 181 442 0 54178 0
[pid=28489] ppid=28455 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28489/stat : 28489 (satsolver.sh) S 28455 28452 27509 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 384252605 9367552 267 33554432000 4194304 5064252 140733495815776 140733495814688 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/28489/statm: 2287 267 226 213 0 72 0
[pid=28490] ppid=28489 vsize=546844 CPUtime=1597.7 cores=0,2,4,6
/proc/28490/stat : 28490 (glucose) R 28489 28452 27509 0 -1 4202496 91584 0 0 0 159681 89 0 0 20 0 1 0 384252605 559968256 125092 33554432000 4194304 5208918 140733489402176 140733489400328 4211518 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/28490/statm: 136711 125092 105 248 0 136460 0
Current children cumulated CPU time (s) 1721.72
Current children cumulated vsize (KiB) 783636

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.94 3/183 28541
/proc/meminfo: memFree=27577540/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=218496 CPUtime=124.02 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 24657 184150 0 0 452 358 11460 132 20 0 1 0 384240177 223739904 44202 33554432000 4194304 6004724 140735708050000 140735708042352 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 10 0 0
/proc/28455/statm: 54624 44202 181 442 0 54178 0
[pid=28489] ppid=28455 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28489/stat : 28489 (satsolver.sh) S 28455 28452 27509 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 384252605 9367552 267 33554432000 4194304 5064252 140733495815776 140733495814688 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/28489/statm: 2287 267 226 213 0 72 0
[pid=28490] ppid=28489 vsize=554296 CPUtime=1657.69 cores=0,2,4,6
/proc/28490/stat : 28490 (glucose) R 28489 28452 27509 0 -1 4202496 92341 0 0 0 165680 89 0 0 20 0 1 0 384252605 567599104 129937 33554432000 4194304 5208918 140733489402176 140733489400008 4232820 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/28490/statm: 138574 129937 105 248 0 138323 0
Current children cumulated CPU time (s) 1781.71
Current children cumulated vsize (KiB) 791088



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 1.94 3/176 28565
/proc/meminfo: memFree=28241236/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=218496 CPUtime=124.02 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 24657 184150 0 0 452 358 11460 132 20 0 1 0 384240177 223739904 44202 33554432000 4194304 6004724 140735708050000 140735708042352 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 10 0 0
/proc/28455/statm: 54624 44202 181 442 0 54178 0
[pid=28489] ppid=28455 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28489/stat : 28489 (satsolver.sh) S 28455 28452 27509 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 384252605 9367552 267 33554432000 4194304 5064252 140733495815776 140733495814688 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/28489/statm: 2287 267 226 213 0 72 0
[pid=28490] ppid=28489 vsize=554296 CPUtime=1675.99 cores=0,2,4,6
/proc/28490/stat : 28490 (glucose) R 28489 28452 27509 0 -1 4202496 92346 0 0 0 167510 89 0 0 20 0 1 0 384252605 567599104 132497 33554432000 4194304 5208918 140733489402176 140733489400008 4211553 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/28490/statm: 138574 132497 105 248 0 138323 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 791088

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 1.94 3/176 28565
/proc/meminfo: memFree=28241236/32873648 swapFree=7376/7376
[pid=28452] ppid=28449 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28452/stat : 28452 (npSolver-pbo.sh) S 28449 28452 27509 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 384240177 9367552 274 33554432000 4194304 5064252 140734723461600 140734723460512 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/28452/statm: 2287 274 233 213 0 72 0
[pid=28455] ppid=28452 vsize=218496 CPUtime=124.02 cores=0,2,4,6
/proc/28455/stat : 28455 (npSolver-pbo) S 28452 28452 27509 0 -1 4202496 24657 184150 0 0 452 358 11460 132 20 0 1 0 384240177 223739904 44202 33554432000 4194304 6004724 140735708050000 140735708042352 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 10 0 0
/proc/28455/statm: 54624 44202 181 442 0 54178 0
[pid=28489] ppid=28455 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/28489/stat : 28489 (satsolver.sh) S 28455 28452 27509 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 384252605 9367552 267 33554432000 4194304 5064252 140733495815776 140733495814688 270707353166 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/28489/statm: 2287 267 226 213 0 72 0
[pid=28490] ppid=28489 vsize=554296 CPUtime=1675.99 cores=0,2,4,6
/proc/28490/stat : 28490 (glucose) R 28489 28452 27509 0 -1 4202496 92346 0 0 0 167510 89 0 0 20 0 1 0 384252605 567599104 132497 33554432000 4194304 5208918 140733489402176 140733489400008 4211553 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/28490/statm: 138574 132497 105 248 0 138323 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 791088

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28452 and gives
#  childrusage.ru_utime.tv_sec=119
#  childrusage.ru_utime.tv_usec=132889
#  childrusage.ru_stime.tv_sec=4
#  childrusage.ru_stime.tv_usec=916252
# CPU time returned by wait4() is 124.049
# while last known CPU time is 1800.01
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.61
CPU time (s): 1800.01
CPU user time (s): 1794.22
CPU system time (s): 5.79
CPU usage (%): 99.9665
Max. virtual memory (cumulated for all children) (KiB): 1046124

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 119.133
system time used= 4.91625
maximum resident set size= 511444
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 209782
page faults= 0
swaps= 0
block input operations= 0
block output operations= 802096
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3202
involuntary context switches= 200

runsolver used 3.13452 second user time and 8.60769 second system time

The end

Launcher Data 

Begin job on node125 at 2012-06-08 20:45:47
IDJOB=3750101
IDBENCH=92732
IDSOLVER=2334
FILE ID=node125/3750101-1339181147
RUNJOBID= node125-1339181147-28427
PBS_JOBID= 14643842
Free space on /tmp= 70760 MiB

SOLVER NAME= npSolver 1.0
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/zahidi/Base/normalized-minisat85_4_27_7.opb
COMMAND LINE= DIR/npSolver-pbo.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3750101-1339181147/watcher-3750101-1339181147 -o /tmp/evaluation-result-3750101-1339181147/solver-3750101-1339181147 -C 1800 -W 1900 -M 15500  HOME/npSolver-pbo.sh HOME/instance-3750101-1339181147.opb 362253413 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c97ea0ca4046b53674ada05533ed4cde
RANDOM SEED=362253413

node125.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.74
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.373
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        29193612 kB
Buffers:          735984 kB
Cached:          1983664 kB
SwapCached:         1248 kB
Active:          2271124 kB
Inactive:         461496 kB
Active(anon):       3180 kB
Inactive(anon):     7424 kB
Active(file):    2267944 kB
Inactive(file):   454072 kB
Unevictable:        7376 kB
Mlocked:            7376 kB
SwapTotal:      67108856 kB
SwapFree:       67102600 kB
Dirty:             19428 kB
Writeback:             0 kB
AnonPages:         14804 kB
Mapped:            10604 kB
Shmem:                96 kB
Slab:             808860 kB
SReclaimable:     252412 kB
SUnreclaim:       556448 kB
KernelStack:        1416 kB
PageTables:         4488 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     104300 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70604 MiB
End job on node125 at 2012-06-08 21:15:48