Trace number 3748607

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
npSolver inc (fixed)? (TO) 1800.07 1800.72

General information on the benchmark

Name/OPT-BIGINT-LIN/zahidi/Multihop/
normalized-minisat25_6_4_9_mh.opb
MD5SUM2d28530068eb86764968fa921334caf4
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark2596841
Best CPU time to get the best result obtained on this benchmark1800.37
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables31350
Total number of constraints73332
Number of constraints which are clauses57050
Number of constraints which are cardinality constraints (but not clauses)32
Number of constraints which are nor clauses,nor cardinality constraints16250
Minimum length of a constraint2
Maximum length of a constraint925
Number of terms in the objective function 16775
Biggest coefficient in the objective function 123505992
Number of bits for the biggest coefficient in the objective function 27
Sum of the numbers in the objective function 14263006373
Number of bits of the sum of numbers in the objective function 34
Biggest number in a constraint 123505992
Number of bits of the biggest number in a constraint 27
Biggest sum of numbers in a constraint 14263006373
Number of bits of the biggest sum of numbers34
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.22	c old isEQ: 0, new EQ is 1
0.00/0.22	c old isEQ: 116, new EQ is 0
0.00/0.23	c old isEQ: 0, new EQ is 0
0.00/0.24	c old isEQ: 0, new EQ is 0
0.00/0.25	c old isEQ: 0, new EQ is 0
0.00/0.25	c old isEQ: 0, new EQ is 0
0.00/0.26	c old isEQ: 0, new EQ is 0
0.00/0.27	c old isEQ: 0, new EQ is 0
0.00/0.28	c old isEQ: 0, new EQ is 0
0.00/0.28	c old isEQ: 0, new EQ is 0
0.00/0.29	c old isEQ: 0, new EQ is 0
0.00/0.30	c old isEQ: 0, new EQ is 0
0.00/0.31	c old isEQ: 0, new EQ is 0
0.00/0.32	c old isEQ: 0, new EQ is 0
0.00/0.32	c old isEQ: 0, new EQ is 0
0.00/0.33	c old isEQ: 0, new EQ is 0
0.00/0.34	c old isEQ: 0, new EQ is 0
0.00/0.35	c old isEQ: 0, new EQ is 0
0.00/0.35	c old isEQ: 0, new EQ is 0
0.00/0.36	c old isEQ: 0, new EQ is 0
0.00/0.37	c old isEQ: 0, new EQ is 0
0.00/0.38	c old isEQ: 0, new EQ is 0
0.00/0.39	c old isEQ: 0, new EQ is 0
0.00/0.39	c old isEQ: 0, new EQ is 0
0.00/0.40	c old isEQ: 0, new EQ is 0
0.00/0.41	c old isEQ: 0, new EQ is 0
0.00/0.43	c old isEQ: 0, new EQ is 1
0.00/0.49	c old isEQ: 1, new EQ is 1
0.00/0.57	c run inc solver
0.00/0.57	c [INC SYSTEM] run initial solver
0.00/0.57	c [INC SYSTEM] preprocess with white file
2.35/2.44	c [INC SYSTEM] finished preprocessing in 1 s
2.35/2.44	c [INC SYSTEM] execute solver
3.91/4.01	c [INC SEARCH] formula is SAT
3.91/4.02	c [INC SYSTEM] solved the initial formula
4.02/4.13	c model valid
4.02/4.13	c current solution ok
4.61/4.76	o 490213439
4.61/4.76	c execute binary inc search
4.61/4.76	c [INC SEARCH] current bound: 245106732
4.61/4.76	c [INC SEARCH] iteration: 0
4.61/4.76	c [INC SEARCH] lower bound: 0 upperbound 490213464 current bound: 245106732 best value:490213464
4.61/4.76	c [INC SYSTEM] there exists a inc, kill it!
4.61/4.76	c write failed with 2
4.61/4.77	c [INC SYSTEM] create new solver instance
4.61/4.77	c [INC] encode full formula
4.61/4.77	c fallback to adder encoding
7.22/7.30	c set iterative enc to: adder
7.22/7.30	c set iterative enc to: none
7.53/7.81	c [INC SEARCH] isOptimum variable: 0
1800.07/1800.72	HOME/npSolver-pbo-I.sh: line 18: 23273 Terminated              ./npSolver-pbo $file $tmp -rnd_seed=$seed -useQuickBound=0 -useBinSearch=1 -useCP2=1 -useInc=1

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3748607-1339175629/watcher-3748607-1339175629 -o /tmp/evaluation-result-3748607-1339175629/solver-3748607-1339175629 -C 1800 -W 1900 -M 15500 HOME/npSolver-pbo-I.sh HOME/instance-3748607-1339175629.opb 1260100311 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 23272
/proc/meminfo: memFree=30672600/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0

[startup+0.0365829 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 23272
/proc/meminfo: memFree=30672600/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100295 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 23272
/proc/meminfo: memFree=30672600/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300288 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 23272
/proc/meminfo: memFree=30672600/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.70015 s]
/proc/loadavg: 1.92 1.98 1.99 3/176 23272
/proc/meminfo: memFree=30672600/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50037 s]
/proc/loadavg: 1.92 1.98 1.99 3/180 23276
/proc/meminfo: memFree=30495836/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=71952 CPUtime=0.58 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 10640 0 0 0 53 5 0 0 20 0 1 0 383688389 73678848 17363 33554432000 4194304 6004724 140735459646096 140735459640560 5186782 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 17988 17363 164 442 0 17542 0
[pid=23275] ppid=23273 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23275/stat : 23275 (cp2_pre.sh) S 23273 23272 22577 0 -1 4202496 607 0 0 0 0 0 0 0 20 0 1 0 383688448 9367552 277 33554432000 4194304 5064252 140737146947744 140737146946448 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/23275/statm: 2287 277 234 213 0 72 0
[pid=23276] ppid=23275 vsize=135864 CPUtime=0.88 cores=0,2,4,6
/proc/23276/stat : 23276 (coprocessor) R 23275 23272 22577 0 -1 4202496 24768 0 0 0 83 5 0 0 20 0 1 0 383688449 139124736 32959 33554432000 4194304 6586260 140737421449744 140737421445896 4676681 0 0 4096 8404994 0 0 0 17 0 0 0 0 0 0
/proc/23276/statm: 33966 32959 192 584 0 33378 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 226112

[startup+3.10022 s]
/proc/loadavg: 1.92 1.98 1.99 3/180 23276
/proc/meminfo: memFree=30462572/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=71952 CPUtime=2.37 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 10657 26481 0 0 53 6 165 13 20 0 1 0 383688389 73678848 17366 33554432000 4194304 6004724 140735459646096 140735459632376 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 17988 17366 167 442 0 17542 0
Current children cumulated CPU time (s) 2.37
Current children cumulated vsize (KiB) 81100
heavy processes:

[startup+6.30035 s]
/proc/loadavg: 1.93 1.98 1.99 3/178 23279
/proc/meminfo: memFree=30530204/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=219408 CPUtime=6.22 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) R 23272 23272 22577 0 -1 4202496 17321 39085 0 0 226 60 319 17 20 0 1 0 383688389 224673792 48957 33554432000 4194304 6004724 140735459646096 140735459638312 4536325 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 54852 48957 183 442 0 54406 0
Current children cumulated CPU time (s) 6.22
Current children cumulated vsize (KiB) 228556

[startup+12.7004 s]
/proc/loadavg: 1.93 1.98 1.99 3/179 23281
/proc/meminfo: memFree=29923656/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=534212 CPUtime=4.87 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 77358 0 0 0 465 22 0 0 20 0 1 0 383689170 547033088 115863 33554432000 4194304 5654031 140736930876832 140736930864648 4232453 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 133553 115863 141 357 0 133193 0
Current children cumulated CPU time (s) 12.42
Current children cumulated vsize (KiB) 631696

[startup+25.5004 s]
/proc/loadavg: 2.01 2.00 2.00 3/179 23281
/proc/meminfo: memFree=29923384/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=535872 CPUtime=17.67 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 78133 0 0 0 1744 23 0 0 20 0 1 0 383689170 548732928 116638 33554432000 4194304 5654031 140736930876832 140736930874616 4232707 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 133968 116638 141 357 0 133608 0
Current children cumulated CPU time (s) 25.22
Current children cumulated vsize (KiB) 633356

[startup+51.1004 s]
/proc/loadavg: 2.01 2.00 2.00 3/179 23281
/proc/meminfo: memFree=29915444/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=538956 CPUtime=43.26 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 79171 0 0 0 4303 23 0 0 20 0 1 0 383689170 551890944 118695 33554432000 4194304 5654031 140736930876832 140736930864648 4232453 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 134739 118695 141 357 0 134379 0
Current children cumulated CPU time (s) 50.81
Current children cumulated vsize (KiB) 636440

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 23281
/proc/meminfo: memFree=29898596/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=541868 CPUtime=94.46 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 79903 0 0 0 9423 23 0 0 20 0 1 0 383689170 554872832 122493 33554432000 4194304 5654031 140736930876832 140736930874728 4232821 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 135467 122493 141 357 0 135107 0
Current children cumulated CPU time (s) 102.01
Current children cumulated vsize (KiB) 639352

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 23282
/proc/meminfo: memFree=29883440/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=544600 CPUtime=154.45 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 80584 0 0 0 15421 24 0 0 20 0 1 0 383689170 557670400 125729 33554432000 4194304 5654031 140736930876832 140736930864648 4232775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 136150 125729 141 357 0 135790 0
Current children cumulated CPU time (s) 162
Current children cumulated vsize (KiB) 642084

[startup+222.3 s]
/proc/loadavg: 2.08 2.02 2.01 3/180 23324
/proc/meminfo: memFree=29531368/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=628636 CPUtime=214.44 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 81942 0 0 0 21418 26 0 0 20 0 1 0 383689170 643723264 129637 33554432000 4194304 5654031 140736930876832 140736930874616 4232821 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 157159 129637 141 357 0 156799 0
Current children cumulated CPU time (s) 221.99
Current children cumulated vsize (KiB) 726120

[startup+282.3 s]
/proc/loadavg: 2.06 2.03 2.00 3/179 23326
/proc/meminfo: memFree=30133016/32873852 swapFree=6864/6864

################
# More data... #
################

/proc/loadavg: 2.00 2.01 2.00 3/179 23342
/proc/meminfo: memFree=29383532/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=654632 CPUtime=1354.16 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 92879 0 0 0 135352 64 0 0 20 0 1 0 383689170 670343168 135193 33554432000 4194304 5654031 140736930876832 140736930864648 4232939 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 163658 135193 141 357 0 163298 0
Current children cumulated CPU time (s) 1361.71
Current children cumulated vsize (KiB) 752116

[startup+1422.31 s]
/proc/loadavg: 2.00 2.01 2.00 3/179 23342
/proc/meminfo: memFree=29399404/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=573244 CPUtime=1414.16 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 93027 0 0 0 141349 67 0 0 20 0 1 0 383689170 587001856 128960 33554432000 4194304 5654031 140736930876832 140736930864648 4232775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 143311 128960 141 357 0 142951 0
Current children cumulated CPU time (s) 1421.71
Current children cumulated vsize (KiB) 670728

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 23342
/proc/meminfo: memFree=29325752/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=575936 CPUtime=1474.15 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 93547 0 0 0 147347 68 0 0 20 0 1 0 383689170 589758464 133568 33554432000 4194304 5654031 140736930876832 140736930864648 4232775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 143984 133568 141 357 0 143624 0
Current children cumulated CPU time (s) 1481.7
Current children cumulated vsize (KiB) 673420

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 23342
/proc/meminfo: memFree=29263372/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=657324 CPUtime=1534.14 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 94236 0 0 0 153345 69 0 0 20 0 1 0 383689170 673099776 137320 33554432000 4194304 5654031 140736930876832 140736930864648 4232484 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 164331 137320 141 357 0 163971 0
Current children cumulated CPU time (s) 1541.69
Current children cumulated vsize (KiB) 754808

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/180 23345
/proc/meminfo: memFree=29359368/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=580024 CPUtime=1594.13 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 94306 0 0 0 159340 73 0 0 20 0 1 0 383689170 593944576 132034 33554432000 4194304 5654031 140736930876832 140736930864648 4232755 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 145006 132034 141 357 0 144646 0
Current children cumulated CPU time (s) 1601.68
Current children cumulated vsize (KiB) 677508

[startup+1662.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/179 23346
/proc/meminfo: memFree=29332880/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=661412 CPUtime=1654.12 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 94998 0 0 0 165338 74 0 0 20 0 1 0 383689170 677285888 136810 33554432000 4194304 5654031 140736930876832 140736930864648 4232775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 165353 136810 141 357 0 164993 0
Current children cumulated CPU time (s) 1661.67
Current children cumulated vsize (KiB) 758896

[startup+1722.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/179 23346
/proc/meminfo: memFree=29303944/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=580024 CPUtime=1714.11 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 95248 0 0 0 171334 77 0 0 20 0 1 0 383689170 593944576 129656 33554432000 4194304 5654031 140736930876832 140736930864648 4214603 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 145006 129656 141 357 0 144646 0
Current children cumulated CPU time (s) 1721.66
Current children cumulated vsize (KiB) 677508

[startup+1782.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/179 23346
/proc/meminfo: memFree=29370220/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=580024 CPUtime=1774.1 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 95574 0 0 0 177333 77 0 0 20 0 1 0 383689170 593944576 134580 33554432000 4194304 5654031 140736930876832 140736930864648 4232821 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 145006 134580 141 357 0 144646 0
Current children cumulated CPU time (s) 1781.65
Current children cumulated vsize (KiB) 677508



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.71 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 23346
/proc/meminfo: memFree=29365816/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=661412 CPUtime=1792.52 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 95975 0 0 0 179173 79 0 0 20 0 1 0 383689170 677285888 135491 33554432000 4194304 5654031 140736930876832 140736930864648 4232775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 165353 135491 141 357 0 164993 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 758896

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1800.71 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 23346
/proc/meminfo: memFree=29365816/32873852 swapFree=6864/6864
[pid=23272] ppid=23270 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23272/stat : 23272 (npSolver-pbo-I.) S 23270 23272 22577 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 383688389 9367552 275 33554432000 4194304 5064252 140736510366320 140736510365232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23272/statm: 2287 275 233 213 0 72 0
[pid=23273] ppid=23272 vsize=88336 CPUtime=7.55 cores=0,2,4,6
/proc/23273/stat : 23273 (npSolver-pbo) S 23272 23272 22577 0 -1 4202496 18708 39600 0 0 327 90 319 19 20 0 1 0 383688389 90456064 21479 33554432000 4194304 6004724 140735459646096 140735459631016 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/23273/statm: 22084 21479 184 442 0 21638 0
[pid=23281] ppid=23273 vsize=661412 CPUtime=1792.52 cores=0,2,4,6
/proc/23281/stat : 23281 (glucosInc) R 23273 23272 22577 0 -1 4202496 95975 0 0 0 179173 79 0 0 20 0 1 0 383689170 677285888 135491 33554432000 4194304 5654031 140736930876832 140736930864648 4232775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23281/statm: 165353 135491 141 357 0 164993 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 758896

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23272 and gives
#  childrusage.ru_utime.tv_sec=6
#  childrusage.ru_utime.tv_usec=465017
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=99832
# CPU time returned by wait4() is 7.56485
# while last known CPU time is 1800.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.72
CPU time (s): 1800.07
CPU user time (s): 1798.19
CPU system time (s): 1.88
CPU usage (%): 99.9638
Max. virtual memory (cumulated for all children) (KiB): 889124

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 6.46502
system time used= 1.09983
maximum resident set size= 448356
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 58684
page faults= 0
swaps= 0
block input operations= 0
block output operations= 430416
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 392
involuntary context switches= 38

runsolver used 4.93725 second user time and 19.525 second system time

The end

Launcher Data 

Begin job on node129 at 2012-06-08 19:13:49
IDJOB=3748607
IDBENCH=92709
IDSOLVER=2333
FILE ID=node129/3748607-1339175629
RUNJOBID= node129-1339170215-22593
PBS_JOBID= 14643830
Free space on /tmp= 70572 MiB

SOLVER NAME= npSolver inc
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/zahidi/Multihop/normalized-minisat25_6_4_9_mh.opb
COMMAND LINE= DIR/npSolver-pbo-I.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3748607-1339175629/watcher-3748607-1339175629 -o /tmp/evaluation-result-3748607-1339175629/solver-3748607-1339175629 -C 1800 -W 1900 -M 15500  HOME/npSolver-pbo-I.sh HOME/instance-3748607-1339175629.opb 1260100311 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2d28530068eb86764968fa921334caf4
RANDOM SEED=1260100311

node129.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873852 kB
MemFree:        30673500 kB
Buffers:          291984 kB
Cached:           469428 kB
SwapCached:         2008 kB
Active:          1123964 kB
Inactive:         191820 kB
Active(anon):     552660 kB
Inactive(anon):     4180 kB
Active(file):     571304 kB
Inactive(file):   187640 kB
Unevictable:        6864 kB
Mlocked:            6864 kB
SwapTotal:      67108856 kB
SwapFree:       67100448 kB
Dirty:             11244 kB
Writeback:             0 kB
AnonPages:        559800 kB
Mapped:            10008 kB
Shmem:                 0 kB
Slab:             743976 kB
SReclaimable:     186268 kB
SUnreclaim:       557708 kB
KernelStack:        1464 kB
PageTables:         5164 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545780 kB
Committed_AS:     754852 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346360 kB
VmallocChunk:   34341988004 kB
HardwareCorrupted:     0 kB
AnonHugePages:    196608 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70256 MiB
End job on node129 at 2012-06-08 19:43:50