Trace number 3699100

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
npSolver inc? (TO) 1800.05 1800.52

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/
pub/unibo/normalized-mps-v2-20-10-sp98ic.opb
MD5SUM433b539d7c7c8ff139e6ea6f7acee573
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark3860756214
Best CPU time to get the best result obtained on this benchmark1800.01
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 4026056741
Optimality of the best value was proved NO
Number of variables10894
Total number of constraints825
Number of constraints which are clauses20
Number of constraints which are cardinality constraints (but not clauses)624
Number of constraints which are nor clauses,nor cardinality constraints181
Minimum length of a constraint2
Maximum length of a constraint5038
Number of terms in the objective function 10894
Biggest coefficient in the objective function 1079902210
Number of bits for the biggest coefficient in the objective function 31
Sum of the numbers in the objective function 3040671454286
Number of bits of the sum of numbers in the objective function 42
Biggest number in a constraint 1079902210
Number of bits of the biggest number in a constraint 31
Biggest sum of numbers in a constraint 3040671454286
Number of bits of the biggest sum of numbers42
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

3.07/3.16	c run inc solver
3.07/3.16	c [INC SYSTEM] run initial solver
3.07/3.16	c [INC SYSTEM] preprocess with white file
35.45/35.53	c [INC SYSTEM] finished preprocessing in 32 s
35.45/35.53	c [INC SYSTEM] execute solver
38.78/38.83	c [INC SEARCH] formula is SAT
38.88/38.93	c [INC SYSTEM] solved the initial formula
38.98/39.04	c model valid
38.98/39.04	c current solution ok
44.39/44.65	o 40551013064
44.39/44.65	c execute binary inc search
44.57/44.73	c [INC SEARCH] current bound: 20275506532
44.57/44.73	c [INC SEARCH] iteration: 0
44.57/44.73	c [INC SEARCH] lower bound: 0 upperbound 40551013064 current bound: 20275506532 best value:40551013064
44.57/44.73	c [INC SYSTEM] there exists a inc, kill it!
44.57/44.73	c write failed with 2
44.57/44.73	c [INC SYSTEM] create new solver instance
44.57/44.73	c [INC] encode full formula
44.57/44.73	c fallback to adder encoding
46.67/46.84	c set iterative enc to: adder
46.67/46.84	c set iterative enc to: none
47.08/47.23	c [INC SEARCH] isOptimum variable: 0

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3699100-1338064654/watcher-3699100-1338064654 -o /tmp/evaluation-result-3699100-1338064654/solver-3699100-1338064654 -C 1800 -W 1900 -M 15500 HOME/npSolver-pbo-I.sh HOME/instance-3699100-1338064654.opb 818827512 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.71 2.21 2.07 2/177 1561
/proc/meminfo: memFree=24830580/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0

[startup+0.0664151 s]
/proc/loadavg: 2.71 2.21 2.07 2/177 1561
/proc/meminfo: memFree=24830580/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100272 s]
/proc/loadavg: 2.71 2.21 2.07 2/177 1561
/proc/meminfo: memFree=24830580/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.30025 s]
/proc/loadavg: 2.71 2.21 2.07 2/177 1561
/proc/meminfo: memFree=24830580/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700281 s]
/proc/loadavg: 2.71 2.21 2.07 2/177 1561
/proc/meminfo: memFree=24830580/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50035 s]
/proc/loadavg: 2.71 2.21 2.07 3/179 1566
/proc/meminfo: memFree=24708204/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=160280 CPUtime=1.49 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) R 1561 1561 339 0 -1 4202496 25772 0 0 0 143 6 0 0 20 0 1 0 272592173 164126720 37702 33554432000 4194304 5992684 140735025732304 140735025727528 4571303 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/1562/statm: 40070 37702 160 440 0 39626 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 169428

[startup+3.10035 s]
/proc/loadavg: 2.71 2.21 2.07 3/179 1566
/proc/meminfo: memFree=24578784/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=428408 CPUtime=3.07 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) R 1561 1561 339 0 -1 4202496 38318 0 0 0 285 22 0 0 20 0 1 0 272592173 438689792 106426 33554432000 4194304 5992684 140735025732304 140735025728160 5182699 0 0 4096 0 0 0 0 17 4 0 0 1 0 0
/proc/1562/statm: 107102 106426 161 440 0 106658 0
Current children cumulated CPU time (s) 3.07
Current children cumulated vsize (KiB) 437556

[startup+6.30036 s]
/proc/loadavg: 2.65 2.20 2.07 3/181 1569
/proc/meminfo: memFree=23670116/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=299424 CPUtime=3.16 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 38325 0 0 0 285 31 0 0 20 0 1 0 272592173 306610176 74186 33554432000 4194304 5992684 140735025732304 140735025726752 5175646 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 1 0 0
/proc/1562/statm: 74856 74186 167 440 0 74412 0
[pid=1567] ppid=1562 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1567/stat : 1567 (cp2_pre.sh) S 1562 1561 339 0 -1 4202496 610 0 0 0 0 0 0 0 20 0 1 0 272592492 9367552 277 33554432000 4194304 5064252 140733710505600 140733710504304 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/1567/statm: 2287 277 234 213 0 72 0
[pid=1569] ppid=1567 vsize=817984 CPUtime=3.1 cores=0,2,4,6
/proc/1569/stat : 1569 (coprocessor) R 1567 1561 339 0 -1 4202496 50938 0 0 0 291 19 0 0 20 0 1 0 272592492 837615616 177325 33554432000 4194304 6586260 140735757834080 140735757830344 5511711 0 0 4096 8404994 0 0 0 17 0 0 0 0 0 0
/proc/1569/statm: 204496 177325 164 584 0 203908 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 1135704

[startup+12.7003 s]
/proc/loadavg: 2.68 2.22 2.07 3/181 1569
/proc/meminfo: memFree=23125096/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=299424 CPUtime=3.16 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 38325 0 0 0 285 31 0 0 20 0 1 0 272592173 306610176 74186 33554432000 4194304 5992684 140735025732304 140735025726752 5175646 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 1 0 0
/proc/1562/statm: 74856 74186 167 440 0 74412 0
[pid=1567] ppid=1562 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1567/stat : 1567 (cp2_pre.sh) S 1562 1561 339 0 -1 4202496 610 0 0 0 0 0 0 0 20 0 1 0 272592492 9367552 277 33554432000 4194304 5064252 140733710505600 140733710504304 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/1567/statm: 2287 277 234 213 0 72 0
[pid=1569] ppid=1567 vsize=1079196 CPUtime=9.49 cores=0,2,4,6
/proc/1569/stat : 1569 (coprocessor) R 1567 1561 339 0 -1 4202496 88520 0 0 0 920 29 0 0 20 0 1 0 272592492 1105096704 264985 33554432000 4194304 6586260 140735757834080 140735757829448 5599522 0 0 4096 8404994 0 0 0 17 0 0 0 0 0 0
/proc/1569/statm: 269799 264985 189 584 0 269211 0
Current children cumulated CPU time (s) 12.65
Current children cumulated vsize (KiB) 1396916

[startup+25.5003 s]
/proc/loadavg: 2.60 2.22 2.08 3/181 1569
/proc/meminfo: memFree=22891556/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=299424 CPUtime=3.16 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 38325 0 0 0 285 31 0 0 20 0 1 0 272592173 306610176 74186 33554432000 4194304 5992684 140735025732304 140735025726752 5175646 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 1 0 0
/proc/1562/statm: 74856 74186 167 440 0 74412 0
[pid=1567] ppid=1562 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1567/stat : 1567 (cp2_pre.sh) S 1562 1561 339 0 -1 4202496 610 0 0 0 0 0 0 0 20 0 1 0 272592492 9367552 277 33554432000 4194304 5064252 140733710505600 140733710504304 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/1567/statm: 2287 277 234 213 0 72 0
[pid=1569] ppid=1567 vsize=1094508 CPUtime=22.29 cores=0,2,4,6
/proc/1569/stat : 1569 (coprocessor) R 1567 1561 339 0 -1 4202496 92336 0 0 0 2199 30 0 0 20 0 1 0 272592492 1120776192 268801 33554432000 4194304 6586260 140735757834080 140735757829624 5599454 0 0 4096 8404994 0 0 0 17 0 0 0 0 0 0
/proc/1569/statm: 273627 268801 189 584 0 273039 0
Current children cumulated CPU time (s) 25.45
Current children cumulated vsize (KiB) 1412228

[startup+51.1003 s]
/proc/loadavg: 2.40 2.20 2.08 3/180 1574
/proc/meminfo: memFree=22519776/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=336032 CPUtime=47.11 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 47257 166718 0 0 614 510 3489 98 20 0 1 0 272592173 344096768 83472 33554432000 4194304 5992684 140735025732304 140735025717208 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 12 0 0
/proc/1562/statm: 84008 83472 187 440 0 83564 0
[pid=1574] ppid=1562 vsize=887560 CPUtime=3.86 cores=0,2,4,6
/proc/1574/stat : 1574 (glucosInc) R 1562 1561 339 0 -1 4202496 107038 0 0 0 356 30 0 0 20 0 1 0 272596896 908861440 189210 33554432000 4194304 5654031 140735600611712 140735600609496 4232821 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/1574/statm: 221890 189210 140 357 0 221530 0
Current children cumulated CPU time (s) 50.97
Current children cumulated vsize (KiB) 1232740

[startup+102.307 s]
/proc/loadavg: 2.17 2.17 2.07 3/180 1574
/proc/meminfo: memFree=21561324/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=336032 CPUtime=47.11 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 47257 166718 0 0 614 510 3489 98 20 0 1 0 272592173 344096768 83472 33554432000 4194304 5992684 140735025732304 140735025717208 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 12 0 0
/proc/1562/statm: 84008 83472 187 440 0 83564 0
[pid=1574] ppid=1562 vsize=908464 CPUtime=55.05 cores=0,2,4,6
/proc/1574/stat : 1574 (glucosInc) R 1562 1561 339 0 -1 4202496 112678 0 0 0 5470 35 0 0 20 0 1 0 272596896 930267136 191616 33554432000 4194304 5654031 140735600611712 140735600609496 4232421 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1574/statm: 227116 191616 142 357 0 226756 0
Current children cumulated CPU time (s) 102.16
Current children cumulated vsize (KiB) 1253644

[startup+162.3 s]
/proc/loadavg: 2.10 2.15 2.07 3/181 1577
/proc/meminfo: memFree=20476648/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=336032 CPUtime=47.11 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 47257 166718 0 0 614 510 3489 98 20 0 1 0 272592173 344096768 83472 33554432000 4194304 5992684 140735025732304 140735025717208 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 12 0 0
/proc/1562/statm: 84008 83472 187 440 0 83564 0
[pid=1574] ppid=1562 vsize=917436 CPUtime=115.04 cores=0,2,4,6
/proc/1574/stat : 1574 (glucosInc) R 1562 1561 339 0 -1 4202496 115393 0 0 0 11465 39 0 0 20 0 1 0 272596896 939454464 191378 33554432000 4194304 5654031 140735600611712 140735600609400 4215009 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1574/statm: 229359 191378 142 357 0 228999 0
Current children cumulated CPU time (s) 162.15
Current children cumulated vsize (KiB) 1262616

[startup+222.3 s]
/proc/loadavg: 2.07 2.13 2.07 3/180 1577
/proc/meminfo: memFree=19306056/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=336032 CPUtime=47.11 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 47257 166718 0 0 614 510 3489 98 20 0 1 0 272592173 344096768 83472 33554432000 4194304 5992684 140735025732304 140735025717208 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 12 0 0
/proc/1562/statm: 84008 83472 187 440 0 83564 0
[pid=1574] ppid=1562 vsize=923764 CPUtime=175.03 cores=0,2,4,6
/proc/1574/stat : 1574 (glucosInc) R 1562 1561 339 0 -1 4202496 117061 0 0 0 17462 41 0 0 20 0 1 0 272596896 945934336 202751 33554432000 4194304 5654031 140735600611712 140735600599528 4233306 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1574/statm: 230941 202751 142 357 0 230581 0
Current children cumulated CPU time (s) 222.14

################
# More data... #
################

/proc/meminfo: memFree=18713556/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=336032 CPUtime=47.11 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 47257 166718 0 0 614 510 3489 98 20 0 1 0 272592173 344096768 83472 33554432000 4194304 5992684 140735025732304 140735025717208 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 12 0 0
/proc/1562/statm: 84008 83472 187 440 0 83564 0
[pid=1574] ppid=1562 vsize=1132548 CPUtime=1314.81 cores=0,2,4,6
/proc/1574/stat : 1574 (glucosInc) R 1562 1561 339 0 -1 4202496 143656 0 0 0 131371 110 0 0 20 0 1 0 272596896 1159729152 231523 33554432000 4194304 5654031 140735600611712 140735600599528 4214603 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1574/statm: 283137 231523 142 357 0 282777 0
Current children cumulated CPU time (s) 1361.92
Current children cumulated vsize (KiB) 1477728

[startup+1422.31 s]
/proc/loadavg: 2.01 2.03 2.04 3/181 1614
/proc/meminfo: memFree=18692940/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=336032 CPUtime=47.11 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 47257 166718 0 0 614 510 3489 98 20 0 1 0 272592173 344096768 83472 33554432000 4194304 5992684 140735025732304 140735025717208 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 12 0 0
/proc/1562/statm: 84008 83472 187 440 0 83564 0
[pid=1574] ppid=1562 vsize=1132548 CPUtime=1374.8 cores=0,2,4,6
/proc/1574/stat : 1574 (glucosInc) R 1562 1561 339 0 -1 4202496 143665 0 0 0 137370 110 0 0 20 0 1 0 272596896 1159729152 236131 33554432000 4194304 5654031 140735600611712 140735600599528 4233176 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1574/statm: 283137 236131 142 357 0 282777 0
Current children cumulated CPU time (s) 1421.91
Current children cumulated vsize (KiB) 1477728

[startup+1482.3 s]
/proc/loadavg: 2.00 2.03 2.03 3/180 1614
/proc/meminfo: memFree=18731396/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=336032 CPUtime=47.11 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 47257 166718 0 0 614 510 3489 98 20 0 1 0 272592173 344096768 83472 33554432000 4194304 5992684 140735025732304 140735025717208 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 12 0 0
/proc/1562/statm: 84008 83472 187 440 0 83564 0
[pid=1574] ppid=1562 vsize=1003344 CPUtime=1434.79 cores=0,2,4,6
/proc/1574/stat : 1574 (glucosInc) R 1562 1561 339 0 -1 4202496 144844 0 0 0 143363 116 0 0 20 0 1 0 272596896 1027424256 226740 33554432000 4194304 5654031 140735600611712 140735600599528 4214957 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1574/statm: 250836 226740 142 357 0 250476 0
Current children cumulated CPU time (s) 1481.9
Current children cumulated vsize (KiB) 1348524

[startup+1542.3 s]
/proc/loadavg: 2.00 2.02 2.03 3/180 1615
/proc/meminfo: memFree=18694908/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=336032 CPUtime=47.11 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 47257 166718 0 0 614 510 3489 98 20 0 1 0 272592173 344096768 83472 33554432000 4194304 5992684 140735025732304 140735025717208 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 12 0 0
/proc/1562/statm: 84008 83472 187 440 0 83564 0
[pid=1574] ppid=1562 vsize=1137296 CPUtime=1494.78 cores=0,2,4,6
/proc/1574/stat : 1574 (glucosInc) R 1562 1561 339 0 -1 4202496 145723 0 0 0 149360 118 0 0 20 0 1 0 272596896 1164591104 235786 33554432000 4194304 5654031 140735600611712 140735600599528 4215168 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1574/statm: 284324 235786 142 357 0 283964 0
Current children cumulated CPU time (s) 1541.89
Current children cumulated vsize (KiB) 1482476

[startup+1602.3 s]
/proc/loadavg: 1.93 2.00 2.02 3/180 1661
/proc/meminfo: memFree=27016276/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=336032 CPUtime=47.11 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 47257 166718 0 0 614 510 3489 98 20 0 1 0 272592173 344096768 83472 33554432000 4194304 5992684 140735025732304 140735025717208 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 12 0 0
/proc/1562/statm: 84008 83472 187 440 0 83564 0
[pid=1574] ppid=1562 vsize=1006280 CPUtime=1554.77 cores=0,2,4,6
/proc/1574/stat : 1574 (glucosInc) R 1562 1561 339 0 -1 4202496 146409 0 0 0 155354 123 0 0 20 0 1 0 272596896 1030430720 225386 33554432000 4194304 5654031 140735600611712 140735600599528 4232939 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1574/statm: 251570 225386 142 357 0 251210 0
Current children cumulated CPU time (s) 1601.88
Current children cumulated vsize (KiB) 1351460

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/180 1661
/proc/meminfo: memFree=25861680/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=336032 CPUtime=47.11 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 47257 166718 0 0 614 510 3489 98 20 0 1 0 272592173 344096768 83472 33554432000 4194304 5992684 140735025732304 140735025717208 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 12 0 0
/proc/1562/statm: 84008 83472 187 440 0 83564 0
[pid=1574] ppid=1562 vsize=1140096 CPUtime=1614.76 cores=0,2,4,6
/proc/1574/stat : 1574 (glucosInc) R 1562 1561 339 0 -1 4202496 147291 0 0 0 161351 125 0 0 20 0 1 0 272596896 1167458304 230854 33554432000 4194304 5654031 140735600611712 140735600599528 4215088 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1574/statm: 285024 230854 142 357 0 284664 0
Current children cumulated CPU time (s) 1661.87
Current children cumulated vsize (KiB) 1485276

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.01 3/180 1661
/proc/meminfo: memFree=24737400/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=336032 CPUtime=47.11 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 47257 166718 0 0 614 510 3489 98 20 0 1 0 272592173 344096768 83472 33554432000 4194304 5992684 140735025732304 140735025717208 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 12 0 0
/proc/1562/statm: 84008 83472 187 440 0 83564 0
[pid=1574] ppid=1562 vsize=1143580 CPUtime=1674.75 cores=0,2,4,6
/proc/1574/stat : 1574 (glucosInc) R 1562 1561 339 0 -1 4202496 148209 0 0 0 167349 126 0 0 20 0 1 0 272596896 1171025920 237393 33554432000 4194304 5654031 140735600611712 140735600599528 4232775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1574/statm: 285895 237393 142 357 0 285535 0
Current children cumulated CPU time (s) 1721.86
Current children cumulated vsize (KiB) 1488760

[startup+1782.3 s]
/proc/loadavg: 2.10 2.03 2.01 3/180 1661
/proc/meminfo: memFree=23666404/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=336032 CPUtime=47.11 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 47257 166718 0 0 614 510 3489 98 20 0 1 0 272592173 344096768 83472 33554432000 4194304 5992684 140735025732304 140735025717208 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 12 0 0
/proc/1562/statm: 84008 83472 187 440 0 83564 0
[pid=1574] ppid=1562 vsize=1013136 CPUtime=1734.74 cores=0,2,4,6
/proc/1574/stat : 1574 (glucosInc) R 1562 1561 339 0 -1 4202496 149041 0 0 0 173344 130 0 0 20 0 1 0 272596896 1037451264 226114 33554432000 4194304 5654031 140735600611712 140735600599528 4232821 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1574/statm: 253284 226114 142 357 0 252924 0
Current children cumulated CPU time (s) 1781.85
Current children cumulated vsize (KiB) 1358316



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 2.07 2.03 2.01 3/180 1662
/proc/meminfo: memFree=23304840/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=336032 CPUtime=47.11 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 47257 166718 0 0 614 510 3489 98 20 0 1 0 272592173 344096768 83472 33554432000 4194304 5992684 140735025732304 140735025717208 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 12 0 0
/proc/1562/statm: 84008 83472 187 440 0 83564 0
[pid=1574] ppid=1562 vsize=1013708 CPUtime=1752.94 cores=0,2,4,6
/proc/1574/stat : 1574 (glucosInc) R 1562 1561 339 0 -1 4202496 149187 0 0 0 175164 130 0 0 20 0 1 0 272596896 1038036992 228815 33554432000 4194304 5654031 140735600611712 140735600609496 4215112 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1574/statm: 253427 228815 142 357 0 253067 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 1358888

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1800.5 s]
/proc/loadavg: 2.07 2.03 2.01 3/180 1662
/proc/meminfo: memFree=23304840/32873648 swapFree=6844/6844
[pid=1561] ppid=1559 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1561/stat : 1561 (npSolver-pbo-I.) S 1559 1561 339 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 272592173 9367552 275 33554432000 4194304 5064252 140735073520176 140735073519088 271787386446 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1561/statm: 2287 275 233 213 0 72 0
[pid=1562] ppid=1561 vsize=336032 CPUtime=47.11 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo) S 1561 1561 339 0 -1 4202496 47257 166718 0 0 614 510 3489 98 20 0 1 0 272592173 344096768 83472 33554432000 4194304 5992684 140735025732304 140735025717208 5179600 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 12 0 0
/proc/1562/statm: 84008 83472 187 440 0 83564 0
[pid=1574] ppid=1562 vsize=1013708 CPUtime=1752.94 cores=0,2,4,6
/proc/1574/stat : 1574 (glucosInc) R 1562 1561 339 0 -1 4202496 149187 0 0 0 175164 130 0 0 20 0 1 0 272596896 1038036992 228815 33554432000 4194304 5654031 140735600611712 140735600609496 4215112 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1574/statm: 253427 228815 142 357 0 253067 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 1358888

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1561 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.001998
# while last known CPU time is 1800.05
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.52
CPU time (s): 1800.05
CPU user time (s): 1792.67
CPU system time (s): 7.38
CPU usage (%): 99.9741
Max. virtual memory (cumulated for all children) (KiB): 1701920

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.000999
maximum resident set size= 1100
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 358
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 1

runsolver used 3.76143 second user time and 10.3144 second system time

The end

Launcher Data 

Begin job on node115 at 2012-05-26 22:37:34
IDJOB=3699100
IDBENCH=2365
IDSOLVER=2276
FILE ID=node115/3699100-1338064654
RUNJOBID= node115-1338051787-355
PBS_JOBID= 14624382
Free space on /tmp= 71568 MiB

SOLVER NAME= npSolver inc
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/pub/unibo/normalized-mps-v2-20-10-sp98ic.opb
COMMAND LINE= DIR/npSolver-pbo-I.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3699100-1338064654/watcher-3699100-1338064654 -o /tmp/evaluation-result-3699100-1338064654/solver-3699100-1338064654 -C 1800 -W 1900 -M 15500  HOME/npSolver-pbo-I.sh HOME/instance-3699100-1338064654.opb 818827512 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 433b539d7c7c8ff139e6ea6f7acee573
RANDOM SEED=818827512

node115.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.462
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.462
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.462
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.462
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.462
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.462
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.462
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.462
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        24830844 kB
Buffers:          254244 kB
Cached:          3133124 kB
SwapCached:            0 kB
Active:          4887720 kB
Inactive:        2359932 kB
Active(anon):    3863024 kB
Inactive(anon):        0 kB
Active(file):    1024696 kB
Inactive(file):  2359932 kB
Unevictable:        6844 kB
Mlocked:            6844 kB
SwapTotal:      67108856 kB
SwapFree:       67108856 kB
Dirty:             15232 kB
Writeback:            16 kB
AnonPages:       3871300 kB
Mapped:            14888 kB
Shmem:               200 kB
Slab:             643684 kB
SReclaimable:      87348 kB
SUnreclaim:       556336 kB
KernelStack:        1472 kB
PageTables:        11488 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:    4321680 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:   3850240 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71252 MiB
End job on node115 at 2012-05-26 23:07:37