Trace number 3748310

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
npSolver inc (fixed)? (TO) 1800.07 1805.4

General information on the benchmark

Name/OPT-BIGINT-LIN/aries-da_nrp/
normalized-aries-da_network_2000_5__647_1792__32.opb
MD5SUM88a1b10031770f0260ca582c16661bcb
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark121608
Best CPU time to get the best result obtained on this benchmark1801.06
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables321998
Total number of constraints12000
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)10002
Number of constraints which are nor clauses,nor cardinality constraints1998
Minimum length of a constraint32
Maximum length of a constraint1409
Number of terms in the objective function 320000
Biggest coefficient in the objective function 130539
Number of bits for the biggest coefficient in the objective function 17
Sum of the numbers in the objective function 11088799392
Number of bits of the sum of numbers in the objective function 34
Biggest number in a constraint 130539
Number of bits of the biggest number in a constraint 17
Biggest sum of numbers in a constraint 11088799392
Number of bits of the biggest sum of numbers34
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

38.22/38.39	c run inc solver
38.22/38.39	c [INC SYSTEM] run initial solver
38.22/38.39	c [INC SYSTEM] preprocess with white file
159.67/164.86	c [INC SYSTEM] finished preprocessing in 126 s
159.67/164.86	c [INC SYSTEM] execute solver

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3748310-1339158273/watcher-3748310-1339158273 -o /tmp/evaluation-result-3748310-1339158273/solver-3748310-1339158273 -C 1800 -W 1900 -M 15500 HOME/npSolver-pbo-I.sh HOME/instance-3748310-1339158273.opb 1269687203 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.08 1.68 1.88 5/181 15651
/proc/meminfo: memFree=30672884/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0

[startup+0.048584 s]
/proc/loadavg: 1.08 1.68 1.88 5/181 15651
/proc/meminfo: memFree=30672884/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100254 s]
/proc/loadavg: 1.08 1.68 1.88 5/181 15651
/proc/meminfo: memFree=30672884/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300263 s]
/proc/loadavg: 1.08 1.68 1.88 5/181 15651
/proc/meminfo: memFree=30672884/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700237 s]
/proc/loadavg: 1.08 1.68 1.88 5/181 15651
/proc/meminfo: memFree=30672884/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50028 s]
/proc/loadavg: 1.08 1.68 1.88 3/182 15655
/proc/meminfo: memFree=30605404/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=157636 CPUtime=1.49 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) R 15651 15651 11784 0 -1 4202496 21351 0 0 0 144 5 0 0 20 0 1 0 25794310 161419264 32649 33554432000 4194304 6004724 140737361562720 140737361558744 4534715 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15652/statm: 39409 32649 154 442 0 38963 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 166784

[startup+3.10027 s]
/proc/loadavg: 1.08 1.68 1.88 3/181 15656
/proc/meminfo: memFree=30489892/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=354244 CPUtime=3.09 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) R 15651 15651 11784 0 -1 4202496 22527 0 0 0 300 9 0 0 20 0 1 0 25794310 362745856 62345 33554432000 4194304 6004724 140737361562720 140737361557672 4534738 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15652/statm: 88561 62345 154 442 0 88115 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 363392

[startup+6.3003 s]
/proc/loadavg: 1.23 1.70 1.88 3/182 15658
/proc/meminfo: memFree=29956596/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=616388 CPUtime=6.28 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) R 15651 15651 11784 0 -1 4202496 23287 0 0 0 613 15 0 0 20 0 1 0 25794310 631181312 124297 33554432000 4194304 6004724 140737361562720 140737361557320 4536263 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15652/statm: 154097 124297 154 442 0 153651 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 625536

[startup+12.7003 s]
/proc/loadavg: 1.29 1.70 1.89 3/182 15658
/proc/meminfo: memFree=29444808/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=1140676 CPUtime=12.69 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) R 15651 15651 11784 0 -1 4202496 24296 0 0 0 1240 29 0 0 20 0 1 0 25794310 1168052224 248201 33554432000 4194304 6004724 140737361562720 140737361557320 4617922 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15652/statm: 285169 248201 154 442 0 284723 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 1149824

[startup+25.5003 s]
/proc/loadavg: 1.52 1.73 1.89 3/182 15658
/proc/meminfo: memFree=28418640/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=2189252 CPUtime=25.49 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) R 15651 15651 11784 0 -1 4202496 25803 0 0 0 2491 58 0 0 20 0 1 0 25794310 2241794048 496009 33554432000 4194304 6004724 140737361562720 140737361557320 4582511 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15652/statm: 547313 496009 154 442 0 546867 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 2198400

[startup+51.1004 s]
/proc/loadavg: 1.84 1.79 1.91 3/184 15660
/proc/meminfo: memFree=23884416/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=38.81 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) S 15651 15651 11784 0 -1 4202496 29195 0 0 0 3374 507 0 0 20 0 1 0 25794310 4373274624 656463 33554432000 4194304 6004724 140737361562720 140737361557184 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 6 0 0
/proc/15652/statm: 1067694 656463 163 442 0 1067248 0
[pid=15659] ppid=15652 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15659/stat : 15659 (cp2_pre.sh) S 15652 15651 11784 0 -1 4202496 606 0 0 0 0 0 0 0 20 0 1 0 25798200 9367552 276 33554432000 4194304 5064252 140737476799280 140737476797984 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/15659/statm: 2287 276 234 213 0 72 0
[pid=15660] ppid=15659 vsize=1214132 CPUtime=12.18 cores=0,2,4,6
/proc/15660/stat : 15660 (coprocessor) R 15659 15651 11784 0 -1 4202496 20370 0 0 0 1172 46 0 0 20 0 1 0 25798200 1243271168 299997 33554432000 4194304 6586260 140733273402192 140733273398952 5732400 0 0 4096 8404994 0 0 0 17 4 0 0 0 0 0
/proc/15660/statm: 303533 299997 138 584 0 302945 0
Current children cumulated CPU time (s) 50.99
Current children cumulated vsize (KiB) 5503204

[startup+102.307 s]
/proc/loadavg: 2.65 2.02 1.98 3/183 15660
/proc/meminfo: memFree=20552308/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=38.81 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) S 15651 15651 11784 0 -1 4202496 29195 0 0 0 3374 507 0 0 20 0 1 0 25794310 4373274624 656463 33554432000 4194304 6004724 140737361562720 140737361557184 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 6 0 0
/proc/15652/statm: 1067694 656463 163 442 0 1067248 0
[pid=15659] ppid=15652 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15659/stat : 15659 (cp2_pre.sh) S 15652 15651 11784 0 -1 4202496 606 0 0 0 0 0 0 0 20 0 1 0 25798200 9367552 276 33554432000 4194304 5064252 140737476799280 140737476797984 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/15659/statm: 2287 276 234 213 0 72 0
[pid=15660] ppid=15659 vsize=4543784 CPUtime=61.8 cores=0,2,4,6
/proc/15660/stat : 15660 (coprocessor) D 15659 15651 11784 0 -1 4202496 30103 0 0 0 5888 292 0 0 20 0 1 0 25798200 4652834816 935754 33554432000 4194304 6586260 140733273402192 140733273397944 5732496 0 0 4096 8404994 18446744071580543392 0 0 17 4 0 0 154 0 0
/proc/15660/statm: 1135946 935754 158 584 0 1135358 0
Current children cumulated CPU time (s) 100.61
Current children cumulated vsize (KiB) 8832856

[startup+162.3 s]
/proc/loadavg: 2.88 2.20 2.04 3/184 15661
/proc/meminfo: memFree=18967700/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=38.81 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) S 15651 15651 11784 0 -1 4202496 29195 0 0 0 3374 507 0 0 20 0 1 0 25794310 4373274624 656463 33554432000 4194304 6004724 140737361562720 140737361557184 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 6 0 0
/proc/15652/statm: 1067694 656463 163 442 0 1067248 0
[pid=15659] ppid=15652 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15659/stat : 15659 (cp2_pre.sh) S 15652 15651 11784 0 -1 4202496 606 0 0 0 0 0 0 0 20 0 1 0 25798200 9367552 276 33554432000 4194304 5064252 140737476799280 140737476797984 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/15659/statm: 2287 276 234 213 0 72 0
[pid=15660] ppid=15659 vsize=4543784 CPUtime=118.89 cores=0,2,4,6
/proc/15660/stat : 15660 (coprocessor) R 15659 15651 11784 0 -1 4202496 30103 0 0 0 11285 604 0 0 20 0 1 0 25798200 4652834816 935754 33554432000 4194304 6586260 140733273402192 140733273397944 5732496 0 0 4096 8404994 0 0 0 17 4 0 0 448 0 0
/proc/15660/statm: 1135946 935754 158 584 0 1135358 0
Current children cumulated CPU time (s) 157.7
Current children cumulated vsize (KiB) 8832856

[startup+222.3 s]
/proc/loadavg: 2.35 2.18 2.04 3/183 15664
/proc/meminfo: memFree=20066204/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=160.1 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) S 15651 15651 11784 0 -1 4202496 29213 31003 0 0 3374 508 11469 659 20 0 1 0 25794310 4373274624 656467 33554432000 4194304 6004724 140737361562720 140737361549000 5190736 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 6 0 0
/proc/15652/statm: 1067694 656467 167 442 0 1067248 0
[pid=15663] ppid=15652 vsize=6528012 CPUtime=57.4 cores=0,2,4,6
/proc/15663/stat : 15663 (glucosInc) R 15652 15651 11784 0 -1 4202496 560989 0 0 0 5546 194 0 0 20 0 1 0 25810797 6684684288 1289254 33554432000 4194304 5654031 140737347886464 140737347874280 4214475 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/15663/statm: 1632003 1289254 141 357 0 1631643 0
Current children cumulated CPU time (s) 217.5
Current children cumulated vsize (KiB) 10807936

[startup+282.3 s]
/proc/loadavg: 2.13 2.14 2.03 3/183 15664
/proc/meminfo: memFree=20027428/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=160.1 cores=0,2,4,6

################
# More data... #
################

/proc/meminfo: memFree=19680720/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=160.1 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) S 15651 15651 11784 0 -1 4202496 29213 31003 0 0 3374 508 11469 659 20 0 1 0 25794310 4373274624 656467 33554432000 4194304 6004724 140737361562720 140737361549000 5190736 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 6 0 0
/proc/15652/statm: 1067694 656467 167 442 0 1067248 0
[pid=15663] ppid=15652 vsize=6768616 CPUtime=1197.23 cores=0,2,4,6
/proc/15663/stat : 15663 (glucosInc) R 15652 15651 11784 0 -1 4202496 731504 0 0 0 119479 244 0 0 20 0 1 0 25810797 6931062784 1376879 33554432000 4194304 5654031 140737347886464 140737347874280 4232707 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15663/statm: 1692154 1376879 141 357 0 1691794 0
Current children cumulated CPU time (s) 1357.33
Current children cumulated vsize (KiB) 11048540

[startup+1422.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 15674
/proc/meminfo: memFree=19661980/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=160.1 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) S 15651 15651 11784 0 -1 4202496 29213 31003 0 0 3374 508 11469 659 20 0 1 0 25794310 4373274624 656467 33554432000 4194304 6004724 140737361562720 140737361549000 5190736 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 6 0 0
/proc/15652/statm: 1067694 656467 167 442 0 1067248 0
[pid=15663] ppid=15652 vsize=6779308 CPUtime=1257.22 cores=0,2,4,6
/proc/15663/stat : 15663 (glucosInc) R 15652 15651 11784 0 -1 4202496 738072 0 0 0 125477 245 0 0 20 0 1 0 25810797 6942011392 1380619 33554432000 4194304 5654031 140737347886464 140737347884248 4232495 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15663/statm: 1694827 1380619 141 357 0 1694467 0
Current children cumulated CPU time (s) 1417.32
Current children cumulated vsize (KiB) 11059232

[startup+1482.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/183 15675
/proc/meminfo: memFree=19652148/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=160.1 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) S 15651 15651 11784 0 -1 4202496 29213 31003 0 0 3374 508 11469 659 20 0 1 0 25794310 4373274624 656467 33554432000 4194304 6004724 140737361562720 140737361549000 5190736 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 6 0 0
/proc/15652/statm: 1067694 656467 167 442 0 1067248 0
[pid=15663] ppid=15652 vsize=6784732 CPUtime=1317.2 cores=0,2,4,6
/proc/15663/stat : 15663 (glucosInc) R 15652 15651 11784 0 -1 4202496 747187 0 0 0 131472 248 0 0 20 0 1 0 25810797 6947565568 1382520 33554432000 4194304 5654031 140737347886464 140737347884248 4232453 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15663/statm: 1696183 1382520 141 357 0 1695823 0
Current children cumulated CPU time (s) 1477.3
Current children cumulated vsize (KiB) 11064656

[startup+1542.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/184 15678
/proc/meminfo: memFree=19668612/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=160.1 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) S 15651 15651 11784 0 -1 4202496 29213 31003 0 0 3374 508 11469 659 20 0 1 0 25794310 4373274624 656467 33554432000 4194304 6004724 140737361562720 140737361549000 5190736 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 6 0 0
/proc/15652/statm: 1067694 656467 167 442 0 1067248 0
[pid=15663] ppid=15652 vsize=6789512 CPUtime=1377.2 cores=0,2,4,6
/proc/15663/stat : 15663 (glucosInc) R 15652 15651 11784 0 -1 4202496 751940 0 0 0 137470 250 0 0 20 0 1 0 25810797 6952460288 1383423 33554432000 4194304 5654031 140737347886464 140737347874280 4232775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15663/statm: 1697378 1383423 141 357 0 1697018 0
Current children cumulated CPU time (s) 1537.3
Current children cumulated vsize (KiB) 11069436

[startup+1602.3 s]
/proc/loadavg: 2.08 2.02 2.00 3/183 15678
/proc/meminfo: memFree=19648328/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=160.1 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) S 15651 15651 11784 0 -1 4202496 29213 31003 0 0 3374 508 11469 659 20 0 1 0 25794310 4373274624 656467 33554432000 4194304 6004724 140737361562720 140737361549000 5190736 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 6 0 0
/proc/15652/statm: 1067694 656467 167 442 0 1067248 0
[pid=15663] ppid=15652 vsize=6799544 CPUtime=1437.19 cores=0,2,4,6
/proc/15663/stat : 15663 (glucosInc) R 15652 15651 11784 0 -1 4202496 758394 0 0 0 143467 252 0 0 20 0 1 0 25810797 6962733056 1387049 33554432000 4194304 5654031 140737347886464 140737347884248 4232767 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15663/statm: 1699886 1387049 141 357 0 1699526 0
Current children cumulated CPU time (s) 1597.29
Current children cumulated vsize (KiB) 11079468

[startup+1662.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/183 15678
/proc/meminfo: memFree=19622632/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=160.1 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) S 15651 15651 11784 0 -1 4202496 29213 31003 0 0 3374 508 11469 659 20 0 1 0 25794310 4373274624 656467 33554432000 4194304 6004724 140737361562720 140737361549000 5190736 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 6 0 0
/proc/15652/statm: 1067694 656467 167 442 0 1067248 0
[pid=15663] ppid=15652 vsize=6810632 CPUtime=1497.18 cores=0,2,4,6
/proc/15663/stat : 15663 (glucosInc) R 15652 15651 11784 0 -1 4202496 765295 0 0 0 149463 255 0 0 20 0 1 0 25810797 6974087168 1392144 33554432000 4194304 5654031 140737347886464 140737347884248 4219892 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15663/statm: 1702658 1392144 141 357 0 1702298 0
Current children cumulated CPU time (s) 1657.28
Current children cumulated vsize (KiB) 11090556

[startup+1722.3 s]
/proc/loadavg: 2.01 2.00 2.00 3/183 15678
/proc/meminfo: memFree=19606164/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=160.1 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) S 15651 15651 11784 0 -1 4202496 29213 31003 0 0 3374 508 11469 659 20 0 1 0 25794310 4373274624 656467 33554432000 4194304 6004724 140737361562720 140737361549000 5190736 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 6 0 0
/proc/15652/statm: 1067694 656467 167 442 0 1067248 0
[pid=15663] ppid=15652 vsize=6816356 CPUtime=1557.17 cores=0,2,4,6
/proc/15663/stat : 15663 (glucosInc) R 15652 15651 11784 0 -1 4202496 774495 0 0 0 155460 257 0 0 20 0 1 0 25810797 6979948544 1394134 33554432000 4194304 5654031 140737347886464 140737347884248 4232880 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15663/statm: 1704089 1394134 141 357 0 1703729 0
Current children cumulated CPU time (s) 1717.27
Current children cumulated vsize (KiB) 11096280

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 15679
/proc/meminfo: memFree=19595108/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=160.1 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) S 15651 15651 11784 0 -1 4202496 29213 31003 0 0 3374 508 11469 659 20 0 1 0 25794310 4373274624 656467 33554432000 4194304 6004724 140737361562720 140737361549000 5190736 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 6 0 0
/proc/15652/statm: 1067694 656467 167 442 0 1067248 0
[pid=15663] ppid=15652 vsize=6823140 CPUtime=1617.16 cores=0,2,4,6
/proc/15663/stat : 15663 (glucosInc) R 15652 15651 11784 0 -1 4202496 780069 0 0 0 161457 259 0 0 20 0 1 0 25810797 6986895360 1396348 33554432000 4194304 5654031 140737347886464 140737347884248 4232821 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15663/statm: 1705785 1396348 141 357 0 1705425 0
Current children cumulated CPU time (s) 1777.26
Current children cumulated vsize (KiB) 11103064



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1805.11 s]
/proc/loadavg: 2.00 2.00 2.00 4/182 15719
/proc/meminfo: memFree=19628588/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=160.1 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) S 15651 15651 11784 0 -1 4202496 29213 31003 0 0 3374 508 11469 659 20 0 1 0 25794310 4373274624 656467 33554432000 4194304 6004724 140737361562720 140737361549000 5190736 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 6 0 0
/proc/15652/statm: 1067694 656467 167 442 0 1067248 0
[pid=15663] ppid=15652 vsize=6823932 CPUtime=1639.97 cores=0,2,4,6
/proc/15663/stat : 15663 (glucosInc) R 15652 15651 11784 0 -1 4202496 780268 0 0 0 163738 259 0 0 20 0 1 0 25810797 6987706368 1396547 33554432000 4194304 5654031 140737347886464 140737347874280 4232707 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15663/statm: 1705983 1396547 141 357 0 1705623 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 11103856

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1805.11 s]
/proc/loadavg: 2.00 2.00 2.00 4/182 15719
/proc/meminfo: memFree=19628588/32873844 swapFree=7124/7124
[pid=15651] ppid=15649 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/15651/stat : 15651 (npSolver-pbo-I.) S 15649 15651 11784 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 25794310 9367552 275 33554432000 4194304 5064252 140733990480576 140733990479488 215143310926 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/15651/statm: 2287 275 233 213 0 72 0
[pid=15652] ppid=15651 vsize=4270776 CPUtime=160.1 cores=0,2,4,6
/proc/15652/stat : 15652 (npSolver-pbo) S 15651 15651 11784 0 -1 4202496 29213 31003 0 0 3374 508 11469 659 20 0 1 0 25794310 4373274624 656467 33554432000 4194304 6004724 140737361562720 140737361549000 5190736 0 0 4096 0 18446744071580380219 0 0 17 2 0 0 6 0 0
/proc/15652/statm: 1067694 656467 167 442 0 1067248 0
[pid=15663] ppid=15652 vsize=6823932 CPUtime=1639.97 cores=0,2,4,6
/proc/15663/stat : 15663 (glucosInc) R 15652 15651 11784 0 -1 4202496 780268 0 0 0 163738 259 0 0 20 0 1 0 25810797 6987706368 1396547 33554432000 4194304 5654031 140737347886464 140737347874280 4232707 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/15663/statm: 1705983 1396547 141 357 0 1705623 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 11103856

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 15651 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1805.4
CPU time (s): 1800.07
CPU user time (s): 1785.81
CPU system time (s): 14.26
CPU usage (%): 99.7048
Max. virtual memory (cumulated for all children) (KiB): 11162052

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0
maximum resident set size= 1100
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 358
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 3

runsolver used 3.82342 second user time and 10.1435 second system time

The end

Launcher Data 

Begin job on node133 at 2012-06-08 14:24:34
IDJOB=3748310
IDBENCH=71904
IDSOLVER=2333
FILE ID=node133/3748310-1339158273
RUNJOBID= node133-1339158273-15620
PBS_JOBID= 14643757
Free space on /tmp= 71180 MiB

SOLVER NAME= npSolver inc
BENCH NAME= PB09/normalized-PB09/OPT-BIGINT-LIN/aries-da_nrp/normalized-aries-da_network_2000_5__647_1792__32.opb
COMMAND LINE= DIR/npSolver-pbo-I.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3748310-1339158273/watcher-3748310-1339158273 -o /tmp/evaluation-result-3748310-1339158273/solver-3748310-1339158273 -C 1800 -W 1900 -M 15500  HOME/npSolver-pbo-I.sh HOME/instance-3748310-1339158273.opb 1269687203 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 88a1b10031770f0260ca582c16661bcb
RANDOM SEED=1269687203

node133.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.139
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.27
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.139
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.139
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.139
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.139
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.139
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.139
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.139
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        30674264 kB
Buffers:          154528 kB
Cached:          1154264 kB
SwapCached:         3996 kB
Active:           329764 kB
Inactive:        1060288 kB
Active(anon):      79416 kB
Inactive(anon):     4988 kB
Active(file):     250348 kB
Inactive(file):  1055300 kB
Unevictable:        7124 kB
Mlocked:            7124 kB
SwapTotal:      67108856 kB
SwapFree:       67100308 kB
Dirty:             37036 kB
Writeback:             8 kB
AnonPages:         67668 kB
Mapped:            10812 kB
Shmem:                 0 kB
Slab:             669264 kB
SReclaimable:     111412 kB
SUnreclaim:       557852 kB
KernelStack:        1448 kB
PageTables:         3856 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     211308 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346376 kB
VmallocChunk:   34341987860 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 68540 MiB
End job on node133 at 2012-06-08 14:54:41