Trace number 3750922

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
npSolver 1.0 (fixed)? (TO) 1800.09 1800.51

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/
manquinho/mds/normalized-mds_500_25_1.opb
MD5SUM93a95f0846e71f0984a2317cf811edef
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark27
Best CPU time to get the best result obtained on this benchmark1796.79
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 35
Optimality of the best value was proved NO
Number of variables500
Total number of constraints500
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints500
Minimum length of a constraint26
Maximum length of a constraint49
Number of terms in the objective function 500
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 500
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 500
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)15716
Sum of products size (including duplicates)31432
Number of different products15716
Sum of products size31432

Solver Data 

0.00/0.04	c run usual solver
0.00/0.37	c model valid
0.00/0.37	c current solution ok
0.00/0.40	o 499
0.00/0.40	c current bound: 249
0.00/0.40	c (debug) using card networks
0.00/0.40	c old isEQ: 249, new EQ is 0
1.13/1.22	c model valid
1.13/1.22	c current solution ok
1.13/1.22	o 48
1.13/1.22	c current bound: 24
1.13/1.22	c (debug) using card networks
1.13/1.22	c old isEQ: 24, new EQ is 0
1800.09/1800.51	c error: unexpected solver exit code
1800.09/1800.51	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3750922-1339129446/watcher-3750922-1339129446 -o /tmp/evaluation-result-3750922-1339129446/solver-3750922-1339129446 -C 1800 -W 1900 -M 15500 HOME/npSolver-pbo.sh HOME/instance-3750922-1339129446.opb 1017958052 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 17205
/proc/meminfo: memFree=31759632/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0

[startup+0.103784 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 17205
/proc/meminfo: memFree=31759632/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.200209 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 17205
/proc/meminfo: memFree=31759632/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300187 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 17205
/proc/meminfo: memFree=31759632/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700242 s]
/proc/loadavg: 2.00 2.00 2.00 3/179 17205
/proc/meminfo: memFree=31759632/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50028 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 17219
/proc/meminfo: memFree=31740924/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
Current children cumulated CPU time (s) 1.2
Current children cumulated vsize (KiB) 15036

[startup+3.10041 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 17226
/proc/meminfo: memFree=31742600/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=15604 CPUtime=1.85 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 3634 0 0 0 185 0 0 0 20 0 1 0 379069808 15978496 2991 33554432000 4194304 5208918 140733563136288 140733563134136 4229748 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 3901 2991 105 248 0 3650 0
Current children cumulated CPU time (s) 3.05
Current children cumulated vsize (KiB) 39788

[startup+6.30037 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 17226
/proc/meminfo: memFree=31728704/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=22720 CPUtime=5.06 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 5774 0 0 0 505 1 0 0 20 0 1 0 379069808 23265280 5269 33554432000 4194304 5208918 140733563136288 140733563134376 4229507 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 5680 5269 105 248 0 5429 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 46904

[startup+12.7004 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 17226
/proc/meminfo: memFree=31660656/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=60320 CPUtime=11.45 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 6298 0 0 0 1144 1 0 0 20 0 1 0 379069808 61767680 11282 33554432000 4194304 5208918 140733563136288 140733563134232 4211534 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 15080 11282 105 248 0 14829 0
Current children cumulated CPU time (s) 12.65
Current children cumulated vsize (KiB) 84504

[startup+25.5005 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 17226
/proc/meminfo: memFree=31683628/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=68336 CPUtime=24.25 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 7999 0 0 0 2423 2 0 0 20 0 1 0 379069808 69976064 14790 33554432000 4194304 5208918 140733563136288 140733563134232 4211397 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 17084 14790 105 248 0 16833 0
Current children cumulated CPU time (s) 25.45
Current children cumulated vsize (KiB) 92520

[startup+51.1005 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 17226
/proc/meminfo: memFree=31607360/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=68336 CPUtime=49.85 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 8865 0 0 0 4981 4 0 0 20 0 1 0 379069808 69976064 16658 33554432000 4194304 5208918 140733563136288 140733563134376 4211553 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 17084 16658 105 248 0 16833 0
Current children cumulated CPU time (s) 51.05
Current children cumulated vsize (KiB) 92520

[startup+102.301 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 17226
/proc/meminfo: memFree=31573932/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=68648 CPUtime=101.05 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 10867 0 0 0 10097 8 0 0 20 0 1 0 379069808 70295552 16736 33554432000 4194304 5208918 140733563136288 140733563134376 4228997 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 17162 16736 105 248 0 16911 0
Current children cumulated CPU time (s) 102.25
Current children cumulated vsize (KiB) 92832

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 17226
/proc/meminfo: memFree=31561192/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=117968 CPUtime=161.03 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 13704 0 0 0 16089 14 0 0 20 0 1 0 379069808 120799232 26711 33554432000 4194304 5208918 140733563136288 140733563134280 4229365 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 29492 26711 105 248 0 29241 0
Current children cumulated CPU time (s) 162.23

################
# More data... #
################

/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 46822 0 0 0 135986 94 0 0 20 0 1 0 379069808 223985664 52969 33554432000 4194304 5208918 140733563136288 140733563134440 4229538 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 54684 52969 105 248 0 54433 0
Current children cumulated CPU time (s) 1362
Current children cumulated vsize (KiB) 242920

[startup+1422.3 s]
/proc/loadavg: 2.03 2.02 2.00 3/183 17237
/proc/meminfo: memFree=31353752/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=218736 CPUtime=1420.77 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 48043 0 0 0 141980 97 0 0 20 0 1 0 379069808 223985664 49897 33554432000 4194304 5208918 140733563136288 140733563134440 4229283 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 54684 49897 105 248 0 54433 0
Current children cumulated CPU time (s) 1421.97
Current children cumulated vsize (KiB) 242920

[startup+1482.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/183 17238
/proc/meminfo: memFree=31214956/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=268824 CPUtime=1480.73 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 48391 0 0 0 147975 98 0 0 20 0 1 0 379069808 275275776 65558 33554432000 4194304 5208918 140733563136288 140733563134440 4229538 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 67206 65558 105 248 0 66955 0
Current children cumulated CPU time (s) 1481.93
Current children cumulated vsize (KiB) 293008

[startup+1542.31 s]
/proc/loadavg: 2.00 2.01 2.00 3/183 17238
/proc/meminfo: memFree=31291204/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=268824 CPUtime=1540.73 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 50137 0 0 0 153972 101 0 0 20 0 1 0 379069808 275275776 58944 33554432000 4194304 5208918 140733563136288 140733563134440 4229365 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 67206 58944 105 248 0 66955 0
Current children cumulated CPU time (s) 1541.93
Current children cumulated vsize (KiB) 293008

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/184 17241
/proc/meminfo: memFree=31402512/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=218736 CPUtime=1600.72 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 51540 0 0 0 159969 103 0 0 20 0 1 0 379069808 223985664 50409 33554432000 4194304 5208918 140733563136288 140733563134440 4229247 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 54684 50409 105 248 0 54433 0
Current children cumulated CPU time (s) 1601.92
Current children cumulated vsize (KiB) 242920

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 17241
/proc/meminfo: memFree=31331744/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=187916 CPUtime=1660.7 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 52558 0 0 0 165965 105 0 0 20 0 1 0 379069808 192425984 44096 33554432000 4194304 5208918 140733563136288 140733563134376 4229365 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 46979 44096 105 248 0 46728 0
Current children cumulated CPU time (s) 1661.9
Current children cumulated vsize (KiB) 212100

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 17241
/proc/meminfo: memFree=31309392/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=268824 CPUtime=1720.7 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 53624 0 0 0 171963 107 0 0 20 0 1 0 379069808 275275776 63552 33554432000 4194304 5208918 140733563136288 140733563134440 4211553 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 67206 63552 105 248 0 66955 0
Current children cumulated CPU time (s) 1721.9
Current children cumulated vsize (KiB) 293008

[startup+1782.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/183 17242
/proc/meminfo: memFree=31340236/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=268824 CPUtime=1780.68 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 54811 0 0 0 177959 109 0 0 20 0 1 0 379069808 275275776 60438 33554432000 4194304 5208918 140733563136288 140733563134440 4229365 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 67206 60438 105 248 0 66955 0
Current children cumulated CPU time (s) 1781.88
Current children cumulated vsize (KiB) 293008



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 2.06 2.01 2.00 3/183 17301
/proc/meminfo: memFree=31516652/32873844 swapFree=7124/7124
[pid=17205] ppid=17203 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17205/stat : 17205 (npSolver-pbo.sh) S 17203 17205 12469 0 -1 4202496 357 0 0 0 0 0 0 0 20 0 1 0 379069685 9367552 274 33554432000 4194304 5064252 140734514643376 140734514642288 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17205/statm: 2287 274 233 213 0 72 0
[pid=17206] ppid=17205 vsize=5888 CPUtime=1.2 cores=0,2,4,6
/proc/17206/stat : 17206 (npSolver-pbo) S 17205 17205 12469 0 -1 4202496 3005 17569 0 0 6 3 98 13 20 0 1 0 379069685 6029312 1048 33554432000 4194304 6004724 140736026978672 140736026971024 5186782 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/17206/statm: 1472 1048 174 442 0 1026 0
[pid=17225] ppid=17206 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/17225/stat : 17225 (satsolver.sh) S 17206 17205 12469 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 379069808 9367552 267 33554432000 4194304 5064252 140734766573536 140734766572448 227141117518 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/17225/statm: 2287 267 226 213 0 72 0
[pid=17226] ppid=17225 vsize=268824 CPUtime=1798.89 cores=0,2,4,6
/proc/17226/stat : 17226 (glucose) R 17225 17205 12469 0 -1 4202496 54821 0 0 0 179779 110 0 0 20 0 1 0 379069808 275275776 65558 33554432000 4194304 5208918 140733563136288 140733563134440 4211553 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/17226/statm: 67206 65558 105 248 0 66955 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 293008

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 17205 and gives
#  childrusage.ru_utime.tv_sec=1
#  childrusage.ru_utime.tv_usec=60838
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=176973
# CPU time returned by wait4() is 1.23781
# while last known CPU time is 1800.09
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.51
CPU time (s): 1800.09
CPU user time (s): 1798.83
CPU system time (s): 1.26
CPU usage (%): 99.9765
Max. virtual memory (cumulated for all children) (KiB): 423716

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1.06084
system time used= 0.176973
maximum resident set size= 31044
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 21552
page faults= 0
swaps= 0
block input operations= 0
block output operations= 7552
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 92
involuntary context switches= 33

runsolver used 6.28104 second user time and 19.885 second system time

The end

Launcher Data 

Begin job on node138 at 2012-06-08 06:24:06
IDJOB=3750922
IDBENCH=48112
IDSOLVER=2334
FILE ID=node138/3750922-1339129446
RUNJOBID= node138-1339110951-13765
PBS_JOBID= 14643715
Free space on /tmp= 70700 MiB

SOLVER NAME= npSolver 1.0
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/manquinho/mds/normalized-mds_500_25_1.opb
COMMAND LINE= DIR/npSolver-pbo.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3750922-1339129446/watcher-3750922-1339129446 -o /tmp/evaluation-result-3750922-1339129446/solver-3750922-1339129446 -C 1800 -W 1900 -M 15500  HOME/npSolver-pbo.sh HOME/instance-3750922-1339129446.opb 1017958052 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 93a95f0846e71f0984a2317cf811edef
RANDOM SEED=1017958052

node138.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.69
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.347
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31760012 kB
Buffers:          117168 kB
Cached:           146124 kB
SwapCached:        19640 kB
Active:           183940 kB
Inactive:         146972 kB
Active(anon):      49512 kB
Inactive(anon):    20456 kB
Active(file):     134428 kB
Inactive(file):   126516 kB
Unevictable:        7124 kB
Mlocked:            7124 kB
SwapTotal:      67108856 kB
SwapFree:       67082140 kB
Dirty:             20972 kB
Writeback:             0 kB
AnonPages:         55704 kB
Mapped:             9892 kB
Shmem:                 0 kB
Slab:             642136 kB
SReclaimable:      83084 kB
SUnreclaim:       559052 kB
KernelStack:        1504 kB
PageTables:         4596 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     180532 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:     16384 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70692 MiB
End job on node138 at 2012-06-08 06:54:07