Trace number 3749818

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
npSolver 1.0 (fixed)? (TO) 1800.95 1801.83

General information on the benchmark

NameOPT-BIGINT-LIN/graca/
normalized-ped3.E.recomb10-0.20-14.opb
MD5SUM291a497ec30de41a6da6a2a376924f13
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark19841
Best CPU time to get the best result obtained on this benchmark1800.15
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables72595
Total number of constraints951921
Number of constraints which are clauses951921
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint340
Number of terms in the objective function 5840
Biggest coefficient in the objective function 341
Number of bits for the biggest coefficient in the objective function 9
Sum of the numbers in the objective function 1875840
Number of bits of the sum of numbers in the objective function 21
Biggest number in a constraint 341
Number of bits of the biggest number in a constraint 9
Biggest sum of numbers in a constraint 1875840
Number of bits of the biggest sum of numbers21
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

2.88/2.93	c run usual solver
5.87/5.96	c model valid
5.87/5.96	c current solution ok
6.60/7.19	o 20155
6.60/7.19	c current bound: 10077
6.60/7.19	c fallback to adder encoding
1744.88/1745.74	c model valid
1744.88/1745.74	c current solution ok
1744.88/1745.77	o 10036
1744.88/1745.77	c current bound: 5018
1744.88/1745.77	c fallback to adder encoding
1799.45/1800.34	c current bound: 7527
1799.45/1800.34	c fallback to adder encoding
1800.95/1801.81	c error: unexpected solver exit code
1800.95/1801.81	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3749818-1339182766/watcher-3749818-1339182766 -o /tmp/evaluation-result-3749818-1339182766/solver-3749818-1339182766 -C 1800 -W 1900 -M 15500 HOME/npSolver-pbo.sh HOME/instance-3749818-1339182766.opb 824306031 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.92 0.98 1.13 2/173 20706
/proc/meminfo: memFree=28053068/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0

[startup+0.105506 s]
/proc/loadavg: 0.92 0.98 1.13 2/173 20706
/proc/meminfo: memFree=28053068/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.200219 s]
/proc/loadavg: 0.92 0.98 1.13 2/173 20706
/proc/meminfo: memFree=28053068/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300262 s]
/proc/loadavg: 0.92 0.98 1.13 2/173 20706
/proc/meminfo: memFree=28053068/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.70017 s]
/proc/loadavg: 0.92 0.98 1.13 2/173 20706
/proc/meminfo: memFree=28053068/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.7333 s]
/proc/loadavg: 0.92 0.98 1.13 2/173 20706
/proc/meminfo: memFree=28053068/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+3.10027 s]
/proc/loadavg: 1.09 1.02 1.14 3/181 20721
/proc/meminfo: memFree=27493724/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354548 CPUtime=2.92 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) S 20706 20706 19535 0 -1 4202496 63272 0 0 0 274 18 0 0 20 0 1 0 384402686 363057152 88279 33554432000 4194304 6004724 140737373691152 140737373685200 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88637 88279 148 442 0 88191 0
[pid=20720] ppid=20707 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20720/stat : 20720 (cp2_pre.sh) S 20707 20706 19535 0 -1 4202496 607 0 0 0 0 0 0 0 20 0 1 0 384402980 9367552 276 33554432000 4194304 5064252 140733585058768 140733585057472 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/20720/statm: 2287 276 234 213 0 72 0
[pid=20721] ppid=20720 vsize=20420 CPUtime=0.14 cores=0,2,4,6
/proc/20721/stat : 20721 (coprocessor) R 20720 20706 19535 0 -1 4202496 5089 0 0 0 14 0 0 0 20 0 1 0 384402981 20910080 4468 33554432000 4194304 6586260 140733951863248 140733585057496 5732400 0 0 4096 8404994 0 0 0 17 4 0 0 0 0 0
/proc/20721/statm: 5105 4468 137 584 0 4517 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 393264

[startup+6.30014 s]
/proc/loadavg: 1.09 1.02 1.14 3/178 20728
/proc/meminfo: memFree=27268508/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=6.27 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) R 20706 20706 19535 0 -1 4202496 63668 30528 0 0 398 48 166 15 20 0 1 0 384402686 363061248 88287 33554432000 4194304 6004724 140737373691152 140737373685528 5190832 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88638 88287 155 442 0 88192 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 363700

[startup+12.7002 s]
/proc/loadavg: 1.45 1.10 1.17 3/181 20732
/proc/meminfo: memFree=26130844/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=7.1 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) S 20706 20706 19535 0 -1 4202496 76601 31043 0 0 447 80 166 17 20 0 1 0 384402686 363061248 88310 33554432000 4194304 6004724 140737373691152 140737373683504 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88638 88310 175 442 0 88192 0
[pid=20730] ppid=20707 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20730/stat : 20730 (satsolver.sh) S 20707 20706 19535 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384403452 9367552 266 33554432000 4194304 5064252 140733432171504 140733432170416 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/20730/statm: 2287 266 226 213 0 72 0
[pid=20731] ppid=20730 vsize=121708 CPUtime=5.02 cores=0,2,4,6
/proc/20731/stat : 20731 (glucose) R 20730 20706 19535 0 -1 4202496 23271 0 0 0 496 6 0 0 20 0 1 0 384403453 124628992 27697 33554432000 4194304 5208918 140736478830336 140736478828184 4229528 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/20731/statm: 30427 27697 105 248 0 30176 0
Current children cumulated CPU time (s) 12.12
Current children cumulated vsize (KiB) 494556

[startup+25.5003 s]
/proc/loadavg: 1.54 1.13 1.18 3/181 20732
/proc/meminfo: memFree=25154264/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=7.1 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) S 20706 20706 19535 0 -1 4202496 76601 31043 0 0 447 80 166 17 20 0 1 0 384402686 363061248 88310 33554432000 4194304 6004724 140737373691152 140737373683504 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88638 88310 175 442 0 88192 0
[pid=20730] ppid=20707 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20730/stat : 20730 (satsolver.sh) S 20707 20706 19535 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384403452 9367552 266 33554432000 4194304 5064252 140733432171504 140733432170416 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/20730/statm: 2287 266 226 213 0 72 0
[pid=20731] ppid=20730 vsize=124284 CPUtime=17.82 cores=0,2,4,6
/proc/20731/stat : 20731 (glucose) R 20730 20706 19535 0 -1 4202496 24180 0 0 0 1774 8 0 0 20 0 1 0 384403453 127266816 27984 33554432000 4194304 5208918 140736478830336 140736478828088 4205631 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/20731/statm: 31071 27984 105 248 0 30820 0
Current children cumulated CPU time (s) 24.92
Current children cumulated vsize (KiB) 497132

[startup+51.1003 s]
/proc/loadavg: 1.69 1.20 1.20 3/183 20734
/proc/meminfo: memFree=20812200/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=7.1 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) S 20706 20706 19535 0 -1 4202496 76601 31043 0 0 447 80 166 17 20 0 1 0 384402686 363061248 88310 33554432000 4194304 6004724 140737373691152 140737373683504 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88638 88310 175 442 0 88192 0
[pid=20730] ppid=20707 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20730/stat : 20730 (satsolver.sh) S 20707 20706 19535 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384403452 9367552 266 33554432000 4194304 5064252 140733432171504 140733432170416 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/20730/statm: 2287 266 226 213 0 72 0
[pid=20731] ppid=20730 vsize=150112 CPUtime=43.41 cores=0,2,4,6
/proc/20731/stat : 20731 (glucose) R 20730 20706 19535 0 -1 4202496 26865 0 0 0 4331 10 0 0 20 0 1 0 384403453 153714688 30536 33554432000 4194304 5208918 140736478830336 140736478826712 4229692 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/20731/statm: 37528 30536 105 248 0 37277 0
Current children cumulated CPU time (s) 50.51
Current children cumulated vsize (KiB) 522960

[startup+102.3 s]
/proc/loadavg: 2.74 1.56 1.32 3/183 20734
/proc/meminfo: memFree=16292496/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=7.1 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) S 20706 20706 19535 0 -1 4202496 76601 31043 0 0 447 80 166 17 20 0 1 0 384402686 363061248 88310 33554432000 4194304 6004724 140737373691152 140737373683504 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88638 88310 175 442 0 88192 0
[pid=20730] ppid=20707 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20730/stat : 20730 (satsolver.sh) S 20707 20706 19535 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384403452 9367552 266 33554432000 4194304 5064252 140733432171504 140733432170416 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/20730/statm: 2287 266 226 213 0 72 0
[pid=20731] ppid=20730 vsize=157100 CPUtime=94.6 cores=0,2,4,6
/proc/20731/stat : 20731 (glucose) R 20730 20706 19535 0 -1 4202496 30690 0 0 0 9441 19 0 0 20 0 1 0 384403453 160870400 32510 33554432000 4194304 5208918 140736478830336 140736478828008 4211871 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/20731/statm: 39275 32510 105 248 0 39024 0
Current children cumulated CPU time (s) 101.7
Current children cumulated vsize (KiB) 529948

[startup+162.3 s]
/proc/loadavg: 2.73 1.74 1.39 3/183 20737
/proc/meminfo: memFree=19237612/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=7.1 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) S 20706 20706 19535 0 -1 4202496 76601 31043 0 0 447 80 166 17 20 0 1 0 384402686 363061248 88310 33554432000 4194304 6004724 140737373691152 140737373683504 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88638 88310 175 442 0 88192 0
[pid=20730] ppid=20707 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20730/stat : 20730 (satsolver.sh) S 20707 20706 19535 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384403452 9367552 266 33554432000 4194304 5064252 140733432171504 140733432170416 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/20730/statm: 2287 266 226 213 0 72 0
[pid=20731] ppid=20730 vsize=167096 CPUtime=154.6 cores=0,2,4,6
/proc/20731/stat : 20731 (glucose) R 20730 20706 19535 0 -1 4202496 34059 0 0 0 15431 29 0 0 20 0 1 0 384403453 171106304 36508 33554432000 4194304 5208918 140736478830336 140736478828088 4229319 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/20731/statm: 41774 36508 105 248 0 41523 0
Current children cumulated CPU time (s) 161.7
Current children cumulated vsize (KiB) 539944

[startup+222.307 s]
/proc/loadavg: 2.48 1.85 1.45 3/183 20737
/proc/meminfo: memFree=16404416/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=7.1 cores=0,2,4,6

################
# More data... #
################

/proc/20731/statm: 73658 63403 105 248 0 73407 0
Current children cumulated CPU time (s) 1361.51
Current children cumulated vsize (KiB) 667480

[startup+1422.3 s]
/proc/loadavg: 2.05 2.01 1.84 3/183 20748
/proc/meminfo: memFree=16258132/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=7.1 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) S 20706 20706 19535 0 -1 4202496 76601 31043 0 0 447 80 166 17 20 0 1 0 384402686 363061248 88310 33554432000 4194304 6004724 140737373691152 140737373683504 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88638 88310 175 442 0 88192 0
[pid=20730] ppid=20707 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20730/stat : 20730 (satsolver.sh) S 20707 20706 19535 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384403452 9367552 266 33554432000 4194304 5064252 140733432171504 140733432170416 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/20730/statm: 2287 266 226 213 0 72 0
[pid=20731] ppid=20730 vsize=297632 CPUtime=1414.41 cores=0,2,4,6
/proc/20731/stat : 20731 (glucose) R 20730 20706 19535 0 -1 4202496 63653 0 0 0 141369 72 0 0 20 0 1 0 384403453 304775168 59114 33554432000 4194304 5208918 140736478830336 140736478828488 4211635 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/20731/statm: 74408 59114 105 248 0 74157 0
Current children cumulated CPU time (s) 1421.51
Current children cumulated vsize (KiB) 670480

[startup+1482.3 s]
/proc/loadavg: 2.02 2.01 1.84 3/183 20748
/proc/meminfo: memFree=16228420/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=7.1 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) S 20706 20706 19535 0 -1 4202496 76601 31043 0 0 447 80 166 17 20 0 1 0 384402686 363061248 88310 33554432000 4194304 6004724 140737373691152 140737373683504 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88638 88310 175 442 0 88192 0
[pid=20730] ppid=20707 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20730/stat : 20730 (satsolver.sh) S 20707 20706 19535 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384403452 9367552 266 33554432000 4194304 5064252 140733432171504 140733432170416 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/20730/statm: 2287 266 226 213 0 72 0
[pid=20731] ppid=20730 vsize=297632 CPUtime=1474.39 cores=0,2,4,6
/proc/20731/stat : 20731 (glucose) R 20730 20706 19535 0 -1 4202496 63850 0 0 0 147366 73 0 0 20 0 1 0 384403453 304775168 65954 33554432000 4194304 5208918 140736478830336 140736478826104 4211635 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/20731/statm: 74408 65954 105 248 0 74157 0
Current children cumulated CPU time (s) 1481.49
Current children cumulated vsize (KiB) 670480

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 1.85 3/183 20749
/proc/meminfo: memFree=16243084/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=7.1 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) S 20706 20706 19535 0 -1 4202496 76601 31043 0 0 447 80 166 17 20 0 1 0 384402686 363061248 88310 33554432000 4194304 6004724 140737373691152 140737373683504 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88638 88310 175 442 0 88192 0
[pid=20730] ppid=20707 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20730/stat : 20730 (satsolver.sh) S 20707 20706 19535 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384403452 9367552 266 33554432000 4194304 5064252 140733432171504 140733432170416 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/20730/statm: 2287 266 226 213 0 72 0
[pid=20731] ppid=20730 vsize=298492 CPUtime=1534.39 cores=0,2,4,6
/proc/20731/stat : 20731 (glucose) R 20730 20706 19535 0 -1 4202496 65040 0 0 0 153363 76 0 0 20 0 1 0 384403453 305655808 62078 33554432000 4194304 5208918 140736478830336 140736478828088 4229365 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/20731/statm: 74623 62078 105 248 0 74372 0
Current children cumulated CPU time (s) 1541.49
Current children cumulated vsize (KiB) 671340

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 1.85 3/183 20749
/proc/meminfo: memFree=16219268/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=7.1 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) S 20706 20706 19535 0 -1 4202496 76601 31043 0 0 447 80 166 17 20 0 1 0 384402686 363061248 88310 33554432000 4194304 6004724 140737373691152 140737373683504 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88638 88310 175 442 0 88192 0
[pid=20730] ppid=20707 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20730/stat : 20730 (satsolver.sh) S 20707 20706 19535 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384403452 9367552 266 33554432000 4194304 5064252 140733432171504 140733432170416 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/20730/statm: 2287 266 226 213 0 72 0
[pid=20731] ppid=20730 vsize=299608 CPUtime=1594.38 cores=0,2,4,6
/proc/20731/stat : 20731 (glucose) R 20730 20706 19535 0 -1 4202496 65342 0 0 0 159361 77 0 0 20 0 1 0 384403453 306798592 68001 33554432000 4194304 5208918 140736478830336 140736478826648 4229365 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/20731/statm: 74902 68001 105 248 0 74651 0
Current children cumulated CPU time (s) 1601.48
Current children cumulated vsize (KiB) 672456

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 1.86 3/184 20752
/proc/meminfo: memFree=16241104/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=7.1 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) S 20706 20706 19535 0 -1 4202496 76601 31043 0 0 447 80 166 17 20 0 1 0 384402686 363061248 88310 33554432000 4194304 6004724 140737373691152 140737373683504 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88638 88310 175 442 0 88192 0
[pid=20730] ppid=20707 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20730/stat : 20730 (satsolver.sh) S 20707 20706 19535 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384403452 9367552 266 33554432000 4194304 5064252 140733432171504 140733432170416 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/20730/statm: 2287 266 226 213 0 72 0
[pid=20731] ppid=20730 vsize=301004 CPUtime=1654.36 cores=0,2,4,6
/proc/20731/stat : 20731 (glucose) R 20730 20706 19535 0 -1 4202496 66681 0 0 0 165357 79 0 0 20 0 1 0 384403453 308228096 61715 33554432000 4194304 5208918 140736478830336 140736478828184 4229311 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/20731/statm: 75251 61715 105 248 0 75000 0
Current children cumulated CPU time (s) 1661.46
Current children cumulated vsize (KiB) 673852

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 1.86 3/183 20752
/proc/meminfo: memFree=16211712/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=7.1 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) S 20706 20706 19535 0 -1 4202496 76601 31043 0 0 447 80 166 17 20 0 1 0 384402686 363061248 88310 33554432000 4194304 6004724 140737373691152 140737373683504 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88638 88310 175 442 0 88192 0
[pid=20730] ppid=20707 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20730/stat : 20730 (satsolver.sh) S 20707 20706 19535 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 384403452 9367552 266 33554432000 4194304 5064252 140733432171504 140733432170416 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/20730/statm: 2287 266 226 213 0 72 0
[pid=20731] ppid=20730 vsize=302480 CPUtime=1714.36 cores=0,2,4,6
/proc/20731/stat : 20731 (glucose) R 20730 20706 19535 0 -1 4202496 67029 0 0 0 171356 80 0 0 20 0 1 0 384403453 309739520 68706 33554432000 4194304 5208918 140736478830336 140736478826712 4229319 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/20731/statm: 75620 68706 105 248 0 75369 0
Current children cumulated CPU time (s) 1721.46
Current children cumulated vsize (KiB) 675328

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.87 3/183 20759
/proc/meminfo: memFree=16382916/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=1745.38 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) S 20706 20706 19535 0 -1 4202496 89525 104047 0 0 604 86 173733 115 20 0 1 0 384402686 363061248 88311 33554432000 4194304 6004724 140737373691152 140737373683504 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88638 88311 176 442 0 88192 0
[pid=20758] ppid=20707 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20758/stat : 20758 (satsolver.sh) S 20707 20706 19535 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 384577306 9367552 266 33554432000 4194304 5064252 140736153939632 140736153938544 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/20758/statm: 2287 266 226 213 0 72 0
[pid=20759] ppid=20758 vsize=123640 CPUtime=36.07 cores=0,2,4,6
/proc/20759/stat : 20759 (glucose) R 20758 20706 19535 0 -1 4202496 23016 0 0 0 3601 6 0 0 20 0 1 0 384577307 126607360 26395 33554432000 4194304 5208918 140735045976016 140735045973864 4229365 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/20759/statm: 30910 26395 105 248 0 30659 0
Current children cumulated CPU time (s) 1781.45
Current children cumulated vsize (KiB) 496488



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1801.8 s]
/proc/loadavg: 2.00 2.00 1.87 3/183 20766
/proc/meminfo: memFree=16393012/32873648 swapFree=7628/7628
[pid=20706] ppid=20704 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20706/stat : 20706 (npSolver-pbo.sh) S 20704 20706 19535 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 384402686 9367552 275 33554432000 4194304 5064252 140734192551872 140734192550784 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20706/statm: 2287 275 233 213 0 72 0
[pid=20707] ppid=20706 vsize=354552 CPUtime=1799.94 cores=0,2,4,6
/proc/20707/stat : 20707 (npSolver-pbo) S 20706 20706 19535 0 -1 4202496 101827 132961 0 0 643 91 179133 127 20 0 1 0 384402686 363061248 88311 33554432000 4194304 6004724 140737373691152 140737373683504 5186782 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/20707/statm: 88638 88311 176 442 0 88192 0
[pid=20765] ppid=20707 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/20765/stat : 20765 (satsolver.sh) S 20707 20706 19535 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 384582764 9367552 267 33554432000 4194304 5064252 140733307786528 140733307785440 217410332238 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/20765/statm: 2287 267 226 213 0 72 0
[pid=20766] ppid=20765 vsize=113984 CPUtime=1.01 cores=0,2,4,6
/proc/20766/stat : 20766 (glucose) R 20765 20706 19535 0 -1 4202496 19443 0 0 0 97 4 0 0 20 0 1 0 384582765 116719616 23791 33554432000 4194304 5208918 140735484926992 140735483876392 4229296 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/20766/statm: 28496 23791 104 248 0 28245 0
Current children cumulated CPU time (s) 1800.95
Current children cumulated vsize (KiB) 486832

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 20706 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.95
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1801.83
CPU time (s): 1800.95
CPU user time (s): 1798.73
CPU system time (s): 2.22
CPU usage (%): 99.9514
Max. virtual memory (cumulated for all children) (KiB): 756584

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.000999
maximum resident set size= 1100
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 358
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 1

runsolver used 4.12937 second user time and 10.5064 second system time

The end

Launcher Data 

Begin job on node122 at 2012-06-08 21:12:47
IDJOB=3749818
IDBENCH=92812
IDSOLVER=2334
FILE ID=node122/3749818-1339182766
RUNJOBID= node122-1339182766-20688
PBS_JOBID= 14643846
Free space on /tmp= 68652 MiB

SOLVER NAME= npSolver 1.0
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/graca/normalized-ped3.E.recomb10-0.20-14.opb
COMMAND LINE= DIR/npSolver-pbo.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3749818-1339182766/watcher-3749818-1339182766 -o /tmp/evaluation-result-3749818-1339182766/solver-3749818-1339182766 -C 1800 -W 1900 -M 15500  HOME/npSolver-pbo.sh HOME/instance-3749818-1339182766.opb 824306031 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 291a497ec30de41a6da6a2a376924f13
RANDOM SEED=824306031

node122.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.06
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.04
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.533
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        28054084 kB
Buffers:          271616 kB
Cached:          3586568 kB
SwapCached:         2140 kB
Active:          2835728 kB
Inactive:        1030796 kB
Active(anon):       8276 kB
Inactive(anon):     2228 kB
Active(file):    2827452 kB
Inactive(file):  1028568 kB
Unevictable:        7628 kB
Mlocked:            7628 kB
SwapTotal:      67108856 kB
SwapFree:       67099488 kB
Dirty:             72920 kB
Writeback:            20 kB
AnonPages:         15980 kB
Mapped:             8040 kB
Shmem:                 0 kB
Slab:             814188 kB
SReclaimable:     257848 kB
SUnreclaim:       556340 kB
KernelStack:        1416 kB
PageTables:         4092 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     109008 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:      4096 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 66772 MiB
End job on node122 at 2012-06-08 21:42:51