Trace number 3717053

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
wbo2satCp2 2012-05-19? (TO) 1800.07 1800.51

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/roussel/
normalized-pigeon-cardinality-51-50--soft-33-100-0.wbo
MD5SUM153666059db7da507c96674bc7662476
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark0.674897
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables2550
Total number of constraints101
Number of soft constraints66
Number of constraints which are clauses51
Number of constraints which are cardinality constraints (but not clauses)50
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint50
Maximum length of a constraint51
Top cost 3685
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 3684
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 52
Number of bits of the biggest sum of numbers6
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

0.00/0.60	o 2165
0.00/0.60	c current bound: 1082
6.47/6.58	o 595
6.47/6.58	c current bound: 297
17.35/17.49	o 233
17.35/17.49	c current bound: 116
17.48/18.24	o 114
17.48/18.24	c current bound: 57
23.46/23.55	o 53
23.46/23.55	c current bound: 26
25.60/25.75	o 25
25.60/25.75	c current bound: 12
29.80/29.92	o 12
29.80/29.92	c current bound: 6
30.89/31.02	o 2
30.89/31.02	c current bound: 1
31.70/31.86	o 1
31.70/31.86	c current bound: 0
1800.07/1800.51	c error: unexpected solver exit code
1800.07/1800.51	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3717053-1338181231/watcher-3717053-1338181231 -o /tmp/evaluation-result-3717053-1338181231/solver-3717053-1338181231 -C 1800 -W 1900 -M 15500 HOME/runWbo2satCp2.sh HOME/instance-3717053-1338181231.wbo 1697183291 HOME HOME 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.01 2.00 3/180 22281
/proc/meminfo: memFree=31551220/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0

[startup+0.0556021 s]
/proc/loadavg: 2.02 2.01 2.00 3/180 22281
/proc/meminfo: memFree=31551220/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100319 s]
/proc/loadavg: 2.02 2.01 2.00 3/180 22281
/proc/meminfo: memFree=31551220/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300299 s]
/proc/loadavg: 2.02 2.01 2.00 3/180 22281
/proc/meminfo: memFree=31551220/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.70024 s]
/proc/loadavg: 2.02 2.01 2.00 3/180 22281
/proc/meminfo: memFree=31551220/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50036 s]
/proc/loadavg: 2.02 2.01 2.00 3/184 22288
/proc/meminfo: memFree=31491716/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=13400 CPUtime=0.64 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 5392 4502 0 0 22 15 26 1 20 0 1 0 284251649 13721600 2820 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 3350 2820 173 410 0 2932 0
[pid=22287] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22287/stat : 22287 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 284251715 9367552 267 33554432000 4194304 5064252 140735836096960 140735836095872 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22287/statm: 2287 267 226 213 0 72 0
[pid=22288] ppid=22287 vsize=46816 CPUtime=0.83 cores=1,3,5,7
/proc/22288/stat : 22288 (glucose_static) R 22287 22281 20252 0 -1 4202496 9726 0 0 0 82 1 0 0 20 0 1 0 284251715 47939584 10425 33554432000 4194304 4896791 140734677191328 140734677188632 4224934 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22288/statm: 11704 10425 78 172 0 11530 0
Current children cumulated CPU time (s) 1.47
Current children cumulated vsize (KiB) 78512

[startup+3.10041 s]
/proc/loadavg: 2.02 2.01 2.00 3/184 22288
/proc/meminfo: memFree=31487988/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=13400 CPUtime=0.64 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 5392 4502 0 0 22 15 26 1 20 0 1 0 284251649 13721600 2820 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 3350 2820 173 410 0 2932 0
[pid=22287] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22287/stat : 22287 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 284251715 9367552 267 33554432000 4194304 5064252 140735836096960 140735836095872 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22287/statm: 2287 267 226 213 0 72 0
[pid=22288] ppid=22287 vsize=52084 CPUtime=2.42 cores=1,3,5,7
/proc/22288/stat : 22288 (glucose_static) R 22287 22281 20252 0 -1 4202496 10256 0 0 0 241 1 0 0 20 0 1 0 284251715 53334016 10941 33554432000 4194304 4896791 140734677191328 140734677188856 4225138 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22288/statm: 13021 10941 78 172 0 12847 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 83780

[startup+6.30042 s]
/proc/loadavg: 2.02 2.01 2.00 3/184 22288
/proc/meminfo: memFree=31481088/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=13400 CPUtime=0.64 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 5392 4502 0 0 22 15 26 1 20 0 1 0 284251649 13721600 2820 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 3350 2820 173 410 0 2932 0
[pid=22287] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22287/stat : 22287 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 284251715 9367552 267 33554432000 4194304 5064252 140735836096960 140735836095872 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22287/statm: 2287 267 226 213 0 72 0
[pid=22288] ppid=22287 vsize=52584 CPUtime=5.62 cores=1,3,5,7
/proc/22288/stat : 22288 (glucose_static) R 22287 22281 20252 0 -1 4202496 10931 0 0 0 561 1 0 0 20 0 1 0 284251715 53846016 11106 33554432000 4194304 4896791 140734677191328 140734677188856 4224983 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22288/statm: 13146 11106 78 172 0 12972 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 84280

[startup+12.7004 s]
/proc/loadavg: 2.01 2.01 2.00 3/184 22291
/proc/meminfo: memFree=31495972/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=11772 CPUtime=6.57 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 7496 16745 0 0 25 15 613 4 20 0 1 0 284251649 12054528 2438 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 2943 2438 173 410 0 2525 0
[pid=22290] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22290/stat : 22290 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 284252309 9367552 267 33554432000 4194304 5064252 140735538743424 140735538742336 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22290/statm: 2287 267 226 213 0 72 0
[pid=22291] ppid=22290 vsize=33028 CPUtime=6.08 cores=1,3,5,7
/proc/22291/stat : 22291 (glucose_static) R 22290 22281 20252 0 -1 4202496 7845 0 0 0 607 1 0 0 20 0 1 0 284252309 33820672 6489 33554432000 4194304 4896791 140735709190112 140735709187320 4224983 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22291/statm: 8257 6489 78 172 0 8083 0
Current children cumulated CPU time (s) 12.65
Current children cumulated vsize (KiB) 63096

[startup+25.5004 s]
/proc/loadavg: 2.01 2.01 2.00 3/184 22300
/proc/meminfo: memFree=31531988/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=11772 CPUtime=23.47 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 9274 44274 0 0 27 16 2291 13 20 0 1 0 284251649 12054528 2438 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 2943 2438 173 410 0 2525 0
[pid=22299] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22299/stat : 22299 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 284254004 9367552 267 33554432000 4194304 5064252 140735638543584 140735638542496 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22299/statm: 2287 267 226 213 0 72 0
[pid=22300] ppid=22299 vsize=19096 CPUtime=1.93 cores=1,3,5,7
/proc/22300/stat : 22300 (glucose_static) R 22299 22281 20252 0 -1 4202496 4597 0 0 0 193 0 0 0 20 0 1 0 284254004 19554304 4067 33554432000 4194304 4896791 140733532218288 140733532215816 4225417 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22300/statm: 4774 4067 78 172 0 4600 0
Current children cumulated CPU time (s) 25.4
Current children cumulated vsize (KiB) 49164

[startup+51.1004 s]
/proc/loadavg: 2.01 2.00 2.00 3/184 22335
/proc/meminfo: memFree=31492272/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=11772 CPUtime=31.78 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 10700 69382 0 0 28 16 3113 21 20 0 1 0 284251649 12054528 2439 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 2943 2439 174 410 0 2525 0
[pid=22334] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22334/stat : 22334 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 284254836 9367552 267 33554432000 4194304 5064252 140733589276272 140733589275184 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22334/statm: 2287 267 226 213 0 72 0
[pid=22335] ppid=22334 vsize=27372 CPUtime=19.22 cores=1,3,5,7
/proc/22335/stat : 22335 (glucose_static) R 22334 22281 20252 0 -1 4202496 12345 0 0 0 1919 3 0 0 20 0 1 0 284254836 28028928 6122 33554432000 4194304 4896791 140736679556224 140736679553432 4225445 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22335/statm: 6843 6122 78 172 0 6669 0
Current children cumulated CPU time (s) 51
Current children cumulated vsize (KiB) 57440

[startup+102.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 22335
/proc/meminfo: memFree=31495024/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=11772 CPUtime=31.78 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 10700 69382 0 0 28 16 3113 21 20 0 1 0 284251649 12054528 2439 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 2943 2439 174 410 0 2525 0
[pid=22334] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22334/stat : 22334 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 284254836 9367552 267 33554432000 4194304 5064252 140733589276272 140733589275184 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22334/statm: 2287 267 226 213 0 72 0
[pid=22335] ppid=22334 vsize=40404 CPUtime=70.41 cores=1,3,5,7
/proc/22335/stat : 22335 (glucose_static) R 22334 22281 20252 0 -1 4202496 22655 0 0 0 7034 7 0 0 20 0 1 0 284254836 41373696 9429 33554432000 4194304 4896791 140736679556224 140736679553432 4225361 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22335/statm: 10101 9429 78 172 0 9927 0
Current children cumulated CPU time (s) 102.19
Current children cumulated vsize (KiB) 70472

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/183 22336
/proc/meminfo: memFree=31492932/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=11772 CPUtime=31.78 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 10700 69382 0 0 28 16 3113 21 20 0 1 0 284251649 12054528 2439 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 2943 2439 174 410 0 2525 0
[pid=22334] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7

################
# More data... #
################

/proc/22335/stat : 22335 (glucose_static) R 22334 22281 20252 0 -1 4202496 76249 0 0 0 138952 64 0 0 20 0 1 0 284254836 141701120 32392 33554432000 4194304 4896791 140736679556224 140736679551960 4223862 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22335/statm: 34595 32392 78 172 0 34421 0
Current children cumulated CPU time (s) 1421.94
Current children cumulated vsize (KiB) 168448

[startup+1482.3 s]
/proc/loadavg: 2.08 2.02 2.01 3/183 22415
/proc/meminfo: memFree=31305448/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=11772 CPUtime=31.78 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 10700 69382 0 0 28 16 3113 21 20 0 1 0 284251649 12054528 2439 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 2943 2439 174 410 0 2525 0
[pid=22334] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22334/stat : 22334 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 284254836 9367552 267 33554432000 4194304 5064252 140733589276272 140733589275184 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22334/statm: 2287 267 226 213 0 72 0
[pid=22335] ppid=22334 vsize=173676 CPUtime=1450.14 cores=1,3,5,7
/proc/22335/stat : 22335 (glucose_static) R 22334 22281 20252 0 -1 4202496 77323 0 0 0 144948 66 0 0 20 0 1 0 284254836 177844224 38041 33554432000 4194304 4896791 140736679556224 140736679553432 4224706 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22335/statm: 43419 38041 78 172 0 43245 0
Current children cumulated CPU time (s) 1481.92
Current children cumulated vsize (KiB) 203744

[startup+1542.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/183 22415
/proc/meminfo: memFree=31294168/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=11772 CPUtime=31.78 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 10700 69382 0 0 28 16 3113 21 20 0 1 0 284251649 12054528 2439 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 2943 2439 174 410 0 2525 0
[pid=22334] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22334/stat : 22334 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 284254836 9367552 267 33554432000 4194304 5064252 140733589276272 140733589275184 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22334/statm: 2287 267 226 213 0 72 0
[pid=22335] ppid=22334 vsize=175144 CPUtime=1510.12 cores=1,3,5,7
/proc/22335/stat : 22335 (glucose_static) R 22334 22281 20252 0 -1 4202496 78663 0 0 0 150944 68 0 0 20 0 1 0 284254836 179347456 38308 33554432000 4194304 4896791 140736679556224 140736679553432 4203806 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22335/statm: 43786 38308 78 172 0 43612 0
Current children cumulated CPU time (s) 1541.9
Current children cumulated vsize (KiB) 205212

[startup+1602.3 s]
/proc/loadavg: 2.24 2.07 2.02 3/183 22415
/proc/meminfo: memFree=31295956/32873844 swapFree=7376/7376
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=11772 CPUtime=31.78 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 10700 69382 0 0 28 16 3113 21 20 0 1 0 284251649 12054528 2439 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 2943 2439 174 410 0 2525 0
[pid=22334] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22334/stat : 22334 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 284254836 9367552 267 33554432000 4194304 5064252 140733589276272 140733589275184 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22334/statm: 2287 267 226 213 0 72 0
[pid=22335] ppid=22334 vsize=176740 CPUtime=1570.11 cores=1,3,5,7
/proc/22335/stat : 22335 (glucose_static) R 22334 22281 20252 0 -1 4202496 80050 0 0 0 156940 71 0 0 20 0 1 0 284254836 180981760 38211 33554432000 4194304 4896791 140736679556224 140736679553432 4225445 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22335/statm: 44185 38211 78 172 0 44011 0
Current children cumulated CPU time (s) 1601.89
Current children cumulated vsize (KiB) 206808

[startup+1662.3 s]
/proc/loadavg: 2.20 2.09 2.02 3/183 22416
/proc/meminfo: memFree=31292176/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=11772 CPUtime=31.78 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 10700 69382 0 0 28 16 3113 21 20 0 1 0 284251649 12054528 2439 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 2943 2439 174 410 0 2525 0
[pid=22334] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22334/stat : 22334 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 284254836 9367552 267 33554432000 4194304 5064252 140733589276272 140733589275184 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22334/statm: 2287 267 226 213 0 72 0
[pid=22335] ppid=22334 vsize=178220 CPUtime=1630.11 cores=1,3,5,7
/proc/22335/stat : 22335 (glucose_static) R 22334 22281 20252 0 -1 4202496 81403 0 0 0 162937 74 0 0 20 0 1 0 284254836 182497280 38080 33554432000 4194304 4896791 140736679556224 140736679551960 4225029 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22335/statm: 44555 38080 78 172 0 44381 0
Current children cumulated CPU time (s) 1661.89
Current children cumulated vsize (KiB) 208288

[startup+1722.3 s]
/proc/loadavg: 2.10 2.08 2.02 3/183 22416
/proc/meminfo: memFree=31287772/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=11772 CPUtime=31.78 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 10700 69382 0 0 28 16 3113 21 20 0 1 0 284251649 12054528 2439 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 2943 2439 174 410 0 2525 0
[pid=22334] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22334/stat : 22334 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 284254836 9367552 267 33554432000 4194304 5064252 140733589276272 140733589275184 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22334/statm: 2287 267 226 213 0 72 0
[pid=22335] ppid=22334 vsize=180084 CPUtime=1690.09 cores=1,3,5,7
/proc/22335/stat : 22335 (glucose_static) R 22334 22281 20252 0 -1 4202496 82833 0 0 0 168933 76 0 0 20 0 1 0 284254836 184406016 37498 33554432000 4194304 4896791 140736679556224 140736679553432 4225011 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22335/statm: 45021 37498 78 172 0 44847 0
Current children cumulated CPU time (s) 1721.87
Current children cumulated vsize (KiB) 210152

[startup+1782.3 s]
/proc/loadavg: 2.08 2.08 2.02 3/184 22419
/proc/meminfo: memFree=31281988/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=11772 CPUtime=31.78 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 10700 69382 0 0 28 16 3113 21 20 0 1 0 284251649 12054528 2439 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 2943 2439 174 410 0 2525 0
[pid=22334] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22334/stat : 22334 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 284254836 9367552 267 33554432000 4194304 5064252 140733589276272 140733589275184 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22334/statm: 2287 267 226 213 0 72 0
[pid=22335] ppid=22334 vsize=151160 CPUtime=1750.08 cores=1,3,5,7
/proc/22335/stat : 22335 (glucose_static) R 22334 22281 20252 0 -1 4202496 83839 0 0 0 174930 78 0 0 20 0 1 0 284254836 154787840 37037 33554432000 4194304 4896791 140736679556224 140736679553800 4224983 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22335/statm: 37790 37037 78 172 0 37616 0
Current children cumulated CPU time (s) 1781.86
Current children cumulated vsize (KiB) 181228



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 2.12 2.09 2.02 3/184 22419
/proc/meminfo: memFree=31271240/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=11772 CPUtime=31.78 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 10700 69382 0 0 28 16 3113 21 20 0 1 0 284251649 12054528 2439 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 2943 2439 174 410 0 2525 0
[pid=22334] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22334/stat : 22334 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 284254836 9367552 267 33554432000 4194304 5064252 140733589276272 140733589275184 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22334/statm: 2287 267 226 213 0 72 0
[pid=22335] ppid=22334 vsize=182116 CPUtime=1768.29 cores=1,3,5,7
/proc/22335/stat : 22335 (glucose_static) R 22334 22281 20252 0 -1 4202496 84330 0 0 0 176750 79 0 0 20 0 1 0 284254836 186486784 39049 33554432000 4194304 4896791 140736679556224 140736679551256 4225124 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22335/statm: 45529 39049 78 172 0 45355 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 212184

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1800.5 s]
/proc/loadavg: 2.12 2.09 2.02 3/184 22419
/proc/meminfo: memFree=31271240/32873844 swapFree=7372/7372
[pid=22281] ppid=22279 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22281/stat : 22281 (runWbo2satCp2.s) S 22279 22281 20252 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 284251649 9367552 274 33554432000 4194304 5064252 140733708062496 140733708061408 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 3 0 0 0 0 0
/proc/22281/statm: 2287 274 233 213 0 72 0
[pid=22282] ppid=22281 vsize=11772 CPUtime=31.78 cores=1,3,5,7
/proc/22282/stat : 22282 (wbo2sat) S 22281 22281 20252 0 -1 4202496 10700 69382 0 0 28 16 3113 21 20 0 1 0 284251649 12054528 2439 33554432000 4194304 5872148 140735863821968 140735863815240 5123914 0 65536 4102 0 18446744071579302229 0 0 17 1 0 0 0 0 0
/proc/22282/statm: 2943 2439 174 410 0 2525 0
[pid=22334] ppid=22282 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/22334/stat : 22334 (satsolver.sh) S 22282 22281 20252 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 284254836 9367552 267 33554432000 4194304 5064252 140733589276272 140733589275184 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 7 0 0 0 0 0
/proc/22334/statm: 2287 267 226 213 0 72 0
[pid=22335] ppid=22334 vsize=182116 CPUtime=1768.29 cores=1,3,5,7
/proc/22335/stat : 22335 (glucose_static) R 22334 22281 20252 0 -1 4202496 84330 0 0 0 176750 79 0 0 20 0 1 0 284254836 186486784 39049 33554432000 4194304 4896791 140736679556224 140736679551256 4225124 0 0 4096 0 0 0 0 17 3 0 0 0 0 0
/proc/22335/statm: 45529 39049 78 172 0 45355 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 212184

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 22281 and gives
#  childrusage.ru_utime.tv_sec=31
#  childrusage.ru_utime.tv_usec=418223
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=383941
# CPU time returned by wait4() is 31.8022
# while last known CPU time is 1800.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.51
CPU time (s): 1800.07
CPU user time (s): 1798.91
CPU system time (s): 1.16
CPU usage (%): 99.9754
Max. virtual memory (cumulated for all children) (KiB): 261368

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 31.4182
system time used= 0.383941
maximum resident set size= 50608
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 81057
page faults= 0
swaps= 0
block input operations= 0
block output operations= 60512
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 84
involuntary context switches= 129

runsolver used 2.99254 second user time and 8.50171 second system time

The end

Launcher Data 

Begin job on node109 at 2012-05-28 07:00:31
IDJOB=3717053
IDBENCH=78721
IDSOLVER=2299
FILE ID=node109/3717053-1338181231
RUNJOBID= node109-1338160560-20269
PBS_JOBID= 14624563
Free space on /tmp= 71232 MiB

SOLVER NAME= wbo2satCp2 2012-05-19
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/roussel/normalized-pigeon-cardinality-51-50--soft-33-100-0.wbo
COMMAND LINE= DIR/runWbo2satCp2.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3717053-1338181231/watcher-3717053-1338181231 -o /tmp/evaluation-result-3717053-1338181231/solver-3717053-1338181231 -C 1800 -W 1900 -M 15500  HOME/runWbo2satCp2.sh HOME/instance-3717053-1338181231.wbo 1697183291 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 153666059db7da507c96674bc7662476
RANDOM SEED=1697183291

node109.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31551832 kB
Buffers:          165172 kB
Cached:           255064 kB
SwapCached:          588 kB
Active:           360484 kB
Inactive:         161928 kB
Active(anon):      96888 kB
Inactive(anon):     7668 kB
Active(file):     263596 kB
Inactive(file):   154260 kB
Unevictable:        7372 kB
Mlocked:            7372 kB
SwapTotal:      67108856 kB
SwapFree:       67106292 kB
Dirty:              8628 kB
Writeback:             0 kB
AnonPages:        266152 kB
Mapped:            11148 kB
Shmem:                 8 kB
Slab:             659344 kB
SReclaimable:     101904 kB
SUnreclaim:       557440 kB
KernelStack:        1528 kB
PageTables:         4140 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     222620 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    208896 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71200 MiB
End job on node109 at 2012-05-28 07:30:31