Trace number 3717115

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
wbo2satCp2 2012-05-19? (TO) 1800.1 1801.72

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB10/oliveras/j60/
normalized-j6030_9-unsat--soft-66-100-0.wbo
MD5SUM1889fba1555b8697309aed0b2b80cc12
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark8
Best CPU time to get the best result obtained on this benchmark0.159975
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables11956
Total number of constraints39426
Number of soft constraints13393
Number of constraints which are clauses39038
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints388
Minimum length of a constraint1
Maximum length of a constraint60
Top cost 678604
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 678603
Biggest number in a constraint 33
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 416
Number of bits of the biggest sum of numbers9
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data 

5.54/5.62	o 7580
5.54/5.62	c current bound: 3790
5.54/5.62	c fallback to adder encoding
462.08/462.26	o 3790
462.08/462.26	c current bound: 1895
462.08/462.26	c fallback to adder encoding
1069.43/1069.72	o 1895
1069.43/1069.72	c current bound: 947
1069.43/1069.72	c fallback to adder encoding
1544.53/1544.97	o 947
1544.53/1544.97	c current bound: 473
1544.53/1544.97	c fallback to adder encoding
1546.96/1548.55	o 346
1546.96/1548.55	c current bound: 173
1546.96/1548.55	c fallback to adder encoding
1800.10/1801.71	c error: unexpected solver exit code
1800.10/1801.71	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3717115-1338190474/watcher-3717115-1338190474 -o /tmp/evaluation-result-3717115-1338190474/solver-3717115-1338190474 -C 1800 -W 1900 -M 15500 HOME/runWbo2satCp2.sh HOME/instance-3717115-1338190474.wbo 282666105 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 23731
/proc/meminfo: memFree=30716832/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0

[startup+0.074944 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 23731
/proc/meminfo: memFree=30716832/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100322 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 23731
/proc/meminfo: memFree=30716832/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300332 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 23731
/proc/meminfo: memFree=30716832/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700232 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 23731
/proc/meminfo: memFree=30716832/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50032 s]
/proc/loadavg: 2.00 2.01 2.00 3/180 23733
/proc/meminfo: memFree=30667156/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=68212 CPUtime=1.49 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) R 23731 23731 20252 0 -1 4202496 6724 0 0 0 147 2 0 0 20 0 1 0 285176021 69849088 12342 33554432000 4194304 5872148 140734840714592 140734840711976 4692427 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23732/statm: 17053 12342 155 410 0 16635 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 77360

[startup+3.10041 s]
/proc/loadavg: 2.00 2.01 2.00 3/181 23734
/proc/meminfo: memFree=30638324/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=68448 CPUtime=2.08 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) S 23731 23731 20252 0 -1 4202496 6943 0 0 0 203 5 0 0 20 0 1 0 285176021 70090752 12914 33554432000 4194304 5872148 140734840714592 140734840710472 5123914 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/23732/statm: 17112 12914 162 410 0 16694 0
[pid=23734] ppid=23732 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23734/stat : 23734 (satsolver.sh) S 23732 23731 20252 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 285176230 9367552 267 33554432000 4194304 5064252 140735943337632 140735943336544 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23734/statm: 2287 267 226 213 0 72 0
Current children cumulated CPU time (s) 2.08
Current children cumulated vsize (KiB) 86744
heavy processes:

[startup+6.30037 s]
/proc/loadavg: 2.00 2.01 2.00 3/180 23735
/proc/meminfo: memFree=30597504/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=177596 CPUtime=6.28 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) R 23731 23731 20252 0 -1 4202496 13421 31208 0 0 309 178 129 12 20 0 1 0 285176021 181858304 35932 33554432000 4194304 5872148 140734840714592 140734840709384 4663484 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23732/statm: 44399 35932 176 410 0 43981 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 186744

[startup+12.7004 s]
/proc/loadavg: 2.08 2.03 2.01 3/182 23738
/proc/meminfo: memFree=30165980/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=177596 CPUtime=6.57 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) S 23731 23731 20252 0 -1 4202496 13865 31208 0 0 330 186 129 12 20 0 1 0 285176021 181858304 39517 33554432000 4194304 5872148 140734840714592 140734840707864 5123914 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/23732/statm: 44399 39517 177 410 0 43981 0
[pid=23737] ppid=23732 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23737/stat : 23737 (satsolver.sh) S 23732 23731 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 285176680 9367552 267 33554432000 4194304 5064252 140735276290208 140735276289120 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23737/statm: 2287 267 226 213 0 72 0
[pid=23738] ppid=23737 vsize=294260 CPUtime=6.09 cores=0,2,4,6
/proc/23738/stat : 23738 (glucose_static) R 23737 23731 20252 0 -1 4202496 50252 0 0 0 597 12 0 0 20 0 1 0 285176680 301322240 69334 33554432000 4194304 4896791 140736781786320 140736781783448 4224921 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/23738/statm: 73565 69334 78 172 0 73391 0
Current children cumulated CPU time (s) 12.66
Current children cumulated vsize (KiB) 490152

[startup+25.5004 s]
/proc/loadavg: 2.06 2.03 2.00 3/182 23738
/proc/meminfo: memFree=30166856/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=177596 CPUtime=6.57 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) S 23731 23731 20252 0 -1 4202496 13865 31208 0 0 330 186 129 12 20 0 1 0 285176021 181858304 39517 33554432000 4194304 5872148 140734840714592 140734840707864 5123914 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/23732/statm: 44399 39517 177 410 0 43981 0
[pid=23737] ppid=23732 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23737/stat : 23737 (satsolver.sh) S 23732 23731 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 285176680 9367552 267 33554432000 4194304 5064252 140735276290208 140735276289120 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23737/statm: 2287 267 226 213 0 72 0
[pid=23738] ppid=23737 vsize=325080 CPUtime=18.89 cores=0,2,4,6
/proc/23738/stat : 23738 (glucose_static) R 23737 23731 20252 0 -1 4202496 50340 0 0 0 1877 12 0 0 20 0 1 0 285176680 332881920 69415 33554432000 4194304 4896791 140736781786320 140736781783848 4224983 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/23738/statm: 81270 69415 78 172 0 81096 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 520972

[startup+51.1004 s]
/proc/loadavg: 2.04 2.02 2.00 3/184 23741
/proc/meminfo: memFree=30165404/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=177596 CPUtime=6.57 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) S 23731 23731 20252 0 -1 4202496 13865 31208 0 0 330 186 129 12 20 0 1 0 285176021 181858304 39517 33554432000 4194304 5872148 140734840714592 140734840707864 5123914 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/23732/statm: 44399 39517 177 410 0 43981 0
[pid=23737] ppid=23732 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23737/stat : 23737 (satsolver.sh) S 23732 23731 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 285176680 9367552 267 33554432000 4194304 5064252 140735276290208 140735276289120 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23737/statm: 2287 267 226 213 0 72 0
[pid=23738] ppid=23737 vsize=325432 CPUtime=44.48 cores=0,2,4,6
/proc/23738/stat : 23738 (glucose_static) R 23737 23731 20252 0 -1 4202496 51460 0 0 0 4436 12 0 0 20 0 1 0 285176680 333242368 69631 33554432000 4194304 4896791 140736781786320 140736781783832 4203102 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/23738/statm: 81358 69631 78 172 0 81184 0
Current children cumulated CPU time (s) 51.05
Current children cumulated vsize (KiB) 521324

[startup+102.307 s]
/proc/loadavg: 2.02 2.02 2.00 3/183 23741
/proc/meminfo: memFree=30157268/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=177596 CPUtime=6.57 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) S 23731 23731 20252 0 -1 4202496 13865 31208 0 0 330 186 129 12 20 0 1 0 285176021 181858304 39517 33554432000 4194304 5872148 140734840714592 140734840707864 5123914 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/23732/statm: 44399 39517 177 410 0 43981 0
[pid=23737] ppid=23732 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23737/stat : 23737 (satsolver.sh) S 23732 23731 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 285176680 9367552 267 33554432000 4194304 5064252 140735276290208 140735276289120 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23737/statm: 2287 267 226 213 0 72 0
[pid=23738] ppid=23737 vsize=328180 CPUtime=95.67 cores=0,2,4,6
/proc/23738/stat : 23738 (glucose_static) R 23737 23731 20252 0 -1 4202496 52475 0 0 0 9554 13 0 0 20 0 1 0 285176680 336056320 71116 33554432000 4194304 4896791 140736781786320 140736781783528 4203058 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/23738/statm: 82045 71116 78 172 0 81871 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 524072

[startup+162.3 s]
/proc/loadavg: 2.06 2.03 2.00 3/183 23741
/proc/meminfo: memFree=30146212/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=177596 CPUtime=6.57 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) S 23731 23731 20252 0 -1 4202496 13865 31208 0 0 330 186 129 12 20 0 1 0 285176021 181858304 39517 33554432000 4194304 5872148 140734840714592 140734840707864 5123914 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/23732/statm: 44399 39517 177 410 0 43981 0
[pid=23737] ppid=23732 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23737/stat : 23737 (satsolver.sh) S 23732 23731 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 285176680 9367552 267 33554432000 4194304 5064252 140735276290208 140735276289120 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23737/statm: 2287 267 226 213 0 72 0
[pid=23738] ppid=23737 vsize=330860 CPUtime=155.65 cores=0,2,4,6
/proc/23738/stat : 23738 (glucose_static) R 23737 23731 20252 0 -1 4202496 53183 0 0 0 15552 13 0 0 20 0 1 0 285176680 338800640 72534 33554432000 4194304 4896791 140736781786320 140736781783528 4225536 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/23738/statm: 82715 72534 78 172 0 82541 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 526752

[startup+222.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/183 23744
/proc/meminfo: memFree=30177736/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0

################
# More data... #
################

/proc/23759/stat : 23759 (glucose_static) R 23758 23731 20252 0 -1 4202496 51681 0 0 0 35148 15 0 0 20 0 1 0 285283078 288063488 65349 33554432000 4194304 4896791 140735397664080 140735397661336 4203098 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23759/statm: 70328 65349 78 172 0 70154 0
Current children cumulated CPU time (s) 1421.95
Current children cumulated vsize (KiB) 482536

[startup+1482.3 s]
/proc/loadavg: 2.06 2.04 2.01 3/183 23805
/proc/meminfo: memFree=30473880/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=182928 CPUtime=1070.32 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) S 23731 23731 20252 0 -1 4202496 28358 146243 0 0 493 208 106273 58 20 0 1 0 285176021 187318272 37778 33554432000 4194304 5872148 140734840714592 140734840707864 5123914 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23732/statm: 45732 37778 177 410 0 45314 0
[pid=23758] ppid=23732 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23758/stat : 23758 (satsolver.sh) S 23732 23731 20252 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 285283078 9367552 267 33554432000 4194304 5064252 140735981791072 140735981789984 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/23758/statm: 2287 267 226 213 0 72 0
[pid=23759] ppid=23758 vsize=282044 CPUtime=411.61 cores=0,2,4,6
/proc/23759/stat : 23759 (glucose_static) R 23758 23731 20252 0 -1 4202496 51899 0 0 0 41146 15 0 0 20 0 1 0 285283078 288813056 66021 33554432000 4194304 4896791 140735397664080 140735397661224 4224983 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23759/statm: 70511 66021 78 172 0 70337 0
Current children cumulated CPU time (s) 1481.93
Current children cumulated vsize (KiB) 483268

[startup+1542.3 s]
/proc/loadavg: 2.10 2.05 2.01 3/184 23808
/proc/meminfo: memFree=30472012/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=182928 CPUtime=1070.32 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) S 23731 23731 20252 0 -1 4202496 28358 146243 0 0 493 208 106273 58 20 0 1 0 285176021 187318272 37778 33554432000 4194304 5872148 140734840714592 140734840707864 5123914 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23732/statm: 45732 37778 177 410 0 45314 0
[pid=23758] ppid=23732 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23758/stat : 23758 (satsolver.sh) S 23732 23731 20252 0 -1 4202496 597 0 0 0 0 0 0 0 20 0 1 0 285283078 9367552 267 33554432000 4194304 5064252 140735981791072 140735981789984 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/23758/statm: 2287 267 226 213 0 72 0
[pid=23759] ppid=23758 vsize=313572 CPUtime=471.6 cores=0,2,4,6
/proc/23759/stat : 23759 (glucose_static) R 23758 23731 20252 0 -1 4202496 52192 0 0 0 47145 15 0 0 20 0 1 0 285283078 321097728 66314 33554432000 4194304 4896791 140735397664080 140735397661608 4224684 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/23759/statm: 78393 66314 78 172 0 78219 0
Current children cumulated CPU time (s) 1541.92
Current children cumulated vsize (KiB) 514796

[startup+1602.3 s]
/proc/loadavg: 2.04 2.04 2.00 3/184 23838
/proc/meminfo: memFree=30525620/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=182928 CPUtime=1547.63 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) S 23731 23731 20252 0 -1 4202496 41118 248829 0 0 624 224 153814 101 20 0 1 0 285176021 187318272 35218 33554432000 4194304 5872148 140734840714592 140734840707864 5123914 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/23732/statm: 45732 35218 177 410 0 45314 0
[pid=23813] ppid=23732 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23813/stat : 23813 (satsolver.sh) S 23732 23731 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 285330939 9367552 267 33554432000 4194304 5064252 140734909188640 140734909187552 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23813/statm: 2287 267 226 213 0 72 0
[pid=23814] ppid=23813 vsize=263056 CPUtime=53.1 cores=0,2,4,6
/proc/23814/stat : 23814 (glucose_static) R 23813 23731 20252 0 -1 4202496 44737 0 0 0 5297 13 0 0 20 0 1 0 285330939 269369344 57641 33554432000 4194304 4896791 140736391033280 140736391030424 4224983 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/23814/statm: 65764 57641 77 172 0 65590 0
Current children cumulated CPU time (s) 1600.73
Current children cumulated vsize (KiB) 464280

[startup+1662.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/183 23838
/proc/meminfo: memFree=30521052/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=182928 CPUtime=1547.63 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) S 23731 23731 20252 0 -1 4202496 41118 248829 0 0 624 224 153814 101 20 0 1 0 285176021 187318272 35218 33554432000 4194304 5872148 140734840714592 140734840707864 5123914 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/23732/statm: 45732 35218 177 410 0 45314 0
[pid=23813] ppid=23732 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23813/stat : 23813 (satsolver.sh) S 23732 23731 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 285330939 9367552 267 33554432000 4194304 5064252 140734909188640 140734909187552 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23813/statm: 2287 267 226 213 0 72 0
[pid=23814] ppid=23813 vsize=265196 CPUtime=113.09 cores=0,2,4,6
/proc/23814/stat : 23814 (glucose_static) R 23813 23731 20252 0 -1 4202496 45393 0 0 0 11296 13 0 0 20 0 1 0 285330939 271560704 58808 33554432000 4194304 4896791 140736391033280 140736391030488 4225124 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/23814/statm: 66299 58808 77 172 0 66125 0
Current children cumulated CPU time (s) 1660.72
Current children cumulated vsize (KiB) 466420

[startup+1722.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/183 23838
/proc/meminfo: memFree=30518244/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=182928 CPUtime=1547.63 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) S 23731 23731 20252 0 -1 4202496 41118 248829 0 0 624 224 153814 101 20 0 1 0 285176021 187318272 35218 33554432000 4194304 5872148 140734840714592 140734840707864 5123914 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/23732/statm: 45732 35218 177 410 0 45314 0
[pid=23813] ppid=23732 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23813/stat : 23813 (satsolver.sh) S 23732 23731 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 285330939 9367552 267 33554432000 4194304 5064252 140734909188640 140734909187552 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23813/statm: 2287 267 226 213 0 72 0
[pid=23814] ppid=23813 vsize=265856 CPUtime=173.08 cores=0,2,4,6
/proc/23814/stat : 23814 (glucose_static) R 23813 23731 20252 0 -1 4202496 45596 0 0 0 17295 13 0 0 20 0 1 0 285330939 272236544 59011 33554432000 4194304 4896791 140736391033280 140736391030488 4223862 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/23814/statm: 66464 59011 77 172 0 66290 0
Current children cumulated CPU time (s) 1720.71
Current children cumulated vsize (KiB) 467080

[startup+1782.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/183 23838
/proc/meminfo: memFree=30509484/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=182928 CPUtime=1547.63 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) S 23731 23731 20252 0 -1 4202496 41118 248829 0 0 624 224 153814 101 20 0 1 0 285176021 187318272 35218 33554432000 4194304 5872148 140734840714592 140734840707864 5123914 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/23732/statm: 45732 35218 177 410 0 45314 0
[pid=23813] ppid=23732 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23813/stat : 23813 (satsolver.sh) S 23732 23731 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 285330939 9367552 267 33554432000 4194304 5064252 140734909188640 140734909187552 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23813/statm: 2287 267 226 213 0 72 0
[pid=23814] ppid=23813 vsize=267036 CPUtime=233.07 cores=0,2,4,6
/proc/23814/stat : 23814 (glucose_static) R 23813 23731 20252 0 -1 4202496 45927 0 0 0 23294 13 0 0 20 0 1 0 285330939 273444864 59340 33554432000 4194304 4896791 140736391033280 140736391030488 4224706 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/23814/statm: 66759 59340 77 172 0 66585 0
Current children cumulated CPU time (s) 1780.7
Current children cumulated vsize (KiB) 468260



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1801.7 s]
/proc/loadavg: 2.00 2.01 2.00 3/183 23838
/proc/meminfo: memFree=30509204/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=182928 CPUtime=1547.63 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) S 23731 23731 20252 0 -1 4202496 41118 248829 0 0 624 224 153814 101 20 0 1 0 285176021 187318272 35218 33554432000 4194304 5872148 140734840714592 140734840707864 5123914 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/23732/statm: 45732 35218 177 410 0 45314 0
[pid=23813] ppid=23732 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23813/stat : 23813 (satsolver.sh) S 23732 23731 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 285330939 9367552 267 33554432000 4194304 5064252 140734909188640 140734909187552 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23813/statm: 2287 267 226 213 0 72 0
[pid=23814] ppid=23813 vsize=267412 CPUtime=252.47 cores=0,2,4,6
/proc/23814/stat : 23814 (glucose_static) R 23813 23731 20252 0 -1 4202496 46049 0 0 0 25234 13 0 0 20 0 1 0 285330939 273829888 59458 33554432000 4194304 4896791 140736391033280 140736391030488 4203820 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/23814/statm: 66853 59458 77 172 0 66679 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 468636

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1801.7 s]
/proc/loadavg: 2.00 2.01 2.00 3/183 23838
/proc/meminfo: memFree=30509204/32873844 swapFree=7372/7372
[pid=23731] ppid=23729 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23731/stat : 23731 (runWbo2satCp2.s) S 23729 23731 20252 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 285176021 9367552 275 33554432000 4194304 5064252 140735722378480 140735722377392 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 4 0 0 0 0 0
/proc/23731/statm: 2287 275 233 213 0 72 0
[pid=23732] ppid=23731 vsize=182928 CPUtime=1547.63 cores=0,2,4,6
/proc/23732/stat : 23732 (wbo2sat) S 23731 23731 20252 0 -1 4202496 41118 248829 0 0 624 224 153814 101 20 0 1 0 285176021 187318272 35218 33554432000 4194304 5872148 140734840714592 140734840707864 5123914 0 65536 4102 0 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/23732/statm: 45732 35218 177 410 0 45314 0
[pid=23813] ppid=23732 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/23813/stat : 23813 (satsolver.sh) S 23732 23731 20252 0 -1 4202496 598 0 0 0 0 0 0 0 20 0 1 0 285330939 9367552 267 33554432000 4194304 5064252 140734909188640 140734909187552 245294065230 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/23813/statm: 2287 267 226 213 0 72 0
[pid=23814] ppid=23813 vsize=267412 CPUtime=252.47 cores=0,2,4,6
/proc/23814/stat : 23814 (glucose_static) R 23813 23731 20252 0 -1 4202496 46049 0 0 0 25234 13 0 0 20 0 1 0 285330939 273829888 59458 33554432000 4194304 4896791 140736391033280 140736391030488 4203820 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/23814/statm: 66853 59458 77 172 0 66679 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 468636

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 23731 and gives
#  childrusage.ru_utime.tv_sec=1544
#  childrusage.ru_utime.tv_usec=391216
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=268503
# CPU time returned by wait4() is 1547.66
# while last known CPU time is 1800.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1801.72
CPU time (s): 1800.1
CPU user time (s): 1796.72
CPU system time (s): 3.38
CPU usage (%): 99.9101
Max. virtual memory (cumulated for all children) (KiB): 565584

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1544.39
system time used= 3.2685
maximum resident set size= 338696
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 290927
page faults= 0
swaps= 0
block input operations= 0
block output operations= 915936
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 231
involuntary context switches= 1719

runsolver used 3.78342 second user time and 12.5261 second system time

The end

Launcher Data 

Begin job on node109 at 2012-05-28 09:34:34
IDJOB=3717115
IDBENCH=79092
IDSOLVER=2299
FILE ID=node109/3717115-1338190474
RUNJOBID= node109-1338160560-20268
PBS_JOBID= 14624563
Free space on /tmp= 71052 MiB

SOLVER NAME= wbo2satCp2 2012-05-19
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB10/oliveras/j60/normalized-j6030_9-unsat--soft-66-100-0.wbo
COMMAND LINE= DIR/runWbo2satCp2.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3717115-1338190474/watcher-3717115-1338190474 -o /tmp/evaluation-result-3717115-1338190474/solver-3717115-1338190474 -C 1800 -W 1900 -M 15500  HOME/runWbo2satCp2.sh HOME/instance-3717115-1338190474.wbo 282666105 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 1889fba1555b8697309aed0b2b80cc12
RANDOM SEED=282666105

node109.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2667.264
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        30716832 kB
Buffers:          187508 kB
Cached:           445216 kB
SwapCached:          588 kB
Active:          1185400 kB
Inactive:         167520 kB
Active(anon):     714396 kB
Inactive(anon):     7668 kB
Active(file):     471004 kB
Inactive(file):   159852 kB
Unevictable:        7372 kB
Mlocked:            7372 kB
SwapTotal:      67108856 kB
SwapFree:       67106292 kB
Dirty:              9920 kB
Writeback:             0 kB
AnonPages:        765348 kB
Mapped:            11092 kB
Shmem:                 8 kB
Slab:             661936 kB
SReclaimable:     104196 kB
SUnreclaim:       557740 kB
KernelStack:        1504 kB
PageTables:         5520 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:    1020288 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    698368 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70984 MiB
End job on node109 at 2012-05-28 10:04:36