Trace number 3703997

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.0? (TO) 1800.13 902.169

General information on the benchmark

Name/OPT-SMALLINT-LIN/
heinz/normalized-datt256.opb
MD5SUMeff0b252efd7ad849119636cdcc0cdec
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables262144
Total number of constraints11077
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)516
Number of constraints which are nor clauses,nor cardinality constraints10561
Minimum length of a constraint1
Maximum length of a constraint57840
Number of terms in the objective function 262144
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 262144
Number of bits of the sum of numbers in the objective function 19
Biggest number in a constraint 2
Number of bits of the biggest number in a constraint 2
Biggest sum of numbers in a constraint 262144
Number of bits of the biggest sum of numbers19
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.0 beta - March, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3703997-1338097729.opb.
0.00/0.00	c Instance file HOME/instance-3703997-1338097729.opb
0.00/0.00	c File size is 18715310 bytes.
3.59/3.67	c Cost Offset: 0
3.59/3.67	c Highest Coefficient sum: 61440
3.59/3.68	c ============================[ Problem Statistics ]=============================
3.59/3.68	c |                                                                             |
3.59/3.68	c |  Parsing time:          3.68         s                                      |
3.59/3.68	c |  Number Variables:      262144                                              |
3.59/3.68	c |  Number Clauses:        516                                                 |
3.59/3.68	c |  Number Cardinality:    21632                                               |
3.59/3.68	c |  Number PB Constraints: 1                                                   |
3.59/3.68	c |                                                                             |
3.85/3.88	c |  Problem Type:          Optimization                                        |
3.85/3.88	c |  Objective Function:    Cardinality Constraint                              |
3.85/3.88	c |                                                                             |
3.85/3.88	c ===============================================================================
1800.13/902.11	c ===============================================================================
1800.13/902.11	c Wall Clock Time: 902.11 s
1800.13/902.11	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3703997-1338097729/watcher-3703997-1338097729 -o /tmp/evaluation-result-3703997-1338097729/solver-3703997-1338097729 -C 1800 -W 1900 -M 15500 pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703997-1338097729.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.85 3.97 3.95 4/178 22536
/proc/meminfo: memFree=30965436/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=23380 CPUtime=0 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) R 22534 22536 19605 0 -1 4202496 594 0 0 0 0 0 0 0 20 0 1 0 275898614 23941120 547 33554432000 4194304 5965102 140736069695248 140734041940648 4396239 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 5845 548 158 433 0 839 0

[startup+0.0135941 s]
/proc/loadavg: 3.85 3.97 3.95 4/178 22536
/proc/meminfo: memFree=30965436/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=26840 CPUtime=0 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) R 22534 22536 19605 0 -1 4202496 1330 0 0 0 0 0 0 0 20 0 1 0 275898614 27484160 1283 33554432000 4194304 5965102 140736069695248 140734041940648 4396569 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 6710 1283 175 433 0 1704 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 26840

[startup+0.10023 s]
/proc/loadavg: 3.85 3.97 3.95 4/178 22536
/proc/meminfo: memFree=30965436/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=58540 CPUtime=0.08 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) R 22534 22536 19605 0 -1 4202496 9437 0 0 0 7 1 0 0 20 0 1 0 275898614 59944960 8671 33554432000 4194304 5965102 140736069695248 140734041940648 5137146 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 14635 8677 363 433 0 9629 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 58540

[startup+0.300218 s]
/proc/loadavg: 3.85 3.97 3.95 4/178 22536
/proc/meminfo: memFree=30965436/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=134964 CPUtime=0.28 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) R 22534 22536 19605 0 -1 4202496 25363 0 0 0 24 4 0 0 20 0 1 0 275898614 138203136 24370 33554432000 4194304 5965102 140736069695248 140734041940648 5137146 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 33741 24371 771 433 0 28735 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 134964

[startup+0.700242 s]
/proc/loadavg: 3.85 3.97 3.95 4/178 22536
/proc/meminfo: memFree=30965436/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=177444 CPUtime=0.69 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) R 22534 22536 19605 0 -1 4202496 37516 0 0 0 62 7 0 0 20 0 1 0 275898614 181702656 36523 33554432000 4194304 5965102 140736069695248 140736069693224 5007171 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 44361 36524 1236 433 0 39355 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 177444

[startup+1.50024 s]
/proc/loadavg: 3.87 3.97 3.95 4/179 22537
/proc/meminfo: memFree=30791816/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=249512 CPUtime=1.49 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) R 22534 22536 19605 0 -1 4202496 56434 0 0 0 139 10 0 0 20 0 1 0 275898614 255500288 55441 33554432000 4194304 5965102 140736069695248 140736069693224 4351027 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 62378 55441 2145 433 0 57372 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 249512

[startup+3.10023 s]
/proc/loadavg: 3.87 3.97 3.95 4/179 22537
/proc/meminfo: memFree=30703404/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=349384 CPUtime=3.09 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) R 22534 22536 19605 0 -1 4202496 83035 0 0 0 295 14 0 0 20 0 1 0 275898614 357769216 82042 33554432000 4194304 5965102 140736069695248 140736069693224 5303350 0 0 4096 16387 0 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 87346 82042 3789 433 0 82340 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 349384

[startup+6.30028 s]
/proc/loadavg: 3.87 3.97 3.95 5/181 22539
/proc/meminfo: memFree=30315976/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=754208 CPUtime=8.82 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 157012 0 0 0 841 41 0 0 20 0 3 0 275898614 772308992 166190 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 188552 166190 194 433 0 188116 0
[pid=22536/tid=22538] ppid=22534 vsize=754208 CPUtime=2.56 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 45970 0 0 0 236 20 0 0 20 0 3 0 275898982 772308992 166190 33554432000 4194304 5965102 140736069695248 139919718492504 4408203 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=754208 CPUtime=2.59 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14196 0 0 0 253 6 0 0 20 0 3 0 275898982 772308992 166190 33554432000 4194304 5965102 140736069695248 139919594850408 4221984 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 8.82
Current children cumulated vsize (KiB) 754208

[startup+12.7003 s]
/proc/loadavg: 3.89 3.97 3.95 5/181 22539
/proc/meminfo: memFree=30166376/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=885280 CPUtime=21.62 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 166998 0 0 0 2117 45 0 0 20 0 3 0 275898614 906526720 198770 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 221320 198770 194 433 0 220884 0
[pid=22536/tid=22538] ppid=22534 vsize=885280 CPUtime=8.94 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 55955 0 0 0 871 23 0 0 20 0 3 0 275898982 906526720 198770 33554432000 4194304 5965102 140736069695248 139919718492504 5143143 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=885280 CPUtime=8.97 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14197 0 0 0 891 6 0 0 20 0 3 0 275898982 906526720 198770 33554432000 4194304 5965102 140736069695248 139919594850408 4221984 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 21.62
Current children cumulated vsize (KiB) 885280

[startup+25.5003 s]
/proc/loadavg: 3.90 3.97 3.95 5/181 22539
/proc/meminfo: memFree=29910872/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=1147424 CPUtime=47.22 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 185364 0 0 0 4670 52 0 0 20 0 3 0 275898614 1174962176 257730 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 286856 257730 194 433 0 286420 0
[pid=22536/tid=22538] ppid=22534 vsize=1147424 CPUtime=21.71 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 74320 0 0 0 2141 30 0 0 20 0 3 0 275898982 1174962176 257730 33554432000 4194304 5965102 140736069695248 139919718492504 4430944 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=1147424 CPUtime=21.75 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14198 0 0 0 2169 6 0 0 20 0 3 0 275898982 1174962176 257730 33554432000 4194304 5965102 140736069695248 139919594850408 4383069 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 47.22
Current children cumulated vsize (KiB) 1147424

[startup+51.1003 s]
/proc/loadavg: 3.93 3.97 3.95 5/181 22540
/proc/meminfo: memFree=29526060/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=1540640 CPUtime=98.42 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 210025 0 0 0 9778 64 0 0 20 0 3 0 275898614 1577615360 351209 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 385160 351209 194 433 0 384724 0
[pid=22536/tid=22538] ppid=22534 vsize=1540640 CPUtime=47.25 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 98981 0 0 0 4683 42 0 0 20 0 3 0 275898982 1577615360 351209 33554432000 4194304 5965102 140736069695248 139919718492504 4409574 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=1540640 CPUtime=47.28 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14198 0 0 0 4722 6 0 0 20 0 3 0 275898982 1577615360 351209 33554432000 4194304 5965102 140736069695248 139919594850408 4383048 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 98.42
Current children cumulated vsize (KiB) 1540640

[startup+102.306 s]
/proc/loadavg: 3.97 3.97 3.95 5/182 22543
/proc/meminfo: memFree=28968452/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2195460 CPUtime=200.81 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 232858 0 0 0 20002 79 0 0 20 0 3 0 275898614 2248151040 479662 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 548865 479662 194 433 0 548429 0
[pid=22536/tid=22538] ppid=22534 vsize=2195460 CPUtime=98.32 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 121805 0 0 0 9774 58 0 0 20 0 3 0 275898982 2248151040 479662 33554432000 4194304 5965102 140736069695248 139919718492504 5144318 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2195460 CPUtime=98.34 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14207 0 0 0 9828 6 0 0 20 0 3 0 275898982 2248151040 479662 33554432000 4194304 5965102 140736069695248 139919594850408 4383036 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 200.81
Current children cumulated vsize (KiB) 2195460

[startup+162.3 s]
/proc/loadavg: 3.99 3.97 3.95 5/181 22543
/proc/meminfo: memFree=28697500/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2457604 CPUtime=320.78 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 250794 0 0 0 31986 92 0 0 20 0 3 0 275898614 2516586496 541232 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 614401 541232 196 433 0 613965 0
[pid=22536/tid=22538] ppid=22534 vsize=2457604 CPUtime=158.16 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 139741 0 0 0 15744 72 0 0 20 0 3 0 275898982 2516586496 541232 33554432000 4194304 5965102 140736069695248 139919718492520 4390200 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2457604 CPUtime=158.18 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14207 0 0 0 15811 7 0 0 20 0 3 0 275898982 2516586496 541232 33554432000 4194304 5965102 140736069695248 139919594850408 4383326 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 320.78
Current children cumulated vsize (KiB) 2457604

[startup+222.3 s]
/proc/loadavg: 3.99 3.97 3.95 5/181 22543
/proc/meminfo: memFree=28566592/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2588676 CPUtime=440.76 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 260073 0 0 0 43982 94 0 0 20 0 3 0 275898614 2650804224 561958 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 647169 561958 196 433 0 646733 0
[pid=22536/tid=22538] ppid=22534 vsize=2588676 CPUtime=218.01 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 149020 0 0 0 21725 76 0 0 20 0 3 0 275898982 2650804224 561958 33554432000 4194304 5965102 140736069695248 139919718491992 4401143 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2588676 CPUtime=218.02 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14207 0 0 0 21794 8 0 0 20 0 3 0 275898982 2650804224 561958 33554432000 4194304 5965102 140736069695248 139919594850408 4383014 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 440.76
Current children cumulated vsize (KiB) 2588676

[startup+282.3 s]
/proc/loadavg: 4.05 3.99 3.95 5/181 22543
/proc/meminfo: memFree=28542584/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2588676 CPUtime=560.74 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 260128 0 0 0 55980 94 0 0 20 0 3 0 275898614 2650804224 565590 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 647169 565590 196 433 0 646733 0
[pid=22536/tid=22538] ppid=22534 vsize=2588676 CPUtime=277.85 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 149046 0 0 0 27708 77 0 0 20 0 3 0 275898982 2650804224 565590 33554432000 4194304 5965102 140736069695248 139919718492504 4390140 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2588676 CPUtime=277.86 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14236 0 0 0 27777 9 0 0 20 0 3 0 275898982 2650804224 565590 33554432000 4194304 5965102 140736069695248 139919594850552 4222416 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 560.74
Current children cumulated vsize (KiB) 2588676

[startup+342.3 s]
/proc/loadavg: 4.02 3.99 3.95 3/176 22544
/proc/meminfo: memFree=29249916/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2588676 CPUtime=680.72 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 260133 0 0 0 67978 94 0 0 20 0 3 0 275898614 2650804224 565595 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 647169 565595 196 433 0 646733 0
[pid=22536/tid=22538] ppid=22534 vsize=2588676 CPUtime=337.7 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 149046 0 0 0 33692 78 0 0 20 0 3 0 275898982 2650804224 565595 33554432000 4194304 5965102 140736069695248 139919718492504 4401107 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2588676 CPUtime=337.7 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14241 0 0 0 33760 10 0 0 20 0 3 0 275898982 2650804224 565595 33554432000 4194304 5965102 140736069695248 139919594850616 4383059 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 680.72
Current children cumulated vsize (KiB) 2588676

[startup+402.3 s]
/proc/loadavg: 4.00 3.99 3.95 5/181 22625
/proc/meminfo: memFree=29142412/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2588676 CPUtime=800.7 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 260195 0 0 0 79975 95 0 0 20 0 3 0 275898614 2650804224 565829 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 647169 565829 196 433 0 646733 0
[pid=22536/tid=22538] ppid=22534 vsize=2588676 CPUtime=397.55 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 149105 0 0 0 39676 79 0 0 20 0 3 0 275898982 2650804224 565829 33554432000 4194304 5965102 140736069695248 139919718492504 4390200 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2588676 CPUtime=397.55 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14244 0 0 0 39743 12 0 0 20 0 3 0 275898982 2650804224 565829 33554432000 4194304 5965102 140736069695248 139919594850616 4383000 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 800.7
Current children cumulated vsize (KiB) 2588676

[startup+462.3 s]
/proc/loadavg: 4.00 3.99 3.95 5/181 22625
/proc/meminfo: memFree=29071636/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2588676 CPUtime=920.68 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 265235 0 0 0 91972 96 0 0 20 0 3 0 275898614 2650804224 570869 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 647169 570869 196 433 0 646733 0
[pid=22536/tid=22538] ppid=22534 vsize=2588676 CPUtime=457.39 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 154140 0 0 0 45659 80 0 0 20 0 3 0 275898982 2650804224 570869 33554432000 4194304 5965102 140736069695248 139919718492152 4390112 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2588676 CPUtime=457.39 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14249 0 0 0 45727 12 0 0 20 0 3 0 275898982 2650804224 570869 33554432000 4194304 5965102 140736069695248 139919594850616 4383059 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 920.68
Current children cumulated vsize (KiB) 2588676

[startup+522.3 s]
/proc/loadavg: 4.00 3.99 3.95 5/181 22625
/proc/meminfo: memFree=28967628/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2654212 CPUtime=1040.66 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 281157 0 0 0 103966 100 0 0 20 0 3 0 275898614 2717913088 586816 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 663553 586816 196 433 0 663117 0
[pid=22536/tid=22538] ppid=22534 vsize=2654212 CPUtime=517.23 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 170054 0 0 0 51638 85 0 0 20 0 3 0 275898982 2717913088 586816 33554432000 4194304 5965102 140736069695248 139919718492152 4390125 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2654212 CPUtime=517.23 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14257 0 0 0 51710 13 0 0 20 0 3 0 275898982 2717913088 586816 33554432000 4194304 5965102 140736069695248 139919594850136 4383063 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1040.66
Current children cumulated vsize (KiB) 2654212

[startup+582.3 s]
/proc/loadavg: 4.00 3.99 3.95 5/181 22625
/proc/meminfo: memFree=28883784/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2719748 CPUtime=1160.64 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 293756 0 0 0 115959 105 0 0 20 0 3 0 275898614 2785021952 600918 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 679937 600918 196 433 0 679501 0
[pid=22536/tid=22538] ppid=22534 vsize=2719748 CPUtime=577.07 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 182648 0 0 0 57617 90 0 0 20 0 3 0 275898982 2785021952 600918 33554432000 4194304 5965102 140736069695248 139919718492152 4401155 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2719748 CPUtime=577.07 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14262 0 0 0 57693 14 0 0 20 0 3 0 275898982 2785021952 600918 33554432000 4194304 5965102 140736069695248 139919594850616 4383033 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1160.64
Current children cumulated vsize (KiB) 2719748

[startup+642.3 s]
/proc/loadavg: 4.00 3.99 3.95 5/181 22625
/proc/meminfo: memFree=28807216/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2785284 CPUtime=1280.62 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 305914 0 0 0 127954 108 0 0 20 0 3 0 275898614 2852130816 613079 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 696321 613079 196 433 0 695885 0
[pid=22536/tid=22538] ppid=22534 vsize=2785284 CPUtime=636.92 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 194802 0 0 0 63597 95 0 0 20 0 3 0 275898982 2852130816 613079 33554432000 4194304 5965102 140736069695248 139919718492152 4404704 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2785284 CPUtime=636.92 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14266 0 0 0 63677 15 0 0 20 0 3 0 275898982 2852130816 613079 33554432000 4194304 5965102 140736069695248 139919594850616 4383061 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1280.62
Current children cumulated vsize (KiB) 2785284

[startup+702.3 s]
/proc/loadavg: 4.00 3.99 3.95 5/182 22629
/proc/meminfo: memFree=28737672/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2785284 CPUtime=1400.58 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 316332 0 0 0 139947 111 0 0 20 0 3 0 275898614 2852130816 623510 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 696321 623510 196 433 0 695885 0
[pid=22536/tid=22538] ppid=22534 vsize=2785284 CPUtime=696.75 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 205201 0 0 0 69576 99 0 0 20 0 3 0 275898982 2852130816 623510 33554432000 4194304 5965102 140736069695248 139919718491960 4401143 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2785284 CPUtime=696.76 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14285 0 0 0 69660 16 0 0 20 0 3 0 275898982 2852130816 623510 33554432000 4194304 5965102 140736069695248 139919594850616 4383063 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1400.58
Current children cumulated vsize (KiB) 2785284

[startup+762.306 s]
/proc/loadavg: 4.06 4.00 3.96 5/182 22652
/proc/meminfo: memFree=28664500/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2852036 CPUtime=1520.57 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 328922 0 0 0 151942 115 0 0 20 0 3 0 275898614 2920484864 636098 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 713009 636098 196 433 0 712573 0
[pid=22536/tid=22538] ppid=22534 vsize=2852036 CPUtime=756.6 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 217741 0 0 0 75556 104 0 0 20 0 3 0 275898982 2920484864 636098 33554432000 4194304 5965102 140736069695248 139919718492152 4222464 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2852036 CPUtime=756.61 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14335 0 0 0 75644 17 0 0 20 0 3 0 275898982 2920484864 636098 33554432000 4194304 5965102 140736069695248 139919594850616 4383059 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1520.57
Current children cumulated vsize (KiB) 2852036

[startup+822.3 s]
/proc/loadavg: 4.02 4.00 3.96 5/181 22652
/proc/meminfo: memFree=28615636/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2917572 CPUtime=1640.54 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 342714 0 0 0 163935 119 0 0 20 0 3 0 275898614 2987593728 649889 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 729393 649889 196 433 0 728957 0
[pid=22536/tid=22538] ppid=22534 vsize=2917572 CPUtime=816.43 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 231489 0 0 0 81535 108 0 0 20 0 3 0 275898982 2987593728 649889 33554432000 4194304 5965102 140736069695248 139919718492152 4221984 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2917572 CPUtime=816.44 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14379 0 0 0 81626 18 0 0 20 0 3 0 275898982 2987593728 649889 33554432000 4194304 5965102 140736069695248 139919594850136 4383048 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1640.54
Current children cumulated vsize (KiB) 2917572

[startup+882.3 s]
/proc/loadavg: 4.01 4.00 3.96 5/181 22652
/proc/meminfo: memFree=28575452/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2983108 CPUtime=1760.52 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 351798 0 0 0 175930 122 0 0 20 0 3 0 275898614 3054702592 659428 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 745777 659428 196 433 0 745341 0
[pid=22536/tid=22538] ppid=22534 vsize=2983108 CPUtime=876.28 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 240549 0 0 0 87515 113 0 0 20 0 3 0 275898982 3054702592 659428 33554432000 4194304 5965102 140736069695248 139919718492152 4222416 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2983108 CPUtime=876.29 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14403 0 0 0 87610 19 0 0 20 0 3 0 275898982 3054702592 659428 33554432000 4194304 5965102 140736069695248 139919594850616 4221984 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1760.52
Current children cumulated vsize (KiB) 2983108



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+902.1 s]
/proc/loadavg: 4.00 4.00 3.96 5/181 22652
/proc/meminfo: memFree=28552444/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2983108 CPUtime=1800.13 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 357395 0 0 0 179889 124 0 0 20 0 3 0 275898614 3054702592 665025 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 745777 665025 196 433 0 745341 0
[pid=22536/tid=22538] ppid=22534 vsize=2983108 CPUtime=896.03 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 246146 0 0 0 89489 114 0 0 20 0 3 0 275898982 3054702592 665025 33554432000 4194304 5965102 140736069695248 139919718492152 4390150 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2983108 CPUtime=896.04 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14403 0 0 0 89585 19 0 0 20 0 3 0 275898982 3054702592 665025 33554432000 4194304 5965102 140736069695248 139919594850616 4383036 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.13
Current children cumulated vsize (KiB) 2983108

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+902.1 s]
/proc/loadavg: 4.00 4.00 3.96 5/181 22652
/proc/meminfo: memFree=28552444/32873844 swapFree=7112/7112
[pid=22536] ppid=22534 vsize=2983108 CPUtime=1800.13 cores=0,2,4,6
/proc/22536/stat : 22536 (pwbo2.0) S 22534 22536 19605 0 -1 4202496 357395 0 0 0 179889 124 0 0 20 0 3 0 275898614 3054702592 665025 33554432000 4194304 5965102 140736069695248 140736069694768 4547341 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0 0 0
/proc/22536/statm: 745777 665025 196 433 0 745341 0
[pid=22536/tid=22538] ppid=22534 vsize=2983108 CPUtime=896.03 cores=0,2,4,6
/proc/22536/task/22538/stat : 22538 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 246146 0 0 0 89489 114 0 0 20 0 3 0 275898982 3054702592 665025 33554432000 4194304 5965102 140736069695248 139919718492152 4390150 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22536/tid=22539] ppid=22534 vsize=2983108 CPUtime=896.04 cores=0,2,4,6
/proc/22536/task/22539/stat : 22539 (pwbo2.0) R 22534 22536 19605 0 -1 4202560 14403 0 0 0 89585 19 0 0 20 0 3 0 275898982 3054702592 665025 33554432000 4194304 5965102 140736069695248 139919594850616 4383036 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.13
Current children cumulated vsize (KiB) 2983108

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 22536 and gives
#  childrusage.ru_utime.tv_sec=1794
#  childrusage.ru_utime.tv_usec=276228
#  childrusage.ru_stime.tv_sec=1
#  childrusage.ru_stime.tv_usec=567761
# CPU time returned by wait4() is 1795.84
# while last known CPU time is 1800.13
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 902.169
CPU time (s): 1800.13
CPU user time (s): 1798.89
CPU system time (s): 1.24
CPU usage (%): 199.534
Max. virtual memory (cumulated for all children) (KiB): 2983108

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1794.28
system time used= 1.56776
maximum resident set size= 2660104
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 357396
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4415
involuntary context switches= 2050

runsolver used 1.80073 second user time and 4.71628 second system time

The end

Launcher Data 

Begin job on node119 at 2012-05-27 07:48:49
IDJOB=3703997
IDBENCH=89871
IDSOLVER=2279
FILE ID=node119/3703997-1338097729
RUNJOBID= node119-1338085105-19621
PBS_JOBID= 14624426
Free space on /tmp= 71588 MiB

SOLVER NAME= pwbo 2.0
BENCH NAME= PB11/normalized-PB11/OPT-SMALLINT-LIN/heinz/normalized-datt256.opb
COMMAND LINE= pwbo2.0 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3703997-1338097729/watcher-3703997-1338097729 -o /tmp/evaluation-result-3703997-1338097729/solver-3703997-1338097729 -C 1800 -W 1900 -M 15500  pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3703997-1338097729.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= eff0b252efd7ad849119636cdcc0cdec
RANDOM SEED=637918099

node119.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        30965708 kB
Buffers:          258636 kB
Cached:           292360 kB
SwapCached:         1776 kB
Active:          1042180 kB
Inactive:          66132 kB
Active(anon):     557268 kB
Inactive(anon):     1972 kB
Active(file):     484912 kB
Inactive(file):    64160 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67100168 kB
Dirty:             23724 kB
Writeback:            20 kB
AnonPages:        567076 kB
Mapped:            12664 kB
Shmem:                 8 kB
Slab:             656544 kB
SReclaimable:      98616 kB
SUnreclaim:       557928 kB
KernelStack:        1448 kB
PageTables:         5072 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     260584 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    364544 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71584 MiB
End job on node119 at 2012-05-27 08:03:54