Trace number 3726390

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.02? (TO) 1800.13 902.276

General information on the benchmark

Name/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_50null20mast_rapportOE2.0_TMAX120_K192_cod2.opb
MD5SUM7e1ba98da2a2cea04a0e7f6c87cec7d2
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-4565
Best CPU time to get the best result obtained on this benchmark1800.5
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables400896
Total number of constraints402763
Number of constraints which are clauses400785
Number of constraints which are cardinality constraints (but not clauses)194
Number of constraints which are nor clauses,nor cardinality constraints1784
Minimum length of a constraint2
Maximum length of a constraint58023
Number of terms in the objective function 892
Biggest coefficient in the objective function 1000
Number of bits for the biggest coefficient in the objective function 10
Sum of the numbers in the objective function 624831
Number of bits of the sum of numbers in the objective function 20
Biggest number in a constraint 1000
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 624831
Number of bits of the biggest sum of numbers20
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3726390-1338660034.opb.
0.00/0.00	c Instance file HOME/instance-3726390-1338660034.opb
0.00/0.00	c File size is 28226981 bytes.
3.39/3.48	c Cost Offset: -624831
3.39/3.48	c Highest Coefficient sum: 66365
3.39/3.48	c ============================[ Problem Statistics ]=============================
3.39/3.48	c |                                                                             |
3.39/3.48	c |  Parsing time:          3.49         s                                      |
3.39/3.48	c |  Number Variables:      400896                                              |
3.39/3.48	c |  Number Clauses:        400785                                              |
3.39/3.48	c |  Number Cardinality:    1977                                                |
3.39/3.48	c |  Number PB Constraints: 1                                                   |
3.39/3.48	c |                                                                             |
3.97/3.86	c |  Problem Type:          Optimization                                        |
3.97/3.86	c |  Objective Function:    PB Constraint                                       |
3.97/3.86	c |                                                                             |
3.97/3.86	c ===============================================================================
1800.13/902.21	c ===============================================================================
1800.13/902.21	c Wall Clock Time: 902.21 s
1800.13/902.21	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3726390-1338660034/watcher-3726390-1338660034 -o /tmp/evaluation-result-3726390-1338660034/solver-3726390-1338660034 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3726390-1338660034.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.92 3.98 3.91 4/179 19110
/proc/meminfo: memFree=26255276/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=32828 CPUtime=0 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) R 19108 19110 15996 0 -1 4202496 621 0 0 0 0 0 0 0 20 0 1 0 332131980 33615872 573 33554432000 4194304 5964478 140733895746880 140735152041656 4395406 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 8207 574 168 433 0 879 0

[startup+0.0981599 s]
/proc/loadavg: 3.92 3.98 3.91 4/179 19110
/proc/meminfo: memFree=26255276/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=48172 CPUtime=0.08 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) R 19108 19110 15996 0 -1 4202496 4609 0 0 0 8 0 0 0 20 0 1 0 332131980 49328128 4479 33554432000 4194304 5964478 140733895746880 140735152041656 5136490 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 12043 4484 426 433 0 4715 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 48172

[startup+0.100365 s]
/proc/loadavg: 3.92 3.98 3.91 4/179 19110
/proc/meminfo: memFree=26255276/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=50596 CPUtime=0.08 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) R 19108 19110 15996 0 -1 4202496 4700 0 0 0 8 0 0 0 20 0 1 0 332131980 51810304 4570 33554432000 4194304 5964478 140733895746880 140735152041656 5248554 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 12649 4571 431 433 0 5321 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 50596

[startup+0.300315 s]
/proc/loadavg: 3.92 3.98 3.91 4/179 19110
/proc/meminfo: memFree=26255276/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=69468 CPUtime=0.29 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) R 19108 19110 15996 0 -1 4202496 10501 0 0 0 28 1 0 0 20 0 1 0 332131980 71135232 10104 33554432000 4194304 5964478 140733895746880 140735152041656 5136420 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 17367 10104 959 433 0 10039 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 69468

[startup+0.700305 s]
/proc/loadavg: 3.92 3.98 3.91 4/179 19110
/proc/meminfo: memFree=26255276/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=114744 CPUtime=0.68 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) R 19108 19110 15996 0 -1 4202496 22310 0 0 0 66 2 0 0 20 0 1 0 332131980 117497856 21383 33554432000 4194304 5964478 140733895746880 140735152041656 5136490 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 28686 21387 1934 433 0 21358 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 114744

[startup+1.50031 s]
/proc/loadavg: 3.92 3.98 3.91 4/180 19111
/proc/meminfo: memFree=26151716/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=208076 CPUtime=1.49 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) R 19108 19110 15996 0 -1 4202496 43074 0 0 0 142 7 0 0 20 0 1 0 332131980 213069824 44153 33554432000 4194304 5964478 140733895746880 140733895745224 4395406 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 52019 44153 3570 433 0 44691 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 208076

[startup+3.10032 s]
/proc/loadavg: 3.92 3.98 3.91 4/180 19111
/proc/meminfo: memFree=26057088/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=322848 CPUtime=3.09 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) R 19108 19110 15996 0 -1 4202496 70562 0 0 0 295 14 0 0 20 0 1 0 332131980 330596352 74136 33554432000 4194304 5964478 140733895746880 140733895745288 4344768 0 0 4096 16387 0 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 80712 74140 6398 433 0 73384 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 322848

[startup+6.30041 s]
/proc/loadavg: 3.93 3.98 3.91 5/182 19113
/proc/meminfo: memFree=25543908/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=885568 CPUtime=8.91 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 161380 0 0 0 840 51 0 0 20 0 3 0 332131980 906821632 180631 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 221392 180631 196 433 0 220956 0
[pid=19110/tid=19112] ppid=19108 vsize=885568 CPUtime=2.76 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 64770 0 0 0 251 25 0 0 20 0 3 0 332132328 906821632 180631 33554432000 4194304 5964478 140733895746880 140397845084456 5122467 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=885568 CPUtime=2.71 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 20273 0 0 0 260 11 0 0 20 0 3 0 332132328 906821632 180631 33554432000 4194304 5964478 140733895746880 140397834594536 4403656 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 8.91
Current children cumulated vsize (KiB) 885568

[startup+12.7004 s]
/proc/loadavg: 3.93 3.98 3.91 5/182 19114
/proc/meminfo: memFree=25478784/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=885568 CPUtime=21.7 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 168851 0 0 0 2116 54 0 0 20 0 3 0 332131980 906821632 190708 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 221392 190708 197 433 0 220956 0
[pid=19110/tid=19112] ppid=19108 vsize=885568 CPUtime=9.14 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 69772 0 0 0 887 27 0 0 20 0 3 0 332132328 906821632 190708 33554432000 4194304 5964478 140733895746880 140397845084504 5142509 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=885568 CPUtime=9.09 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 22742 0 0 0 897 12 0 0 20 0 3 0 332132328 906821632 190708 33554432000 4194304 5964478 140733895746880 140397834594616 4392882 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 21.7
Current children cumulated vsize (KiB) 885568

[startup+25.5005 s]
/proc/loadavg: 3.95 3.98 3.91 5/182 19114
/proc/meminfo: memFree=25405036/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=1016640 CPUtime=47.3 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 180803 0 0 0 4667 63 0 0 20 0 3 0 332131980 1041039360 205456 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 254160 205456 197 433 0 253724 0
[pid=19110/tid=19112] ppid=19108 vsize=1016640 CPUtime=21.91 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 81559 0 0 0 2156 35 0 0 20 0 3 0 332132328 1041039360 205456 33554432000 4194304 5964478 140733895746880 140397845084456 5130842 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=1016640 CPUtime=21.86 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 22907 0 0 0 2173 13 0 0 20 0 3 0 332132328 1041039360 205456 33554432000 4194304 5964478 140733895746880 140397834594664 4222464 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 47.3
Current children cumulated vsize (KiB) 1016640

[startup+51.1005 s]
/proc/loadavg: 3.96 3.98 3.91 5/182 19137
/proc/meminfo: memFree=25247788/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=1082300 CPUtime=98.48 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 205917 0 0 0 9770 78 0 0 20 0 3 0 332131980 1108275200 231902 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 270575 231902 197 433 0 270139 0
[pid=19110/tid=19112] ppid=19108 vsize=1082300 CPUtime=47.44 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 106321 0 0 0 4695 49 0 0 20 0 3 0 332132328 1108275200 231902 33554432000 4194304 5964478 140733895746880 140397845084696 4419587 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=1082300 CPUtime=47.39 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 23259 0 0 0 4725 14 0 0 20 0 3 0 332132328 1108275200 231902 33554432000 4194304 5964478 140733895746880 140397834594664 4392918 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 98.48
Current children cumulated vsize (KiB) 1082300

[startup+102.3 s]
/proc/loadavg: 3.98 3.98 3.91 5/181 19137
/proc/meminfo: memFree=24923892/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=1360848 CPUtime=200.86 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 258136 0 0 0 19974 112 0 0 20 0 3 0 332131980 1393508352 292947 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 340212 292947 197 433 0 339776 0
[pid=19110/tid=19112] ppid=19108 vsize=1360848 CPUtime=98.52 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 157878 0 0 0 9769 83 0 0 20 0 3 0 332132328 1393508352 292947 33554432000 4194304 5964478 140733895746880 140397845084696 5142822 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=1360848 CPUtime=98.45 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 23921 0 0 0 9830 15 0 0 20 0 3 0 332132328 1393508352 292947 33554432000 4194304 5964478 140733895746880 140397834594616 4399873 0 0 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 200.86
Current children cumulated vsize (KiB) 1360848

[startup+162.301 s]
/proc/loadavg: 3.99 3.98 3.91 5/181 19137
/proc/meminfo: memFree=24652140/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=1590264 CPUtime=320.83 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 274390 0 0 0 31948 135 0 0 20 0 3 0 332131980 1628430336 340861 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 397566 340861 197 433 0 397130 0
[pid=19110/tid=19112] ppid=19108 vsize=1590264 CPUtime=158.36 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 173631 0 0 0 15732 104 0 0 20 0 3 0 332132328 1628430336 340861 33554432000 4194304 5964478 140733895746880 140397845084424 5130901 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=1590264 CPUtime=158.28 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 24422 0 0 0 15809 19 0 0 20 0 3 0 332132328 1628430336 340861 33554432000 4194304 5964478 140733895746880 140397834594552 4392918 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 320.83
Current children cumulated vsize (KiB) 1590264

[startup+222.308 s]
/proc/loadavg: 3.99 3.98 3.91 5/181 19137
/proc/meminfo: memFree=24222016/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=1958876 CPUtime=440.83 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 300299 0 0 0 43920 163 0 0 20 0 3 0 332131980 2005889024 414455 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 489719 414455 197 433 0 489283 0
[pid=19110/tid=19112] ppid=19108 vsize=1958876 CPUtime=218.21 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 199061 0 0 0 21689 132 0 0 20 0 3 0 332132328 2005889024 414455 33554432000 4194304 5964478 140733895746880 140397845084456 5135617 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=1958876 CPUtime=218.13 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 24901 0 0 0 21792 21 0 0 20 0 3 0 332132328 2005889024 414455 33554432000 4194304 5964478 140733895746880 140397834594616 4392805 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 440.83
Current children cumulated vsize (KiB) 1958876

[startup+282.3 s]
/proc/loadavg: 3.99 3.98 3.91 5/181 19137
/proc/meminfo: memFree=23945116/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=2196412 CPUtime=560.79 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 339486 0 0 0 55882 197 0 0 20 0 3 0 332131980 2249125888 460439 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 549103 460439 197 433 0 548667 0
[pid=19110/tid=19112] ppid=19108 vsize=2196412 CPUtime=278.05 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 237674 0 0 0 27639 166 0 0 20 0 3 0 332132328 2249125888 460439 33554432000 4194304 5964478 140733895746880 140397845084696 5133791 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=2196412 CPUtime=277.97 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 25475 0 0 0 27774 23 0 0 20 0 3 0 332132328 2249125888 460439 33554432000 4194304 5964478 140733895746880 140397834594616 4222416 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 560.79
Current children cumulated vsize (KiB) 2196412

[startup+342.301 s]
/proc/loadavg: 4.07 4.00 3.92 5/181 19138
/proc/meminfo: memFree=23633940/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=2458556 CPUtime=680.77 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 355015 0 0 0 67864 213 0 0 20 0 3 0 332131980 2517561344 511962 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 614639 511962 197 433 0 614203 0
[pid=19110/tid=19112] ppid=19108 vsize=2458556 CPUtime=337.89 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 252780 0 0 0 33606 183 0 0 20 0 3 0 332132328 2517561344 511962 33554432000 4194304 5964478 140733895746880 140397845084504 4399900 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=2458556 CPUtime=337.82 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 25898 0 0 0 33757 25 0 0 20 0 3 0 332132328 2517561344 511962 33554432000 4194304 5964478 140733895746880 140397834594616 4403343 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 680.77
Current children cumulated vsize (KiB) 2458556

[startup+402.3 s]
/proc/loadavg: 4.02 4.00 3.92 5/181 19138
/proc/meminfo: memFree=23478864/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=2524092 CPUtime=800.75 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 367783 0 0 0 79846 229 0 0 20 0 3 0 332131980 2584670208 531599 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 631023 531599 197 433 0 630587 0
[pid=19110/tid=19112] ppid=19108 vsize=2524092 CPUtime=397.74 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 264995 0 0 0 39575 199 0 0 20 0 3 0 332132328 2584670208 531599 33554432000 4194304 5964478 140733895746880 140397845084504 4390878 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=2524092 CPUtime=397.66 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 26451 0 0 0 39739 27 0 0 20 0 3 0 332132328 2584670208 531599 33554432000 4194304 5964478 140733895746880 140397834594616 4389132 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 800.75
Current children cumulated vsize (KiB) 2524092

[startup+462.3 s]
/proc/loadavg: 4.01 4.00 3.92 5/181 19138
/proc/meminfo: memFree=23289872/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=2655164 CPUtime=920.72 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 384795 0 0 0 91828 244 0 0 20 0 3 0 332131980 2718887936 559095 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 663791 559095 197 433 0 663355 0
[pid=19110/tid=19112] ppid=19108 vsize=2655164 CPUtime=457.59 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 281620 0 0 0 45546 213 0 0 20 0 3 0 332132328 2718887936 559095 33554432000 4194304 5964478 140733895746880 140397845084504 4392918 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=2655164 CPUtime=457.49 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 26838 0 0 0 45722 27 0 0 20 0 3 0 332132328 2718887936 559095 33554432000 4194304 5964478 140733895746880 140397834594616 4389147 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 920.72
Current children cumulated vsize (KiB) 2655164

[startup+522.301 s]
/proc/loadavg: 4.00 4.00 3.92 5/181 19138
/proc/meminfo: memFree=23058036/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=2851772 CPUtime=1040.69 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 395530 0 0 0 103813 256 0 0 20 0 3 0 332131980 2920214528 593802 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 712943 593802 197 433 0 712507 0
[pid=19110/tid=19112] ppid=19108 vsize=2851772 CPUtime=517.43 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 291855 0 0 0 51517 226 0 0 20 0 3 0 332132328 2920214528 593802 33554432000 4194304 5964478 140733895746880 140397845084568 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=2851772 CPUtime=517.33 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 27338 0 0 0 51704 29 0 0 20 0 3 0 332132328 2920214528 593802 33554432000 4194304 5964478 140733895746880 140397834594616 4399912 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1040.69
Current children cumulated vsize (KiB) 2851772

[startup+582.3 s]
/proc/loadavg: 3.43 3.87 3.88 3/174 19166
/proc/meminfo: memFree=24641304/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=2982844 CPUtime=1160.68 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 400972 0 0 0 115801 267 0 0 20 0 3 0 332131980 3054432256 619021 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 745711 619021 197 433 0 745275 0
[pid=19110/tid=19112] ppid=19108 vsize=2982844 CPUtime=577.28 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 296647 0 0 0 57492 236 0 0 20 0 3 0 332132328 3054432256 619021 33554432000 4194304 5964478 140733895746880 140397845084696 5142496 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=2982844 CPUtime=577.18 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 27988 0 0 0 57687 31 0 0 20 0 3 0 332132328 3054432256 619021 33554432000 4194304 5964478 140733895746880 140397834594616 4392882 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1160.68
Current children cumulated vsize (KiB) 2982844

[startup+642.3 s]
/proc/loadavg: 2.52 3.53 3.76 3/173 19167
/proc/meminfo: memFree=24495820/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=3048380 CPUtime=1280.65 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 413576 0 0 0 127782 283 0 0 20 0 3 0 332131980 3121541120 643334 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 762095 643334 197 433 0 761659 0
[pid=19110/tid=19112] ppid=19108 vsize=3048380 CPUtime=637.12 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 308677 0 0 0 63460 252 0 0 20 0 3 0 332132328 3121541120 643334 33554432000 4194304 5964478 140733895746880 140397845084696 4389164 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=3048380 CPUtime=637.02 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 28562 0 0 0 63669 33 0 0 20 0 3 0 332132328 3121541120 643334 33554432000 4194304 5964478 140733895746880 140397834594616 4389164 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1280.65
Current children cumulated vsize (KiB) 3048380

[startup+702.3 s]
/proc/loadavg: 2.19 3.25 3.64 3/173 19167
/proc/meminfo: memFree=24423004/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=3261564 CPUtime=1400.63 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 423245 0 0 0 139737 326 0 0 20 0 3 0 332131980 3339841536 682905 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 815391 682905 197 433 0 814955 0
[pid=19110/tid=19112] ppid=19108 vsize=3261564 CPUtime=696.97 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 317763 0 0 0 69402 295 0 0 20 0 3 0 332132328 3339841536 682905 33554432000 4194304 5964478 140733895746880 140397845084504 5139166 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=3261564 CPUtime=696.87 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 29145 0 0 0 69651 36 0 0 20 0 3 0 332132328 3339841536 682905 33554432000 4194304 5964478 140733895746880 140397834594664 4221984 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1400.63
Current children cumulated vsize (KiB) 3261564

[startup+762.3 s]
/proc/loadavg: 2.07 3.02 3.54 3/173 19167
/proc/meminfo: memFree=24297872/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=3322912 CPUtime=1520.61 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 491765 0 0 0 151658 403 0 0 20 0 3 0 332131980 3402661888 705000 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 830728 705000 197 433 0 830292 0
[pid=19110/tid=19112] ppid=19108 vsize=3322912 CPUtime=756.81 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 385691 0 0 0 75309 372 0 0 20 0 3 0 332132328 3402661888 705000 33554432000 4194304 5964478 140733895746880 140397845084504 4409255 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=3322912 CPUtime=756.72 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 29737 0 0 0 75634 38 0 0 20 0 3 0 332132328 3402661888 705000 33554432000 4194304 5964478 140733895746880 140397834594616 4403708 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1520.61
Current children cumulated vsize (KiB) 3322912

[startup+822.3 s]
/proc/loadavg: 2.10 2.85 3.44 3/173 19167
/proc/meminfo: memFree=24107904/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=3474492 CPUtime=1640.54 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 533742 0 0 0 163590 464 0 0 20 0 3 0 332131980 3557879808 738986 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 868623 738986 197 433 0 868187 0
[pid=19110/tid=19112] ppid=19108 vsize=3474492 CPUtime=816.65 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 427156 0 0 0 81233 432 0 0 20 0 3 0 332132328 3557879808 738986 33554432000 4194304 5964478 140733895746880 140397845084568 5122424 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=3474492 CPUtime=816.51 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 30249 0 0 0 81611 40 0 0 20 0 3 0 332132328 3557879808 738986 33554432000 4194304 5964478 140733895746880 140397834594616 4222416 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1640.54
Current children cumulated vsize (KiB) 3474492

[startup+882.307 s]
/proc/loadavg: 2.04 2.69 3.35 3/173 19167
/proc/meminfo: memFree=23963660/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=3658960 CPUtime=1760.38 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 578299 0 0 0 175513 525 0 0 20 0 3 0 332131980 3746775040 788435 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 914740 788435 197 433 0 914304 0
[pid=19110/tid=19112] ppid=19108 vsize=3658960 CPUtime=876.5 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 471179 0 0 0 87158 492 0 0 20 0 3 0 332132328 3746775040 788435 33554432000 4194304 5964478 140733895746880 140397845084504 5142509 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=3658960 CPUtime=876.21 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 30783 0 0 0 87579 42 0 0 20 0 3 0 332132328 3746775040 788435 33554432000 4194304 5964478 140733895746880 140397834594616 4389170 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1760.38
Current children cumulated vsize (KiB) 3658960



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+902.2 s]
/proc/loadavg: 2.02 2.64 3.32 3/173 19167
/proc/meminfo: memFree=23991704/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=3673832 CPUtime=1800.13 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 599097 0 0 0 179463 550 0 0 20 0 3 0 332131980 3762003968 781373 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 918458 781373 197 433 0 918022 0
[pid=19110/tid=19112] ppid=19108 vsize=3673832 CPUtime=896.35 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 491794 0 0 0 89119 516 0 0 20 0 3 0 332132328 3762003968 781373 33554432000 4194304 5964478 140733895746880 140397845084568 5122378 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=3673832 CPUtime=896.02 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 30966 0 0 0 89559 43 0 0 20 0 3 0 332132328 3762003968 781373 33554432000 4194304 5964478 140733895746880 140397834594616 4222464 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.13
Current children cumulated vsize (KiB) 3673832

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+902.2 s]
/proc/loadavg: 2.02 2.64 3.32 3/173 19167
/proc/meminfo: memFree=23991704/32873844 swapFree=7628/7628
[pid=19110] ppid=19108 vsize=3673832 CPUtime=1800.13 cores=1,3,5,7
/proc/19110/stat : 19110 (pwbo2.02) S 19108 19110 15996 0 -1 4202496 599097 0 0 0 179463 550 0 0 20 0 3 0 332131980 3762003968 781373 33554432000 4194304 5964478 140733895746880 140733895746400 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/19110/statm: 918458 781373 197 433 0 918022 0
[pid=19110/tid=19112] ppid=19108 vsize=3673832 CPUtime=896.35 cores=1,3,5,7
/proc/19110/task/19112/stat : 19112 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 491794 0 0 0 89119 516 0 0 20 0 3 0 332132328 3762003968 781373 33554432000 4194304 5964478 140733895746880 140397845084568 5122378 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=19110/tid=19113] ppid=19108 vsize=3673832 CPUtime=896.02 cores=1,3,5,7
/proc/19110/task/19113/stat : 19113 (pwbo2.02) R 19108 19110 15996 0 -1 4202560 30966 0 0 0 89559 43 0 0 20 0 3 0 332132328 3762003968 781373 33554432000 4194304 5964478 140733895746880 140397834594616 4222464 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.13
Current children cumulated vsize (KiB) 3673832

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 19110 and gives
#  childrusage.ru_utime.tv_sec=1790
#  childrusage.ru_utime.tv_usec=132858
#  childrusage.ru_stime.tv_sec=5
#  childrusage.ru_stime.tv_usec=820115
# CPU time returned by wait4() is 1795.95
# while last known CPU time is 1800.13
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 902.276
CPU time (s): 1800.13
CPU user time (s): 1794.63
CPU system time (s): 5.5
CPU usage (%): 199.51
Max. virtual memory (cumulated for all children) (KiB): 3764060

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1790.13
system time used= 5.82011
maximum resident set size= 3229048
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 599099
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7716
involuntary context switches= 2269

runsolver used 2.15267 second user time and 5.49216 second system time

The end

Launcher Data 

Begin job on node107 at 2012-06-02 20:00:34
IDJOB=3726390
IDBENCH=90863
IDSOLVER=2309
FILE ID=node107/3726390-1338660034
RUNJOBID= node107-1338651552-17542
PBS_JOBID= 14636473
Free space on /tmp= 70748 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB12/normalized-PB12/OPT-SMALLINT-LIN/sroussel/NG/normalized-NG.dot_unif_50null20mast_rapportOE2.0_TMAX120_K192_cod2.opb
COMMAND LINE= pwbo2.02 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3726390-1338660034/watcher-3726390-1338660034 -o /tmp/evaluation-result-3726390-1338660034/solver-3726390-1338660034 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3726390-1338660034.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7e1ba98da2a2cea04a0e7f6c87cec7d2
RANDOM SEED=906147800

node107.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.86
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.760
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        26255416 kB
Buffers:          464916 kB
Cached:          4405908 kB
SwapCached:           76 kB
Active:          2752632 kB
Inactive:        2982940 kB
Active(anon):     856108 kB
Inactive(anon):    11072 kB
Active(file):    1896524 kB
Inactive(file):  2971868 kB
Unevictable:        7628 kB
Mlocked:            7628 kB
SwapTotal:      67108856 kB
SwapFree:       67108780 kB
Dirty:             33008 kB
Writeback:             0 kB
AnonPages:        876488 kB
Mapped:            15044 kB
Shmem:               184 kB
Slab:             734916 kB
SReclaimable:     177128 kB
SUnreclaim:       557788 kB
KernelStack:        1472 kB
PageTables:         5764 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     258412 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    350208 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70752 MiB
End job on node107 at 2012-06-02 20:15:39