Trace number 3704083

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.0? (TO) 1800.18 902.192

General information on the benchmark

Name/OPT-SMALLINT-LIN/sroussel/NG/
normalized-NG.dot_unif_20null0mast_rapportOE2.0_TMAX180_K192_cod2.opb
MD5SUM9ed9dacab453c9b73d400442dcf06abd
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-21805
Best CPU time to get the best result obtained on this benchmark1800.77
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables400896
Total number of constraints402763
Number of constraints which are clauses400785
Number of constraints which are cardinality constraints (but not clauses)194
Number of constraints which are nor clauses,nor cardinality constraints1784
Minimum length of a constraint2
Maximum length of a constraint58023
Number of terms in the objective function 1427
Biggest coefficient in the objective function 998
Number of bits for the biggest coefficient in the objective function 10
Sum of the numbers in the objective function 733864
Number of bits of the sum of numbers in the objective function 20
Biggest number in a constraint 998
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 733864
Number of bits of the biggest sum of numbers20
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                    2.0 beta - March, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3704083-1338100448.opb.
0.00/0.00	c Instance file HOME/instance-3704083-1338100448.opb
0.00/0.00	c File size is 28233148 bytes.
3.39/3.41	c Cost Offset: -733864
3.39/3.41	c Highest Coefficient sum: 65856
3.39/3.41	c ============================[ Problem Statistics ]=============================
3.39/3.41	c |                                                                             |
3.39/3.41	c |  Parsing time:          3.41         s                                      |
3.39/3.41	c |  Number Variables:      400896                                              |
3.39/3.41	c |  Number Clauses:        400785                                              |
3.39/3.41	c |  Number Cardinality:    1977                                                |
3.39/3.41	c |  Number PB Constraints: 1                                                   |
3.39/3.41	c |                                                                             |
3.88/3.76	c |  Problem Type:          Optimization                                        |
3.88/3.76	c |  Objective Function:    PB Constraint                                       |
3.88/3.76	c |                                                                             |
3.88/3.76	c ===============================================================================
1800.18/902.11	c ===============================================================================
1800.18/902.11	c Wall Clock Time: 902.11 s
1800.18/902.11	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3704083-1338100448/watcher-3704083-1338100448 -o /tmp/evaluation-result-3704083-1338100448/solver-3704083-1338100448 -C 1800 -W 1900 -M 15500 pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3704083-1338100448.opb 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.77 3.92 3.94 3/178 22871
/proc/meminfo: memFree=30444092/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=32812 CPUtime=0 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) R 22869 22871 19605 0 -1 4202496 619 0 0 0 0 0 0 0 20 0 1 0 276170609 33599488 572 33554432000 4194304 5965102 140734375863648 140736562382040 5134329 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 8203 572 169 433 0 874 0

[startup+0.063793 s]
/proc/loadavg: 3.77 3.92 3.94 3/178 22871
/proc/meminfo: memFree=30444092/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=44052 CPUtime=0.05 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) R 22869 22871 19605 0 -1 4202496 3225 0 0 0 5 0 0 0 20 0 1 0 276170609 45109248 3145 33554432000 4194304 5965102 140734375863648 140736562382040 5160536 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 11013 3145 319 433 0 3684 0
Current children cumulated CPU time (s) 0.05
Current children cumulated vsize (KiB) 44052

[startup+0.100268 s]
/proc/loadavg: 3.77 3.92 3.94 3/178 22871
/proc/meminfo: memFree=30444092/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=47840 CPUtime=0.09 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) R 22869 22871 19605 0 -1 4202496 4442 0 0 0 9 0 0 0 20 0 1 0 276170609 48988160 4313 33554432000 4194304 5965102 140734375863648 140736562382040 5137146 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 11960 4315 410 433 0 4631 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 47840

[startup+0.300226 s]
/proc/loadavg: 3.77 3.92 3.94 3/178 22871
/proc/meminfo: memFree=30444092/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=68268 CPUtime=0.29 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) R 22869 22871 19605 0 -1 4202496 10198 0 0 0 27 2 0 0 20 0 1 0 276170609 69906432 9802 33554432000 4194304 5965102 140734375863648 140734375861704 5137146 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 17067 9802 918 433 0 9738 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 68268

[startup+0.700225 s]
/proc/loadavg: 3.77 3.92 3.94 3/178 22871
/proc/meminfo: memFree=30444092/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=113100 CPUtime=0.69 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) R 22869 22871 19605 0 -1 4202496 21466 0 0 0 65 4 0 0 20 0 1 0 276170609 115814400 20540 33554432000 4194304 5965102 140734375863648 140734375861640 5137146 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 28275 20541 1862 433 0 20946 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 113100

[startup+1.50022 s]
/proc/loadavg: 3.77 3.92 3.94 4/179 22872
/proc/meminfo: memFree=30334884/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=208148 CPUtime=1.49 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) R 22869 22871 19605 0 -1 4202496 42885 0 0 0 143 6 0 0 20 0 1 0 276170609 213143552 43965 33554432000 4194304 5965102 140734375863648 140734375861736 4420575 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 52037 43965 3593 433 0 44708 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 208148

[startup+3.10023 s]
/proc/loadavg: 3.71 3.91 3.93 4/179 22872
/proc/meminfo: memFree=30231944/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=326580 CPUtime=3.09 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) R 22869 22871 19605 0 -1 4202496 71354 0 0 0 296 13 0 0 20 0 1 0 276170609 334417920 75440 33554432000 4194304 5965102 140734375863648 140734375861656 5137146 0 0 4096 16387 0 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 81645 75440 6533 433 0 74316 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 326580

[startup+6.30036 s]
/proc/loadavg: 3.71 3.91 3.93 5/181 22874
/proc/meminfo: memFree=29742724/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=860108 CPUtime=9.02 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 164112 0 0 0 823 79 0 0 20 0 3 0 276170609 880750592 183407 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 215027 183407 198 433 0 214591 0
[pid=22871/tid=22873] ppid=22869 vsize=860108 CPUtime=2.83 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 61405 0 0 0 230 53 0 0 20 0 3 0 276170950 880750592 183407 33554432000 4194304 5965102 140734375863648 140200458864984 5123123 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=860108 CPUtime=2.81 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 26647 0 0 0 267 14 0 0 20 0 3 0 276170950 880750592 183407 33554432000 4194304 5965102 140734375863648 140200448375096 4400955 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 9.02
Current children cumulated vsize (KiB) 860108

[startup+12.7003 s]
/proc/loadavg: 3.75 3.91 3.93 5/181 22874
/proc/meminfo: memFree=29662812/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=892836 CPUtime=21.82 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 172022 0 0 0 2100 82 0 0 20 0 3 0 276170609 914264064 194864 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 223209 194864 199 433 0 222773 0
[pid=22871/tid=22873] ppid=22869 vsize=892836 CPUtime=9.21 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 69221 0 0 0 866 55 0 0 20 0 3 0 276170950 914264064 194864 33554432000 4194304 5965102 140734375863648 140200458865176 5143165 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=892836 CPUtime=9.19 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 26741 0 0 0 905 14 0 0 20 0 3 0 276170950 914264064 194864 33554432000 4194304 5965102 140734375863648 140200448375096 4404383 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 21.82
Current children cumulated vsize (KiB) 892836

[startup+25.5004 s]
/proc/loadavg: 3.79 3.91 3.93 5/181 22874
/proc/meminfo: memFree=29595476/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=958372 CPUtime=47.41 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 192597 0 0 0 4649 92 0 0 20 0 3 0 276170609 981372928 210997 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 239593 210997 199 433 0 239157 0
[pid=22871/tid=22873] ppid=22869 vsize=958372 CPUtime=21.98 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 89634 0 0 0 2134 64 0 0 20 0 3 0 276170950 981372928 210997 33554432000 4194304 5965102 140734375863648 140200458864984 5139822 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=958372 CPUtime=21.96 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 26903 0 0 0 2181 15 0 0 20 0 3 0 276170950 981372928 210997 33554432000 4194304 5965102 140734375863648 140200448375000 4221984 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 47.41
Current children cumulated vsize (KiB) 958372

[startup+51.1004 s]
/proc/loadavg: 3.86 3.92 3.93 5/181 22874
/proc/meminfo: memFree=29389704/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=1220516 CPUtime=98.61 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 235172 0 0 0 9748 113 0 0 20 0 3 0 276170609 1249808384 264971 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 305129 264971 199 433 0 304693 0
[pid=22871/tid=22873] ppid=22869 vsize=1220516 CPUtime=47.52 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 131842 0 0 0 4669 83 0 0 20 0 3 0 276170950 1249808384 264971 33554432000 4194304 5965102 140734375863648 140200458864984 4220704 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=1220516 CPUtime=47.49 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 27270 0 0 0 4734 15 0 0 20 0 3 0 276170950 1249808384 264971 33554432000 4194304 5965102 140734375863648 140200448375096 4390169 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 98.61
Current children cumulated vsize (KiB) 1220516

[startup+102.306 s]
/proc/loadavg: 3.94 3.93 3.93 5/181 22875
/proc/meminfo: memFree=29014400/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=1548196 CPUtime=201 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 258201 0 0 0 19961 139 0 0 20 0 3 0 276170609 1585352704 329660 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 387049 329660 199 433 0 386613 0
[pid=22871/tid=22873] ppid=22869 vsize=1548196 CPUtime=98.59 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 154329 0 0 0 9750 109 0 0 20 0 3 0 276170950 1585352704 329660 33554432000 4194304 5965102 140734375863648 140200458865176 5143165 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=1548196 CPUtime=98.56 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 27812 0 0 0 9839 17 0 0 20 0 3 0 276170950 1585352704 329660 33554432000 4194304 5965102 140734375863648 140200448375096 4390200 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 201
Current children cumulated vsize (KiB) 1548196

[startup+162.3 s]
/proc/loadavg: 3.98 3.94 3.93 5/181 22875
/proc/meminfo: memFree=28640788/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=2097092 CPUtime=320.97 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 279985 0 0 0 31931 166 0 0 20 0 3 0 276170609 2147422208 430174 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 524273 430174 199 433 0 523837 0
[pid=22871/tid=22873] ppid=22869 vsize=2097092 CPUtime=158.43 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 175253 0 0 0 15707 136 0 0 20 0 3 0 276170950 2147422208 430174 33554432000 4194304 5965102 140734375863648 140200458865176 5131557 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=2097092 CPUtime=158.4 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 28672 0 0 0 15820 20 0 0 20 0 3 0 276170950 2147422208 430174 33554432000 4194304 5965102 140734375863648 140200448375096 4404379 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 320.97
Current children cumulated vsize (KiB) 2097092

[startup+222.3 s]
/proc/loadavg: 3.99 3.95 3.93 5/181 22875
/proc/meminfo: memFree=28347796/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=2388116 CPUtime=440.95 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 360708 0 0 0 43853 242 0 0 20 0 3 0 276170609 2445430784 496141 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 597029 496141 199 433 0 596593 0
[pid=22871/tid=22873] ppid=22869 vsize=2388116 CPUtime=218.28 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 255087 0 0 0 21617 211 0 0 20 0 3 0 276170950 2445430784 496141 33554432000 4194304 5965102 140734375863648 140200458865048 5143143 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=2388116 CPUtime=218.23 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 29561 0 0 0 21800 23 0 0 20 0 3 0 276170950 2445430784 496141 33554432000 4194304 5965102 140734375863648 140200448375144 4393958 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 440.95
Current children cumulated vsize (KiB) 2388116

[startup+282.3 s]
/proc/loadavg: 3.99 3.95 3.93 5/181 22875
/proc/meminfo: memFree=28084916/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=2654272 CPUtime=560.92 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 580934 0 0 0 55678 414 0 0 20 0 3 0 276170609 2717974528 565896 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 663568 565907 199 433 0 663132 0
[pid=22871/tid=22873] ppid=22869 vsize=2654272 CPUtime=278.12 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 474426 0 0 0 27430 382 0 0 20 0 3 0 276170950 2717974528 565911 33554432000 4194304 5965102 140734375863648 140200458865048 4396446 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=2654272 CPUtime=278.06 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 30463 0 0 0 27780 26 0 0 20 0 3 0 276170950 2717974528 565917 33554432000 4194304 5965102 140734375863648 140200448375144 4404748 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 560.92
Current children cumulated vsize (KiB) 2654272

[startup+342.3 s]
/proc/loadavg: 3.77 3.91 3.91 5/181 22916
/proc/meminfo: memFree=28413616/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=3035188 CPUtime=680.86 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 762663 0 0 0 67526 560 0 0 20 0 3 0 276170609 3108032512 651707 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 758797 651707 199 433 0 758361 0
[pid=22871/tid=22873] ppid=22869 vsize=3035188 CPUtime=337.97 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 655240 0 0 0 33272 525 0 0 20 0 3 0 276170950 3108032512 651707 33554432000 4194304 5965102 140734375863648 140200458865048 5139822 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=3035188 CPUtime=337.87 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 31363 0 0 0 33758 29 0 0 20 0 3 0 276170950 3108032512 651707 33554432000 4194304 5965102 140734375863648 140200448375096 4221984 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 680.86
Current children cumulated vsize (KiB) 3035188

[startup+402.3 s]
/proc/loadavg: 3.98 3.95 3.93 5/182 22920
/proc/meminfo: memFree=27850300/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=3293316 CPUtime=800.82 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 948874 0 0 0 79378 704 0 0 20 0 3 0 276170609 3372355584 720049 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 823329 720049 199 433 0 822893 0
[pid=22871/tid=22873] ppid=22869 vsize=3293316 CPUtime=397.81 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 840671 0 0 0 39113 668 0 0 20 0 3 0 276170950 3372355584 720049 33554432000 4194304 5965102 140734375863648 140200458865000 4420679 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=3293316 CPUtime=397.69 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 32143 0 0 0 39737 32 0 0 20 0 3 0 276170950 3372355584 720049 33554432000 4194304 5965102 140734375863648 140200448375000 4222384 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 800.82
Current children cumulated vsize (KiB) 3293316

[startup+462.3 s]
/proc/loadavg: 3.99 3.96 3.93 5/181 22920
/proc/meminfo: memFree=27521640/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=3625012 CPUtime=920.78 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 1119069 0 0 0 91232 846 0 0 20 0 3 0 276170609 3712012288 786831 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 906253 786831 199 433 0 905817 0
[pid=22871/tid=22873] ppid=22869 vsize=3625012 CPUtime=457.66 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 1009947 0 0 0 44958 808 0 0 20 0 3 0 276170950 3712012288 786831 33554432000 4194304 5965102 140734375863648 140200458865048 4220672 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=3625012 CPUtime=457.51 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 33062 0 0 0 45717 34 0 0 20 0 3 0 276170950 3712012288 786831 33554432000 4194304 5965102 140734375863648 140200448374616 4400894 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 920.78
Current children cumulated vsize (KiB) 3625012

[startup+522.3 s]
/proc/loadavg: 3.99 3.96 3.93 5/181 22920
/proc/meminfo: memFree=27248392/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=3989604 CPUtime=1040.73 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 1239458 0 0 0 103115 958 0 0 20 0 3 0 276170609 4085354496 877132 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 997401 877132 199 433 0 996965 0
[pid=22871/tid=22873] ppid=22869 vsize=3989604 CPUtime=517.5 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 1129742 0 0 0 50831 919 0 0 20 0 3 0 276170950 4085354496 877132 33554432000 4194304 5965102 140734375863648 140200458865480 5139774 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=3989604 CPUtime=517.33 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 33656 0 0 0 51697 36 0 0 20 0 3 0 276170950 4085354496 877132 33554432000 4194304 5965102 140734375863648 140200448375096 4388991 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1040.73
Current children cumulated vsize (KiB) 3989604

[startup+582.3 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 22920
/proc/meminfo: memFree=27084216/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=4042748 CPUtime=1160.69 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 1268794 0 0 0 115078 991 0 0 20 0 3 0 276170609 4139773952 895054 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 1010687 895054 199 433 0 1010251 0
[pid=22871/tid=22873] ppid=22869 vsize=4042748 CPUtime=577.35 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 1158459 0 0 0 56784 951 0 0 20 0 3 0 276170950 4139773952 895054 33554432000 4194304 5965102 140734375863648 140200458865592 4393852 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=4042748 CPUtime=577.15 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 34275 0 0 0 57675 40 0 0 20 0 3 0 276170950 4139773952 895054 33554432000 4194304 5965102 140734375863648 140200448375096 4222464 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1160.69
Current children cumulated vsize (KiB) 4042748

[startup+642.3 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 22920
/proc/meminfo: memFree=27027148/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=4071460 CPUtime=1280.67 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 1305367 0 0 0 127047 1020 0 0 20 0 3 0 276170609 4169175040 894516 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 1017865 894516 199 433 0 1017429 0
[pid=22871/tid=22873] ppid=22869 vsize=4071460 CPUtime=637.19 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 1194394 0 0 0 62740 979 0 0 20 0 3 0 276170950 4169175040 894516 33554432000 4194304 5965102 140734375863648 140200458865480 4404552 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=4071460 CPUtime=637 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 34913 0 0 0 63657 43 0 0 20 0 3 0 276170950 4169175040 894516 33554432000 4194304 5965102 140734375863648 140200448375144 4390116 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1280.67
Current children cumulated vsize (KiB) 4071460

[startup+702.3 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 22921
/proc/meminfo: memFree=26961572/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=4112388 CPUtime=1400.64 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 1343447 0 0 0 139013 1051 0 0 20 0 3 0 276170609 4211085312 906865 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 1028097 906865 199 433 0 1027661 0
[pid=22871/tid=22873] ppid=22869 vsize=4112388 CPUtime=697.03 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 1231872 0 0 0 68694 1009 0 0 20 0 3 0 276170950 4211085312 906865 33554432000 4194304 5965102 140734375863648 140200458865592 4393736 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=4112388 CPUtime=696.83 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 35515 0 0 0 69638 45 0 0 20 0 3 0 276170950 4211085312 906865 33554432000 4194304 5965102 140734375863648 140200448375032 4221984 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1400.64
Current children cumulated vsize (KiB) 4112388

[startup+762.306 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 22921
/proc/meminfo: memFree=26916916/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=4243460 CPUtime=1520.63 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 1368230 0 0 0 150986 1077 0 0 20 0 3 0 276170609 4345303040 938111 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 1060865 938111 199 433 0 1060429 0
[pid=22871/tid=22873] ppid=22869 vsize=4243460 CPUtime=756.88 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 1255976 0 0 0 74653 1035 0 0 20 0 3 0 276170950 4345303040 938111 33554432000 4194304 5965102 140734375863648 140200458865592 5180557 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=4243460 CPUtime=756.68 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 36194 0 0 0 75621 47 0 0 20 0 3 0 276170950 4345303040 938111 33554432000 4194304 5965102 140734375863648 140200448375096 4390187 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1520.63
Current children cumulated vsize (KiB) 4243460

[startup+822.3 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 22921
/proc/meminfo: memFree=26699260/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=4333604 CPUtime=1640.6 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 1409920 0 0 0 162948 1112 0 0 20 0 3 0 276170609 4437610496 958627 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 1083401 958627 199 433 0 1082965 0
[pid=22871/tid=22873] ppid=22869 vsize=4333604 CPUtime=816.72 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 1297107 0 0 0 80603 1069 0 0 20 0 3 0 276170950 4437610496 958627 33554432000 4194304 5965102 140734375863648 140200458865048 4400955 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=4333604 CPUtime=816.52 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 36753 0 0 0 81602 50 0 0 20 0 3 0 276170950 4437610496 958627 33554432000 4194304 5965102 140734375863648 140200448375096 4390200 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1640.6
Current children cumulated vsize (KiB) 4333604

[startup+882.3 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 22921
/proc/meminfo: memFree=26673580/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=4464676 CPUtime=1760.58 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 1462266 0 0 0 174909 1149 0 0 20 0 3 0 276170609 4571828224 981191 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 1116169 981191 199 433 0 1115733 0
[pid=22871/tid=22873] ppid=22869 vsize=4464676 CPUtime=876.56 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 1348700 0 0 0 86551 1105 0 0 20 0 3 0 276170950 4571828224 981191 33554432000 4194304 5965102 140734375863648 140200458864984 4394025 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=4464676 CPUtime=876.35 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 37506 0 0 0 87582 53 0 0 20 0 3 0 276170950 4571828224 981191 33554432000 4194304 5965102 140734375863648 140200448375144 4390150 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1760.58
Current children cumulated vsize (KiB) 4464676



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+902.1 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 22921
/proc/meminfo: memFree=26583588/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=4530212 CPUtime=1800.18 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 1475988 0 0 0 178855 1163 0 0 20 0 3 0 276170609 4638937088 1003415 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 1132553 1003415 199 433 0 1132117 0
[pid=22871/tid=22873] ppid=22869 vsize=4530212 CPUtime=896.32 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 1362120 0 0 0 88514 1118 0 0 20 0 3 0 276170950 4638937088 1003415 33554432000 4194304 5965102 140734375863648 140200458865480 5134596 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=4530212 CPUtime=896.11 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 37808 0 0 0 89557 54 0 0 20 0 3 0 276170950 4638937088 1003415 33554432000 4194304 5965102 140734375863648 140200448375096 4390112 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.18
Current children cumulated vsize (KiB) 4530212

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+902.1 s]
/proc/loadavg: 3.99 3.97 3.93 5/181 22921
/proc/meminfo: memFree=26583588/32873844 swapFree=7112/7112
[pid=22871] ppid=22869 vsize=4530212 CPUtime=1800.18 cores=0,2,4,6
/proc/22871/stat : 22871 (pwbo2.0) S 22869 22871 19605 0 -1 4202496 1475988 0 0 0 178855 1163 0 0 20 0 3 0 276170609 4638937088 1003415 33554432000 4194304 5965102 140734375863648 140734375863168 4547341 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0 0 0
/proc/22871/statm: 1132553 1003415 199 433 0 1132117 0
[pid=22871/tid=22873] ppid=22869 vsize=4530212 CPUtime=896.32 cores=0,2,4,6
/proc/22871/task/22873/stat : 22873 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 1362120 0 0 0 88514 1118 0 0 20 0 3 0 276170950 4638937088 1003415 33554432000 4194304 5965102 140734375863648 140200458865480 5134596 0 0 4096 16387 0 0 0 -1 4 0 0 0 0 0
[pid=22871/tid=22874] ppid=22869 vsize=4530212 CPUtime=896.11 cores=0,2,4,6
/proc/22871/task/22874/stat : 22874 (pwbo2.0) R 22869 22871 19605 0 -1 4202560 37808 0 0 0 89557 54 0 0 20 0 3 0 276170950 4638937088 1003415 33554432000 4194304 5965102 140734375863648 140200448375096 4390112 0 0 4096 16387 0 0 0 -1 2 0 0 0 0 0
Current children cumulated CPU time (s) 1800.18
Current children cumulated vsize (KiB) 4530212

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 22871 and gives
#  childrusage.ru_utime.tv_sec=1783
#  childrusage.ru_utime.tv_usec=991792
#  childrusage.ru_stime.tv_sec=11
#  childrusage.ru_stime.tv_usec=958182
# CPU time returned by wait4() is 1795.95
# while last known CPU time is 1800.18
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 902.192
CPU time (s): 1800.18
CPU user time (s): 1788.55
CPU system time (s): 11.63
CPU usage (%): 199.534
Max. virtual memory (cumulated for all children) (KiB): 4604036

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1783.99
system time used= 11.9582
maximum resident set size= 4068284
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1475990
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8456
involuntary context switches= 1977

runsolver used 1.87371 second user time and 5.05323 second system time

The end

Launcher Data 

Begin job on node119 at 2012-05-27 08:34:09
IDJOB=3704083
IDBENCH=91042
IDSOLVER=2279
FILE ID=node119/3704083-1338100448
RUNJOBID= node119-1338085105-19621
PBS_JOBID= 14624426
Free space on /tmp= 71552 MiB

SOLVER NAME= pwbo 2.0
BENCH NAME= PB12/normalized-PB12/OPT-SMALLINT-LIN/sroussel/NG/normalized-NG.dot_unif_20null0mast_rapportOE2.0_TMAX180_K192_cod2.opb
COMMAND LINE= pwbo2.0 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3704083-1338100448/watcher-3704083-1338100448 -o /tmp/evaluation-result-3704083-1338100448/solver-3704083-1338100448 -C 1800 -W 1900 -M 15500  pwbo2.0 -file-format=opb -verbosity=0 HOME/instance-3704083-1338100448.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9ed9dacab453c9b73d400442dcf06abd
RANDOM SEED=1410544827

node119.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.88
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.943
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        30444092 kB
Buffers:          259908 kB
Cached:           338204 kB
SwapCached:         1776 kB
Active:          1553616 kB
Inactive:          76476 kB
Active(anon):    1032000 kB
Inactive(anon):     1972 kB
Active(file):     521616 kB
Inactive(file):    74504 kB
Unevictable:        7112 kB
Mlocked:            7112 kB
SwapTotal:      67108856 kB
SwapFree:       67100168 kB
Dirty:             33088 kB
Writeback:             0 kB
AnonPages:       1037652 kB
Mapped:            12616 kB
Shmem:                 8 kB
Slab:             657160 kB
SReclaimable:      98940 kB
SUnreclaim:       558220 kB
KernelStack:        1464 kB
PageTables:         5900 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     506704 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    352256 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71548 MiB
End job on node119 at 2012-05-27 08:49:13