Trace number 3695859

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb2sat 2012-05-19? (TO) 1800.1 1800.62

General information on the benchmark

NameOPT-BIGINT-LIN/graca/
normalized-ped2.G.recomb10-0.01-5.opb
MD5SUMa790f652addb363b399514db95e6c8e6
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark124485
Best CPU time to get the best result obtained on this benchmark1800.36
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables208271
Total number of constraints1687459
Number of constraints which are clauses1687459
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint579
Number of terms in the objective function 18980
Biggest coefficient in the objective function 581
Number of bits for the biggest coefficient in the objective function 10
Sum of the numbers in the objective function 10690980
Number of bits of the sum of numbers in the objective function 24
Biggest number in a constraint 581
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 10690980
Number of bits of the biggest sum of numbers24
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

7.17/7.23	c model valid
7.17/7.23	c current solution ok
10.82/11.02	o 254676
10.82/11.02	c current bound: 127338
10.82/11.02	c fallback to adder encoding
1800.10/1800.61	c error: unexpected solver exit code
1800.10/1800.61	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3695859-1338229161/watcher-3695859-1338229161 -o /tmp/evaluation-result-3695859-1338229161/solver-3695859-1338229161 -C 1800 -W 1900 -M 15500 HOME/runPb2sat.sh HOME/instance-3695859-1338229161.opb 438081844 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.08 1.18 1.55 3/173 22783
/proc/meminfo: memFree=30335956/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0

[startup+0.10326 s]
/proc/loadavg: 1.08 1.18 1.55 3/173 22783
/proc/meminfo: memFree=30335956/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.200181 s]
/proc/loadavg: 1.08 1.18 1.55 3/173 22783
/proc/meminfo: memFree=30335956/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300142 s]
/proc/loadavg: 1.08 1.18 1.55 3/173 22783
/proc/meminfo: memFree=30335956/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700126 s]
/proc/loadavg: 1.08 1.18 1.55 3/173 22783
/proc/meminfo: memFree=30335956/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50025 s]
/proc/loadavg: 1.08 1.18 1.55 3/175 22785
/proc/meminfo: memFree=30283120/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=20188 CPUtime=1.49 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) R 22783 22783 22749 0 -1 4202496 3173 0 0 0 148 1 0 0 20 0 1 0 289042349 20672512 3657 33554432000 4194304 5873084 140733204072848 140733203958520 5127424 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22784/statm: 5047 3657 145 410 0 4629 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 29336

[startup+3.10022 s]
/proc/loadavg: 1.08 1.18 1.55 3/179 22796
/proc/meminfo: memFree=30258100/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=37628 CPUtime=3.09 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) R 22783 22783 22749 0 -1 4202496 3962 0 0 0 307 2 0 0 20 0 1 0 289042349 38531072 6482 33554432000 4194304 5873084 140733204072848 140733204069752 5127424 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22784/statm: 9407 6482 145 410 0 8989 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 46776

[startup+6.30015 s]
/proc/loadavg: 1.15 1.19 1.55 3/179 22798
/proc/meminfo: memFree=30129428/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=102108 CPUtime=6.27 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) R 22783 22783 22749 0 -1 4202496 12956 20530 0 0 552 11 59 5 20 0 1 0 289042349 104558592 19043 33554432000 4194304 5873084 140733204072848 140733204068040 5127424 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/22784/statm: 25527 19043 168 410 0 25109 0
Current children cumulated CPU time (s) 6.27
Current children cumulated vsize (KiB) 111256

[startup+12.7003 s]
/proc/loadavg: 1.22 1.20 1.55 3/181 22801
/proc/meminfo: memFree=29744020/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=241216 CPUtime=12.52 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) R 22783 22783 22749 0 -1 4202496 20700 21044 0 0 865 316 59 12 20 0 1 0 289042349 247005184 51261 33554432000 4194304 5873084 140733204072848 140733204067240 4394360 0 0 4096 0 0 0 0 17 4 0 0 15 0 0
/proc/22784/statm: 60304 51261 179 410 0 59886 0
Current children cumulated CPU time (s) 12.52
Current children cumulated vsize (KiB) 250364

[startup+25.5003 s]
/proc/loadavg: 1.47 1.26 1.56 3/181 22804
/proc/meminfo: memFree=29143484/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=241216 CPUtime=12.77 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) S 22783 22783 22749 0 -1 4202496 21077 21044 0 0 872 334 59 12 20 0 1 0 289042349 247005184 51773 33554432000 4194304 5873084 140733204072848 140733204066664 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 15 0 0
/proc/22784/statm: 60304 51773 179 410 0 59886 0
[pid=22802] ppid=22784 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22802/stat : 22802 (satsolver.sh) S 22784 22783 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 289043643 9367552 267 33554432000 4194304 5064252 140737252715968 140737252714880 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/22802/statm: 2287 267 226 213 0 72 0
[pid=22803] ppid=22802 vsize=406836 CPUtime=12.54 cores=0,2,4,6
/proc/22803/stat : 22803 (glucose_static) R 22802 22783 22749 0 -1 4202496 67105 0 0 0 1236 18 0 0 20 0 1 0 289043643 416600064 91313 33554432000 4194304 4896791 140736069151072 140736069148280 4203098 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/22803/statm: 101709 91313 78 172 0 101535 0
Current children cumulated CPU time (s) 25.31
Current children cumulated vsize (KiB) 666348

[startup+51.1004 s]
/proc/loadavg: 1.70 1.33 1.58 3/184 22809
/proc/meminfo: memFree=28556876/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=241216 CPUtime=12.77 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) S 22783 22783 22749 0 -1 4202496 21077 21044 0 0 872 334 59 12 20 0 1 0 289042349 247005184 51773 33554432000 4194304 5873084 140733204072848 140733204066664 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 15 0 0
/proc/22784/statm: 60304 51773 179 410 0 59886 0
[pid=22802] ppid=22784 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22802/stat : 22802 (satsolver.sh) S 22784 22783 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 289043643 9367552 267 33554432000 4194304 5064252 140737252715968 140737252714880 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/22802/statm: 2287 267 226 213 0 72 0
[pid=22803] ppid=22802 vsize=406980 CPUtime=38.14 cores=0,2,4,6
/proc/22803/stat : 22803 (glucose_static) R 22802 22783 22749 0 -1 4202496 67135 0 0 0 3796 18 0 0 20 0 1 0 289043643 416747520 91343 33554432000 4194304 4896791 140736069151072 140736069148440 4203064 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/22803/statm: 101745 91343 78 172 0 101571 0
Current children cumulated CPU time (s) 50.91
Current children cumulated vsize (KiB) 666492

[startup+102.3 s]
/proc/loadavg: 1.94 1.45 1.60 3/183 22810
/proc/meminfo: memFree=28552672/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=241216 CPUtime=12.77 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) S 22783 22783 22749 0 -1 4202496 21077 21044 0 0 872 334 59 12 20 0 1 0 289042349 247005184 51773 33554432000 4194304 5873084 140733204072848 140733204066664 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 15 0 0
/proc/22784/statm: 60304 51773 179 410 0 59886 0
[pid=22802] ppid=22784 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22802/stat : 22802 (satsolver.sh) S 22784 22783 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 289043643 9367552 267 33554432000 4194304 5064252 140737252715968 140737252714880 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/22802/statm: 2287 267 226 213 0 72 0
[pid=22803] ppid=22802 vsize=408744 CPUtime=89.33 cores=0,2,4,6
/proc/22803/stat : 22803 (glucose_static) R 22802 22783 22749 0 -1 4202496 67546 0 0 0 8915 18 0 0 20 0 1 0 289043643 418553856 92265 33554432000 4194304 4896791 140736069151072 140736069148280 4223888 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/22803/statm: 102186 92265 78 172 0 102012 0
Current children cumulated CPU time (s) 102.1
Current children cumulated vsize (KiB) 668256

[startup+162.3 s]
/proc/loadavg: 2.01 1.56 1.63 3/183 22810
/proc/meminfo: memFree=28431328/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=241216 CPUtime=12.77 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) S 22783 22783 22749 0 -1 4202496 21077 21044 0 0 872 334 59 12 20 0 1 0 289042349 247005184 51773 33554432000 4194304 5873084 140733204072848 140733204066664 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 15 0 0
/proc/22784/statm: 60304 51773 179 410 0 59886 0
[pid=22802] ppid=22784 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22802/stat : 22802 (satsolver.sh) S 22784 22783 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 289043643 9367552 267 33554432000 4194304 5064252 140737252715968 140737252714880 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/22802/statm: 2287 267 226 213 0 72 0
[pid=22803] ppid=22802 vsize=486348 CPUtime=149.31 cores=0,2,4,6
/proc/22803/stat : 22803 (glucose_static) R 22802 22783 22749 0 -1 4202496 77538 0 0 0 14900 31 0 0 20 0 1 0 289043643 498020352 107657 33554432000 4194304 4896791 140736069151072 140736069148280 4401607 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/22803/statm: 121587 107657 78 172 0 121413 0
Current children cumulated CPU time (s) 162.08
Current children cumulated vsize (KiB) 745860

[startup+222.307 s]
/proc/loadavg: 2.00 1.64 1.65 3/183 22810
/proc/meminfo: memFree=28405596/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=241216 CPUtime=12.77 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) S 22783 22783 22749 0 -1 4202496 21077 21044 0 0 872 334 59 12 20 0 1 0 289042349 247005184 51773 33554432000 4194304 5873084 140733204072848 140733204066664 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 15 0 0
/proc/22784/statm: 60304 51773 179 410 0 59886 0
[pid=22802] ppid=22784 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22802/stat : 22802 (satsolver.sh) S 22784 22783 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 289043643 9367552 267 33554432000 4194304 5064252 140737252715968 140737252714880 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/22802/statm: 2287 267 226 213 0 72 0
[pid=22803] ppid=22802 vsize=501540 CPUtime=209.31 cores=0,2,4,6
/proc/22803/stat : 22803 (glucose_static) R 22802 22783 22749 0 -1 4202496 83404 0 0 0 20890 41 0 0 20 0 1 0 289043643 513576960 108652 33554432000 4194304 4896791 140736069151072 140736069146808 4223776 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/22803/statm: 125385 108652 78 172 0 125211 0
Current children cumulated CPU time (s) 222.08

################
# More data... #
################

/proc/22803/stat : 22803 (glucose_static) R 22802 22783 22749 0 -1 4202496 137449 0 0 0 140794 115 0 0 20 0 1 0 289043643 754601984 163555 33554432000 4194304 4896791 140736069151072 140736069148280 4203820 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/22803/statm: 184229 163555 78 172 0 184055 0
Current children cumulated CPU time (s) 1421.86
Current children cumulated vsize (KiB) 996428

[startup+1482.3 s]
/proc/loadavg: 2.06 2.01 1.89 3/183 22820
/proc/meminfo: memFree=27978840/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=241216 CPUtime=12.77 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) S 22783 22783 22749 0 -1 4202496 21077 21044 0 0 872 334 59 12 20 0 1 0 289042349 247005184 51773 33554432000 4194304 5873084 140733204072848 140733204066664 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 15 0 0
/proc/22784/statm: 60304 51773 179 410 0 59886 0
[pid=22802] ppid=22784 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22802/stat : 22802 (satsolver.sh) S 22784 22783 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 289043643 9367552 267 33554432000 4194304 5064252 140737252715968 140737252714880 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/22802/statm: 2287 267 226 213 0 72 0
[pid=22803] ppid=22802 vsize=739276 CPUtime=1469.07 cores=0,2,4,6
/proc/22803/stat : 22803 (glucose_static) R 22802 22783 22749 0 -1 4202496 138050 0 0 0 146792 115 0 0 20 0 1 0 289043643 757018624 168244 33554432000 4194304 4896791 140736069151072 140736069148600 4203856 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/22803/statm: 184819 168244 78 172 0 184645 0
Current children cumulated CPU time (s) 1481.84
Current children cumulated vsize (KiB) 998788

[startup+1542.31 s]
/proc/loadavg: 2.02 2.01 1.90 3/183 22820
/proc/meminfo: memFree=27952524/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=241216 CPUtime=12.77 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) S 22783 22783 22749 0 -1 4202496 21077 21044 0 0 872 334 59 12 20 0 1 0 289042349 247005184 51773 33554432000 4194304 5873084 140733204072848 140733204066664 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 15 0 0
/proc/22784/statm: 60304 51773 179 410 0 59886 0
[pid=22802] ppid=22784 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22802/stat : 22802 (satsolver.sh) S 22784 22783 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 289043643 9367552 267 33554432000 4194304 5064252 140737252715968 140737252714880 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/22802/statm: 2287 267 226 213 0 72 0
[pid=22803] ppid=22802 vsize=740164 CPUtime=1529.07 cores=0,2,4,6
/proc/22803/stat : 22803 (glucose_static) R 22802 22783 22749 0 -1 4202496 138267 0 0 0 152792 115 0 0 20 0 1 0 289043643 757927936 171016 33554432000 4194304 4896791 140736069151072 140736069148296 4203775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/22803/statm: 185041 171016 78 172 0 184867 0
Current children cumulated CPU time (s) 1541.84
Current children cumulated vsize (KiB) 999676

[startup+1602.3 s]
/proc/loadavg: 2.01 2.00 1.90 3/182 22820
/proc/meminfo: memFree=27964996/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=241216 CPUtime=12.77 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) S 22783 22783 22749 0 -1 4202496 21077 21044 0 0 872 334 59 12 20 0 1 0 289042349 247005184 51773 33554432000 4194304 5873084 140733204072848 140733204066664 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 15 0 0
/proc/22784/statm: 60304 51773 179 410 0 59886 0
[pid=22802] ppid=22784 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22802/stat : 22802 (satsolver.sh) S 22784 22783 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 289043643 9367552 267 33554432000 4194304 5064252 140737252715968 140737252714880 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/22802/statm: 2287 267 226 213 0 72 0
[pid=22803] ppid=22802 vsize=747196 CPUtime=1589.05 cores=0,2,4,6
/proc/22803/stat : 22803 (glucose_static) R 22802 22783 22749 0 -1 4202496 140659 0 0 0 158787 118 0 0 20 0 1 0 289043643 765128704 166425 33554432000 4194304 4896791 140736069151072 140736069148280 4225029 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/22803/statm: 186799 166425 78 172 0 186625 0
Current children cumulated CPU time (s) 1601.82
Current children cumulated vsize (KiB) 1006708

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/183 22822
/proc/meminfo: memFree=27925672/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=241216 CPUtime=12.77 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) S 22783 22783 22749 0 -1 4202496 21077 21044 0 0 872 334 59 12 20 0 1 0 289042349 247005184 51773 33554432000 4194304 5873084 140733204072848 140733204066664 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 15 0 0
/proc/22784/statm: 60304 51773 179 410 0 59886 0
[pid=22802] ppid=22784 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22802/stat : 22802 (satsolver.sh) S 22784 22783 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 289043643 9367552 267 33554432000 4194304 5064252 140737252715968 140737252714880 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/22802/statm: 2287 267 226 213 0 72 0
[pid=22803] ppid=22802 vsize=748076 CPUtime=1649.04 cores=0,2,4,6
/proc/22803/stat : 22803 (glucose_static) R 22802 22783 22749 0 -1 4202496 140891 0 0 0 164786 118 0 0 20 0 1 0 289043643 766029824 169780 33554432000 4194304 4896791 140736069151072 140736069148280 4203806 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/22803/statm: 187019 169780 78 172 0 186845 0
Current children cumulated CPU time (s) 1661.81
Current children cumulated vsize (KiB) 1007588

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/183 22822
/proc/meminfo: memFree=27944912/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=241216 CPUtime=12.77 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) S 22783 22783 22749 0 -1 4202496 21077 21044 0 0 872 334 59 12 20 0 1 0 289042349 247005184 51773 33554432000 4194304 5873084 140733204072848 140733204066664 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 15 0 0
/proc/22784/statm: 60304 51773 179 410 0 59886 0
[pid=22802] ppid=22784 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22802/stat : 22802 (satsolver.sh) S 22784 22783 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 289043643 9367552 267 33554432000 4194304 5064252 140737252715968 140737252714880 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/22802/statm: 2287 267 226 213 0 72 0
[pid=22803] ppid=22802 vsize=753148 CPUtime=1709.03 cores=0,2,4,6
/proc/22803/stat : 22803 (glucose_static) R 22802 22783 22749 0 -1 4202496 142539 0 0 0 170780 123 0 0 20 0 1 0 289043643 771223552 164779 33554432000 4194304 4896791 140736069151072 140736069148280 4203775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/22803/statm: 188287 164779 78 172 0 188113 0
Current children cumulated CPU time (s) 1721.8
Current children cumulated vsize (KiB) 1012660

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 1.91 3/183 22822
/proc/meminfo: memFree=27911860/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=241216 CPUtime=12.77 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) S 22783 22783 22749 0 -1 4202496 21077 21044 0 0 872 334 59 12 20 0 1 0 289042349 247005184 51773 33554432000 4194304 5873084 140733204072848 140733204066664 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 15 0 0
/proc/22784/statm: 60304 51773 179 410 0 59886 0
[pid=22802] ppid=22784 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22802/stat : 22802 (satsolver.sh) S 22784 22783 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 289043643 9367552 267 33554432000 4194304 5064252 140737252715968 140737252714880 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/22802/statm: 2287 267 226 213 0 72 0
[pid=22803] ppid=22802 vsize=755128 CPUtime=1769.03 cores=0,2,4,6
/proc/22803/stat : 22803 (glucose_static) R 22802 22783 22749 0 -1 4202496 143060 0 0 0 176779 124 0 0 20 0 1 0 289043643 773251072 169899 33554432000 4194304 4896791 140736069151072 140736069146808 4203780 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/22803/statm: 188782 169899 78 172 0 188608 0
Current children cumulated CPU time (s) 1781.8
Current children cumulated vsize (KiB) 1014640



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 1.91 3/183 22822
/proc/meminfo: memFree=27915968/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=241216 CPUtime=12.77 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) S 22783 22783 22749 0 -1 4202496 21077 21044 0 0 872 334 59 12 20 0 1 0 289042349 247005184 51773 33554432000 4194304 5873084 140733204072848 140733204066664 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 15 0 0
/proc/22784/statm: 60304 51773 179 410 0 59886 0
[pid=22802] ppid=22784 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22802/stat : 22802 (satsolver.sh) S 22784 22783 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 289043643 9367552 267 33554432000 4194304 5064252 140737252715968 140737252714880 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/22802/statm: 2287 267 226 213 0 72 0
[pid=22803] ppid=22802 vsize=756028 CPUtime=1787.33 cores=0,2,4,6
/proc/22803/stat : 22803 (glucose_static) R 22802 22783 22749 0 -1 4202496 143804 0 0 0 178607 126 0 0 20 0 1 0 289043643 774172672 164655 33554432000 4194304 4896791 140736069151072 140736069148600 4225640 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/22803/statm: 189007 164655 78 172 0 188833 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 1015540

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1800.6 s]
/proc/loadavg: 2.00 2.00 1.91 3/183 22822
/proc/meminfo: memFree=27915968/32873648 swapFree=6860/6860
[pid=22783] ppid=22781 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22783/stat : 22783 (runPb2sat.sh) S 22781 22783 22749 0 -1 4202496 358 0 0 0 0 0 0 0 20 0 1 0 289042349 9367552 275 33554432000 4194304 5064252 140737052638640 140737052637552 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/22783/statm: 2287 275 233 213 0 72 0
[pid=22784] ppid=22783 vsize=241216 CPUtime=12.77 cores=0,2,4,6
/proc/22784/stat : 22784 (pb2sat) S 22783 22783 22749 0 -1 4202496 21077 21044 0 0 872 334 59 12 20 0 1 0 289042349 247005184 51773 33554432000 4194304 5873084 140733204072848 140733204066664 5124602 0 65536 4102 0 18446744071579302229 0 0 17 4 0 0 15 0 0
/proc/22784/statm: 60304 51773 179 410 0 59886 0
[pid=22802] ppid=22784 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/22802/stat : 22802 (satsolver.sh) S 22784 22783 22749 0 -1 4202496 596 0 0 0 0 0 0 0 20 0 1 0 289043643 9367552 267 33554432000 4194304 5064252 140737252715968 140737252714880 266435454542 0 65536 4100 65538 18446744071579302229 0 0 17 2 0 0 0 0 0
/proc/22802/statm: 2287 267 226 213 0 72 0
[pid=22803] ppid=22802 vsize=756028 CPUtime=1787.33 cores=0,2,4,6
/proc/22803/stat : 22803 (glucose_static) R 22802 22783 22749 0 -1 4202496 143804 0 0 0 178607 126 0 0 20 0 1 0 289043643 774172672 164655 33554432000 4194304 4896791 140736069151072 140736069148600 4225640 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/22803/statm: 189007 164655 78 172 0 188833 0
Current children cumulated CPU time (s) 1800.1
Current children cumulated vsize (KiB) 1015540

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 22783 and gives
#  childrusage.ru_utime.tv_sec=9
#  childrusage.ru_utime.tv_usec=318583
#  childrusage.ru_stime.tv_sec=3
#  childrusage.ru_stime.tv_usec=473471
# CPU time returned by wait4() is 12.7921
# while last known CPU time is 1800.1
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.62
CPU time (s): 1800.1
CPU user time (s): 1795.38
CPU system time (s): 4.72
CPU usage (%): 99.9714
Max. virtual memory (cumulated for all children) (KiB): 1226660

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 9.31858
system time used= 3.47347
maximum resident set size= 329184
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 43097
page faults= 0
swaps= 0
block input operations= 0
block output operations= 489696
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 106

runsolver used 3.19251 second user time and 8.49071 second system time

The end

Launcher Data 

Begin job on node116 at 2012-05-28 20:19:23
IDJOB=3695859
IDBENCH=92819
IDSOLVER=2274
FILE ID=node116/3695859-1338229161
RUNJOBID= node116-1338229161-22765
PBS_JOBID= 14624642
Free space on /tmp= 71372 MiB

SOLVER NAME= pb2sat 2012-05-19
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/graca/normalized-ped2.G.recomb10-0.01-5.opb
COMMAND LINE= DIR/runPb2sat.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3695859-1338229161/watcher-3695859-1338229161 -o /tmp/evaluation-result-3695859-1338229161/solver-3695859-1338229161 -C 1800 -W 1900 -M 15500  HOME/runPb2sat.sh HOME/instance-3695859-1338229161.opb 438081844 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a790f652addb363b399514db95e6c8e6
RANDOM SEED=438081844

node116.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.11
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5438.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.556
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873648 kB
MemFree:        30336220 kB
Buffers:          389928 kB
Cached:          1284644 kB
SwapCached:         3236 kB
Active:           905312 kB
Inactive:         783588 kB
Active(anon):       5604 kB
Inactive(anon):     8956 kB
Active(file):     899708 kB
Inactive(file):   774632 kB
Unevictable:        6860 kB
Mlocked:            6860 kB
SwapTotal:      67108856 kB
SwapFree:       67103668 kB
Dirty:            129088 kB
Writeback:             0 kB
AnonPages:         19028 kB
Mapped:            11928 kB
Shmem:                96 kB
Slab:             709196 kB
SReclaimable:     149164 kB
SUnreclaim:       560032 kB
KernelStack:        1416 kB
PageTables:         4052 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545680 kB
Committed_AS:     106952 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346400 kB
VmallocChunk:   34341988052 kB
HardwareCorrupted:     0 kB
AnonHugePages:      2048 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7680 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 70816 MiB
End job on node116 at 2012-05-28 20:49:24