Trace number 3746383

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
npSolver inc-topDown (fixed)? (TO) 1800.05 1800.41

General information on the benchmark

Namenormalized-PB06/SATUNSAT-SMALLINT/web/www.ps.uni-sb.de/
~walser/benchmarks/ppp-problems/normalized-ppp:1-9,16-19.opb
MD5SUM732cdc3fa8b0bf0f47e882c13d928a6d
Bench CategoryDEC-SMALLINT (no optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark0
Best CPU time to get the best result obtained on this benchmark204.064
Has Objective FunctionNO
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved NO
Number of variables4626
Total number of constraints30747
Number of constraints which are clauses29724
Number of constraints which are cardinality constraints (but not clauses)945
Number of constraints which are nor clauses,nor cardinality constraints78
Minimum length of a constraint3
Maximum length of a constraint29
Number of terms in the objective function 0
Biggest coefficient in the objective function 0
Number of bits for the biggest coefficient in the objective function 0
Sum of the numbers in the objective function 0
Number of bits of the sum of numbers in the objective function 0
Biggest number in a constraint 10
Number of bits of the biggest number in a constraint 4
Biggest sum of numbers in a constraint 101
Number of bits of the biggest sum of numbers7
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.13	c run inc solver
0.00/0.13	c [INC SYSTEM] run initial solver
0.00/0.13	c [INC SYSTEM] preprocess with white file
0.00/0.47	c [INC SYSTEM] finished preprocessing in 0 s
0.00/0.47	c [INC SYSTEM] execute solver
1800.05/1800.41	HOME/npSolver-pbo-Itd.sh: line 18: 11283 Terminated              ./npSolver-pbo $file $tmp -rnd_seed=$seed -useQuickBound=0 -useBinSearch=0 -useCP2=1 -useInc=1

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3746383-1339098199/watcher-3746383-1339098199 -o /tmp/evaluation-result-3746383-1339098199/solver-3746383-1339098199 -C 1800 -W 1900 -M 15500 HOME/npSolver-pbo-Itd.sh HOME/instance-3746383-1339098199.opb 1098599510 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.22 0.06 0.02 1/169 11282
/proc/meminfo: memFree=25021060/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0

[startup+0.0241369 s]
/proc/loadavg: 0.22 0.06 0.02 1/169 11282
/proc/meminfo: memFree=25021060/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100283 s]
/proc/loadavg: 0.22 0.06 0.02 1/169 11282
/proc/meminfo: memFree=25021060/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300165 s]
/proc/loadavg: 0.22 0.06 0.02 1/169 11282
/proc/meminfo: memFree=25021060/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700187 s]
/proc/loadavg: 0.22 0.06 0.02 1/169 11282
/proc/meminfo: memFree=25021060/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50027 s]
/proc/loadavg: 0.22 0.06 0.02 2/172 11288
/proc/meminfo: memFree=24996464/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=21912 CPUtime=1.01 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 3890 0 0 0 101 0 0 0 20 0 1 0 375948566 22437888 4930 33554432000 4194304 5654031 140733511790864 140733511788760 4233204 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 5478 4930 141 357 0 5118 0
Current children cumulated CPU time (s) 1.46
Current children cumulated vsize (KiB) 47584

[startup+3.10025 s]
/proc/loadavg: 0.28 0.07 0.02 2/172 11288
/proc/meminfo: memFree=24989600/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=21912 CPUtime=2.61 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 4648 0 0 0 261 0 0 0 20 0 1 0 375948566 22437888 5135 33554432000 4194304 5654031 140733511790864 140733511788744 4233232 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 5478 5135 141 357 0 5118 0
Current children cumulated CPU time (s) 3.06
Current children cumulated vsize (KiB) 47584

[startup+6.30026 s]
/proc/loadavg: 0.28 0.07 0.02 2/172 11334
/proc/meminfo: memFree=24979884/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=37324 CPUtime=5.81 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 5464 0 0 0 581 0 0 0 20 0 1 0 375948566 38219776 7332 33554432000 4194304 5654031 140733511790864 140733511788744 4232968 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 9331 7332 141 357 0 8971 0
Current children cumulated CPU time (s) 6.26
Current children cumulated vsize (KiB) 62996

[startup+12.7003 s]
/proc/loadavg: 0.47 0.12 0.04 3/179 11364
/proc/meminfo: memFree=24937584/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=44508 CPUtime=12.21 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 6360 0 0 0 1220 1 0 0 20 0 1 0 375948566 45576192 10758 33554432000 4194304 5654031 140733511790864 140733511788664 4233190 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 11127 10758 141 357 0 10767 0
Current children cumulated CPU time (s) 12.66
Current children cumulated vsize (KiB) 70180

[startup+25.5003 s]
/proc/loadavg: 0.71 0.18 0.06 3/179 11365
/proc/meminfo: memFree=24903044/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=56428 CPUtime=25.01 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 7041 0 0 0 2500 1 0 0 20 0 1 0 375948566 57782272 13617 33554432000 4194304 5654031 140733511790864 140733511778680 4233232 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 14107 13617 141 357 0 13747 0
Current children cumulated CPU time (s) 25.46
Current children cumulated vsize (KiB) 82100

[startup+51.1003 s]
/proc/loadavg: 1.20 0.34 0.11 3/179 11365
/proc/meminfo: memFree=24860464/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=98932 CPUtime=50.59 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 8193 0 0 0 5057 2 0 0 20 0 1 0 375948566 101306368 22192 33554432000 4194304 5654031 140733511790864 140733511778680 4232729 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 24733 22192 141 357 0 24373 0
Current children cumulated CPU time (s) 51.04
Current children cumulated vsize (KiB) 124604

[startup+102.3 s]
/proc/loadavg: 1.68 0.62 0.22 3/179 11367
/proc/meminfo: memFree=24858724/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=98932 CPUtime=101.79 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 10553 0 0 0 10173 6 0 0 20 0 1 0 375948566 101306368 24403 33554432000 4194304 5654031 140733511790864 140733511788888 4215327 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 24733 24403 141 357 0 24373 0
Current children cumulated CPU time (s) 102.24
Current children cumulated vsize (KiB) 124604

[startup+162.3 s]
/proc/loadavg: 1.88 0.87 0.33 3/179 11367
/proc/meminfo: memFree=24749068/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=179996 CPUtime=161.77 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 14786 0 0 0 16165 12 0 0 20 0 1 0 375948566 184315904 43440 33554432000 4194304 5654031 140733511790864 140733511778680 4243753 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 44999 43440 141 357 0 44639 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 205668

[startup+222.306 s]
/proc/loadavg: 1.99 1.09 0.43 3/179 11367
/proc/meminfo: memFree=24694288/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=200052 CPUtime=221.77 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 17056 0 0 0 22161 16 0 0 20 0 1 0 375948566 204853248 48454 33554432000 4194304 5654031 140733511790864 140733511778680 4232821 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 50013 48454 141 357 0 49653 0
Current children cumulated CPU time (s) 222.22
Current children cumulated vsize (KiB) 225724

[startup+282.3 s]

################
# More data... #
################

/proc/loadavg: 2.03 1.98 1.52 3/179 11405
/proc/meminfo: memFree=24516440/32873844 swapFree=7124/7124
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=354040 CPUtime=1361.56 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 78231 0 0 0 136032 124 0 0 20 0 1 0 375948566 362536960 80999 33554432000 4194304 5654031 140733511790864 140733511788648 4232994 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 88510 80999 141 357 0 88150 0
Current children cumulated CPU time (s) 1362.01
Current children cumulated vsize (KiB) 379712

[startup+1422.3 s]
/proc/loadavg: 2.01 1.98 1.55 3/179 11405
/proc/meminfo: memFree=24435312/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=410316 CPUtime=1421.57 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 81203 0 0 0 142029 128 0 0 20 0 1 0 375948566 420163584 92885 33554432000 4194304 5654031 140733511790864 140733511778680 4234029 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 102579 92885 141 357 0 102219 0
Current children cumulated CPU time (s) 1422.02
Current children cumulated vsize (KiB) 435988

[startup+1482.3 s]
/proc/loadavg: 2.00 1.98 1.57 3/179 11405
/proc/meminfo: memFree=24368456/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=417520 CPUtime=1481.55 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 84088 0 0 0 148023 132 0 0 20 0 1 0 375948566 427540480 99067 33554432000 4194304 5654031 140733511790864 140733511788648 4215006 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 104380 99067 141 357 0 104020 0
Current children cumulated CPU time (s) 1482
Current children cumulated vsize (KiB) 443192

[startup+1542.31 s]
/proc/loadavg: 2.00 1.98 1.60 3/178 11405
/proc/meminfo: memFree=24407372/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=369928 CPUtime=1541.54 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 86939 0 0 0 154017 137 0 0 20 0 1 0 375948566 378806272 89839 33554432000 4194304 5654031 140733511790864 140733511778680 4232916 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 92482 89839 141 357 0 92122 0
Current children cumulated CPU time (s) 1541.99
Current children cumulated vsize (KiB) 395600

[startup+1602.3 s]
/proc/loadavg: 2.00 1.98 1.62 3/179 11406
/proc/meminfo: memFree=24454036/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=373708 CPUtime=1601.53 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 90365 0 0 0 160009 144 0 0 20 0 1 0 375948566 382676992 86559 33554432000 4194304 5654031 140733511790864 140733511788952 4215964 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 93427 86559 141 357 0 93067 0
Current children cumulated CPU time (s) 1601.98
Current children cumulated vsize (KiB) 399380

[startup+1662.3 s]
/proc/loadavg: 2.00 1.98 1.64 3/179 11409
/proc/meminfo: memFree=24418636/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=430980 CPUtime=1661.52 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 93537 0 0 0 166005 147 0 0 20 0 1 0 375948566 441323520 95572 33554432000 4194304 5654031 140733511790864 140733511788648 4232939 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 107745 95572 141 357 0 107385 0
Current children cumulated CPU time (s) 1661.97
Current children cumulated vsize (KiB) 456652

[startup+1722.3 s]
/proc/loadavg: 2.00 1.98 1.66 3/179 11409
/proc/meminfo: memFree=24475524/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=390260 CPUtime=1721.51 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 96614 0 0 0 172001 150 0 0 20 0 1 0 375948566 399626240 96326 33554432000 4194304 5654031 140733511790864 140733511778680 4215009 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 97565 96326 141 357 0 97205 0
Current children cumulated CPU time (s) 1721.96
Current children cumulated vsize (KiB) 415932

[startup+1782.3 s]
/proc/loadavg: 2.00 1.98 1.68 3/179 11409
/proc/meminfo: memFree=24393340/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=443644 CPUtime=1781.5 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 98907 0 0 0 177996 154 0 0 20 0 1 0 375948566 454291456 101402 33554432000 4194304 5654031 140733511790864 140733511778680 4232788 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 110911 101402 141 357 0 110551 0
Current children cumulated CPU time (s) 1781.95
Current children cumulated vsize (KiB) 469316



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.07 2.00 1.69 3/179 11409
/proc/meminfo: memFree=24393500/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=397744 CPUtime=1799.6 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 100751 0 0 0 179803 157 0 0 20 0 1 0 375948566 407289856 93863 33554432000 4194304 5654031 140733511790864 140733511788648 4215248 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 99436 93863 141 357 0 99076 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 423416

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+1800.4 s]
/proc/loadavg: 2.07 2.00 1.69 3/179 11409
/proc/meminfo: memFree=24393500/32873844 swapFree=7120/7120
[pid=11282] ppid=11280 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/11282/stat : 11282 (npSolver-pbo-It) S 11280 11282 11080 0 -1 4202496 359 0 0 0 0 0 0 0 20 0 1 0 375948518 9367552 275 33554432000 4194304 5064252 140733953808864 140733953807776 235374536270 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/11282/statm: 2287 275 233 213 0 72 0
[pid=11283] ppid=11282 vsize=16524 CPUtime=0.45 cores=0,2,4,6
/proc/11283/stat : 11283 (npSolver-pbo) S 11282 11282 11080 0 -1 4202496 5740 4987 0 0 12 1 31 1 20 0 1 0 375948518 16920576 3530 33554432000 4194304 6004724 140735501185648 140735501171928 5190736 0 0 4096 0 18446744071580380219 0 0 17 4 0 0 0 0 0
/proc/11283/statm: 4131 3530 152 442 0 3685 0
[pid=11288] ppid=11283 vsize=397744 CPUtime=1799.6 cores=0,2,4,6
/proc/11288/stat : 11288 (glucosInc) R 11283 11282 11080 0 -1 4202496 100751 0 0 0 179803 157 0 0 20 0 1 0 375948566 407289856 93863 33554432000 4194304 5654031 140733511790864 140733511788648 4215248 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/11288/statm: 99436 93863 141 357 0 99076 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 423416

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 11282 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=439933
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=35994
# CPU time returned by wait4() is 0.475927
# while last known CPU time is 1800.05
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1800.41
CPU time (s): 1800.05
CPU user time (s): 1798.46
CPU system time (s): 1.59
CPU usage (%): 99.9799
Max. virtual memory (cumulated for all children) (KiB): 518904

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.439933
system time used= 0.035994
maximum resident set size= 41412
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11102
page faults= 0
swaps= 0
block input operations= 0
block output operations= 4216
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12
involuntary context switches= 9

runsolver used 2.71759 second user time and 7.13192 second system time

The end

Launcher Data 

Begin job on node104 at 2012-06-07 21:43:20
IDJOB=3746383
IDBENCH=1498
IDSOLVER=2332
FILE ID=node104/3746383-1339098199
RUNJOBID= node104-1339098178-11096
PBS_JOBID= 14643749
Free space on /tmp= 67072 MiB

SOLVER NAME= npSolver inc-topDown
BENCH NAME= PB06//final/normalized-PB06/SATUNSAT-SMALLINT/web/www.ps.uni-sb.de/~walser/benchmarks/ppp-problems/normalized-ppp:1-9,16-19.opb
COMMAND LINE= DIR/npSolver-pbo-Itd.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3746383-1339098199/watcher-3746383-1339098199 -o /tmp/evaluation-result-3746383-1339098199/solver-3746383-1339098199 -C 1800 -W 1900 -M 15500  HOME/npSolver-pbo-Itd.sh HOME/instance-3746383-1339098199.opb 1098599510 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 732cdc3fa8b0bf0f47e882c13d928a6d
RANDOM SEED=1098599510

node104.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.266
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.53
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.266
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.266
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.266
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.266
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.266
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.266
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.266
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        25021324 kB
Buffers:         2726452 kB
Cached:          4072020 kB
SwapCached:          924 kB
Active:          3260032 kB
Inactive:        3549960 kB
Active(anon):       2188 kB
Inactive(anon):     8412 kB
Active(file):    3257844 kB
Inactive(file):  3541548 kB
Unevictable:        7120 kB
Mlocked:            7120 kB
SwapTotal:      67108856 kB
SwapFree:       67105276 kB
Dirty:              9800 kB
Writeback:             0 kB
AnonPages:         14456 kB
Mapped:            10048 kB
Shmem:                 8 kB
Slab:             903404 kB
SReclaimable:     345020 kB
SUnreclaim:       558384 kB
KernelStack:        1376 kB
PageTables:         3740 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:      93028 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 67056 MiB
End job on node104 at 2012-06-07 22:13:20