Trace number 3702435

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
npSolver inc-topdown-quickBound? (TO) 1800.09 1801.34

General information on the benchmark

Name/OPT-BIGINT-LIN/heinz/
normalized-n3seq24.opb
MD5SUM748baf4f5accf34b9eefa80f1acc6fdd
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark277
Best CPU time to get the best result obtained on this benchmark1800.08
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables119856
Total number of constraints6044
Number of constraints which are clauses1112
Number of constraints which are cardinality constraints (but not clauses)4484
Number of constraints which are nor clauses,nor cardinality constraints448
Minimum length of a constraint24
Maximum length of a constraint52272
Number of terms in the objective function 106176
Biggest coefficient in the objective function 336
Number of bits for the biggest coefficient in the objective function 9
Sum of the numbers in the objective function 9558600
Number of bits of the sum of numbers in the objective function 24
Biggest number in a constraint 336
Number of bits of the biggest number in a constraint 9
Biggest sum of numbers in a constraint 9558600
Number of bits of the biggest sum of numbers24
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

1.79/1.83	c fallback to adder encoding
1.99/2.05	c fallback to adder encoding
3.29/3.39	c fallback to adder encoding
3.49/3.59	c fallback to adder encoding
5.79/5.88	c fallback to adder encoding
6.18/6.21	c fallback to adder encoding
6.49/6.54	c fallback to adder encoding
6.78/6.87	c fallback to adder encoding
7.19/7.20	c fallback to adder encoding
7.48/7.52	c fallback to adder encoding
7.78/7.84	c fallback to adder encoding
8.09/8.15	c fallback to adder encoding
8.39/8.43	c fallback to adder encoding
8.69/8.71	c fallback to adder encoding
8.88/8.99	c fallback to adder encoding
9.19/9.25	c fallback to adder encoding
10.89/10.92	c fallback to adder encoding
11.19/11.25	c fallback to adder encoding
11.49/11.59	c fallback to adder encoding
11.88/11.92	c fallback to adder encoding
12.19/12.25	c fallback to adder encoding
12.48/12.57	c fallback to adder encoding
12.79/12.89	c fallback to adder encoding
13.09/13.20	c fallback to adder encoding
13.39/13.48	c fallback to adder encoding
13.68/13.77	c fallback to adder encoding
13.98/14.04	c fallback to adder encoding
14.19/14.30	c fallback to adder encoding
18.48/18.59	c fallback to adder encoding
18.78/18.81	c fallback to adder encoding
19.89/19.98	c fallback to adder encoding
20.19/20.20	c fallback to adder encoding
25.79/25.81	c fallback to adder encoding
26.08/26.19	c fallback to adder encoding
26.48/26.59	c fallback to adder encoding
26.89/26.98	c fallback to adder encoding
27.28/27.36	c fallback to adder encoding
27.68/27.74	c fallback to adder encoding
28.08/28.11	c fallback to adder encoding
28.38/28.47	c fallback to adder encoding
29.09/29.16	c fallback to adder encoding
29.48/29.50	c fallback to adder encoding
29.78/29.83	c fallback to adder encoding
30.08/30.14	c fallback to adder encoding
30.39/30.44	c fallback to adder encoding
30.69/30.73	c fallback to adder encoding
32.28/32.38	c fallback to adder encoding
32.68/32.77	c fallback to adder encoding
33.08/33.17	c fallback to adder encoding
33.48/33.56	c fallback to adder encoding
33.88/33.95	c fallback to adder encoding
34.29/34.32	c fallback to adder encoding
34.58/34.69	c fallback to adder encoding
34.99/35.05	c fallback to adder encoding
35.38/35.40	c fallback to adder encoding
35.68/35.74	c fallback to adder encoding
35.98/36.07	c fallback to adder encoding
36.28/36.38	c fallback to adder encoding
36.58/36.68	c fallback to adder encoding
36.88/36.98	c fallback to adder encoding
38.58/38.63	c fallback to adder encoding
38.78/38.89	c fallback to adder encoding
39.08/39.15	c fallback to adder encoding
40.38/40.48	c fallback to adder encoding
40.69/40.75	c fallback to adder encoding
40.98/41.00	c fallback to adder encoding
52.05/52.17	c run inc solver
52.05/52.17	c [INC SYSTEM] run initial solver
52.05/52.17	c [INC SYSTEM] preprocess with white file
150.97/151.94	c [INC SYSTEM] finished preprocessing in 99 s
150.97/151.94	c [INC SYSTEM] execute solver

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3702435-1338103773/watcher-3702435-1338103773 -o /tmp/evaluation-result-3702435-1338103773/solver-3702435-1338103773 -C 1800 -W 1900 -M 15500 HOME/npSolver-pbo-Itdqb.sh HOME/instance-3702435-1338103773.opb 1154621377 HOME HOME 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.01 2.00 2/180 1562
/proc/meminfo: memFree=31416984/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0

[startup+0.027037 s]
/proc/loadavg: 2.00 2.01 2.00 2/180 1562
/proc/meminfo: memFree=31416984/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100256 s]
/proc/loadavg: 2.00 2.01 2.00 2/180 1562
/proc/meminfo: memFree=31416984/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300234 s]
/proc/loadavg: 2.00 2.01 2.00 2/180 1562
/proc/meminfo: memFree=31416984/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700227 s]
/proc/loadavg: 2.00 2.01 2.00 2/180 1562
/proc/meminfo: memFree=31416984/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.5003 s]
/proc/loadavg: 1.92 2.00 1.99 3/182 1568
/proc/meminfo: memFree=31387432/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=44448 CPUtime=1.49 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) R 1562 1562 15712 0 -1 4202496 10999 0 0 0 147 2 0 0 20 0 1 0 276501789 45514752 10551 33554432000 4194304 5992684 140735171490976 140735171486712 5179600 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/1566/statm: 11112 10551 144 440 0 10668 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 53596

[startup+3.10031 s]
/proc/loadavg: 1.92 2.00 1.99 3/182 1568
/proc/meminfo: memFree=31334856/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=171684 CPUtime=3.09 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) R 1562 1562 15712 0 -1 4202496 27995 0 0 0 303 6 0 0 20 0 1 0 276501789 175804416 35738 33554432000 4194304 5992684 140735171490976 140735171486200 4568560 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/1566/statm: 42921 35738 167 440 0 42477 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 180832

[startup+6.30032 s]
/proc/loadavg: 1.93 2.00 1.99 3/182 1568
/proc/meminfo: memFree=31102640/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=484200 CPUtime=6.29 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) R 1562 1562 15712 0 -1 4202496 56339 0 0 0 614 15 0 0 20 0 1 0 276501789 495820800 95957 33554432000 4194304 5992684 140735171490976 140735171486200 4568064 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/1566/statm: 121050 95957 168 440 0 120606 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 493348

[startup+12.7003 s]
/proc/loadavg: 1.93 2.00 1.99 3/182 1568
/proc/meminfo: memFree=30654200/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=933700 CPUtime=12.69 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) R 1562 1562 15712 0 -1 4202496 106087 0 0 0 1239 30 0 0 20 0 1 0 276501789 956108800 201155 33554432000 4194304 5992684 140735171490976 140735171486376 4606704 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/1566/statm: 233425 201155 168 440 0 232981 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 942848

[startup+25.5003 s]
/proc/loadavg: 1.95 2.00 1.99 3/182 1568
/proc/meminfo: memFree=29684916/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=1902004 CPUtime=25.48 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) R 1562 1562 15712 0 -1 4202496 214848 0 0 0 2484 64 0 0 20 0 1 0 276501789 1947652096 439047 33554432000 4194304 5992684 140735171490976 140735171475208 4225888 0 0 4096 0 0 0 0 17 4 0 0 0 0 0
/proc/1566/statm: 475501 439047 169 440 0 475057 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 1911152

[startup+51.1003 s]
/proc/loadavg: 1.96 2.00 1.99 3/183 1571
/proc/meminfo: memFree=24989592/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=5676536 CPUtime=51.06 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) R 1562 1562 15712 0 -1 4202496 395533 0 0 0 4776 330 0 0 20 0 1 0 276501789 5812772864 1380657 33554432000 4194304 5992684 140735171490976 140735171486832 5182699 0 0 4096 0 0 0 0 17 0 0 0 2 0 0
/proc/1566/statm: 1419134 1380657 170 440 0 1418690 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 5685684

[startup+102.307 s]
/proc/loadavg: 2.61 2.16 2.05 3/184 1574
/proc/meminfo: memFree=21002740/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=3732736 CPUtime=52.32 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) S 1562 1562 15712 0 -1 4202496 395541 0 0 0 4779 453 0 0 20 0 1 0 276501789 3822321664 894713 33554432000 4194304 5992684 140735171490976 140735171485424 5175646 0 65536 4102 0 18446744071579302229 0 0 17 0 0 0 3 0 0
/proc/1566/statm: 933184 894713 176 440 0 932740 0
[pid=1572] ppid=1566 vsize=9148 CPUtime=0.01 cores=0,2,4,6
/proc/1572/stat : 1572 (cp2_pre.sh) S 1566 1562 15712 0 -1 4202496 609 0 0 0 0 1 0 0 20 0 1 0 276507024 9367552 277 33554432000 4194304 5064252 140736804072096 140736804070800 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 6 0 0 0 0 0
/proc/1572/statm: 2287 277 234 213 0 72 0
[pid=1573] ppid=1572 vsize=5343808 CPUtime=49.72 cores=0,2,4,6
/proc/1573/stat : 1573 (coprocessor) R 1572 1562 15712 0 -1 4202496 29957 0 0 0 4708 264 0 0 20 0 1 0 276507028 5472059392 1041988 33554432000 4194304 6586260 140734531372624 140734531368376 5732496 0 0 4096 8404994 0 0 0 17 2 0 0 16 0 0
/proc/1573/statm: 1335952 1041988 158 584 0 1335364 0
Current children cumulated CPU time (s) 102.05
Current children cumulated vsize (KiB) 9094840

[startup+162.3 s]
/proc/loadavg: 2.76 2.30 2.10 3/183 1576
/proc/meminfo: memFree=23309064/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=3732736 CPUtime=151.06 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) S 1562 1562 15712 0 -1 4202496 395557 30860 0 0 4779 455 9324 548 20 0 1 0 276501789 3822321664 894715 33554432000 4194304 5992684 140735171490976 140735171477240 5179600 0 0 4096 0 18446744071580380219 0 0 17 6 0 0 3 0 0
/proc/1566/statm: 933184 894715 178 440 0 932740 0
[pid=1576] ppid=1566 vsize=3167256 CPUtime=10.33 cores=0,2,4,6
/proc/1576/stat : 1576 (glucosInc) R 1566 1562 15712 0 -1 4202496 286092 0 0 0 932 101 0 0 20 0 1 0 276516983 3243270144 676357 33554432000 4194304 5654031 140736288473984 140736287423336 4240632 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/1576/statm: 791814 676358 108 357 0 791454 0
Current children cumulated CPU time (s) 161.39
Current children cumulated vsize (KiB) 6909140

[startup+222.3 s]
/proc/loadavg: 2.28 2.24 2.09 3/184 1577
/proc/meminfo: memFree=19925560/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=3732736 CPUtime=151.06 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) S 1562 1562 15712 0 -1 4202496 395557 30860 0 0 4779 455 9324 548 20 0 1 0 276501789 3822321664 894715 33554432000 4194304 5992684 140735171490976 140735171477240 5179600 0 0 4096 0 18446744071580380219 0 0 17 6 0 0 3 0 0
/proc/1566/statm: 933184 894715 178 440 0 932740 0
[pid=1576] ppid=1566 vsize=6905608 CPUtime=70.3 cores=0,2,4,6
/proc/1576/stat : 1576 (glucosInc) R 1566 1562 15712 0 -1 4202496 680648 0 0 0 6810 220 0 0 20 0 1 0 276516983 7071342592 1478916 33554432000 4194304 5654031 140736288473984 140736288461800 4244487 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/1576/statm: 1726402 1478916 141 357 0 1726042 0
Current children cumulated CPU time (s) 221.36
Current children cumulated vsize (KiB) 10647492

[startup+282.3 s]
/proc/loadavg: 2.10 2.19 2.08 3/183 1577
/proc/meminfo: memFree=19911656/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=3732736 CPUtime=151.06 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) S 1562 1562 15712 0 -1 4202496 395557 30860 0 0 4779 455 9324 548 20 0 1 0 276501789 3822321664 894715 33554432000 4194304 5992684 140735171490976 140735171477240 5179600 0 0 4096 0 18446744071580380219 0 0 17 6 0 0 3 0 0
/proc/1566/statm: 933184 894715 178 440 0 932740 0
[pid=1576] ppid=1566 vsize=6913604 CPUtime=130.3 cores=0,2,4,6
/proc/1576/stat : 1576 (glucosInc) R 1566 1562 15712 0 -1 4202496 682629 0 0 0 12809 221 0 0 20 0 1 0 276516983 7079530496 1481408 33554432000 4194304 5654031 140736288473984 140736288461800 4232477 0 0 4096 0 0 0 0 17 0 0 0 0 0 0
/proc/1576/statm: 1728401 1481408 141 357 0 1728041 0
Current children cumulated CPU time (s) 281.36
Current children cumulated vsize (KiB) 10655488

[startup+342.3 s]

################
# More data... #
################

/proc/meminfo: memFree=19077020/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=3732736 CPUtime=151.06 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) S 1562 1562 15712 0 -1 4202496 395557 30860 0 0 4779 455 9324 548 20 0 1 0 276501789 3822321664 894715 33554432000 4194304 5992684 140735171490976 140735171477240 5179600 0 0 4096 0 18446744071580380219 0 0 17 6 0 0 3 0 0
/proc/1566/statm: 933184 894715 178 440 0 932740 0
[pid=1576] ppid=1566 vsize=7934188 CPUtime=1210.12 cores=0,2,4,6
/proc/1576/stat : 1576 (glucosInc) R 1566 1562 15712 0 -1 4202496 712602 0 0 0 120769 243 0 0 20 0 1 0 276516983 8124608512 1591886 33554432000 4194304 5654031 140736288473984 140736288461800 4214638 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1576/statm: 1983547 1591886 141 357 0 1983187 0
Current children cumulated CPU time (s) 1361.18
Current children cumulated vsize (KiB) 11676072

[startup+1422.31 s]
/proc/loadavg: 2.01 2.01 2.01 3/181 1709
/proc/meminfo: memFree=19041464/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=3732736 CPUtime=151.06 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) S 1562 1562 15712 0 -1 4202496 395557 30860 0 0 4779 455 9324 548 20 0 1 0 276501789 3822321664 894715 33554432000 4194304 5992684 140735171490976 140735171477240 5179600 0 0 4096 0 18446744071580380219 0 0 17 6 0 0 3 0 0
/proc/1566/statm: 933184 894715 178 440 0 932740 0
[pid=1576] ppid=1566 vsize=7937888 CPUtime=1270.11 cores=0,2,4,6
/proc/1576/stat : 1576 (glucosInc) R 1566 1562 15712 0 -1 4202496 713688 0 0 0 126767 244 0 0 20 0 1 0 276516983 8128397312 1599104 33554432000 4194304 5654031 140736288473984 140736288461800 4214475 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1576/statm: 1984472 1599104 141 357 0 1984112 0
Current children cumulated CPU time (s) 1421.17
Current children cumulated vsize (KiB) 11679772

[startup+1482.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 1709
/proc/meminfo: memFree=19373668/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=3732736 CPUtime=151.06 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) S 1562 1562 15712 0 -1 4202496 395557 30860 0 0 4779 455 9324 548 20 0 1 0 276501789 3822321664 894715 33554432000 4194304 5992684 140735171490976 140735171477240 5179600 0 0 4096 0 18446744071580380219 0 0 17 6 0 0 3 0 0
/proc/1566/statm: 933184 894715 178 440 0 932740 0
[pid=1576] ppid=1566 vsize=7019740 CPUtime=1330.1 cores=0,2,4,6
/proc/1576/stat : 1576 (glucosInc) R 1566 1562 15712 0 -1 4202496 715784 0 0 0 132742 268 0 0 20 0 1 0 276516983 7188213760 1516882 33554432000 4194304 5654031 140736288473984 140736288461800 4214432 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1576/statm: 1754935 1516882 142 357 0 1754575 0
Current children cumulated CPU time (s) 1481.16
Current children cumulated vsize (KiB) 10761624

[startup+1542.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 1709
/proc/meminfo: memFree=19338348/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=3732736 CPUtime=151.06 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) S 1562 1562 15712 0 -1 4202496 395557 30860 0 0 4779 455 9324 548 20 0 1 0 276501789 3822321664 894715 33554432000 4194304 5992684 140735171490976 140735171477240 5179600 0 0 4096 0 18446744071580380219 0 0 17 6 0 0 3 0 0
/proc/1566/statm: 933184 894715 178 440 0 932740 0
[pid=1576] ppid=1566 vsize=7022516 CPUtime=1390.08 cores=0,2,4,6
/proc/1576/stat : 1576 (glucosInc) R 1566 1562 15712 0 -1 4202496 716558 0 0 0 138740 268 0 0 20 0 1 0 276516983 7191056384 1523277 33554432000 4194304 5654031 140736288473984 140736288461800 4232775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1576/statm: 1755629 1523277 142 357 0 1755269 0
Current children cumulated CPU time (s) 1541.14
Current children cumulated vsize (KiB) 10764400

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/181 1710
/proc/meminfo: memFree=19322308/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=3732736 CPUtime=151.06 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) S 1562 1562 15712 0 -1 4202496 395557 30860 0 0 4779 455 9324 548 20 0 1 0 276501789 3822321664 894715 33554432000 4194304 5992684 140735171490976 140735171477240 5179600 0 0 4096 0 18446744071580380219 0 0 17 6 0 0 3 0 0
/proc/1566/statm: 933184 894715 178 440 0 932740 0
[pid=1576] ppid=1566 vsize=7024864 CPUtime=1450.07 cores=0,2,4,6
/proc/1576/stat : 1576 (glucosInc) R 1566 1562 15712 0 -1 4202496 717234 0 0 0 144738 269 0 0 20 0 1 0 276516983 7193460736 1528552 33554432000 4194304 5654031 140736288473984 140736288461800 4214616 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1576/statm: 1756216 1528552 142 357 0 1755856 0
Current children cumulated CPU time (s) 1601.13
Current children cumulated vsize (KiB) 10766748

[startup+1662.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/181 1712
/proc/meminfo: memFree=19374204/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=3732736 CPUtime=151.06 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) S 1562 1562 15712 0 -1 4202496 395557 30860 0 0 4779 455 9324 548 20 0 1 0 276501789 3822321664 894715 33554432000 4194304 5992684 140735171490976 140735171477240 5179600 0 0 4096 0 18446744071580380219 0 0 17 6 0 0 3 0 0
/proc/1566/statm: 933184 894715 178 440 0 932740 0
[pid=1576] ppid=1566 vsize=7029724 CPUtime=1510.06 cores=0,2,4,6
/proc/1576/stat : 1576 (glucosInc) R 1566 1562 15712 0 -1 4202496 718515 0 0 0 150736 270 0 0 20 0 1 0 276516983 7198437376 1535965 33554432000 4194304 5654031 140736288473984 140736288461800 4233448 0 0 4096 0 0 0 0 17 6 0 0 0 0 0
/proc/1576/statm: 1757431 1535965 142 357 0 1757071 0
Current children cumulated CPU time (s) 1661.12
Current children cumulated vsize (KiB) 10771608

[startup+1722.3 s]
/proc/loadavg: 2.08 2.03 2.00 3/181 1712
/proc/meminfo: memFree=19306384/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=3732736 CPUtime=151.06 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) S 1562 1562 15712 0 -1 4202496 395557 30860 0 0 4779 455 9324 548 20 0 1 0 276501789 3822321664 894715 33554432000 4194304 5992684 140735171490976 140735171477240 5179600 0 0 4096 0 18446744071580380219 0 0 17 6 0 0 3 0 0
/proc/1566/statm: 933184 894715 178 440 0 932740 0
[pid=1576] ppid=1566 vsize=7957424 CPUtime=1570.05 cores=0,2,4,6
/proc/1576/stat : 1576 (glucosInc) R 1566 1562 15712 0 -1 4202496 720767 0 0 0 156722 283 0 0 20 0 1 0 276516983 8148402176 1544826 33554432000 4194304 5654031 140736288473984 140736288461800 4232707 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1576/statm: 1989356 1544826 142 357 0 1988996 0
Current children cumulated CPU time (s) 1721.11
Current children cumulated vsize (KiB) 11699308

[startup+1782.3 s]
/proc/loadavg: 2.16 2.05 2.01 3/181 1712
/proc/meminfo: memFree=19239304/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=3732736 CPUtime=151.06 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) S 1562 1562 15712 0 -1 4202496 395557 30860 0 0 4779 455 9324 548 20 0 1 0 276501789 3822321664 894715 33554432000 4194304 5992684 140735171490976 140735171477240 5179600 0 0 4096 0 18446744071580380219 0 0 17 6 0 0 3 0 0
/proc/1566/statm: 933184 894715 178 440 0 932740 0
[pid=1576] ppid=1566 vsize=7966060 CPUtime=1630.02 cores=0,2,4,6
/proc/1576/stat : 1576 (glucosInc) R 1566 1562 15712 0 -1 4202496 722488 0 0 0 162719 283 0 0 20 0 1 0 276516983 8157245440 1553190 33554432000 4194304 5654031 140736288473984 140736288461800 4233464 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1576/statm: 1991515 1553190 142 357 0 1991155 0
Current children cumulated CPU time (s) 1781.08
Current children cumulated vsize (KiB) 11707944



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1801.3 s]
/proc/loadavg: 2.12 2.05 2.01 3/181 1712
/proc/meminfo: memFree=19226460/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=3732736 CPUtime=151.06 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) S 1562 1562 15712 0 -1 4202496 395557 30860 0 0 4779 455 9324 548 20 0 1 0 276501789 3822321664 894715 33554432000 4194304 5992684 140735171490976 140735171477240 5179600 0 0 4096 0 18446744071580380219 0 0 17 6 0 0 3 0 0
/proc/1566/statm: 933184 894715 178 440 0 932740 0
[pid=1576] ppid=1566 vsize=7968172 CPUtime=1649.03 cores=0,2,4,6
/proc/1576/stat : 1576 (glucosInc) R 1566 1562 15712 0 -1 4202496 723085 0 0 0 164619 284 0 0 20 0 1 0 276516983 8159408128 1556342 33554432000 4194304 5654031 140736288473984 140736288461800 4232775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1576/statm: 1992043 1556342 142 357 0 1991683 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 11710056

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1801.3 s]
/proc/loadavg: 2.12 2.05 2.01 3/181 1712
/proc/meminfo: memFree=19226460/32873844 swapFree=7632/7632
[pid=1562] ppid=1560 vsize=9148 CPUtime=0 cores=0,2,4,6
/proc/1562/stat : 1562 (npSolver-pbo-It) S 1560 1562 15712 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 276501789 9367552 274 33554432000 4194304 5064252 140733833736304 140733833735216 209883653710 0 65536 4100 65538 18446744071579302229 0 0 17 0 0 0 0 0 0
/proc/1562/statm: 2287 274 233 213 0 72 0
[pid=1566] ppid=1562 vsize=3732736 CPUtime=151.06 cores=0,2,4,6
/proc/1566/stat : 1566 (npSolver-pbo) S 1562 1562 15712 0 -1 4202496 395557 30860 0 0 4779 455 9324 548 20 0 1 0 276501789 3822321664 894715 33554432000 4194304 5992684 140735171490976 140735171477240 5179600 0 0 4096 0 18446744071580380219 0 0 17 6 0 0 3 0 0
/proc/1566/statm: 933184 894715 178 440 0 932740 0
[pid=1576] ppid=1566 vsize=7968172 CPUtime=1649.03 cores=0,2,4,6
/proc/1576/stat : 1576 (glucosInc) R 1566 1562 15712 0 -1 4202496 723085 0 0 0 164619 284 0 0 20 0 1 0 276516983 8159408128 1556342 33554432000 4194304 5654031 140736288473984 140736288461800 4232775 0 0 4096 0 0 0 0 17 2 0 0 0 0 0
/proc/1576/statm: 1992043 1556342 142 357 0 1991683 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 11710056

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 1562 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=0
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1800.09
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1801.34
CPU time (s): 1800.09
CPU user time (s): 1787.22
CPU system time (s): 12.87
CPU usage (%): 99.9308
Max. virtual memory (cumulated for all children) (KiB): 13156136

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0
maximum resident set size= 1096
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 356
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 4
involuntary context switches= 1

runsolver used 3.86141 second user time and 10.1525 second system time

The end

Launcher Data 

Begin job on node141 at 2012-05-27 09:29:35
IDJOB=3702435
IDBENCH=89898
IDSOLVER=2278
FILE ID=node141/3702435-1338103773
RUNJOBID= node141-1338087612-15728
PBS_JOBID= 14624446
Free space on /tmp= 71496 MiB

SOLVER NAME= npSolver inc-topdown-quickBound
BENCH NAME= PB11/normalized-PB11/OPT-BIGINT-LIN/heinz/normalized-n3seq24.opb
COMMAND LINE= DIR/npSolver-pbo-Itdqb.sh BENCHNAME RANDOMSEED TMPDIR DIR
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3702435-1338103773/watcher-3702435-1338103773 -o /tmp/evaluation-result-3702435-1338103773/solver-3702435-1338103773 -C 1800 -W 1900 -M 15500  HOME/npSolver-pbo-Itdqb.sh HOME/instance-3702435-1338103773.opb 1154621377 HOME HOME

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 748baf4f5accf34b9eefa80f1acc6fdd
RANDOM SEED=1154621377

node141.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.48
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.93
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.744
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873844 kB
MemFree:        31416860 kB
Buffers:          154244 kB
Cached:           300816 kB
SwapCached:          232 kB
Active:           332448 kB
Inactive:         314396 kB
Active(anon):     180480 kB
Inactive(anon):    12856 kB
Active(file):     151968 kB
Inactive(file):   301540 kB
Unevictable:        7632 kB
Mlocked:            7632 kB
SwapTotal:      67108856 kB
SwapFree:       67108624 kB
Dirty:             40940 kB
Writeback:             0 kB
AnonPages:        200292 kB
Mapped:            12392 kB
Shmem:               172 kB
Slab:             670612 kB
SReclaimable:     112792 kB
SUnreclaim:       557820 kB
KernelStack:        1480 kB
PageTables:         4468 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545776 kB
Committed_AS:     323696 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346368 kB
VmallocChunk:   34341987984 kB
HardwareCorrupted:     0 kB
AnonHugePages:    135168 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 69576 MiB
End job on node141 at 2012-05-27 09:59:36