Trace number 3726037

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pwbo 2.02? (TO) 1800.11 901.323

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/
market-split/normalized-market-split_4_30_3.opb
MD5SUMd2b3af71376059fa940b007abcee01cc
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark25.1222
Has Objective FunctionYES
SatisfiableNO
(Un)Satisfiability was provedYES
Best value of the objective function
Optimality of the best value was proved
Number of variables31
Total number of constraints9
Number of constraints which are clauses1
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints8
Minimum length of a constraint1
Maximum length of a constraint30
Number of terms in the objective function 1
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1
Number of bits of the sum of numbers in the objective function 1
Biggest number in a constraint 940
Number of bits of the biggest number in a constraint 10
Biggest sum of numbers in a constraint 2821
Number of bits of the biggest sum of numbers12
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c ==============================[ Solver Version ]===============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  pwbo:                     2.02 beta - May, 2012                            |
0.00/0.00	c |                                                                             |
0.00/0.00	c Parsing opb file format. File HOME/instance-3726037-1338656064.opb.
0.00/0.00	c Instance file HOME/instance-3726037-1338656064.opb
0.00/0.00	c File size is 2114 bytes.
0.00/0.00	c Cost Offset: 0
0.00/0.00	c Highest Coefficient sum: 2821
0.00/0.00	c ============================[ Problem Statistics ]=============================
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Parsing time:          0.00         s                                      |
0.00/0.00	c |  Number Variables:      31                                                  |
0.00/0.00	c |  Number Clauses:        1                                                   |
0.00/0.00	c |  Number Cardinality:    0                                                   |
0.00/0.00	c |  Number PB Constraints: 8                                                   |
0.00/0.00	c |                                                                             |
0.00/0.00	c |  Problem Type:          Optimization                                        |
0.00/0.00	c |  Objective Function:    Cardinality Constraint                              |
0.00/0.00	c |                                                                             |
0.00/0.00	c ===============================================================================
1800.11/901.31	c ===============================================================================
1800.11/901.31	c Wall Clock Time: 901.31 s
1800.11/901.31	s UNKNOWN

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3726037-1338656064/watcher-3726037-1338656064 -o /tmp/evaluation-result-3726037-1338656064/solver-3726037-1338656064 -C 1800 -W 1900 -M 15500 pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3726037-1338656064.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 3.89 3.99 3.93 4/176 22236
/proc/meminfo: memFree=28221320/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=162228 CPUtime=0 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 792 0 0 0 0 0 0 0 20 0 3 0 331731898 166121472 744 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 40557 745 189 433 0 40121 0
[pid=22236/tid=22237] ppid=22234 vsize=162228 CPUtime=0 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 29 0 0 0 0 0 0 0 20 0 3 0 331731899 166121472 745 33554432000 4194304 5964478 140735089370544 140733501166024 5136490 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=162228 CPUtime=0 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 30 0 0 0 0 0 0 0 20 0 3 0 331731899 166121472 745 33554432000 4194304 5964478 140735089370544 140733501166024 5136490 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0

[startup+0.0787451 s]
/proc/loadavg: 3.89 3.99 3.93 4/176 22236
/proc/meminfo: memFree=28221320/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=162228 CPUtime=0.14 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 1236 0 0 0 14 0 0 0 20 0 3 0 331731898 166121472 1188 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 40557 1188 191 433 0 40121 0
[pid=22236/tid=22237] ppid=22234 vsize=162228 CPUtime=0.06 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 283 0 0 0 6 0 0 0 20 0 3 0 331731899 166121472 1188 33554432000 4194304 5964478 140735089370544 140055877949424 5136490 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=162228 CPUtime=0.06 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 219 0 0 0 6 0 0 0 20 0 3 0 331731899 166121472 1188 33554432000 4194304 5964478 140735089370544 140055867459888 4400508 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.14
Current children cumulated vsize (KiB) 162228

[startup+0.100281 s]
/proc/loadavg: 3.89 3.99 3.93 4/176 22236
/proc/meminfo: memFree=28221320/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=162228 CPUtime=0.18 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 1312 0 0 0 18 0 0 0 20 0 3 0 331731898 166121472 1264 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 40557 1264 191 433 0 40121 0
[pid=22236/tid=22237] ppid=22234 vsize=162228 CPUtime=0.08 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 332 0 0 0 8 0 0 0 20 0 3 0 331731899 166121472 1264 33554432000 4194304 5964478 140735089370544 140055877949424 4570837 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=162228 CPUtime=0.08 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 246 0 0 0 8 0 0 0 20 0 3 0 331731899 166121472 1264 33554432000 4194304 5964478 140735089370544 140055867459888 4570837 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 162228

[startup+0.300235 s]
/proc/loadavg: 3.89 3.99 3.93 4/176 22236
/proc/meminfo: memFree=28221320/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=162372 CPUtime=0.56 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 1900 0 0 0 55 1 0 0 20 0 3 0 331731898 166268928 1852 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 40593 1852 191 433 0 40157 0
[pid=22236/tid=22237] ppid=22234 vsize=162372 CPUtime=0.28 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 677 0 0 0 26 2 0 0 20 0 3 0 331731899 166268928 1852 33554432000 4194304 5964478 140735089370544 140055877949424 4391694 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=162372 CPUtime=0.27 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 489 0 0 0 27 0 0 0 20 0 3 0 331731899 166268928 1852 33554432000 4194304 5964478 140735089370544 140055867459888 4372993 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 0.56
Current children cumulated vsize (KiB) 162372

[startup+0.700241 s]
/proc/loadavg: 3.89 3.99 3.93 4/176 22236
/proc/meminfo: memFree=28221320/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=162516 CPUtime=1.36 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 2451 0 0 0 134 2 0 0 20 0 3 0 331731898 166416384 2403 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 40629 2403 191 433 0 40193 0
[pid=22236/tid=22237] ppid=22234 vsize=162516 CPUtime=0.67 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 1146 0 0 0 65 2 0 0 20 0 3 0 331731899 166416384 2403 33554432000 4194304 5964478 140735089370544 140055877949424 4400628 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=162516 CPUtime=0.67 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 571 0 0 0 67 0 0 0 20 0 3 0 331731899 166416384 2403 33554432000 4194304 5964478 140735089370544 140055867459888 5143823 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1.36
Current children cumulated vsize (KiB) 162516

[startup+1.50027 s]
/proc/loadavg: 3.89 3.99 3.93 5/179 22239
/proc/meminfo: memFree=28211500/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=163308 CPUtime=2.93 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 3118 0 0 0 291 2 0 0 20 0 3 0 331731898 167227392 3070 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 40827 3070 191 433 0 40391 0
[pid=22236/tid=22237] ppid=22234 vsize=163308 CPUtime=1.46 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 1622 0 0 0 144 2 0 0 20 0 3 0 331731899 167227392 3070 33554432000 4194304 5964478 140735089370544 140055877949424 4400010 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=163308 CPUtime=1.45 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 762 0 0 0 145 0 0 0 20 0 3 0 331731899 167227392 3070 33554432000 4194304 5964478 140735089370544 140055867459888 4399952 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 2.93
Current children cumulated vsize (KiB) 163308

[startup+3.10036 s]
/proc/loadavg: 3.89 3.99 3.93 5/179 22239
/proc/meminfo: memFree=28207284/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=164656 CPUtime=6.11 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 4445 0 0 0 607 4 0 0 20 0 3 0 331731898 168607744 4397 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 41164 4397 191 433 0 40728 0
[pid=22236/tid=22237] ppid=22234 vsize=164656 CPUtime=3.05 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 2610 0 0 0 302 3 0 0 20 0 3 0 331731899 168607744 4397 33554432000 4194304 5964478 140735089370544 140055877949424 4399952 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=164656 CPUtime=3.03 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 1101 0 0 0 303 0 0 0 20 0 3 0 331731899 168607744 4397 33554432000 4194304 5964478 140735089370544 140055867459888 4400538 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 6.11
Current children cumulated vsize (KiB) 164656

[startup+6.30035 s]
/proc/loadavg: 3.74 3.96 3.92 4/174 22247
/proc/meminfo: memFree=28446604/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=167360 CPUtime=12.47 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 6177 0 0 0 1242 5 0 0 20 0 3 0 331731898 171376640 6138 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 41840 6138 191 433 0 41404 0
[pid=22236/tid=22237] ppid=22234 vsize=167360 CPUtime=6.24 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 3959 0 0 0 620 4 0 0 20 0 3 0 331731899 171376640 6138 33554432000 4194304 5964478 140735089370544 140055877949424 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=167360 CPUtime=6.19 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 1484 0 0 0 618 1 0 0 20 0 3 0 331731899 171376640 6138 33554432000 4194304 5964478 140735089370544 140055867459888 5139166 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 12.47
Current children cumulated vsize (KiB) 167360

[startup+12.7004 s]
/proc/loadavg: 3.76 3.96 3.92 5/179 22280
/proc/meminfo: memFree=28375804/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=172068 CPUtime=25.23 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 8378 0 0 0 2517 6 0 0 20 0 3 0 331731898 176197632 8339 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 43017 8339 191 433 0 42581 0
[pid=22236/tid=22237] ppid=22234 vsize=172068 CPUtime=12.62 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 5622 0 0 0 1258 4 0 0 20 0 3 0 331731899 176197632 8339 33554432000 4194304 5964478 140735089370544 140055877949424 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=172068 CPUtime=12.53 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 2022 0 0 0 1252 1 0 0 20 0 3 0 331731899 176197632 8339 33554432000 4194304 5964478 140735089370544 140055867459888 4389540 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 25.23
Current children cumulated vsize (KiB) 172068

[startup+25.5004 s]
/proc/loadavg: 3.81 3.96 3.92 5/179 22280
/proc/meminfo: memFree=28328848/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=176192 CPUtime=50.74 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 11563 0 0 0 5066 8 0 0 20 0 3 0 331731898 180420608 13198 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 44048 13198 191 433 0 43612 0
[pid=22236/tid=22237] ppid=22234 vsize=176192 CPUtime=25.39 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 8372 0 0 0 2533 6 0 0 20 0 3 0 331731899 180420608 13198 33554432000 4194304 5964478 140735089370544 140055877949424 4221120 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=176192 CPUtime=25.21 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 2457 0 0 0 2520 1 0 0 20 0 3 0 331731899 180420608 13198 33554432000 4194304 5964478 140735089370544 140055867459888 4399938 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 50.74
Current children cumulated vsize (KiB) 176192

[startup+51.1004 s]
/proc/loadavg: 3.87 3.96 3.92 5/179 22281
/proc/meminfo: memFree=28278972/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=186192 CPUtime=101.79 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 16393 0 0 0 10169 10 0 0 20 0 3 0 331731898 190660608 18028 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 46548 18028 191 433 0 46112 0
[pid=22236/tid=22237] ppid=22234 vsize=186192 CPUtime=50.92 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 12693 0 0 0 5084 8 0 0 20 0 3 0 331731899 190660608 18028 33554432000 4194304 5964478 140735089370544 140055877949448 4399938 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=186192 CPUtime=50.61 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 2966 0 0 0 5059 2 0 0 20 0 3 0 331731899 190660608 18028 33554432000 4194304 5964478 140735089370544 140055867459416 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 101.79
Current children cumulated vsize (KiB) 186192

[startup+102.307 s]
/proc/loadavg: 3.94 3.97 3.92 5/179 22281
/proc/meminfo: memFree=28206664/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=194820 CPUtime=204 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 22517 0 0 0 20386 14 0 0 20 0 3 0 331731898 199495680 24152 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 48705 24152 191 433 0 48269 0
[pid=22236/tid=22237] ppid=22234 vsize=194820 CPUtime=102 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 17939 0 0 0 10188 12 0 0 20 0 3 0 331731899 199495680 24152 33554432000 4194304 5964478 140735089370544 140055877949480 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=194820 CPUtime=101.49 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 3844 0 0 0 10145 4 0 0 20 0 3 0 331731899 199495680 24152 33554432000 4194304 5964478 140735089370544 140055867459944 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 204
Current children cumulated vsize (KiB) 194820

[startup+162.3 s]
/proc/loadavg: 3.98 3.97 3.92 5/179 22281
/proc/meminfo: memFree=28142796/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=269388 CPUtime=323.77 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 28016 0 0 0 32359 18 0 0 20 0 3 0 331731898 275853312 29639 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 67347 29639 191 433 0 66911 0
[pid=22236/tid=22237] ppid=22234 vsize=269388 CPUtime=161.81 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 22777 0 0 0 16165 16 0 0 20 0 3 0 331731899 275853312 29639 33554432000 4194304 5964478 140735089370544 140055877949400 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=269388 CPUtime=161.15 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 4505 0 0 0 16109 6 0 0 20 0 3 0 331731899 275853312 29639 33554432000 4194304 5964478 140735089370544 140055867460000 4399938 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 323.77
Current children cumulated vsize (KiB) 269388

[startup+222.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/179 22281
/proc/meminfo: memFree=28085824/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=284696 CPUtime=443.57 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 34846 0 0 0 44334 23 0 0 20 0 3 0 331731898 291528704 36474 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 71174 36474 191 433 0 70738 0
[pid=22236/tid=22237] ppid=22234 vsize=284696 CPUtime=221.65 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 29181 0 0 0 22144 21 0 0 20 0 3 0 331731899 291528704 36474 33554432000 4194304 5964478 140735089370544 140055877948952 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=284696 CPUtime=220.82 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 4931 0 0 0 22074 8 0 0 20 0 3 0 331731899 291528704 36474 33554432000 4194304 5964478 140735089370544 140055867460000 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 443.57
Current children cumulated vsize (KiB) 284696

################
# More data... #
################

[pid=22236/tid=22238] ppid=22234 vsize=296420 CPUtime=340.24 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 5567 0 0 0 34013 11 0 0 20 0 3 0 331731899 303534080 45049 33554432000 4194304 5964478 140735089370544 140055867460000 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 683.26
Current children cumulated vsize (KiB) 296420

[startup+402.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/180 22308
/proc/meminfo: memFree=27965288/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=309244 CPUtime=803.11 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 47627 0 0 0 80279 32 0 0 20 0 3 0 331731898 316665856 49691 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 77311 49691 191 433 0 76875 0
[pid=22236/tid=22237] ppid=22234 vsize=309244 CPUtime=401.17 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 40813 0 0 0 40086 31 0 0 20 0 3 0 331731899 316665856 49691 33554432000 4194304 5964478 140735089370544 140055877949240 4399938 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=309244 CPUtime=399.96 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 6080 0 0 0 39983 13 0 0 20 0 3 0 331731899 316665856 49691 33554432000 4194304 5964478 140735089370544 140055867459944 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 803.11
Current children cumulated vsize (KiB) 309244

[startup+462.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/179 22308
/proc/meminfo: memFree=27926000/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=312188 CPUtime=922.99 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 50764 0 0 0 92264 35 0 0 20 0 3 0 331731898 319680512 52834 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 78047 52834 191 433 0 77611 0
[pid=22236/tid=22237] ppid=22234 vsize=312188 CPUtime=461.01 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 43311 0 0 0 46068 33 0 0 20 0 3 0 331731899 319680512 52834 33554432000 4194304 5964478 140735089370544 140055877949448 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=312188 CPUtime=459.7 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 6719 0 0 0 45956 14 0 0 20 0 3 0 331731899 319680512 52834 33554432000 4194304 5964478 140735089370544 140055867460000 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 922.99
Current children cumulated vsize (KiB) 312188

[startup+522.3 s]
/proc/loadavg: 3.99 3.97 3.92 5/179 22308
/proc/meminfo: memFree=27900964/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=312188 CPUtime=1042.83 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 53664 0 0 0 104247 36 0 0 20 0 3 0 331731898 319680512 55734 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 78047 55734 191 433 0 77611 0
[pid=22236/tid=22237] ppid=22234 vsize=312188 CPUtime=520.85 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 46199 0 0 0 52050 35 0 0 20 0 3 0 331731899 319680512 55734 33554432000 4194304 5964478 140735089370544 140055877949448 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=312188 CPUtime=519.41 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 6731 0 0 0 51926 15 0 0 20 0 3 0 331731899 319680512 55734 33554432000 4194304 5964478 140735089370544 140055867460000 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1042.83
Current children cumulated vsize (KiB) 312188

[startup+582.3 s]
/proc/loadavg: 4.04 3.99 3.92 5/179 22308
/proc/meminfo: memFree=27865480/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=379708 CPUtime=1162.68 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 56668 0 0 0 116230 38 0 0 20 0 3 0 331731898 388820992 58657 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 94927 58657 191 433 0 94491 0
[pid=22236/tid=22237] ppid=22234 vsize=379708 CPUtime=580.7 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 49167 0 0 0 58032 38 0 0 20 0 3 0 331731899 388820992 58657 33554432000 4194304 5964478 140735089370544 140055877949480 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=379708 CPUtime=579.12 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 6767 0 0 0 57896 16 0 0 20 0 3 0 331731899 388820992 58657 33554432000 4194304 5964478 140735089370544 140055867460000 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1162.68
Current children cumulated vsize (KiB) 379708

[startup+642.3 s]
/proc/loadavg: 4.01 3.99 3.92 5/179 22308
/proc/meminfo: memFree=27838564/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=383700 CPUtime=1282.6 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 59375 0 0 0 128220 40 0 0 20 0 3 0 331731898 392908800 61361 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 95925 61361 191 433 0 95489 0
[pid=22236/tid=22237] ppid=22234 vsize=383700 CPUtime=640.55 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 51609 0 0 0 64015 40 0 0 20 0 3 0 331731899 392908800 61361 33554432000 4194304 5964478 140735089370544 140055877949432 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=383700 CPUtime=638.89 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 7032 0 0 0 63872 17 0 0 20 0 3 0 331731899 392908800 61361 33554432000 4194304 5964478 140735089370544 140055867459944 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1282.6
Current children cumulated vsize (KiB) 383700

[startup+702.3 s]
/proc/loadavg: 4.00 3.99 3.92 5/179 22309
/proc/meminfo: memFree=27796316/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=397232 CPUtime=1402.47 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 64454 0 0 0 140203 44 0 0 20 0 3 0 331731898 406765568 66798 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 99308 66798 191 433 0 98872 0
[pid=22236/tid=22237] ppid=22234 vsize=397232 CPUtime=700.38 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 56577 0 0 0 69993 45 0 0 20 0 3 0 331731899 406765568 66798 33554432000 4194304 5964478 140735089370544 140055877948952 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=397232 CPUtime=698.64 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 7143 0 0 0 69846 18 0 0 20 0 3 0 331731899 406765568 66798 33554432000 4194304 5964478 140735089370544 140055867459416 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1402.47
Current children cumulated vsize (KiB) 397232

[startup+762.307 s]
/proc/loadavg: 4.07 4.00 3.93 5/179 22309
/proc/meminfo: memFree=27770804/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=412044 CPUtime=1522.35 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 68342 0 0 0 152188 47 0 0 20 0 3 0 331731898 421933056 70766 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 103011 70766 191 433 0 102575 0
[pid=22236/tid=22237] ppid=22234 vsize=412044 CPUtime=760.22 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 59960 0 0 0 75973 49 0 0 20 0 3 0 331731899 421933056 70766 33554432000 4194304 5964478 140735089370544 140055877949536 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=412044 CPUtime=758.38 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 7648 0 0 0 75818 20 0 0 20 0 3 0 331731899 421933056 70766 33554432000 4194304 5964478 140735089370544 140055867460000 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1522.35
Current children cumulated vsize (KiB) 412044

[startup+822.3 s]
/proc/loadavg: 4.02 4.00 3.93 5/178 22309
/proc/meminfo: memFree=27741700/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=412896 CPUtime=1642.25 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 70037 0 0 0 164177 48 0 0 20 0 3 0 331731898 422805504 72972 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 103224 72972 191 433 0 102788 0
[pid=22236/tid=22237] ppid=22234 vsize=412896 CPUtime=820.06 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 61582 0 0 0 81956 50 0 0 20 0 3 0 331731899 422805504 72972 33554432000 4194304 5964478 140735089370544 140055877949480 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=412896 CPUtime=818.15 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 7721 0 0 0 81794 21 0 0 20 0 3 0 331731899 422805504 72972 33554432000 4194304 5964478 140735089370544 140055867460000 4399952 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1642.25
Current children cumulated vsize (KiB) 412896

[startup+882.3 s]
/proc/loadavg: 4.01 4.00 3.93 5/179 22310
/proc/meminfo: memFree=27714920/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=421704 CPUtime=1762.15 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 73323 0 0 0 176164 51 0 0 20 0 3 0 331731898 431824896 76258 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 105426 76258 191 433 0 104990 0
[pid=22236/tid=22237] ppid=22234 vsize=421704 CPUtime=879.91 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 64468 0 0 0 87938 53 0 0 20 0 3 0 331731899 431824896 76258 33554432000 4194304 5964478 140735089370544 140055877949240 4399920 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=421704 CPUtime=877.9 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 8121 0 0 0 87767 23 0 0 20 0 3 0 331731899 431824896 76258 33554432000 4194304 5964478 140735089370544 140055867460000 4399920 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1762.15
Current children cumulated vsize (KiB) 421704



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+901.3 s]
/proc/loadavg: 4.00 4.00 3.93 5/179 22310
/proc/meminfo: memFree=27709712/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=421704 CPUtime=1800.11 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 74228 0 0 0 179960 51 0 0 20 0 3 0 331731898 431824896 77163 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 105426 77163 191 433 0 104990 0
[pid=22236/tid=22237] ppid=22234 vsize=421704 CPUtime=898.86 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 65373 0 0 0 89833 53 0 0 20 0 3 0 331731899 431824896 77163 33554432000 4194304 5964478 140735089370544 140055877948952 4399938 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=421704 CPUtime=896.81 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 8121 0 0 0 89658 23 0 0 20 0 3 0 331731899 431824896 77163 33554432000 4194304 5964478 140735089370544 140055867460000 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.11
Current children cumulated vsize (KiB) 421704

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+901.3 s]
/proc/loadavg: 4.00 4.00 3.93 5/179 22310
/proc/meminfo: memFree=27709712/32873852 swapFree=7624/7624
[pid=22236] ppid=22234 vsize=421704 CPUtime=1800.11 cores=1,3,5,7
/proc/22236/stat : 22236 (pwbo2.02) S 22234 22236 19474 0 -1 4202496 74228 0 0 0 179960 51 0 0 20 0 3 0 331731898 431824896 77163 33554432000 4194304 5964478 140735089370544 140735089370064 4546685 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/22236/statm: 105426 77163 191 433 0 104990 0
[pid=22236/tid=22237] ppid=22234 vsize=421704 CPUtime=898.86 cores=1,3,5,7
/proc/22236/task/22237/stat : 22237 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 65373 0 0 0 89833 53 0 0 20 0 3 0 331731899 431824896 77163 33554432000 4194304 5964478 140735089370544 140055877948952 4399938 0 0 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=22236/tid=22238] ppid=22234 vsize=421704 CPUtime=896.81 cores=1,3,5,7
/proc/22236/task/22238/stat : 22238 (pwbo2.02) R 22234 22236 19474 0 -1 4202560 8121 0 0 0 89658 23 0 0 20 0 3 0 331731899 431824896 77163 33554432000 4194304 5964478 140735089370544 140055867460000 4221120 0 0 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1800.11
Current children cumulated vsize (KiB) 421704

Child status: 0

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 22236 and gives
#  childrusage.ru_utime.tv_sec=1794
#  childrusage.ru_utime.tv_usec=938127
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=790879
# CPU time returned by wait4() is 1795.73
# while last known CPU time is 1800.11
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 901.323
CPU time (s): 1800.11
CPU user time (s): 1799.6
CPU system time (s): 0.51
CPU usage (%): 199.719
Max. virtual memory (cumulated for all children) (KiB): 421704

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1794.94
system time used= 0.790879
maximum resident set size= 308660
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 74230
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 603
involuntary context switches= 1831

runsolver used 2.16067 second user time and 5.47517 second system time

The end

Launcher Data 

Begin job on node131 at 2012-06-02 18:54:24
IDJOB=3726037
IDBENCH=2897
IDSOLVER=2309
FILE ID=node131/3726037-1338656064
RUNJOBID= node131-1338651542-21056
PBS_JOBID= 14636449
Free space on /tmp= 71392 MiB

SOLVER NAME= pwbo 2.02
BENCH NAME= PB06/final/normalized-PB06/OPT-SMALLINT/submitted-PB06/manquiho/market-split/normalized-market-split_4_30_3.opb
COMMAND LINE= pwbo2.02 -file-format=opb -verbosity=0 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3726037-1338656064/watcher-3726037-1338656064 -o /tmp/evaluation-result-3726037-1338656064/solver-3726037-1338656064 -C 1800 -W 1900 -M 15500  pwbo2.02 -file-format=opb -verbosity=0 HOME/instance-3726037-1338656064.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d2b3af71376059fa940b007abcee01cc
RANDOM SEED=1308940687

node131.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.61
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.805
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873852 kB
MemFree:        28221856 kB
Buffers:          540272 kB
Cached:          2998732 kB
SwapCached:         2348 kB
Active:          1618444 kB
Inactive:        2174728 kB
Active(anon):     250248 kB
Inactive(anon):     3676 kB
Active(file):    1368196 kB
Inactive(file):  2171052 kB
Unevictable:        7624 kB
Mlocked:            7624 kB
SwapTotal:      67108856 kB
SwapFree:       67099088 kB
Dirty:              5460 kB
Writeback:             0 kB
AnonPages:        258480 kB
Mapped:            15024 kB
Shmem:                 0 kB
Slab:             719220 kB
SReclaimable:     161612 kB
SUnreclaim:       557608 kB
KernelStack:        1448 kB
PageTables:         4476 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545780 kB
Committed_AS:     226708 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346360 kB
VmallocChunk:   34341988004 kB
HardwareCorrupted:     0 kB
AnonHugePages:    231424 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71392 MiB
End job on node131 at 2012-06-02 19:09:28