Trace number 3731620

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
PB10: pb_cplex 2010-06-29? (TO) 1800.13 584.217

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/submitted-PB06/liu/
wnq/normalized-wnq_n100_mw99_6.opb.PB06.opb
MD5SUM5f836d1b8d150c1925229546ed283812
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark371
Best CPU time to get the best result obtained on this benchmark1793.18
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 453
Optimality of the best value was proved NO
Number of variables10000
Total number of constraints656900
Number of constraints which are clauses656900
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint2
Maximum length of a constraint100
Number of terms in the objective function 10000
Biggest coefficient in the objective function 99
Number of bits for the biggest coefficient in the objective function 7
Sum of the numbers in the objective function 491651
Number of bits of the sum of numbers in the objective function 19
Biggest number in a constraint 99
Number of bits of the biggest number in a constraint 7
Biggest sum of numbers in a constraint 491651
Number of bits of the biggest sum of numbers19
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-3731620-1339246896.opb.
0.00/0.00	c Instance file HOME/instance-3731620-1339246896.opb
0.00/0.00	c File size is 17233665 bytes.
11.48/11.58	c Highest Coefficient sum: 101
11.48/11.58	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
11.89/11.96	c ============================[ Problem Statistics ]=============================
11.89/11.96	c |                                                                             |
11.89/11.96	c |  Parsing time:          11.86        s                                      |
11.89/11.96	c |  Number Variables:      10000                                               |
12.00/12.07	c |  Number Constraints:    656900                                              |
12.00/12.07	c ===============================================================================
1799.99/584.21	c Remaining time 1788.04 sec.
1799.99/584.21	c 
1799.99/584.21	c *** INTERRUPTED ***
1799.99/584.21	s UNKNOWN
1799.99/584.21	c Total CPU time              : 1773.41 s
1799.99/584.21	c Memory used           : 1172.65 MB
1799.99/584.21	c CPU time              : 1773.41 s
1799.99/584.21	c 
1799.99/584.21	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2011 Olivier ROUSSEL

This is runsolver version 3.3.1 (svn: 989)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-3731620-1339246896/watcher-3731620-1339246896 -o /tmp/evaluation-result-3731620-1339246896/solver-3731620-1339246896 -C 1800 -W 1900 -M 15500 run HOME/instance-3731620-1339246896.opb 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 4.45 1.31 0.45 7/183 24684
/proc/meminfo: memFree=30898160/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0

[startup+0.0149901 s]
/proc/loadavg: 4.45 1.31 0.45 7/183 24684
/proc/meminfo: memFree=30898160/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.100216 s]
/proc/loadavg: 4.45 1.31 0.45 7/183 24684
/proc/meminfo: memFree=30898160/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.300179 s]
/proc/loadavg: 4.45 1.31 0.45 7/183 24684
/proc/meminfo: memFree=30898160/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+0.700177 s]
/proc/loadavg: 4.45 1.31 0.45 7/183 24684
/proc/meminfo: memFree=30898160/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 9148

[startup+1.50022 s]
/proc/loadavg: 4.66 1.40 0.48 3/185 24686
/proc/meminfo: memFree=30895044/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
[pid=24685] ppid=24684 vsize=32000 CPUtime=1.49 cores=1,3,5,7
/proc/24685/stat : 24685 (pb_cplex) R 24684 24684 24426 0 -1 4202496 975 0 0 0 149 0 0 0 20 0 1 0 390815107 32768000 931 33554432000 134512640 146736320 4292381728 4292339616 140679059 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/24685/statm: 8000 931 308 2985 0 726 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 41148

[startup+3.1003 s]
/proc/loadavg: 4.66 1.40 0.48 3/185 24686
/proc/meminfo: memFree=30894424/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
[pid=24685] ppid=24684 vsize=32132 CPUtime=3.09 cores=1,3,5,7
/proc/24685/stat : 24685 (pb_cplex) R 24684 24684 24426 0 -1 4202496 1009 0 0 0 309 0 0 0 20 0 1 0 390815107 32903168 965 33554432000 134512640 146736320 4292381728 4292339712 140684755 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/24685/statm: 8033 965 308 2985 0 759 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 41280

[startup+6.30022 s]
/proc/loadavg: 4.66 1.40 0.48 3/185 24686
/proc/meminfo: memFree=30893680/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
[pid=24685] ppid=24684 vsize=32432 CPUtime=6.29 cores=1,3,5,7
/proc/24685/stat : 24685 (pb_cplex) R 24684 24684 24426 0 -1 4202496 1062 0 0 0 629 0 0 0 20 0 1 0 390815107 33210368 1018 33554432000 134512640 146736320 4292381728 4292339536 140526612 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/24685/statm: 8108 1018 308 2985 0 834 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 41580

[startup+12.7003 s]
/proc/loadavg: 4.25 1.42 0.50 3/185 24686
/proc/meminfo: memFree=30654772/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
[pid=24685] ppid=24684 vsize=307764 CPUtime=12.68 cores=1,3,5,7
/proc/24685/stat : 24685 (pb_cplex) R 24684 24684 24426 0 -1 4202496 65673 0 0 0 1256 12 0 0 20 0 1 0 390815107 315150336 70860 33554432000 134512640 146736320 4292381728 4292379816 138686278 0 0 4096 16387 0 0 0 17 3 0 0 0 0 0
/proc/24685/statm: 76941 70860 621 2985 0 73875 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 316912

[startup+25.5005 s]
/proc/loadavg: 5.22 1.72 0.61 17/192 24707
/proc/meminfo: memFree=30625044/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
[pid=24685] ppid=24684 vsize=394852 CPUtime=46.71 cores=1,3,5,7
/proc/24685/stat : 24685 (pb_cplex) R 24684 24684 24426 0 -1 4202496 117821 0 0 0 4626 45 0 0 20 0 8 0 390815107 404328448 69087 33554432000 134512640 146736320 4292381728 4292373904 136403129 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0 0 0
/proc/24685/statm: 98713 69087 957 2985 0 95647 0
[pid=24685/tid=24701] ppid=24684 vsize=394852 CPUtime=4.09 cores=1,3,5,7
/proc/24685/task/24701/stat : 24701 (pb_cplex) S 24684 24684 24426 0 -1 4202560 1907 0 0 0 407 2 0 0 20 0 8 0 390816765 404328448 69087 33554432000 134512640 146736320 4292381728 3987685008 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24685/tid=24702] ppid=24684 vsize=394852 CPUtime=4.55 cores=1,3,5,7
/proc/24685/task/24702/stat : 24702 (pb_cplex) R 24684 24684 24426 0 -1 4202560 2179 0 0 0 452 3 0 0 20 0 8 0 390816765 404328448 69087 33554432000 134512640 146736320 4292381728 4075085736 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=24685/tid=24703] ppid=24684 vsize=394852 CPUtime=4.46 cores=1,3,5,7
/proc/24685/task/24703/stat : 24703 (pb_cplex) R 24684 24684 24426 0 -1 4202560 2910 0 0 0 445 1 0 0 20 0 8 0 390816765 404328448 69087 33554432000 134512640 146736320 4292381728 4093041668 136385184 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=24685/tid=24704] ppid=24684 vsize=394852 CPUtime=2.79 cores=1,3,5,7
/proc/24685/task/24704/stat : 24704 (pb_cplex) S 24684 24684 24426 0 -1 4202560 1864 0 0 0 278 1 0 0 20 0 8 0 390816765 404328448 69087 33554432000 134512640 146736320 4292381728 4051652240 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24685/tid=24705] ppid=24684 vsize=394852 CPUtime=2.76 cores=1,3,5,7
/proc/24685/task/24705/stat : 24705 (pb_cplex) S 24684 24684 24426 0 -1 4202560 1601 0 0 0 274 2 0 0 20 0 8 0 390816765 404328448 69087 33554432000 134512640 146736320 4292381728 3973471888 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24685/tid=24706] ppid=24684 vsize=394852 CPUtime=3.69 cores=1,3,5,7
/proc/24685/task/24706/stat : 24706 (pb_cplex) R 24684 24684 24426 0 -1 4202560 1350 0 0 0 366 3 0 0 20 0 8 0 390816765 404328448 69087 33554432000 134512640 146736320 4292381728 3962637456 136007977 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=24685/tid=24707] ppid=24684 vsize=394852 CPUtime=5.84 cores=1,3,5,7
/proc/24685/task/24707/stat : 24707 (pb_cplex) R 24684 24684 24426 0 -1 4202560 2108 0 0 0 581 3 0 0 20 0 8 0 390816765 404328448 69087 33554432000 134512640 146736320 4292381728 3952151556 136385167 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 46.71
Current children cumulated vsize (KiB) 404000

[startup+51.1005 s]
/proc/loadavg: 8.02 2.72 0.97 10/191 24735
/proc/meminfo: memFree=30402216/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
[pid=24685] ppid=24684 vsize=643140 CPUtime=117.27 cores=1,3,5,7
/proc/24685/stat : 24685 (pb_cplex) S 24684 24684 24426 0 -1 4202496 275475 0 0 0 11584 143 0 0 20 0 8 0 390815107 658575360 123925 33554432000 134512640 146736320 4292381728 4292378128 144580073 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24685/statm: 160785 123925 962 2985 0 157719 0
[pid=24685/tid=24729] ppid=24684 vsize=643140 CPUtime=6.68 cores=1,3,5,7
/proc/24685/task/24729/stat : 24729 (pb_cplex) R 24684 24684 24426 0 -1 4202560 15014 0 0 0 659 9 0 0 20 0 8 0 390818427 658575360 123925 33554432000 134512640 146736320 4292381728 3943688968 135525285 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=24685/tid=24730] ppid=24684 vsize=643140 CPUtime=6.15 cores=1,3,5,7
/proc/24685/task/24730/stat : 24730 (pb_cplex) S 24684 24684 24426 0 -1 4202560 15050 0 0 0 606 9 0 0 20 0 8 0 390818427 658575360 123925 33554432000 134512640 146736320 4292381728 3954179728 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24685/tid=24731] ppid=24684 vsize=643140 CPUtime=7.01 cores=1,3,5,7
/proc/24685/task/24731/stat : 24731 (pb_cplex) S 24684 24684 24426 0 -1 4202560 2558 0 0 0 699 2 0 0 20 0 8 0 390818427 658575360 123925 33554432000 134512640 146736320 4292381728 3964665488 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24685/tid=24732] ppid=24684 vsize=643140 CPUtime=6.45 cores=1,3,5,7
/proc/24685/task/24732/stat : 24732 (pb_cplex) R 24684 24684 24426 0 -1 4202560 14812 0 0 0 639 6 0 0 20 0 8 0 390818427 658575360 123925 33554432000 134512640 146736320 4292381728 4051648328 135525124 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=24685/tid=24733] ppid=24684 vsize=643140 CPUtime=9.15 cores=1,3,5,7
/proc/24685/task/24733/stat : 24733 (pb_cplex) S 24684 24684 24426 0 -1 4202560 10403 0 0 0 908 7 0 0 20 0 8 0 390818427 658575360 123925 33554432000 134512640 146736320 4292381728 3720392336 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
[pid=24685/tid=24734] ppid=24684 vsize=643140 CPUtime=9.1 cores=1,3,5,7
/proc/24685/task/24734/stat : 24734 (pb_cplex) S 24684 24684 24426 0 -1 4202560 8437 0 0 0 906 4 0 0 20 0 8 0 390818427 658575360 123925 33554432000 134512640 146736320 4292381728 3709906576 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24685/tid=24735] ppid=24684 vsize=643140 CPUtime=6.62 cores=1,3,5,7
/proc/24685/task/24735/stat : 24735 (pb_cplex) S 24684 24684 24426 0 -1 4202560 11711 0 0 0 655 7 0 0 20 0 8 0 390818427 658575360 123925 33554432000 134512640 146736320 4292381728 3699420816 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 117.27
Current children cumulated vsize (KiB) 652288

[startup+102.307 s]
/proc/loadavg: 10.94 4.30 1.60 11/191 24735
/proc/meminfo: memFree=30298844/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
[pid=24685] ppid=24684 vsize=750456 CPUtime=285.04 cores=1,3,5,7
/proc/24685/stat : 24685 (pb_cplex) R 24684 24684 24426 0 -1 4202496 700458 0 0 0 28112 392 0 0 20 0 8 0 390815107 768466944 149843 33554432000 134512640 146736320 4292381728 4292374832 136901157 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24685/statm: 187614 149843 983 2985 0 184548 0
[pid=24685/tid=24729] ppid=24684 vsize=750456 CPUtime=28.02 cores=1,3,5,7
/proc/24685/task/24729/stat : 24729 (pb_cplex) R 24684 24684 24426 0 -1 4202560 69268 0 0 0 2763 39 0 0 20 0 8 0 390818427 768466944 149843 33554432000 134512640 146736320 4292381728 3943688476 136406506 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24685/tid=24730] ppid=24684 vsize=750456 CPUtime=26.92 cores=1,3,5,7
/proc/24685/task/24730/stat : 24730 (pb_cplex) R 24684 24684 24426 0 -1 4202560 65897 0 0 0 2655 37 0 0 20 0 8 0 390818427 768466944 149843 33554432000 134512640 146736320 4292381728 3954176488 138686287 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=24685/tid=24731] ppid=24684 vsize=750460 CPUtime=27.07 cores=1,3,5,7
/proc/24685/task/24731/stat : 24731 (pb_cplex) R 24684 24684 24426 0 -1 4202560 59959 0 0 0 2675 32 0 0 20 0 8 0 390818427 768471040 149843 33554432000 134512640 146736320 4292381728 3964662952 137117077 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24685/tid=24732] ppid=24684 vsize=750460 CPUtime=27.07 cores=1,3,5,7
/proc/24685/task/24732/stat : 24732 (pb_cplex) R 24684 24684 24426 0 -1 4202560 69717 0 0 0 2667 40 0 0 20 0 8 0 390818427 768471040 149843 33554432000 134512640 146736320 4292381728 4051647396 138725656 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=24685/tid=24733] ppid=24684 vsize=750460 CPUtime=30.14 cores=1,3,5,7
/proc/24685/task/24733/stat : 24733 (pb_cplex) R 24684 24684 24426 0 -1 4202560 63576 0 0 0 2977 37 0 0 20 0 8 0 390818427 768471040 149843 33554432000 134512640 146736320 4292381728 3720386104 136475826 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=24685/tid=24734] ppid=24684 vsize=750460 CPUtime=31.59 cores=1,3,5,7
/proc/24685/task/24734/stat : 24734 (pb_cplex) R 24684 24684 24426 0 -1 4202560 56022 0 0 0 3124 35 0 0 20 0 8 0 390818427 768471040 149843 33554432000 134512640 146736320 4292381728 3709901808 137177747 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=24685/tid=24735] ppid=24684 vsize=750460 CPUtime=27.08 cores=1,3,5,7
/proc/24685/task/24735/stat : 24735 (pb_cplex) R 24684 24684 24426 0 -1 4202560 70078 0 0 0 2669 39 0 0 20 0 8 0 390818427 768471040 149843 33554432000 134512640 146736320 4292381728 3699409764 144580846 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 285.04
Current children cumulated vsize (KiB) 759604

############
# WARNING:
# current cumulated CPU time (320.25 s) is less than in the last sample (320.39 s)
# The time of a child was probably not reported to its father.
# (see the two samples below)
# Adding the difference (0.140015 s) to the 'lost time'.

[startup+111.301 s]
/proc/loadavg: 11.25 4.58 1.72 12/191 24735
/proc/meminfo: memFree=30297100/32873852 swapFree=6864/6864

################
# More data... #
################

[pid=24685/tid=24761] ppid=24684 vsize=933644 CPUtime=90.99 cores=1,3,5,7
/proc/24685/task/24761/stat : 24761 (pb_cplex) R 24684 24684 24426 0 -1 4202560 71115 0 0 0 9003 96 0 0 20 0 8 0 390826708 956051456 187480 33554432000 134512640 146736320 4292381728 3702285288 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24685/tid=24762] ppid=24684 vsize=933644 CPUtime=89.14 cores=1,3,5,7
/proc/24685/task/24762/stat : 24762 (pb_cplex) R 24684 24684 24426 0 -1 4202560 97088 0 0 0 8813 101 0 0 20 0 8 0 390826708 956051456 187480 33554432000 134512640 146736320 4292381728 3691802256 144580073 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=24685/tid=24763] ppid=24684 vsize=933644 CPUtime=89.47 cores=1,3,5,7
/proc/24685/task/24763/stat : 24763 (pb_cplex) S 24684 24684 24426 0 -1 4202560 100328 0 0 0 8831 116 0 0 20 0 8 0 390826708 956051456 187480 33554432000 134512640 146736320 4292381728 3674205840 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
Current children cumulated CPU time (s) 1048.04
Current children cumulated vsize (KiB) 942792

[startup+402.3 s]
/proc/loadavg: 11.57 8.76 4.28 14/191 24764
/proc/meminfo: memFree=30089360/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
[pid=24685] ppid=24684 vsize=995616 CPUtime=1224.05 cores=1,3,5,7
/proc/24685/stat : 24685 (pb_cplex) S 24684 24684 24426 0 -1 4202496 1675474 0 0 0 120857 1548 0 0 20 0 8 0 390815107 1019510784 203002 33554432000 134512640 146736320 4292381728 4292378128 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24685/statm: 248904 203002 996 2985 0 245838 0
[pid=24685/tid=24757] ppid=24684 vsize=995616 CPUtime=112.16 cores=1,3,5,7
/proc/24685/task/24757/stat : 24757 (pb_cplex) R 24684 24684 24426 0 -1 4202560 90269 0 0 0 11089 127 0 0 20 0 8 0 390826708 1019510784 203002 33554432000 134512640 146736320 4292381728 3952159296 136854933 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24685/tid=24758] ppid=24684 vsize=995616 CPUtime=106.9 cores=1,3,5,7
/proc/24685/task/24758/stat : 24758 (pb_cplex) R 24684 24684 24426 0 -1 4202560 82763 0 0 0 10553 137 0 0 20 0 8 0 390826708 1019510784 203002 33554432000 134512640 146736320 4292381728 3962642640 136008335 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=24685/tid=24759] ppid=24684 vsize=995616 CPUtime=113.38 cores=1,3,5,7
/proc/24685/task/24759/stat : 24759 (pb_cplex) R 24684 24684 24426 0 -1 4202560 115664 0 0 0 11200 138 0 0 20 0 8 0 390826708 1019510784 203002 33554432000 134512640 146736320 4292381728 3973129192 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=24685/tid=24760] ppid=24684 vsize=995616 CPUtime=110.15 cores=1,3,5,7
/proc/24685/task/24760/stat : 24760 (pb_cplex) R 24684 24684 24426 0 -1 4202560 101672 0 0 0 10886 129 0 0 20 0 8 0 390826708 1019510784 203002 33554432000 134512640 146736320 4292381728 4051649512 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24685/tid=24761] ppid=24684 vsize=995616 CPUtime=113.18 cores=1,3,5,7
/proc/24685/task/24761/stat : 24761 (pb_cplex) R 24684 24684 24426 0 -1 4202560 88074 0 0 0 11195 123 0 0 20 0 8 0 390826708 1019510784 203002 33554432000 134512640 146736320 4292381728 3702284356 136385175 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=24685/tid=24762] ppid=24684 vsize=995616 CPUtime=110.41 cores=1,3,5,7
/proc/24685/task/24762/stat : 24762 (pb_cplex) R 24684 24684 24426 0 -1 4202560 118731 0 0 0 10913 128 0 0 20 0 8 0 390826708 1019510784 203002 33554432000 134512640 146736320 4292381728 3691799428 135850295 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24685/tid=24763] ppid=24684 vsize=995616 CPUtime=110.88 cores=1,3,5,7
/proc/24685/task/24763/stat : 24763 (pb_cplex) R 24684 24684 24426 0 -1 4202560 110990 0 0 0 10943 145 0 0 20 0 8 0 390826708 1019510784 203002 33554432000 134512640 146736320 4292381728 3674202160 136384861 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1224.05
Current children cumulated vsize (KiB) 1004764

[startup+462.3 s]
/proc/loadavg: 10.59 9.07 4.67 9/184 24870
/proc/meminfo: memFree=30116596/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
[pid=24685] ppid=24684 vsize=1059852 CPUtime=1406.46 cores=1,3,5,7
/proc/24685/stat : 24685 (pb_cplex) R 24684 24684 24426 0 -1 4202496 1876996 0 0 0 138760 1886 0 0 20 0 8 0 390815107 1085288448 219228 33554432000 134512640 146736320 4292381728 4292374816 136388276 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24685/statm: 264963 219228 996 2985 0 261897 0
[pid=24685/tid=24757] ppid=24684 vsize=1059852 CPUtime=134.05 cores=1,3,5,7
/proc/24685/task/24757/stat : 24757 (pb_cplex) R 24684 24684 24426 0 -1 4202560 105475 0 0 0 13242 163 0 0 20 0 8 0 390826708 1085288448 219228 33554432000 134512640 146736320 4292381728 3952157672 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24685/tid=24758] ppid=24684 vsize=1059852 CPUtime=130 cores=1,3,5,7
/proc/24685/task/24758/stat : 24758 (pb_cplex) R 24684 24684 24426 0 -1 4202560 98611 0 0 0 12821 179 0 0 20 0 8 0 390826708 1085288448 219228 33554432000 134512640 146736320 4292381728 3962643432 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=24685/tid=24759] ppid=24684 vsize=1059852 CPUtime=136.37 cores=1,3,5,7
/proc/24685/task/24759/stat : 24759 (pb_cplex) R 24684 24684 24426 0 -1 4202560 129106 0 0 0 13468 169 0 0 20 0 8 0 390826708 1085288448 219228 33554432000 134512640 146736320 4292381728 3973129092 135850319 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=24685/tid=24760] ppid=24684 vsize=1059852 CPUtime=131.93 cores=1,3,5,7
/proc/24685/task/24760/stat : 24760 (pb_cplex) R 24684 24684 24426 0 -1 4202560 126892 0 0 0 13016 177 0 0 20 0 8 0 390826708 1085288448 219228 33554432000 134512640 146736320 4292381728 4051648604 135855170 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24685/tid=24761] ppid=24684 vsize=1059852 CPUtime=135.03 cores=1,3,5,7
/proc/24685/task/24761/stat : 24761 (pb_cplex) R 24684 24684 24426 0 -1 4202560 110820 0 0 0 13331 172 0 0 20 0 8 0 390826708 1085288448 219228 33554432000 134512640 146736320 4292381728 3702285288 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24685/tid=24762] ppid=24684 vsize=1059852 CPUtime=132.55 cores=1,3,5,7
/proc/24685/task/24762/stat : 24762 (pb_cplex) R 24684 24684 24426 0 -1 4202560 147402 0 0 0 13089 166 0 0 20 0 8 0 390826708 1085288448 219228 33554432000 134512640 146736320 4292381728 3691798740 135846438 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=24685/tid=24763] ppid=24684 vsize=1059852 CPUtime=134.22 cores=1,3,5,7
/proc/24685/task/24763/stat : 24763 (pb_cplex) R 24684 24684 24426 0 -1 4202560 133598 0 0 0 13232 190 0 0 20 0 8 0 390826708 1085288448 219228 33554432000 134512640 146736320 4292381728 3674202320 136008050 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1406.46
Current children cumulated vsize (KiB) 1069000

[startup+522.3 s]
/proc/loadavg: 10.37 9.24 4.99 10/185 24880
/proc/meminfo: memFree=30003188/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
[pid=24685] ppid=24684 vsize=1131452 CPUtime=1601.38 cores=1,3,5,7
/proc/24685/stat : 24685 (pb_cplex) S 24684 24684 24426 0 -1 4202496 2058505 0 0 0 157878 2260 0 0 20 0 8 0 390815107 1158606848 237070 33554432000 134512640 146736320 4292381728 4292378128 144580073 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0 0 0
/proc/24685/statm: 282863 237070 996 2985 0 279797 0
[pid=24685/tid=24757] ppid=24684 vsize=1131452 CPUtime=157.78 cores=1,3,5,7
/proc/24685/task/24757/stat : 24757 (pb_cplex) S 24684 24684 24426 0 -1 4202560 125748 0 0 0 15566 212 0 0 20 0 8 0 390826708 1158606848 237070 33554432000 134512640 146736320 4292381728 3952160400 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24685/tid=24758] ppid=24684 vsize=1131452 CPUtime=154.62 cores=1,3,5,7
/proc/24685/task/24758/stat : 24758 (pb_cplex) S 24684 24684 24426 0 -1 4202560 110991 0 0 0 15235 227 0 0 20 0 8 0 390826708 1158606848 237070 33554432000 134512640 146736320 4292381728 3962646160 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24685/tid=24759] ppid=24684 vsize=1131452 CPUtime=161.47 cores=1,3,5,7
/proc/24685/task/24759/stat : 24759 (pb_cplex) R 24684 24684 24426 0 -1 4202560 140270 0 0 0 15933 214 0 0 20 0 8 0 390826708 1158606848 237070 33554432000 134512640 146736320 4292381728 3973129192 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24685/tid=24760] ppid=24684 vsize=1131452 CPUtime=156.15 cores=1,3,5,7
/proc/24685/task/24760/stat : 24760 (pb_cplex) S 24684 24684 24426 0 -1 4202560 138204 0 0 0 15391 224 0 0 20 0 8 0 390826708 1158606848 237070 33554432000 134512640 146736320 4292381728 4051652240 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24685/tid=24761] ppid=24684 vsize=1131452 CPUtime=159.65 cores=1,3,5,7
/proc/24685/task/24761/stat : 24761 (pb_cplex) S 24684 24684 24426 0 -1 4202560 132374 0 0 0 15748 217 0 0 20 0 8 0 390826708 1158606848 237070 33554432000 134512640 146736320 4292381728 3702288016 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24685/tid=24762] ppid=24684 vsize=1131452 CPUtime=155.69 cores=1,3,5,7
/proc/24685/task/24762/stat : 24762 (pb_cplex) S 24684 24684 24426 0 -1 4202560 162967 0 0 0 15354 215 0 0 20 0 8 0 390826708 1158606848 237070 33554432000 134512640 146736320 4292381728 3691802256 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24685/tid=24763] ppid=24684 vsize=1131452 CPUtime=157.27 cores=1,3,5,7
/proc/24685/task/24763/stat : 24763 (pb_cplex) S 24684 24684 24426 0 -1 4202560 161098 0 0 0 15480 247 0 0 20 0 8 0 390826708 1158606848 237070 33554432000 134512640 146736320 4292381728 3674205840 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 1 0 0 0 0 0
Current children cumulated CPU time (s) 1601.38
Current children cumulated vsize (KiB) 1140600

[startup+582.3 s]
/proc/loadavg: 11.34 9.63 5.39 16/191 24895
/proc/meminfo: memFree=29867716/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
[pid=24685] ppid=24684 vsize=1198800 CPUtime=1793.21 cores=1,3,5,7
/proc/24685/stat : 24685 (pb_cplex) R 24684 24684 24426 0 -1 4202496 2203588 0 0 0 176671 2650 0 0 20 0 8 0 390815107 1227571200 253941 33554432000 134512640 146736320 4292381728 4292376472 144580332 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0 0 0
/proc/24685/statm: 299700 253941 996 2985 0 296634 0
[pid=24685/tid=24757] ppid=24684 vsize=1198800 CPUtime=182.19 cores=1,3,5,7
/proc/24685/task/24757/stat : 24757 (pb_cplex) S 24684 24684 24426 0 -1 4202560 151782 0 0 0 17935 284 0 0 20 0 8 0 390826708 1227571200 253941 33554432000 134512640 146736320 4292381728 3952160400 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 5 0 0 0 0 0
[pid=24685/tid=24758] ppid=24684 vsize=1198800 CPUtime=179 cores=1,3,5,7
/proc/24685/task/24758/stat : 24758 (pb_cplex) R 24684 24684 24426 0 -1 4202560 124184 0 0 0 17612 288 0 0 20 0 8 0 390826708 1227571200 253941 33554432000 134512640 146736320 4292381728 3962643392 137341516 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24685/tid=24759] ppid=24684 vsize=1198800 CPUtime=184.68 cores=1,3,5,7
/proc/24685/task/24759/stat : 24759 (pb_cplex) R 24684 24684 24426 0 -1 4202560 147725 0 0 0 18225 243 0 0 20 0 8 0 390826708 1227571200 253941 33554432000 134512640 146736320 4292381728 3973128304 136384895 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=24685/tid=24760] ppid=24684 vsize=1198800 CPUtime=179.93 cores=1,3,5,7
/proc/24685/task/24760/stat : 24760 (pb_cplex) R 24684 24684 24426 0 -1 4202560 152458 0 0 0 17729 264 0 0 20 0 8 0 390826708 1227571200 253941 33554432000 134512640 146736320 4292381728 4051649512 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24685/tid=24761] ppid=24684 vsize=1198800 CPUtime=182.64 cores=1,3,5,7
/proc/24685/task/24761/stat : 24761 (pb_cplex) R 24684 24684 24426 0 -1 4202560 143492 0 0 0 18002 262 0 0 20 0 8 0 390826708 1227571200 253941 33554432000 134512640 146736320 4292381728 3702285288 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
[pid=24685/tid=24762] ppid=24684 vsize=1198800 CPUtime=179.17 cores=1,3,5,7
/proc/24685/task/24762/stat : 24762 (pb_cplex) R 24684 24684 24426 0 -1 4202560 180155 0 0 0 17645 272 0 0 20 0 8 0 390826708 1227571200 253941 33554432000 134512640 146736320 4292381728 3691799528 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=24685/tid=24763] ppid=24684 vsize=1198800 CPUtime=181.05 cores=1,3,5,7
/proc/24685/task/24763/stat : 24763 (pb_cplex) R 24684 24684 24426 0 -1 4202560 169032 0 0 0 17808 297 0 0 20 0 8 0 390826708 1227571200 253941 33554432000 134512640 146736320 4292381728 3674203112 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
Current children cumulated CPU time (s) 1793.21
Current children cumulated vsize (KiB) 1207948



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+584.201 s]
/proc/loadavg: 11.34 9.63 5.39 13/191 24895
/proc/meminfo: memFree=29865980/32873852 swapFree=6864/6864
[pid=24684] ppid=24682 vsize=9148 CPUtime=0 cores=1,3,5,7
/proc/24684/stat : 24684 (run) S 24682 24684 24426 0 -1 4202496 354 0 0 0 0 0 0 0 20 0 1 0 390815106 9367552 270 33554432000 4194304 5064252 140736237584320 140736237583232 229355710030 0 65536 4100 65538 18446744071579302229 0 0 17 5 0 0 0 0 0
/proc/24684/statm: 2287 270 229 213 0 72 0
[pid=24685] ppid=24684 vsize=1200792 CPUtime=1799.99 cores=1,3,5,7
/proc/24685/stat : 24685 (pb_cplex) R 24684 24684 24426 0 -1 4202496 2210281 0 0 0 177338 2661 0 0 20 0 8 0 390815107 1229611008 254435 33554432000 134512640 146736320 4292381728 4292375400 144757825 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0 0 0
/proc/24685/statm: 300198 254435 996 2985 0 297132 0
[pid=24685/tid=24757] ppid=24684 vsize=1200792 CPUtime=182.96 cores=1,3,5,7
/proc/24685/task/24757/stat : 24757 (pb_cplex) R 24684 24684 24426 0 -1 4202560 151822 0 0 0 18011 285 0 0 20 0 8 0 390826708 1229611008 254435 33554432000 134512640 146736320 4292381728 3952158464 137334501 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24685/tid=24758] ppid=24684 vsize=1200792 CPUtime=179.83 cores=1,3,5,7
/proc/24685/task/24758/stat : 24758 (pb_cplex) R 24684 24684 24426 0 -1 4202560 125405 0 0 0 17695 288 0 0 20 0 8 0 390826708 1229611008 254435 33554432000 134512640 146736320 4292381728 3962642500 136385179 0 2 4096 16387 0 0 0 -1 5 0 0 0 0 0
[pid=24685/tid=24759] ppid=24684 vsize=1200792 CPUtime=185.54 cores=1,3,5,7
/proc/24685/task/24759/stat : 24759 (pb_cplex) R 24684 24684 24426 0 -1 4202560 148439 0 0 0 18310 244 0 0 20 0 8 0 390826708 1229611008 254435 33554432000 134512640 146736320 4292381728 3973128260 136385174 0 2 4096 16387 0 0 0 -1 3 0 0 0 0 0
[pid=24685/tid=24760] ppid=24684 vsize=1200792 CPUtime=180.85 cores=1,3,5,7
/proc/24685/task/24760/stat : 24760 (pb_cplex) R 24684 24684 24426 0 -1 4202560 154299 0 0 0 17818 267 0 0 20 0 8 0 390826708 1229611008 254435 33554432000 134512640 146736320 4292381728 4051648580 136385172 0 2 4096 16387 0 0 0 -1 1 0 0 0 0 0
[pid=24685/tid=24761] ppid=24684 vsize=1200792 CPUtime=183.48 cores=1,3,5,7
/proc/24685/task/24761/stat : 24761 (pb_cplex) S 24684 24684 24426 0 -1 4202560 143492 0 0 0 18085 263 0 0 20 0 8 0 390826708 1229611008 254435 33554432000 134512640 146736320 4292381728 3702288016 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 7 0 0 0 0 0
[pid=24685/tid=24762] ppid=24684 vsize=1200792 CPUtime=179.99 cores=1,3,5,7
/proc/24685/task/24762/stat : 24762 (pb_cplex) S 24684 24684 24426 0 -1 4202560 180883 0 0 0 17727 272 0 0 20 0 8 0 390826708 1229611008 254435 33554432000 134512640 146736320 4292381728 3691802256 144580073 0 2 4096 16387 18446744071579510697 0 0 -1 3 0 0 0 0 0
[pid=24685/tid=24763] ppid=24684 vsize=1200792 CPUtime=181.9 cores=1,3,5,7
/proc/24685/task/24763/stat : 24763 (pb_cplex) R 24684 24684 24426 0 -1 4202560 169220 0 0 0 17890 300 0 0 20 0 8 0 390826708 1229611008 254435 33554432000 134512640 146736320 4292381728 3674200460 135465050 0 2 4096 16387 0 0 0 -1 7 0 0 0 0 0
Current children cumulated CPU time (s) 1799.99
Current children cumulated vsize (KiB) 1209940

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24684 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.000999
# while last known CPU time is 1799.99
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...


# WARNING:
# The CPU time of some children was not reported to their father
# (probably because of a missing or aborted wait()).
# This 'lost CPU time' is added to the watched process CPU time.
#  lost CPU time (s): 0.140015
#  lost CPU user time (s): 0.180023
#  lost CPU system time (s): -0.04

Real time (s): 584.217
CPU time (s): 1800.13
CPU user time (s): 1773.56
CPU system time (s): 26.57
CPU usage (%): 308.127
Max. virtual memory (cumulated for all children) (KiB): 1210964

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.000999
maximum resident set size= 1080
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 354
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 1

runsolver used 1.57076 second user time and 4.19536 second system time

The end

Launcher Data 

Begin job on node129 at 2012-06-09 15:01:36
IDJOB=3731620
IDBENCH=1970
IDSOLVER=2325
FILE ID=node129/3731620-1339246896
RUNJOBID= node129-1339246833-24444
PBS_JOBID= 14644352
Free space on /tmp= 70996 MiB

SOLVER NAME= PB10: pb_cplex 2010-06-29
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/submitted-PB06/liu/wnq/normalized-wnq_n100_mw99_6.opb.PB06.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-3731620-1339246896/watcher-3731620-1339246896 -o /tmp/evaluation-result-3731620-1339246896/solver-3731620-1339246896 -C 1800 -W 1900 -M 15500  run HOME/instance-3731620-1339246896.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 5f836d1b8d150c1925229546ed283812
RANDOM SEED=355494544

node129.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.91
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.92
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.957
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5331.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32873852 kB
MemFree:        30898432 kB
Buffers:          436944 kB
Cached:           489884 kB
SwapCached:         2008 kB
Active:           705160 kB
Inactive:         350076 kB
Active(anon):     125740 kB
Inactive(anon):     4180 kB
Active(file):     579420 kB
Inactive(file):   345896 kB
Unevictable:        6864 kB
Mlocked:            6864 kB
SwapTotal:      67108856 kB
SwapFree:       67100448 kB
Dirty:             33576 kB
Writeback:             0 kB
AnonPages:        133204 kB
Mapped:            12356 kB
Shmem:                 0 kB
Slab:             780268 kB
SReclaimable:     222148 kB
SUnreclaim:       558120 kB
KernelStack:        1504 kB
PageTables:         4316 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545780 kB
Committed_AS:     242092 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346360 kB
VmallocChunk:   34341988004 kB
HardwareCorrupted:     0 kB
AnonHugePages:     22528 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7872 kB
DirectMap2M:    33538048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-3731620-1339246896.opb

Free space on /tmp at the end= 70980 MiB
End job on node129 at 2012-06-09 15:11:23