Trace number 2697931

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb_cplex 2010-07-01? (TO) 1800.33 387.221

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900582300--soft-33-100-0.wbo
MD5SUM9fdf6a24194e0c0ae14212c193866ebe
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark403.22
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints1830
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 92327
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 92326
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 683
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing wbo file format. File HOME/instance-2697931-1278543425.wbo.
0.00/0.00	c Instance file HOME/instance-2697931-1278543425.wbo
0.00/0.00	c File size is 92438 bytes.
0.00/0.67	c Highest Coefficient sum: 683
0.00/0.67	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.67	c ============================[ Problem Statistics ]=============================
0.00/0.67	c |                                                                             |
0.00/0.67	c |  Parsing time:          0.67         s                                      |
0.00/0.67	c |  Number Variables:      2061                                                |
0.00/0.67	c |  Number Constraints:    2708                                                |
0.00/0.67	c ===============================================================================
1800.30/387.21	c Remaining time 1799.33 sec.
1800.30/387.21	c 
1800.30/387.21	c *** INTERRUPTED ***
1800.30/387.21	s UNKNOWN
1800.30/387.21	c Total CPU time              : 1782 s
1800.30/387.21	c Memory used           : 147.91 MB
1800.30/387.21	c CPU time              : 1782 s
1800.30/387.21	c 
1800.30/387.21	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2697931-1278543425/watcher-2697931-1278543425 -o /tmp/evaluation-result-2697931-1278543425/solver-2697931-1278543425 -C 1800 -W 2000 -M 3800 run HOME/instance-2697931-1278543425.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 2.03 2.07 3/196 21587
/proc/meminfo: memFree=28744132/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0

[startup+0.09785 s]
/proc/loadavg: 1.92 2.03 2.07 3/196 21587
/proc/meminfo: memFree=28744132/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.10079 s]
/proc/loadavg: 1.92 2.03 2.07 3/196 21587
/proc/meminfo: memFree=28744132/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300753 s]
/proc/loadavg: 1.92 2.03 2.07 3/196 21587
/proc/meminfo: memFree=28744132/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700682 s]
/proc/loadavg: 1.92 2.03 2.07 3/196 21587
/proc/meminfo: memFree=28744132/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50054 s]
/proc/loadavg: 1.92 2.03 2.07 3/205 21603
/proc/meminfo: memFree=28714540/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
[pid=21588] ppid=21587 vsize=134728 CPUtime=3.35
/proc/21588/stat : 21588 (pb_cplex) S 21587 21587 19071 0 -1 4202496 15964 0 0 0 330 5 0 0 19 0 8 0 22556085 137961472 10311 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/21588/statm: 33682 10311 1064 2985 0 30224 0
[pid=21588/tid=21597] ppid=21587 vsize=134728 CPUtime=0.2
/proc/21588/task/21597/stat : 21597 (pb_cplex) S 21587 21587 19071 0 -1 4202560 213 0 0 0 20 0 0 0 17 0 8 0 22556183 137961472 10311 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 2 0 0 0
[pid=21588/tid=21598] ppid=21587 vsize=134728 CPUtime=0.29
/proc/21588/task/21598/stat : 21598 (pb_cplex) R 21587 21587 19071 0 -1 4202560 470 0 0 0 29 0 0 0 19 0 8 0 22556183 137961472 10311 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=21588/tid=21599] ppid=21587 vsize=134728 CPUtime=0.29
/proc/21588/task/21599/stat : 21599 (pb_cplex) S 21587 21587 19071 0 -1 4202560 233 0 0 0 29 0 0 0 18 0 8 0 22556183 137961472 10311 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 6 0 0 0
[pid=21588/tid=21600] ppid=21587 vsize=134728 CPUtime=0.26
/proc/21588/task/21600/stat : 21600 (pb_cplex) S 21587 21587 19071 0 -1 4202560 92 0 0 0 26 0 0 0 17 0 8 0 22556183 137961472 10311 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 5 0 0 0
[pid=21588/tid=21601] ppid=21587 vsize=134728 CPUtime=0.36
/proc/21588/task/21601/stat : 21601 (pb_cplex) S 21587 21587 19071 0 -1 4202560 610 0 0 0 36 0 0 0 17 0 8 0 22556183 137961472 10311 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 4 0 0 0
[pid=21588/tid=21602] ppid=21587 vsize=134728 CPUtime=0.26
/proc/21588/task/21602/stat : 21602 (pb_cplex) S 21587 21587 19071 0 -1 4202560 586 0 0 0 26 0 0 0 17 0 8 0 22556183 137961472 10311 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 1 0 0 0
[pid=21588/tid=21603] ppid=21587 vsize=134728 CPUtime=0.29
/proc/21588/task/21603/stat : 21603 (pb_cplex) S 21587 21587 19071 0 -1 4202560 244 0 0 0 29 0 0 0 19 0 8 0 22556183 137961472 10311 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 3.35
Current children cumulated vsize (KiB) 143428

[startup+3.10026 s]
/proc/loadavg: 1.92 2.03 2.07 3/198 21603
/proc/meminfo: memFree=28712944/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
[pid=21588] ppid=21587 vsize=115228 CPUtime=5.62
/proc/21588/stat : 21588 (pb_cplex) R 21587 21587 19071 0 -1 4202496 23304 0 0 0 554 8 0 0 24 0 8 0 22556085 117993472 7018 4089446400 134512640 146736320 4293866448 18446744073709551615 139044552 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/21588/statm: 28807 7018 1078 2985 0 25349 0
Current children cumulated CPU time (s) 5.62
Current children cumulated vsize (KiB) 123928

[startup+6.30077 s]
/proc/loadavg: 2.49 2.14 2.11 10/205 21624
/proc/meminfo: memFree=28691188/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
[pid=21588] ppid=21587 vsize=142716 CPUtime=19.2
/proc/21588/stat : 21588 (pb_cplex) R 21587 21587 19071 0 -1 4202496 44714 0 0 0 1903 17 0 0 15 0 8 0 22556085 146141184 13057 4089446400 134512640 146736320 4293866448 18446744073709551615 144580332 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/21588/statm: 35679 13057 1079 2985 0 32221 0
[pid=21588/tid=21618] ppid=21587 vsize=142716 CPUtime=1.73
/proc/21588/task/21618/stat : 21618 (pb_cplex) S 21587 21587 19071 0 -1 4202560 2465 0 0 0 172 1 0 0 15 0 8 0 22556327 146141184 13057 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 3 0 0 0
[pid=21588/tid=21619] ppid=21587 vsize=142716 CPUtime=1.69
/proc/21588/task/21619/stat : 21619 (pb_cplex) R 21587 21587 19071 0 -1 4202560 1419 0 0 0 168 1 0 0 15 0 8 0 22556327 146141184 13057 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=21588/tid=21620] ppid=21587 vsize=142716 CPUtime=1.68
/proc/21588/task/21620/stat : 21620 (pb_cplex) S 21587 21587 19071 0 -1 4202560 2082 0 0 0 168 0 0 0 15 0 8 0 22556327 146141184 13057 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 5 0 0 0
[pid=21588/tid=21621] ppid=21587 vsize=142716 CPUtime=1.6
/proc/21588/task/21621/stat : 21621 (pb_cplex) S 21587 21587 19071 0 -1 4202560 2839 0 0 0 159 1 0 0 15 0 8 0 22556327 146141184 13057 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 6 0 0 0
[pid=21588/tid=21622] ppid=21587 vsize=142716 CPUtime=1.66
/proc/21588/task/21622/stat : 21622 (pb_cplex) S 21587 21587 19071 0 -1 4202560 6561 0 0 0 165 1 0 0 15 0 8 0 22556327 146141184 13057 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 0 0 0 0
[pid=21588/tid=21623] ppid=21587 vsize=142716 CPUtime=1.63
/proc/21588/task/21623/stat : 21623 (pb_cplex) S 21587 21587 19071 0 -1 4202560 1329 0 0 0 162 1 0 0 15 0 8 0 22556327 146141184 13057 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 6 0 0 0
[pid=21588/tid=21624] ppid=21587 vsize=142716 CPUtime=1.66
/proc/21588/task/21624/stat : 21624 (pb_cplex) S 21587 21587 19071 0 -1 4202560 1473 0 0 0 166 0 0 0 15 0 8 0 22556327 146141184 13057 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 19.2
Current children cumulated vsize (KiB) 151416

[startup+12.7395 s]
/proc/loadavg: 3.01 2.26 2.15 5/205 21624
/proc/meminfo: memFree=28691296/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
[pid=21588] ppid=21587 vsize=143740 CPUtime=47.35
/proc/21588/stat : 21588 (pb_cplex) R 21587 21587 19071 0 -1 4202496 50547 0 0 0 4692 43 0 0 15 0 8 0 22556085 147189760 13293 4089446400 134512640 146736320 4293866448 18446744073709551615 136017763 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/21588/statm: 35935 13293 1079 2985 0 32477 0
[pid=21588/tid=21618] ppid=21587 vsize=143740 CPUtime=5.43
/proc/21588/task/21618/stat : 21618 (pb_cplex) R 21587 21587 19071 0 -1 4202560 2521 0 0 0 537 6 0 0 15 0 8 0 22556327 147189760 13293 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=21588/tid=21619] ppid=21587 vsize=143740 CPUtime=5.42
/proc/21588/task/21619/stat : 21619 (pb_cplex) R 21587 21587 19071 0 -1 4202560 1423 0 0 0 538 4 0 0 15 0 8 0 22556327 147189760 13293 4089446400 134512640 146736320 4293866448 18446744073709551615 136403116 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=21588/tid=21620] ppid=21587 vsize=143740 CPUtime=5.36
/proc/21588/task/21620/stat : 21620 (pb_cplex) D 21587 21587 19071 0 -1 4202560 4161 0 0 0 533 3 0 0 15 0 8 0 22556327 147189760 13293 4089446400 134512640 146736320 4293866448 18446744073709551615 144797972 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=21588/tid=21621] ppid=21587 vsize=143740 CPUtime=5.03
/proc/21588/task/21621/stat : 21621 (pb_cplex) R 21587 21587 19071 0 -1 4202560 4147 0 0 0 499 4 0 0 15 0 8 0 22556327 147189760 13293 4089446400 134512640 146736320 4293866448 18446744073709551615 136017526 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=21588/tid=21622] ppid=21587 vsize=143740 CPUtime=4.91
/proc/21588/task/21622/stat : 21622 (pb_cplex) D 21587 21587 19071 0 -1 4202560 8311 0 0 0 487 4 0 0 15 0 8 0 22556327 147189760 13293 4089446400 134512640 146736320 4293866448 18446744073709551615 136387674 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=21588/tid=21623] ppid=21587 vsize=143740 CPUtime=5.09
/proc/21588/task/21623/stat : 21623 (pb_cplex) R 21587 21587 19071 0 -1 4202560 1913 0 0 0 506 3 0 0 16 0 8 0 22556327 147189760 13293 4089446400 134512640 146736320 4293866448 18446744073709551615 136413248 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=21588/tid=21624] ppid=21587 vsize=143740 CPUtime=5.1
/proc/21588/task/21624/stat : 21624 (pb_cplex) R 21587 21587 19071 0 -1 4202560 1495 0 0 0 507 3 0 0 15 0 8 0 22556327 147189760 13293 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 47.35
Current children cumulated vsize (KiB) 152440

[startup+25.5003 s]
/proc/loadavg: 3.33 2.37 2.19 3/205 21646
/proc/meminfo: memFree=28704196/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
[pid=21588] ppid=21587 vsize=125468 CPUtime=91.73
/proc/21588/stat : 21588 (pb_cplex) R 21587 21587 19071 0 -1 4202496 67832 0 0 0 9081 92 0 0 24 0 8 0 22556085 128479232 9691 4089446400 134512640 146736320 4293866448 18446744073709551615 136007289 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/21588/statm: 31367 9691 1089 2985 0 27909 0
[pid=21588/tid=21640] ppid=21587 vsize=125468 CPUtime=0
/proc/21588/task/21640/stat : 21640 (pb_cplex) S 21587 21587 19071 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 8 0 22558525 128479232 9691 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 0 0 0 0
[pid=21588/tid=21641] ppid=21587 vsize=125468 CPUtime=0
/proc/21588/task/21641/stat : 21641 (pb_cplex) S 21587 21587 19071 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 8 0 22558525 128479232 9691 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 0 0 0 0
[pid=21588/tid=21642] ppid=21587 vsize=125468 CPUtime=0
/proc/21588/task/21642/stat : 21642 (pb_cplex) S 21587 21587 19071 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 8 0 22558525 128479232 9691 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 0 0 0 0
[pid=21588/tid=21643] ppid=21587 vsize=125468 CPUtime=0
/proc/21588/task/21643/stat : 21643 (pb_cplex) S 21587 21587 19071 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 8 0 22558525 128479232 9691 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 0 0 0 0
[pid=21588/tid=21644] ppid=21587 vsize=125468 CPUtime=0
/proc/21588/task/21644/stat : 21644 (pb_cplex) S 21587 21587 19071 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 8 0 22558525 128479232 9691 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 0 0 0 0
[pid=21588/tid=21645] ppid=21587 vsize=125468 CPUtime=0
/proc/21588/task/21645/stat : 21645 (pb_cplex) S 21587 21587 19071 0 -1 4202560 1 0 0 0 0 0 0 0 20 0 8 0 22558525 128479232 9691 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 0 0 0 0
[pid=21588/tid=21646] ppid=21587 vsize=125468 CPUtime=0
/proc/21588/task/21646/stat : 21646 (pb_cplex) S 21587 21587 19071 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 8 0 22558525 128479232 9691 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 91.73
Current children cumulated vsize (KiB) 134168

[startup+51.1007 s]
/proc/loadavg: 3.24 2.42 2.21 3/205 21647
/proc/meminfo: memFree=28689224/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
[pid=21588] ppid=21587 vsize=142196 CPUtime=207.09
/proc/21588/stat : 21588 (pb_cplex) S 21587 21587 19071 0 -1 4202496 99206 0 0 0 20515 194 0 0 16 0 8 0 22556085 145608704 13596 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/21588/statm: 35549 13596 1090 2985 0 32091 0
[pid=21588/tid=21640] ppid=21587 vsize=142196 CPUtime=13.57
/proc/21588/task/21640/stat : 21640 (pb_cplex) S 21587 21587 19071 0 -1 4202560 3392 0 0 0 1345 12 0 0 15 0 8 0 22558525 145608704 13596 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 5 0 0 0
[pid=21588/tid=21641] ppid=21587 vsize=142196 CPUtime=13.89
/proc/21588/task/21641/stat : 21641 (pb_cplex) S 21587 21587 19071 0 -1 4202560 7565 0 0 0 1376 13 0 0 15 0 8 0 22558525 145608704 13596 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 3 0 0 0
[pid=21588/tid=21642] ppid=21587 vsize=142196 CPUtime=13.18
/proc/21588/task/21642/stat : 21642 (pb_cplex) S 21587 21587 19071 0 -1 4202560 2811 0 0 0 1307 11 0 0 15 0 8 0 22558525 145608704 13596 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 7 0 0 0
[pid=21588/tid=21643] ppid=21587 vsize=142196 CPUtime=14.25
/proc/21588/task/21643/stat : 21643 (pb_cplex) S 21587 21587 19071 0 -1 4202560 4216 0 0 0 1412 13 0 0 16 0 8 0 22558525 145608704 13596 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 0 0 0 0
[pid=21588/tid=21644] ppid=21587 vsize=142196 CPUtime=13.72
/proc/21588/task/21644/stat : 21644 (pb_cplex) R 21587 21587 19071 0 -1 4202560 4370 0 0 0 1357 15 0 0 16 0 8 0 22558525 145608704 13596 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=21588/tid=21645] ppid=21587 vsize=142196 CPUtime=15.11
/proc/21588/task/21645/stat : 21645 (pb_cplex) S 21587 21587 19071 0 -1 4202560 2660 0 0 0 1499 12 0 0 15 0 8 0 22558525 145608704 13596 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 4 0 0 0
[pid=21588/tid=21646] ppid=21587 vsize=142196 CPUtime=14.3
/proc/21588/task/21646/stat : 21646 (pb_cplex) R 21587 21587 19071 0 -1 4202560 2227 0 0 0 1421 9 0 0 15 0 8 0 22558525 145608704 13596 4089446400 134512640 146736320 4293866448 18446744073709551615 136007179 0 2 4096 16387 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 207.09
Current children cumulated vsize (KiB) 150896

[startup+102.307 s]
/proc/loadavg: 5.52 3.12 2.45 10/205 21648
/proc/meminfo: memFree=28687284/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
[pid=21588] ppid=21587 vsize=148340 CPUtime=465.95
/proc/21588/stat : 21588 (pb_cplex) S 21587 21587 19071 0 -1 4202496 127576 0 0 0 46140 455 0 0 16 0 8 0 22556085 151900160 14862 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/21588/statm: 37085 14862 1090 2985 0 33627 0
[pid=21588/tid=21640] ppid=21587 vsize=148340 CPUtime=45.74
/proc/21588/task/21640/stat : 21640 (pb_cplex) S 21587 21587 19071 0 -1 4202560 5543 0 0 0 4534 40 0 0 15 0 8 0 22558525 151900160 14862 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 2 0 0 0
[pid=21588/tid=21641] ppid=21587 vsize=148340 CPUtime=45.46
/proc/21588/task/21641/stat : 21641 (pb_cplex) S 21587 21587 19071 0 -1 4202560 11136 0 0 0 4506 40 0 0 15 0 8 0 22558525 151900160 14862 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 0 0 0 0
[pid=21588/tid=21642] ppid=21587 vsize=148340 CPUtime=45.63
/proc/21588/task/21642/stat : 21642 (pb_cplex) R 21587 21587 19071 0 -1 4202560 6318 0 0 0 4518 45 0 0 16 0 8 0 22558525 151900160 14862 4089446400 134512640 146736320 4293866448 18446744073709551615 135854505 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=21588/tid=21643] ppid=21587 vsize=148340 CPUtime=46.67
/proc/21588/task/21643/stat : 21643 (pb_cplex) S 21587 21587 19071 0 -1 4202560 10942 0 0 0 4619 48 0 0 15 0 8 0 22558525 151900160 14862 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 5 0 0 0
[pid=21588/tid=21644] ppid=21587 vsize=148340 CPUtime=46.19
/proc/21588/task/21644/stat : 21644 (pb_cplex) S 21587 21587 19071 0 -1 4202560 7177 0 0 0 4573 46 0 0 15 0 8 0 22558525 151900160 14862 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 3 0 0 0
[pid=21588/tid=21645] ppid=21587 vsize=148340 CPUtime=47.73
/proc/21588/task/21645/stat : 21645 (pb_cplex) S 21587 21587 19071 0 -1 4202560 7831 0 0 0 4726 47 0 0 15 0 8 0 22558525 151900160 14862 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 1 0 0 0
[pid=21588/tid=21646] ppid=21587 vsize=148340 CPUtime=46.58
/proc/21588/task/21646/stat : 21646 (pb_cplex) S 21587 21587 19071 0 -1 4202560 3698 0 0 0 4617 41 0 0 16 0 8 0 22558525 151900160 14862 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 465.95
Current children cumulated vsize (KiB) 157040

[startup+162.301 s]
/proc/loadavg: 5.30 3.48 2.61 10/205 21649
/proc/meminfo: memFree=28687520/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
[pid=21588] ppid=21587 vsize=147316 CPUtime=757.3
/proc/21588/stat : 21588 (pb_cplex) S 21587 21587 19071 0 -1 4202496 133978 0 0 0 74975 755 0 0 15 0 8 0 22556085 150851584 14690 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/21588/statm: 36829 14690 1090 2985 0 33371 0
[pid=21588/tid=21640] ppid=21587 vsize=147316 CPUtime=81.97
/proc/21588/task/21640/stat : 21640 (pb_cplex) S 21587 21587 19071 0 -1 4202560 5782 0 0 0 8120 77 0 0 15 0 8 0 22558525 150851584 14690 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 2 0 0 0
[pid=21588/tid=21641] ppid=21587 vsize=147316 CPUtime=82.02
/proc/21588/task/21641/stat : 21641 (pb_cplex) S 21587 21587 19071 0 -1 4202560 11882 0 0 0 8120 82 0 0 15 0 8 0 22558525 150851584 14690 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 7 0 0 0
[pid=21588/tid=21642] ppid=21587 vsize=147316 CPUtime=81.82
/proc/21588/task/21642/stat : 21642 (pb_cplex) S 21587 21587 19071 0 -1 4202560 6994 0 0 0 8097 85 0 0 15 0 8 0 22558525 150851584 14690 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 3 0 0 0
[pid=21588/tid=21643] ppid=21587 vsize=147316 CPUtime=83.24
/proc/21588/task/21643/stat : 21643 (pb_cplex) S 21587 21587 19071 0 -1 4202560 12222 0 0 0 8233 91 0 0 15 0 8 0 22558525 150851584 14690 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 6 0 0 0
[pid=21588/tid=21644] ppid=21587 vsize=147316 CPUtime=82.82
/proc/21588/task/21644/stat : 21644 (pb_cplex) S 21587 21587 19071 0 -1 4202560 8873 0 0 0 8200 82 0 0 15 0 8 0 22558525 150851584 14690 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 7 0 0 0
[pid=21588/tid=21645] ppid=21587 vsize=147316 CPUtime=84.19
/proc/21588/task/21645/stat : 21645 (pb_cplex) S 21587 21587 19071 0 -1 4202560 8245 0 0 0 8337 82 0 0 16 0 8 0 22558525 150851584 14690 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 1 0 0 0
[pid=21588/tid=21646] ppid=21587 vsize=147316 CPUtime=82.93
/proc/21588/task/21646/stat : 21646 (pb_cplex) R 21587 21587 19071 0 -1 4202560 4229 0 0 0 8216 77 0 0 15 0 8 0 22558525 150851584 14690 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 757.3
Current children cumulated vsize (KiB) 156016

[startup+222.301 s]
/proc/loadavg: 5.20 3.75 2.76 9/205 21651
/proc/meminfo: memFree=28686276/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
[pid=21588] ppid=21587 vsize=146788 CPUtime=1031.26
/proc/21588/stat : 21588 (pb_cplex) R 21587 21587 19071 0 -1 4202496 141834 0 0 0 102076 1050 0 0 15 0 8 0 22556085 150310912 14695 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0
/proc/21588/statm: 36697 14695 1090 2985 0 33239 0
[pid=21588/tid=21640] ppid=21587 vsize=146788 CPUtime=115.63
/proc/21588/task/21640/stat : 21640 (pb_cplex) R 21587 21587 19071 0 -1 4202560 6714 0 0 0 11454 109 0 0 18 0 8 0 22558525 150310912 14695 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=21588/tid=21641] ppid=21587 vsize=146788 CPUtime=115.83
/proc/21588/task/21641/stat : 21641 (pb_cplex) S 21587 21587 19071 0 -1 4202560 12617 0 0 0 11460 123 0 0 15 0 8 0 22558525 150310912 14695 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 5 0 0 0
[pid=21588/tid=21642] ppid=21587 vsize=146788 CPUtime=116.01
/proc/21588/task/21642/stat : 21642 (pb_cplex) R 21587 21587 19071 0 -1 4202560 7980 0 0 0 11475 126 0 0 15 0 8 0 22558525 150310912 14695 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=21588/tid=21643] ppid=21587 vsize=146788 CPUtime=117.88
/proc/21588/task/21643/stat : 21643 (pb_cplex) R 21587 21587 19071 0 -1 4202560 13333 0 0 0 11662 126 0 0 15 0 8 0 22558525 150310912 14695 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=21588/tid=21644] ppid=21587 vsize=146788 CPUtime=117.16
/proc/21588/task/21644/stat : 21644 (pb_cplex) S 21587 21587 19071 0 -1 4202560 10251 0 0 0 11596 120 0 0 15 0 8 0 22558525 150310912 14695 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 2 0 0 0
[pid=21588/tid=21645] ppid=21587 vsize=146788 CPUtime=118.43
/proc/21588/task/21645/stat : 21645 (pb_cplex) R 21587 21587 19071 0 -1 4202560 9305 0 0 0 11725 118 0 0 15 0 8 0 22558525 150310912 14695 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=21588/tid=21646] ppid=21587 vsize=146788 CPUtime=117.15
/proc/21588/task/21646/stat : 21646 (pb_cplex) S 21587 21587 19071 0 -1 4202560 5110 0 0 0 11606 109 0 0 15 0 8 0 22558525 150310912 14695 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1031.26
Current children cumulated vsize (KiB) 155488

[startup+282.301 s]
/proc/loadavg: 5.06 4.08 2.94 9/205 21662
/proc/meminfo: memFree=28686076/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
[pid=21588] ppid=21587 vsize=146788 CPUtime=1321.68
/proc/21588/stat : 21588 (pb_cplex) S 21587 21587 19071 0 -1 4202496 147799 0 0 0 130829 1339 0 0 15 0 8 0 22556085 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/21588/statm: 36697 14716 1108 2985 0 33239 0
[pid=21588/tid=21640] ppid=21587 vsize=146788 CPUtime=151.46
/proc/21588/task/21640/stat : 21640 (pb_cplex) S 21587 21587 19071 0 -1 4202560 7958 0 0 0 14999 147 0 0 15 0 8 0 22558525 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 6 0 0 0
[pid=21588/tid=21641] ppid=21587 vsize=146788 CPUtime=151.6
/proc/21588/task/21641/stat : 21641 (pb_cplex) S 21587 21587 19071 0 -1 4202560 13907 0 0 0 15008 152 0 0 15 0 8 0 22558525 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 4 0 0 0
[pid=21588/tid=21642] ppid=21587 vsize=146788 CPUtime=152.62
/proc/21588/task/21642/stat : 21642 (pb_cplex) S 21587 21587 19071 0 -1 4202560 8083 0 0 0 15097 165 0 0 16 0 8 0 22558525 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 5 0 0 0
[pid=21588/tid=21643] ppid=21587 vsize=146788 CPUtime=154.19
/proc/21588/task/21643/stat : 21643 (pb_cplex) S 21587 21587 19071 0 -1 4202560 13695 0 0 0 15256 163 0 0 15 0 8 0 22558525 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 6 0 0 0
[pid=21588/tid=21644] ppid=21587 vsize=146788 CPUtime=153.41
/proc/21588/task/21644/stat : 21644 (pb_cplex) S 21587 21587 19071 0 -1 4202560 11181 0 0 0 15185 156 0 0 15 0 8 0 22558525 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 3 0 0 0
[pid=21588/tid=21645] ppid=21587 vsize=146788 CPUtime=155.43
/proc/21588/task/21645/stat : 21645 (pb_cplex) S 21587 21587 19071 0 -1 4202560 9810 0 0 0 15388 155 0 0 16 0 8 0 22558525 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 1 0 0 0
[pid=21588/tid=21646] ppid=21587 vsize=146788 CPUtime=152.89
/proc/21588/task/21646/stat : 21646 (pb_cplex) R 21587 21587 19071 0 -1 4202560 5769 0 0 0 15148 141 0 0 15 0 8 0 22558525 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1321.68
Current children cumulated vsize (KiB) 155488

[startup+342.301 s]
/proc/loadavg: 6.91 4.77 3.24 10/205 21664
/proc/meminfo: memFree=28685768/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
[pid=21588] ppid=21587 vsize=146788 CPUtime=1600.76
/proc/21588/stat : 21588 (pb_cplex) R 21587 21587 19071 0 -1 4202496 151140 0 0 0 158441 1635 0 0 15 0 8 0 22556085 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 136017763 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/21588/statm: 36697 14716 1108 2985 0 33239 0
[pid=21588/tid=21640] ppid=21587 vsize=146788 CPUtime=185.64
/proc/21588/task/21640/stat : 21640 (pb_cplex) R 21587 21587 19071 0 -1 4202560 8123 0 0 0 18383 181 0 0 18 0 8 0 22558525 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 135920669 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=21588/tid=21641] ppid=21587 vsize=146788 CPUtime=186.08
/proc/21588/task/21641/stat : 21641 (pb_cplex) R 21587 21587 19071 0 -1 4202560 14372 0 0 0 18416 192 0 0 15 0 8 0 22558525 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=21588/tid=21642] ppid=21587 vsize=146788 CPUtime=187.56
/proc/21588/task/21642/stat : 21642 (pb_cplex) R 21587 21587 19071 0 -1 4202560 8287 0 0 0 18551 205 0 0 15 0 8 0 22558525 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=21588/tid=21643] ppid=21587 vsize=146788 CPUtime=188.98
/proc/21588/task/21643/stat : 21643 (pb_cplex) R 21587 21587 19071 0 -1 4202560 13962 0 0 0 18698 200 0 0 15 0 8 0 22558525 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=21588/tid=21644] ppid=21587 vsize=146788 CPUtime=188.66
/proc/21588/task/21644/stat : 21644 (pb_cplex) R 21587 21587 19071 0 -1 4202560 12217 0 0 0 18677 189 0 0 15 0 8 0 22558525 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 136403116 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=21588/tid=21645] ppid=21587 vsize=146788 CPUtime=190.85
/proc/21588/task/21645/stat : 21645 (pb_cplex) R 21587 21587 19071 0 -1 4202560 10496 0 0 0 18891 194 0 0 15 0 8 0 22558525 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=21588/tid=21646] ppid=21587 vsize=146788 CPUtime=187.5
/proc/21588/task/21646/stat : 21646 (pb_cplex) R 21587 21587 19071 0 -1 4202560 6115 0 0 0 18576 174 0 0 15 0 8 0 22558525 150310912 14716 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 1600.76
Current children cumulated vsize (KiB) 155488



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+387.207 s]
/proc/loadavg: 6.30 4.92 3.36 10/205 21678
/proc/meminfo: memFree=28682708/32950928 swapFree=67111528/67111528
[pid=21587] ppid=21585 vsize=8700 CPUtime=0
/proc/21587/stat : 21587 (run) S 21585 21587 19071 0 -1 4202496 363 0 0 0 0 0 0 0 18 0 1 0 22556085 8908800 248 4089446400 4194304 4922060 140735434281008 18446744073709551615 268272508037 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/21587/statm: 2175 248 208 178 0 68 0
[pid=21588] ppid=21587 vsize=151456 CPUtime=1800.3
/proc/21588/stat : 21588 (pb_cplex) R 21587 21587 19071 0 -1 4202496 174934 0 0 0 178198 1832 0 0 16 0 8 0 22556085 155090944 15209 4089446400 134512640 146736320 4293866448 18446744073709551615 139042888 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/21588/statm: 37864 15209 1114 2985 0 34406 0
[pid=21588/tid=21672] ppid=21587 vsize=151456 CPUtime=1.11
/proc/21588/task/21672/stat : 21672 (pb_cplex) S 21587 21587 19071 0 -1 4202560 1898 0 0 0 111 0 0 0 16 0 8 0 22594091 155090944 15209 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 1 0 0 0
[pid=21588/tid=21673] ppid=21587 vsize=151456 CPUtime=2.21
/proc/21588/task/21673/stat : 21673 (pb_cplex) R 21587 21587 19071 0 -1 4202560 44 0 0 0 221 0 0 0 16 0 8 0 22594091 155090944 15209 4089446400 134512640 146736320 4293866448 18446744073709551615 136388439 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=21588/tid=21674] ppid=21587 vsize=151456 CPUtime=3.44
/proc/21588/task/21674/stat : 21674 (pb_cplex) S 21587 21587 19071 0 -1 4202560 968 0 0 0 344 0 0 0 16 0 8 0 22594091 155090944 15209 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 1 0 0 0
[pid=21588/tid=21675] ppid=21587 vsize=151456 CPUtime=1.92
/proc/21588/task/21675/stat : 21675 (pb_cplex) S 21587 21587 19071 0 -1 4202560 517 0 0 0 192 0 0 0 16 0 8 0 22594091 155090944 15209 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 0 0 0 0
[pid=21588/tid=21676] ppid=21587 vsize=151456 CPUtime=2.18
/proc/21588/task/21676/stat : 21676 (pb_cplex) R 21587 21587 19071 0 -1 4202560 62 0 0 0 218 0 0 0 16 0 8 0 22594091 155090944 15209 4089446400 134512640 146736320 4293866448 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=21588/tid=21677] ppid=21587 vsize=151456 CPUtime=1.75
/proc/21588/task/21677/stat : 21677 (pb_cplex) S 21587 21587 19071 0 -1 4202560 1142 0 0 0 175 0 0 0 16 0 8 0 22594091 155090944 15209 4089446400 134512640 146736320 4293866448 18446744073709551615 144580073 0 2 4096 16387 18446604453932059392 0 0 -1 3 0 0 0
[pid=21588/tid=21678] ppid=21587 vsize=151456 CPUtime=4.72
/proc/21588/task/21678/stat : 21678 (pb_cplex) R 21587 21587 19071 0 -1 4202560 45 0 0 0 471 1 0 0 24 0 8 0 22594091 155090944 15209 4089446400 134512640 146736320 4293866448 18446744073709551615 139044531 0 2 4096 16387 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 1800.3
Current children cumulated vsize (KiB) 160156

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 387.221
CPU time (s): 1800.33
CPU user time (s): 1782
CPU system time (s): 18.3252
CPU usage (%): 464.935
Max. virtual memory (cumulated for all children) (KiB): 167448

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1782
system time used= 18.3252
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 175307
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 339561
involuntary context switches= 12252

runsolver used 0.693894 second user time and 1.41978 second system time

The end

Launcher Data 

Begin job on node122 at 2010-07-08 00:57:05
IDJOB=2697931
IDBENCH=78953
IDSOLVER=1210
FILE ID=node122/2697931-1278543425
PBS_JOBID= 11239234
Free space on /tmp= 73372 MiB

SOLVER NAME= pb_cplex 2010-07-01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900582300--soft-33-100-0.wbo
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2697931-1278543425/watcher-2697931-1278543425 -o /tmp/evaluation-result-2697931-1278543425/solver-2697931-1278543425 -C 1800 -W 2000 -M 3800  run HOME/instance-2697931-1278543425.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 9fdf6a24194e0c0ae14212c193866ebe
RANDOM SEED=587125673

node122.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.839
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.839
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5226.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.839
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.839
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.81
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.839
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.76
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.839
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.67
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.839
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.839
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32950928 kB
MemFree:      28744660 kB
Buffers:        150636 kB
Cached:        2878772 kB
SwapCached:          0 kB
Active:        2092684 kB
Inactive:      1958260 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32950928 kB
LowFree:      28744660 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           16748 kB
Writeback:           0 kB
AnonPages:     1021500 kB
Mapped:          20456 kB
Slab:            91216 kB
PageTables:       6748 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83586992 kB
Committed_AS:  1655264 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 73356 MiB
End job on node122 at 2010-07-08 01:03:33