Trace number 2697447

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb_cplex 2010-07-01? (TO) 1800.74 399.894

General information on the benchmark

Name/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/
tsp/normalized-t3002.11tsp11.1900548667--soft-0-100-0.wbo
MD5SUMfe10d6822f5aa7d11d2a88b2406ba570
Bench CategorySOFT-SMALLINT-LIN (only soft constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark584.992
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints2707
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 137946
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 137945
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 625
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing wbo file format. File HOME/instance-2697447-1278055780.wbo.
0.00/0.00	c Instance file HOME/instance-2697447-1278055780.wbo
0.00/0.00	c File size is 96763 bytes.
1.39/1.48	c Highest Coefficient sum: 625
1.39/1.48	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
1.39/1.49	c ============================[ Problem Statistics ]=============================
1.39/1.49	c |                                                                             |
1.39/1.49	c |  Parsing time:          1.49         s                                      |
1.39/1.49	c |  Number Variables:      2938                                                |
1.39/1.49	c |  Number Constraints:    2708                                                |
1.39/1.49	c ===============================================================================
1800.15/399.89	c Remaining time 1798.51 sec.
1800.15/399.89	c 
1800.15/399.89	c *** INTERRUPTED ***
1800.15/399.89	s UNKNOWN
1800.15/399.89	c Total CPU time              : 1784.51 s
1800.15/399.89	c Memory used           : 142.77 MB
1800.15/399.89	c CPU time              : 1784.51 s
1800.15/399.89	c 
1800.15/399.89	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2697447-1278055780/watcher-2697447-1278055780 -o /tmp/evaluation-result-2697447-1278055780/solver-2697447-1278055780 -C 1800 -W 2000 -M 3800 run HOME/instance-2697447-1278055780.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 11.00 9.69 5.98 4/179 26248
/proc/meminfo: memFree=30616160/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0

[startup+0.0276781 s]
/proc/loadavg: 11.00 9.69 5.98 4/179 26248
/proc/meminfo: memFree=30616160/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.101673 s]
/proc/loadavg: 11.00 9.69 5.98 4/179 26248
/proc/meminfo: memFree=30616160/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300604 s]
/proc/loadavg: 11.00 9.69 5.98 4/179 26248
/proc/meminfo: memFree=30616160/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700535 s]
/proc/loadavg: 11.00 9.69 5.98 4/179 26248
/proc/meminfo: memFree=30616160/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50039 s]
/proc/loadavg: 11.00 9.69 5.98 3/181 26250
/proc/meminfo: memFree=30614408/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
[pid=26249] ppid=26248 vsize=19104 CPUtime=1.49
/proc/26249/stat : 26249 (pb_cplex) R 26248 26248 25677 0 -1 4202496 1883 0 0 0 149 0 0 0 25 0 1 0 146873466 19562496 1747 4089446400 134512640 146736320 4288631824 18446744073709551615 138736244 0 0 4096 16387 0 0 0 17 4 0 0 0
/proc/26249/statm: 4776 1747 737 2985 0 1318 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 27804

[startup+3.10111 s]
/proc/loadavg: 10.44 9.60 5.97 10/188 26264
/proc/meminfo: memFree=30572936/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
[pid=26249] ppid=26248 vsize=101032 CPUtime=5.34
/proc/26249/stat : 26249 (pb_cplex) R 26248 26248 25677 0 -1 4202496 19490 0 0 0 528 6 0 0 16 0 1 0 146873466 103456768 10275 4089446400 134512640 146736320 4288631824 18446744073709551615 136461575 0 0 4096 16387 0 0 0 17 6 0 0 0
/proc/26249/statm: 25258 10275 1071 2985 0 21800 0
Current children cumulated CPU time (s) 5.34
Current children cumulated vsize (KiB) 109732

[startup+6.3005 s]
/proc/loadavg: 10.44 9.60 5.97 4/188 26285
/proc/meminfo: memFree=30566612/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
[pid=26249] ppid=26248 vsize=139944 CPUtime=16.36
/proc/26249/stat : 26249 (pb_cplex) S 26248 26248 25677 0 -1 4202496 34677 0 0 0 1621 15 0 0 17 0 8 0 146873466 143302656 12999 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/26249/statm: 34986 12999 1080 2985 0 31528 0
[pid=26249/tid=26279] ppid=26248 vsize=139944 CPUtime=1.77
/proc/26249/task/26279/stat : 26279 (pb_cplex) S 26248 26248 25677 0 -1 4202560 1783 0 0 0 177 0 0 0 16 0 8 0 146873801 143302656 12999 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 6 0 0 0
[pid=26249/tid=26280] ppid=26248 vsize=139944 CPUtime=1.28
/proc/26249/task/26280/stat : 26280 (pb_cplex) R 26248 26248 25677 0 -1 4202560 3295 0 0 0 127 1 0 0 16 0 8 0 146873801 143302656 12999 4089446400 134512640 146736320 4288631824 18446744073709551615 136471158 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=26249/tid=26281] ppid=26248 vsize=139944 CPUtime=1.13
/proc/26249/task/26281/stat : 26281 (pb_cplex) S 26248 26248 25677 0 -1 4202560 333 0 0 0 113 0 0 0 15 0 8 0 146873801 143302656 12999 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 5 0 0 0
[pid=26249/tid=26282] ppid=26248 vsize=139944 CPUtime=1.08
/proc/26249/task/26282/stat : 26282 (pb_cplex) S 26248 26248 25677 0 -1 4202560 1404 0 0 0 108 0 0 0 15 0 8 0 146873801 143302656 12999 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 2 0 0 0
[pid=26249/tid=26283] ppid=26248 vsize=139944 CPUtime=0.93
/proc/26249/task/26283/stat : 26283 (pb_cplex) S 26248 26248 25677 0 -1 4202560 477 0 0 0 93 0 0 0 15 0 8 0 146873801 143302656 12999 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 0 0 0 0
[pid=26249/tid=26284] ppid=26248 vsize=139944 CPUtime=1.03
/proc/26249/task/26284/stat : 26284 (pb_cplex) S 26248 26248 25677 0 -1 4202560 3864 0 0 0 103 0 0 0 15 0 8 0 146873801 143302656 12999 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 4 0 0 0
[pid=26249/tid=26285] ppid=26248 vsize=139944 CPUtime=1.06
/proc/26249/task/26285/stat : 26285 (pb_cplex) S 26248 26248 25677 0 -1 4202560 154 0 0 0 106 0 0 0 15 0 8 0 146873801 143302656 12999 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 16.36
Current children cumulated vsize (KiB) 148644

[startup+12.7013 s]
/proc/loadavg: 9.92 9.51 5.96 3/188 26286
/proc/meminfo: memFree=30561560/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
[pid=26249] ppid=26248 vsize=144040 CPUtime=43.63
/proc/26249/stat : 26249 (pb_cplex) S 26248 26248 25677 0 -1 4202496 43123 0 0 0 4314 49 0 0 16 0 8 0 146873466 147496960 13808 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0
/proc/26249/statm: 36010 13808 1081 2985 0 32552 0
[pid=26249/tid=26279] ppid=26248 vsize=144040 CPUtime=5.14
/proc/26249/task/26279/stat : 26279 (pb_cplex) R 26248 26248 25677 0 -1 4202560 2650 0 0 0 509 5 0 0 16 0 8 0 146873801 147496960 13808 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=26249/tid=26280] ppid=26248 vsize=144040 CPUtime=4.64
/proc/26249/task/26280/stat : 26280 (pb_cplex) S 26248 26248 25677 0 -1 4202560 5135 0 0 0 459 5 0 0 15 0 8 0 146873801 147496960 13808 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 5 0 0 0
[pid=26249/tid=26281] ppid=26248 vsize=144040 CPUtime=4.52
/proc/26249/task/26281/stat : 26281 (pb_cplex) S 26248 26248 25677 0 -1 4202560 354 0 0 0 448 4 0 0 15 0 8 0 146873801 147496960 13808 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 4 0 0 0
[pid=26249/tid=26282] ppid=26248 vsize=144040 CPUtime=4.47
/proc/26249/task/26282/stat : 26282 (pb_cplex) S 26248 26248 25677 0 -1 4202560 3832 0 0 0 442 5 0 0 15 0 8 0 146873801 147496960 13808 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 6 0 0 0
[pid=26249/tid=26283] ppid=26248 vsize=144040 CPUtime=4.33
/proc/26249/task/26283/stat : 26283 (pb_cplex) S 26248 26248 25677 0 -1 4202560 2198 0 0 0 429 4 0 0 15 0 8 0 146873801 147496960 13808 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 2 0 0 0
[pid=26249/tid=26284] ppid=26248 vsize=144040 CPUtime=4.51
/proc/26249/task/26284/stat : 26284 (pb_cplex) R 26248 26248 25677 0 -1 4202560 5404 0 0 0 447 4 0 0 15 0 8 0 146873801 147496960 13808 4089446400 134512640 146736320 4288631824 18446744073709551615 135454073 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=26249/tid=26285] ppid=26248 vsize=144040 CPUtime=4.36
/proc/26249/task/26285/stat : 26285 (pb_cplex) S 26248 26248 25677 0 -1 4202560 176 0 0 0 432 4 0 0 15 0 8 0 146873801 147496960 13808 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 43.63
Current children cumulated vsize (KiB) 152740

[startup+25.501 s]
/proc/loadavg: 9.48 9.43 5.99 10/188 26300
/proc/meminfo: memFree=30559688/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
[pid=26249] ppid=26248 vsize=142092 CPUtime=91.86
/proc/26249/stat : 26249 (pb_cplex) R 26248 26248 25677 0 -1 4202496 62793 0 0 0 9092 94 0 0 15 0 8 0 146873466 145502208 13612 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/26249/statm: 35523 13612 1085 2985 0 32065 0
[pid=26249/tid=26294] ppid=26248 vsize=142092 CPUtime=2.85
/proc/26249/task/26294/stat : 26294 (pb_cplex) R 26248 26248 25677 0 -1 4202560 1280 0 0 0 285 0 0 0 15 0 8 0 146875294 145502208 13612 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=26249/tid=26295] ppid=26248 vsize=142092 CPUtime=2.41
/proc/26249/task/26295/stat : 26295 (pb_cplex) R 26248 26248 25677 0 -1 4202560 3234 0 0 0 240 1 0 0 16 0 8 0 146875294 145502208 13612 4089446400 134512640 146736320 4288631824 18446744073709551615 136475798 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=26249/tid=26296] ppid=26248 vsize=142092 CPUtime=3.6
/proc/26249/task/26296/stat : 26296 (pb_cplex) R 26248 26248 25677 0 -1 4202560 866 0 0 0 359 1 0 0 15 0 8 0 146875294 145502208 13612 4089446400 134512640 146736320 4288631824 18446744073709551615 136017763 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=26249/tid=26297] ppid=26248 vsize=142092 CPUtime=2.74
/proc/26249/task/26297/stat : 26297 (pb_cplex) R 26248 26248 25677 0 -1 4202560 1134 0 0 0 273 1 0 0 15 0 8 0 146875294 145502208 13612 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=26249/tid=26298] ppid=26248 vsize=142092 CPUtime=2.17
/proc/26249/task/26298/stat : 26298 (pb_cplex) R 26248 26248 25677 0 -1 4202560 2429 0 0 0 217 0 0 0 15 0 8 0 146875294 145502208 13612 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=26249/tid=26299] ppid=26248 vsize=142092 CPUtime=4.58
/proc/26249/task/26299/stat : 26299 (pb_cplex) R 26248 26248 25677 0 -1 4202560 29 0 0 0 457 1 0 0 18 0 8 0 146875294 145502208 13612 4089446400 134512640 146736320 4288631824 18446744073709551615 144580332 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=26249/tid=26300] ppid=26248 vsize=142092 CPUtime=3.73
/proc/26249/task/26300/stat : 26300 (pb_cplex) R 26248 26248 25677 0 -1 4202560 5096 0 0 0 372 1 0 0 15 0 8 0 146875294 145502208 13612 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 91.86
Current children cumulated vsize (KiB) 150792

[startup+51.1423 s]
/proc/loadavg: 8.30 9.17 5.99 8/188 26300
/proc/meminfo: memFree=30558164/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
[pid=26249] ppid=26248 vsize=146188 CPUtime=212.83
/proc/26249/stat : 26249 (pb_cplex) R 26248 26248 25677 0 -1 4202496 72472 0 0 0 21087 196 0 0 15 0 8 0 146873466 149696512 14369 4089446400 134512640 146736320 4288631824 18446744073709551615 136017803 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/26249/statm: 36547 14369 1085 2985 0 33089 0
[pid=26249/tid=26294] ppid=26248 vsize=146188 CPUtime=17.75
/proc/26249/task/26294/stat : 26294 (pb_cplex) R 26248 26248 25677 0 -1 4202560 1976 0 0 0 1763 12 0 0 15 0 8 0 146875294 149696512 14369 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=26249/tid=26295] ppid=26248 vsize=146188 CPUtime=17.67
/proc/26249/task/26295/stat : 26295 (pb_cplex) S 26248 26248 25677 0 -1 4202560 4811 0 0 0 1753 14 0 0 15 0 8 0 146875294 149696512 14369 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 4 0 0 0
[pid=26249/tid=26296] ppid=26248 vsize=146188 CPUtime=18.93
/proc/26249/task/26296/stat : 26296 (pb_cplex) R 26248 26248 25677 0 -1 4202560 2083 0 0 0 1879 14 0 0 15 0 8 0 146875294 149696512 14369 4089446400 134512640 146736320 4288631824 18446744073709551615 135526785 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=26249/tid=26297] ppid=26248 vsize=146188 CPUtime=17.77
/proc/26249/task/26297/stat : 26297 (pb_cplex) R 26248 26248 25677 0 -1 4202560 2369 0 0 0 1762 15 0 0 15 0 8 0 146875294 149696512 14369 4089446400 134512640 146736320 4288631824 18446744073709551615 139044581 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=26249/tid=26298] ppid=26248 vsize=146188 CPUtime=17.42
/proc/26249/task/26298/stat : 26298 (pb_cplex) S 26248 26248 25677 0 -1 4202560 3361 0 0 0 1727 15 0 0 15 0 8 0 146875294 149696512 14369 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 5 0 0 0
[pid=26249/tid=26299] ppid=26248 vsize=146188 CPUtime=19.66
/proc/26249/task/26299/stat : 26299 (pb_cplex) R 26248 26248 25677 0 -1 4202560 2203 0 0 0 1953 13 0 0 15 0 8 0 146875294 149696512 14369 4089446400 134512640 146736320 4288631824 18446744073709551615 135454201 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=26249/tid=26300] ppid=26248 vsize=146188 CPUtime=18.89
/proc/26249/task/26300/stat : 26300 (pb_cplex) R 26248 26248 25677 0 -1 4202560 5720 0 0 0 1877 12 0 0 15 0 8 0 146875294 149696512 14369 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 212.83
Current children cumulated vsize (KiB) 154888

[startup+102.307 s]
/proc/loadavg: 5.78 8.41 5.92 10/188 26302
/proc/meminfo: memFree=30559052/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
[pid=26249] ppid=26248 vsize=145164 CPUtime=358.24
/proc/26249/stat : 26249 (pb_cplex) S 26248 26248 25677 0 -1 4202496 76864 0 0 0 35518 306 0 0 16 0 8 0 146873466 148647936 14208 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/26249/statm: 36291 14208 1085 2985 0 32833 0
[pid=26249/tid=26294] ppid=26248 vsize=145164 CPUtime=32.55
/proc/26249/task/26294/stat : 26294 (pb_cplex) S 26248 26248 25677 0 -1 4202560 2323 0 0 0 3228 27 0 0 15 0 8 0 146875294 148647936 14208 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 1 0 0 0
[pid=26249/tid=26295] ppid=26248 vsize=145164 CPUtime=32.32
/proc/26249/task/26295/stat : 26295 (pb_cplex) S 26248 26248 25677 0 -1 4202560 5533 0 0 0 3202 30 0 0 16 0 8 0 146875294 148647936 14208 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 5 0 0 0
[pid=26249/tid=26296] ppid=26248 vsize=145164 CPUtime=33.71
/proc/26249/task/26296/stat : 26296 (pb_cplex) R 26248 26248 25677 0 -1 4202560 2346 0 0 0 3345 26 0 0 15 0 8 0 146875294 148647936 14208 4089446400 134512640 146736320 4288631824 18446744073709551615 136403109 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=26249/tid=26297] ppid=26248 vsize=145164 CPUtime=32.62
/proc/26249/task/26297/stat : 26297 (pb_cplex) R 26248 26248 25677 0 -1 4202560 2743 0 0 0 3235 27 0 0 16 0 8 0 146875294 148647936 14208 4089446400 134512640 146736320 4288631824 18446744073709551615 136007626 0 2 4096 16387 0 0 0 -1 2 0 0 0

################
# More data... #
################

[pid=26249/tid=26299] ppid=26248 vsize=145164 CPUtime=34.41
/proc/26249/task/26299/stat : 26299 (pb_cplex) S 26248 26248 25677 0 -1 4202560 2779 0 0 0 3415 26 0 0 15 0 8 0 146875294 148647936 14208 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 2 0 0 0
[pid=26249/tid=26300] ppid=26248 vsize=145164 CPUtime=61.09
/proc/26249/task/26300/stat : 26300 (pb_cplex) S 26248 26248 25677 0 -1 4202560 6326 0 0 0 6083 26 0 0 16 0 8 0 146875294 148647936 14208 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 358.24
Current children cumulated vsize (KiB) 153864

[startup+162.301 s]
/proc/loadavg: 6.51 8.23 6.00 3/188 26307
/proc/meminfo: memFree=30558508/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
[pid=26249] ppid=26248 vsize=145164 CPUtime=652.62
/proc/26249/stat : 26249 (pb_cplex) S 26248 26248 25677 0 -1 4202496 91713 0 0 0 64685 577 0 0 15 0 8 0 146873466 148647936 14259 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/26249/statm: 36291 14259 1085 2985 0 32833 0
[pid=26249/tid=26294] ppid=26248 vsize=145164 CPUtime=69.21
/proc/26249/task/26294/stat : 26294 (pb_cplex) S 26248 26248 25677 0 -1 4202560 4432 0 0 0 6859 62 0 0 15 0 8 0 146875294 148647936 14259 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 6 0 0 0
[pid=26249/tid=26295] ppid=26248 vsize=145164 CPUtime=69.03
/proc/26249/task/26295/stat : 26295 (pb_cplex) S 26248 26248 25677 0 -1 4202560 7341 0 0 0 6839 64 0 0 15 0 8 0 146875294 148647936 14259 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 0 0 0 0
[pid=26249/tid=26296] ppid=26248 vsize=145164 CPUtime=70.45
/proc/26249/task/26296/stat : 26296 (pb_cplex) S 26248 26248 25677 0 -1 4202560 4278 0 0 0 6984 61 0 0 15 0 8 0 146875294 148647936 14259 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 5 0 0 0
[pid=26249/tid=26297] ppid=26248 vsize=145164 CPUtime=69.88
/proc/26249/task/26297/stat : 26297 (pb_cplex) S 26248 26248 25677 0 -1 4202560 4190 0 0 0 6927 61 0 0 15 0 8 0 146875294 148647936 14259 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 3 0 0 0
[pid=26249/tid=26298] ppid=26248 vsize=145164 CPUtime=68.75
/proc/26249/task/26298/stat : 26298 (pb_cplex) S 26248 26248 25677 0 -1 4202560 6874 0 0 0 6814 61 0 0 15 0 8 0 146875294 148647936 14259 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 7 0 0 0
[pid=26249/tid=26299] ppid=26248 vsize=145164 CPUtime=71.03
/proc/26249/task/26299/stat : 26299 (pb_cplex) S 26248 26248 25677 0 -1 4202560 3892 0 0 0 7041 62 0 0 15 0 8 0 146875294 148647936 14259 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 7 0 0 0
[pid=26249/tid=26300] ppid=26248 vsize=145164 CPUtime=97.84
/proc/26249/task/26300/stat : 26300 (pb_cplex) R 26248 26248 25677 0 -1 4202560 8097 0 0 0 9723 61 0 0 16 0 8 0 146875294 148647936 14259 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 652.62
Current children cumulated vsize (KiB) 153864

[startup+222.307 s]
/proc/loadavg: 5.83 7.74 5.98 9/188 26308
/proc/meminfo: memFree=30558708/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
[pid=26249] ppid=26248 vsize=144140 CPUtime=952.28
/proc/26249/stat : 26249 (pb_cplex) S 26248 26248 25677 0 -1 4202496 100278 0 0 0 94376 852 0 0 15 0 8 0 146873466 147599360 14159 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/26249/statm: 36035 14159 1101 2985 0 32577 0
[pid=26249/tid=26294] ppid=26248 vsize=144140 CPUtime=106.83
/proc/26249/task/26294/stat : 26294 (pb_cplex) S 26248 26248 25677 0 -1 4202560 5103 0 0 0 10586 97 0 0 15 0 8 0 146875294 147599360 14159 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 3 0 0 0
[pid=26249/tid=26295] ppid=26248 vsize=144140 CPUtime=106.32
/proc/26249/task/26295/stat : 26295 (pb_cplex) S 26248 26248 25677 0 -1 4202560 8173 0 0 0 10532 100 0 0 15 0 8 0 146875294 147599360 14159 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 0 0 0 0
[pid=26249/tid=26296] ppid=26248 vsize=144140 CPUtime=107.76
/proc/26249/task/26296/stat : 26296 (pb_cplex) R 26248 26248 25677 0 -1 4202560 5514 0 0 0 10678 98 0 0 16 0 8 0 146875294 147599360 14159 4089446400 134512640 146736320 4288631824 18446744073709551615 135526778 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=26249/tid=26297] ppid=26248 vsize=144140 CPUtime=107.67
/proc/26249/task/26297/stat : 26297 (pb_cplex) S 26248 26248 25677 0 -1 4202560 6194 0 0 0 10668 99 0 0 15 0 8 0 146875294 147599360 14159 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 1 0 0 0
[pid=26249/tid=26298] ppid=26248 vsize=144140 CPUtime=106.09
/proc/26249/task/26298/stat : 26298 (pb_cplex) S 26248 26248 25677 0 -1 4202560 7952 0 0 0 10517 92 0 0 15 0 8 0 146875294 147599360 14159 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 6 0 0 0
[pid=26249/tid=26299] ppid=26248 vsize=144140 CPUtime=108.33
/proc/26249/task/26299/stat : 26299 (pb_cplex) S 26248 26248 25677 0 -1 4202560 4616 0 0 0 10740 93 0 0 15 0 8 0 146875294 147599360 14159 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 7 0 0 0
[pid=26249/tid=26300] ppid=26248 vsize=144140 CPUtime=135.27
/proc/26249/task/26300/stat : 26300 (pb_cplex) S 26248 26248 25677 0 -1 4202560 9154 0 0 0 13433 94 0 0 15 0 8 0 146875294 147599360 14159 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 952.28
Current children cumulated vsize (KiB) 152840

[startup+282.301 s]
/proc/loadavg: 5.73 7.41 5.97 9/188 26309
/proc/meminfo: memFree=30557712/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
[pid=26249] ppid=26248 vsize=146188 CPUtime=1251.45
/proc/26249/stat : 26249 (pb_cplex) R 26248 26248 25677 0 -1 4202496 108394 0 0 0 124016 1129 0 0 15 0 8 0 146873466 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/26249/statm: 36547 14526 1103 2985 0 33089 0
[pid=26249/tid=26294] ppid=26248 vsize=146188 CPUtime=144.35
/proc/26249/task/26294/stat : 26294 (pb_cplex) S 26248 26248 25677 0 -1 4202560 5685 0 0 0 14303 132 0 0 16 0 8 0 146875294 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 4 0 0 0
[pid=26249/tid=26295] ppid=26248 vsize=146188 CPUtime=143.69
/proc/26249/task/26295/stat : 26295 (pb_cplex) S 26248 26248 25677 0 -1 4202560 8809 0 0 0 14236 133 0 0 16 0 8 0 146875294 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 1 0 0 0
[pid=26249/tid=26296] ppid=26248 vsize=146188 CPUtime=145.03
/proc/26249/task/26296/stat : 26296 (pb_cplex) S 26248 26248 25677 0 -1 4202560 6016 0 0 0 14371 132 0 0 16 0 8 0 146875294 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 5 0 0 0
[pid=26249/tid=26297] ppid=26248 vsize=146188 CPUtime=145.52
/proc/26249/task/26297/stat : 26297 (pb_cplex) S 26248 26248 25677 0 -1 4202560 8222 0 0 0 14422 130 0 0 16 0 8 0 146875294 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 7 0 0 0
[pid=26249/tid=26298] ppid=26248 vsize=146188 CPUtime=143.23
/proc/26249/task/26298/stat : 26298 (pb_cplex) S 26248 26248 25677 0 -1 4202560 9861 0 0 0 14196 127 0 0 15 0 8 0 146875294 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 3 0 0 0
[pid=26249/tid=26299] ppid=26248 vsize=146188 CPUtime=145.6
/proc/26249/task/26299/stat : 26299 (pb_cplex) S 26248 26248 25677 0 -1 4202560 5457 0 0 0 14432 128 0 0 15 0 8 0 146875294 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 6 0 0 0
[pid=26249/tid=26300] ppid=26248 vsize=146188 CPUtime=172.39
/proc/26249/task/26300/stat : 26300 (pb_cplex) S 26248 26248 25677 0 -1 4202560 10217 0 0 0 17109 130 0 0 15 0 8 0 146875294 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1251.45
Current children cumulated vsize (KiB) 154888

[startup+342.301 s]
/proc/loadavg: 7.43 7.59 6.13 10/188 26311
/proc/meminfo: memFree=30558108/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
[pid=26249] ppid=26248 vsize=146188 CPUtime=1529.63
/proc/26249/stat : 26249 (pb_cplex) R 26248 26248 25677 0 -1 4202496 113819 0 0 0 151584 1379 0 0 15 0 8 0 146873466 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/26249/statm: 36547 14526 1103 2985 0 33089 0
[pid=26249/tid=26294] ppid=26248 vsize=146188 CPUtime=179.13
/proc/26249/task/26294/stat : 26294 (pb_cplex) R 26248 26248 25677 0 -1 4202560 5973 0 0 0 17748 165 0 0 15 0 8 0 146875294 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=26249/tid=26295] ppid=26248 vsize=146188 CPUtime=178.38
/proc/26249/task/26295/stat : 26295 (pb_cplex) R 26248 26248 25677 0 -1 4202560 9356 0 0 0 17675 163 0 0 15 0 8 0 146875294 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=26249/tid=26296] ppid=26248 vsize=146188 CPUtime=179.66
/proc/26249/task/26296/stat : 26296 (pb_cplex) R 26248 26248 25677 0 -1 4202560 6371 0 0 0 17801 165 0 0 15 0 8 0 146875294 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=26249/tid=26297] ppid=26248 vsize=146188 CPUtime=180.55
/proc/26249/task/26297/stat : 26297 (pb_cplex) R 26248 26248 25677 0 -1 4202560 9537 0 0 0 17894 161 0 0 16 0 8 0 146875294 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 138462907 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=26249/tid=26298] ppid=26248 vsize=146188 CPUtime=178.03
/proc/26249/task/26298/stat : 26298 (pb_cplex) R 26248 26248 25677 0 -1 4202560 10844 0 0 0 17648 155 0 0 15 0 8 0 146875294 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 135237143 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=26249/tid=26299] ppid=26248 vsize=146188 CPUtime=180.19
/proc/26249/task/26299/stat : 26299 (pb_cplex) R 26248 26248 25677 0 -1 4202560 5949 0 0 0 17857 162 0 0 15 0 8 0 146875294 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 137361234 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=26249/tid=26300] ppid=26248 vsize=146188 CPUtime=206.93
/proc/26249/task/26300/stat : 26300 (pb_cplex) R 26248 26248 25677 0 -1 4202560 11440 0 0 0 20532 161 0 0 16 0 8 0 146875294 149696512 14526 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1529.63
Current children cumulated vsize (KiB) 154888



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+399.801 s]
/proc/loadavg: 7.27 7.48 6.17 3/188 26313
/proc/meminfo: memFree=30557372/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
[pid=26249] ppid=26248 vsize=146188 CPUtime=1800.15
/proc/26249/stat : 26249 (pb_cplex) S 26248 26248 25677 0 -1 4202496 120700 0 0 0 178394 1621 0 0 16 0 8 0 146873466 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0
/proc/26249/statm: 36547 14578 1103 2985 0 33089 0
[pid=26249/tid=26294] ppid=26248 vsize=146188 CPUtime=212.87
/proc/26249/task/26294/stat : 26294 (pb_cplex) S 26248 26248 25677 0 -1 4202560 6484 0 0 0 21095 192 0 0 15 0 8 0 146875294 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 5 0 0 0
[pid=26249/tid=26295] ppid=26248 vsize=146188 CPUtime=212.21
/proc/26249/task/26295/stat : 26295 (pb_cplex) R 26248 26248 25677 0 -1 4202560 10419 0 0 0 21025 196 0 0 16 0 8 0 146875294 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=26249/tid=26296] ppid=26248 vsize=146188 CPUtime=213.4
/proc/26249/task/26296/stat : 26296 (pb_cplex) R 26248 26248 25677 0 -1 4202560 7319 0 0 0 21143 197 0 0 15 0 8 0 146875294 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=26249/tid=26297] ppid=26248 vsize=146188 CPUtime=214.44
/proc/26249/task/26297/stat : 26297 (pb_cplex) R 26248 26248 25677 0 -1 4202560 10618 0 0 0 21256 188 0 0 15 0 8 0 146875294 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=26249/tid=26298] ppid=26248 vsize=146188 CPUtime=211.85
/proc/26249/task/26298/stat : 26298 (pb_cplex) S 26248 26248 25677 0 -1 4202560 11289 0 0 0 20996 189 0 0 15 0 8 0 146875294 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 2 0 0 0
[pid=26249/tid=26299] ppid=26248 vsize=146188 CPUtime=214.01
/proc/26249/task/26299/stat : 26299 (pb_cplex) S 26248 26248 25677 0 -1 4202560 6999 0 0 0 21213 188 0 0 16 0 8 0 146875294 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 6 0 0 0
[pid=26249/tid=26300] ppid=26248 vsize=146188 CPUtime=240.7
/proc/26249/task/26300/stat : 26300 (pb_cplex) S 26248 26248 25677 0 -1 4202560 12016 0 0 0 23879 191 0 0 15 0 8 0 146875294 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1800.15
Current children cumulated vsize (KiB) 154888

Sending SIGTERM to process tree (bottom up)

Solver just ended. Dumping a history of the last processes samples

[startup+399.801 s]
/proc/loadavg: 7.27 7.48 6.17 3/188 26313
/proc/meminfo: memFree=Sleeping 30557372/32951124 swapFree=67111528/67111528
[pid=26248] ppid=26246 vsize=8700 CPUtime=0
/proc/26248/stat : 26248 (run) S 26246 26248 25677 0 -1 4202496 364 0 0 0 0 0 0 0 25 0 1 0 146873466 8908800 249 4089446400 4194304 4922060 140737451775936 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/26248/statm: 2175 249 208 178 0 68 0
[pid=26249] ppid=26248 vsize=146188 CPUtime=1800.15
/proc/26249/stat : 26249 (pb_cplex) S 26248 26248 25677 0 -1 4202496 120700 0 0 0 178394 1621 0 0 16 0 8 0 146873466 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0
/proc/26249/statm: 36547 14578 1103 2985 0 33089 0
[pid=26249/tid=26294] ppid=26248 vsize=146188 CPUtime=212.87
/proc/26249/task/26294/stat : 26294 (pb_cplex) S 26248 26248 25677 0 -1 4202560 6484 0 0 0 21095 192 0 0 15 0 8 0 146875294 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 5 0 0 0
[pid=26249/tid=26295] ppid=26248 vsize=146188 CPUtime=212.21
/proc/26249/task/26295/stat : 26295 (pb_cplex) R 26248 26248 25677 0 -1 4202560 10419 0 0 0 21025 196 0 0 16 0 8 0 146875294 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=26249/tid=26296] ppid=26248 vsize=146188 CPUtime=213.4
/proc/26249/task/26296/stat : 26296 (pb_cplex) R 26248 26248 25677 0 -1 4202560 7319 0 0 0 21143 197 0 0 15 0 8 0 146875294 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=26249/tid=26297] ppid=26248 vsize=146188 CPUtime=214.44
/proc/26249/task/26297/stat : 26297 (pb_cplex) R 26248 26248 25677 0 -1 4202560 10618 0 0 0 21256 188 0 0 15 0 8 0 146875294 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=26249/tid=26298] ppid=26248 vsize=146188 CPUtime=211.85
/proc/26249/task/26298/stat : 26298 (pb_cplex) S 26248 26248 25677 0 -1 4202560 11289 0 0 0 20996 189 0 0 15 0 8 0 146875294 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 2 0 0 0
[pid=26249/tid=26299] ppid=26248 vsize=146188 CPUtime=214.01
/proc/26249/task/26299/stat : 26299 (pb_cplex) S 26248 26248 25677 0 -1 4202560 6999 0 0 0 21213 188 0 0 16 0 8 0 146875294 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 6 0 0 0
[pid=26249/tid=26300] ppid=26248 vsize=146188 CPUtime=240.7
/proc/26249/task/26300/stat : 26300 (pb_cplex) S 26248 26248 25677 0 -1 4202560 12016 0 0 0 23879 191 0 0 15 0 8 0 146875294 149696512 14578 4089446400 134512640 146736320 4288631824 18446744073709551615 144580073 0 2 4096 16387 18446604471144274752 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 1800.15
Current children cumulated vsize (KiB) 154888

Child status: 0
Real time (s): 399.894
CPU time (s): 1800.74
CPU user time (s): 1784.51
CPU system time (s): 16.2285
CPU usage (%): 450.304
Max. virtual memory (cumulated for all children) (KiB): 156936

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1784.51
system time used= 16.2285
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 121074
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 296954
involuntary context switches= 11243

runsolver used 0.698893 second user time and 1.57676 second system time

The end

Launcher Data 

Begin job on node139 at 2010-07-02 09:29:40
IDJOB=2697447
IDBENCH=79297
IDSOLVER=1210
FILE ID=node139/2697447-1278055780
PBS_JOBID= 11198903
Free space on /tmp= 74136 MiB

SOLVER NAME= pb_cplex 2010-07-01
BENCH NAME= PB10/normalized-PB10/SOFT-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900548667--soft-0-100-0.wbo
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2697447-1278055780/watcher-2697447-1278055780 -o /tmp/evaluation-result-2697447-1278055780/solver-2697447-1278055780 -C 1800 -W 2000 -M 3800  run HOME/instance-2697447-1278055780.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= fe10d6822f5aa7d11d2a88b2406ba570
RANDOM SEED=1593565720

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30616820 kB
Buffers:        225676 kB
Cached:        1619908 kB
SwapCached:          0 kB
Active:        1116256 kB
Inactive:      1067308 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30616820 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           16724 kB
Writeback:           0 kB
AnonPages:      338092 kB
Mapped:          18804 kB
Slab:            86100 kB
PageTables:       5476 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   544796 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74120 MiB
End job on node139 at 2010-07-02 09:36:20