Trace number 2697871

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb_cplex 2010-07-01? (TO) 1800.25 486.537

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900577940--soft-33-100-0.wbo
MD5SUM426e5957e411ffe2f76bd332943fd07d
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark1
Best CPU time to get the best result obtained on this benchmark467.838
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints1816
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 92461
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 92460
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 661
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing wbo file format. File HOME/instance-2697871-1278054866.wbo.
0.00/0.00	c Instance file HOME/instance-2697871-1278054866.wbo
0.00/0.00	c File size is 92398 bytes.
0.00/0.65	c Highest Coefficient sum: 661
0.00/0.65	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.66	c ============================[ Problem Statistics ]=============================
0.00/0.66	c |                                                                             |
0.00/0.66	c |  Parsing time:          0.66         s                                      |
0.00/0.66	c |  Number Variables:      2047                                                |
0.00/0.66	c |  Number Constraints:    2708                                                |
0.00/0.66	c ===============================================================================
1800.15/486.53	c Remaining time 1799.34 sec.
1800.15/486.53	c 
1800.15/486.53	c *** INTERRUPTED ***
1800.15/486.53	s UNKNOWN
1800.15/486.53	c Total CPU time              : 1784.45 s
1800.15/486.53	c Memory used           : 163.95 MB
1800.15/486.53	c CPU time              : 1784.45 s
1800.15/486.53	c 
1800.15/486.53	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2697871-1278054866/watcher-2697871-1278054866 -o /tmp/evaluation-result-2697871-1278054866/solver-2697871-1278054866 -C 1800 -W 2000 -M 3800 run HOME/instance-2697871-1278054866.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 0.06 0.02 0.00 2/173 25979
/proc/meminfo: memFree=30910604/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0

[startup+0.0219621 s]
/proc/loadavg: 0.06 0.02 0.00 2/173 25979
/proc/meminfo: memFree=30910604/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100968 s]
/proc/loadavg: 0.06 0.02 0.00 2/173 25979
/proc/meminfo: memFree=30910604/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300929 s]
/proc/loadavg: 0.06 0.02 0.00 2/173 25979
/proc/meminfo: memFree=30910604/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700778 s]
/proc/loadavg: 0.06 0.02 0.00 2/173 25979
/proc/meminfo: memFree=30910604/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50066 s]
/proc/loadavg: 0.14 0.03 0.01 3/188 25999
/proc/meminfo: memFree=30873532/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
[pid=25980] ppid=25979 vsize=132864 CPUtime=3.23
/proc/25980/stat : 25980 (pb_cplex) S 25979 25979 25692 0 -1 4202496 15283 0 0 0 317 6 0 0 16 0 8 0 146782115 136052736 9945 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0
/proc/25980/statm: 33216 9945 1069 2985 0 29758 0
Current children cumulated CPU time (s) 3.23
Current children cumulated vsize (KiB) 141564

[startup+3.1004 s]
/proc/loadavg: 0.14 0.03 0.01 5/188 26027
/proc/meminfo: memFree=30831536/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
[pid=25980] ppid=25979 vsize=120860 CPUtime=5.55
/proc/25980/stat : 25980 (pb_cplex) R 25979 25979 25692 0 -1 4202496 20574 0 0 0 547 8 0 0 21 0 8 0 146782115 123760640 8372 4089446400 134512640 146736320 4289238160 18446744073709551615 136007643 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/25980/statm: 30215 8372 1079 2985 0 26757 0
Current children cumulated CPU time (s) 5.55
Current children cumulated vsize (KiB) 129560

[startup+6.30175 s]
/proc/loadavg: 0.14 0.03 0.01 10/195 26069
/proc/meminfo: memFree=30801356/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
[pid=25980] ppid=25979 vsize=141916 CPUtime=17.06
/proc/25980/stat : 25980 (pb_cplex) R 25979 25979 25692 0 -1 4202496 28289 0 0 0 1691 15 0 0 20 0 8 0 146782115 145321984 13224 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/25980/statm: 35479 13224 1081 2985 0 32021 0
[pid=25980/tid=26063] ppid=25979 vsize=141916 CPUtime=1.26
/proc/25980/task/26063/stat : 26063 (pb_cplex) R 25979 25979 25692 0 -1 4202560 368 0 0 0 126 0 0 0 15 0 8 0 146782409 145321984 13224 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=25980/tid=26064] ppid=25979 vsize=141916 CPUtime=1.39
/proc/25980/task/26064/stat : 26064 (pb_cplex) R 25979 25979 25692 0 -1 4202560 786 0 0 0 139 0 0 0 15 0 8 0 146782409 145321984 13224 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=25980/tid=26065] ppid=25979 vsize=141916 CPUtime=1.23
/proc/25980/task/26065/stat : 26065 (pb_cplex) R 25979 25979 25692 0 -1 4202560 1037 0 0 0 123 0 0 0 15 0 8 0 146782409 145321984 13224 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=25980/tid=26066] ppid=25979 vsize=141916 CPUtime=1.09
/proc/25980/task/26066/stat : 26066 (pb_cplex) R 25979 25979 25692 0 -1 4202560 3513 0 0 0 109 0 0 0 15 0 8 0 146782409 145321984 13224 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=25980/tid=26067] ppid=25979 vsize=141916 CPUtime=1.35
/proc/25980/task/26067/stat : 26067 (pb_cplex) R 25979 25979 25692 0 -1 4202560 675 0 0 0 135 0 0 0 15 0 8 0 146782409 145321984 13224 4089446400 134512640 146736320 4289238160 18446744073709551615 137081895 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=25980/tid=26068] ppid=25979 vsize=141916 CPUtime=1.83
/proc/25980/task/26068/stat : 26068 (pb_cplex) R 25979 25979 25692 0 -1 4202560 620 0 0 0 182 1 0 0 15 0 8 0 146782409 145321984 13224 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=25980/tid=26069] ppid=25979 vsize=141916 CPUtime=1.37
/proc/25980/task/26069/stat : 26069 (pb_cplex) S 25979 25979 25692 0 -1 4202560 334 0 0 0 137 0 0 0 16 0 8 0 146782409 145321984 13224 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 17.06
Current children cumulated vsize (KiB) 150616

[startup+12.7056 s]
/proc/loadavg: 1.87 0.41 0.13 9/195 26069
/proc/meminfo: memFree=30793880/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
[pid=25980] ppid=25979 vsize=142940 CPUtime=40.29
/proc/25980/stat : 25980 (pb_cplex) R 25979 25979 25692 0 -1 4202496 37124 0 0 0 3990 39 0 0 15 0 8 0 146782115 146370560 13651 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0
/proc/25980/statm: 35735 13651 1081 2985 0 32277 0
[pid=25980/tid=26063] ppid=25979 vsize=142940 CPUtime=4.1
/proc/25980/task/26063/stat : 26063 (pb_cplex) R 25979 25979 25692 0 -1 4202560 754 0 0 0 407 3 0 0 15 0 8 0 146782409 146370560 13651 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=25980/tid=26064] ppid=25979 vsize=142940 CPUtime=4.21
/proc/25980/task/26064/stat : 26064 (pb_cplex) R 25979 25979 25692 0 -1 4202560 800 0 0 0 418 3 0 0 15 0 8 0 146782409 146370560 13651 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=25980/tid=26065] ppid=25979 vsize=142940 CPUtime=4.14
/proc/25980/task/26065/stat : 26065 (pb_cplex) R 25979 25979 25692 0 -1 4202560 1112 0 0 0 412 2 0 0 15 0 8 0 146782409 146370560 13651 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=25980/tid=26066] ppid=25979 vsize=142940 CPUtime=3.97
/proc/25980/task/26066/stat : 26066 (pb_cplex) S 25979 25979 25692 0 -1 4202560 6113 0 0 0 393 4 0 0 15 0 8 0 146782409 146370560 13651 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 7 0 0 0
[pid=25980/tid=26067] ppid=25979 vsize=142940 CPUtime=4.2
/proc/25980/task/26067/stat : 26067 (pb_cplex) S 25979 25979 25692 0 -1 4202560 1668 0 0 0 416 4 0 0 15 0 8 0 146782409 146370560 13651 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 7 0 0 0
[pid=25980/tid=26068] ppid=25979 vsize=142940 CPUtime=4.75
/proc/25980/task/26068/stat : 26068 (pb_cplex) S 25979 25979 25692 0 -1 4202560 4964 0 0 0 471 4 0 0 15 0 8 0 146782409 146370560 13651 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 7 0 0 0
[pid=25980/tid=26069] ppid=25979 vsize=142940 CPUtime=4.32
/proc/25980/task/26069/stat : 26069 (pb_cplex) S 25979 25979 25692 0 -1 4202560 342 0 0 0 429 3 0 0 15 0 8 0 146782409 146370560 13651 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 40.29
Current children cumulated vsize (KiB) 151640

[startup+25.5012 s]
/proc/loadavg: 2.89 0.67 0.22 3/195 26098
/proc/meminfo: memFree=30769700/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
[pid=25980] ppid=25979 vsize=158660 CPUtime=76.3
/proc/25980/stat : 25980 (pb_cplex) S 25979 25979 25692 0 -1 4202496 62965 0 0 0 7550 80 0 0 19 0 8 0 146782115 162467840 16811 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0
/proc/25980/statm: 39665 16811 1093 2985 0 36207 0
[pid=25980/tid=26091] ppid=25979 vsize=158660 CPUtime=0
/proc/25980/task/26091/stat : 26091 (pb_cplex) S 25979 25979 25692 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 8 0 146784152 162467840 16811 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 5 0 0 0
[pid=25980/tid=26092] ppid=25979 vsize=158660 CPUtime=0.17
/proc/25980/task/26092/stat : 26092 (pb_cplex) S 25979 25979 25692 0 -1 4202560 734 0 0 0 17 0 0 0 18 0 8 0 146784152 162467840 16811 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 4 0 0 0
[pid=25980/tid=26093] ppid=25979 vsize=158660 CPUtime=0.37
/proc/25980/task/26093/stat : 26093 (pb_cplex) S 25979 25979 25692 0 -1 4202560 509 0 0 0 37 0 0 0 18 0 8 0 146784152 162467840 16811 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 3 0 0 0
[pid=25980/tid=26094] ppid=25979 vsize=158660 CPUtime=0.33
/proc/25980/task/26094/stat : 26094 (pb_cplex) S 25979 25979 25692 0 -1 4202560 736 0 0 0 33 0 0 0 18 0 8 0 146784152 162467840 16811 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 7 0 0 0
[pid=25980/tid=26095] ppid=25979 vsize=158660 CPUtime=0.43
/proc/25980/task/26095/stat : 26095 (pb_cplex) S 25979 25979 25692 0 -1 4202560 1234 0 0 0 43 0 0 0 18 0 8 0 146784152 162467840 16811 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 7 0 0 0
[pid=25980/tid=26096] ppid=25979 vsize=158660 CPUtime=2.9
/proc/25980/task/26096/stat : 26096 (pb_cplex) R 25979 25979 25692 0 -1 4202560 45 0 0 0 290 0 0 0 19 0 8 0 146784152 162467840 16811 4089446400 134512640 146736320 4289238160 18446744073709551615 135521474 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=25980/tid=26097] ppid=25979 vsize=158660 CPUtime=0.73
/proc/25980/task/26097/stat : 26097 (pb_cplex) S 25979 25979 25692 0 -1 4202560 1923 0 0 0 73 0 0 0 16 0 8 0 146784152 162467840 16811 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 76.3
Current children cumulated vsize (KiB) 167360

[startup+51.1142 s]
/proc/loadavg: 5.29 1.42 0.48 8/195 26098
/proc/meminfo: memFree=30758584/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
[pid=25980] ppid=25979 vsize=169924 CPUtime=172.6
/proc/25980/stat : 25980 (pb_cplex) S 25979 25979 25692 0 -1 4202496 99319 0 0 0 17095 165 0 0 15 0 8 0 146782115 174002176 19308 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 6 0 0 0
/proc/25980/statm: 42481 19308 1088 2985 0 39023 0
[pid=25980/tid=26091] ppid=25979 vsize=169924 CPUtime=11.92
/proc/25980/task/26091/stat : 26091 (pb_cplex) R 25979 25979 25692 0 -1 4202560 2891 0 0 0 1181 11 0 0 15 0 8 0 146784152 174002176 19308 4089446400 134512640 146736320 4289238160 18446744073709551615 136017740 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=25980/tid=26092] ppid=25979 vsize=169924 CPUtime=12.16
/proc/25980/task/26092/stat : 26092 (pb_cplex) R 25979 25979 25692 0 -1 4202560 5031 0 0 0 1207 9 0 0 15 0 8 0 146784152 174002176 19308 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=25980/tid=26093] ppid=25979 vsize=169924 CPUtime=12.29
/proc/25980/task/26093/stat : 26093 (pb_cplex) R 25979 25979 25692 0 -1 4202560 4250 0 0 0 1220 9 0 0 15 0 8 0 146784152 174002176 19308 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=25980/tid=26094] ppid=25979 vsize=169924 CPUtime=11.98
/proc/25980/task/26094/stat : 26094 (pb_cplex) R 25979 25979 25692 0 -1 4202560 10563 0 0 0 1187 11 0 0 15 0 8 0 146784152 174002176 19308 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=25980/tid=26095] ppid=25979 vsize=169924 CPUtime=12.02
/proc/25980/task/26095/stat : 26095 (pb_cplex) R 25979 25979 25692 0 -1 4202560 8407 0 0 0 1190 12 0 0 15 0 8 0 146784152 174002176 19308 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=25980/tid=26096] ppid=25979 vsize=169924 CPUtime=15.08
/proc/25980/task/26096/stat : 26096 (pb_cplex) R 25979 25979 25692 0 -1 4202560 3590 0 0 0 1499 9 0 0 15 0 8 0 146784152 174002176 19308 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=25980/tid=26097] ppid=25979 vsize=169924 CPUtime=12.66
/proc/25980/task/26097/stat : 26097 (pb_cplex) S 25979 25979 25692 0 -1 4202560 5646 0 0 0 1255 11 0 0 15 0 8 0 146784152 174002176 19308 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 172.6
Current children cumulated vsize (KiB) 178624

[startup+102.316 s]
/proc/loadavg: 7.42 2.68 0.96 8/195 26100
/proc/meminfo: memFree=30758468/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
[pid=25980] ppid=25979 vsize=170948 CPUtime=361.54
/proc/25980/stat : 25980 (pb_cplex) R 25979 25979 25692 0 -1 4202496 116284 0 0 0 35825 329 0 0 15 0 8 0 146782115 175050752 19433 4089446400 134512640 146736320 4289238160 18446744073709551615 136676168 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0
/proc/25980/statm: 42737 19433 1088 2985 0 39279 0
[pid=25980/tid=26091] ppid=25979 vsize=170948 CPUtime=35.24
/proc/25980/task/26091/stat : 26091 (pb_cplex) R 25979 25979 25692 0 -1 4202560 3756 0 0 0 3493 31 0 0 15 0 8 0 146784152 175050752 19433 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=25980/tid=26092] ppid=25979 vsize=170948 CPUtime=35.58
/proc/25980/task/26092/stat : 26092 (pb_cplex) S 25979 25979 25692 0 -1 4202560 8993 0 0 0 3528 30 0 0 15 0 8 0 146784152 175050752 19433 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 3 0 0 0
[pid=25980/tid=26093] ppid=25979 vsize=170948 CPUtime=35.6
/proc/25980/task/26093/stat : 26093 (pb_cplex) S 25979 25979 25692 0 -1 4202560 7653 0 0 0 3535 25 0 0 15 0 8 0 146784152 175050752 19433 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 3 0 0 0
[pid=25980/tid=26094] ppid=25979 vsize=170948 CPUtime=35.1
/proc/25980/task/26094/stat : 26094 (pb_cplex) S 25979 25979 25692 0 -1 4202560 11633 0 0 0 3480 30 0 0 15 0 8 0 146784152 175050752 19433 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 3 0 0 0

################
# More data... #
################

/proc/25980/task/26096/stat : 26096 (pb_cplex) S 25979 25979 25692 0 -1 4202560 5711 0 0 0 6578 56 0 0 15 0 8 0 146784152 176099328 19769 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 6 0 0 0
[pid=25980/tid=26097] ppid=25979 vsize=171972 CPUtime=63.2
/proc/25980/task/26097/stat : 26097 (pb_cplex) R 25979 25979 25692 0 -1 4202560 10331 0 0 0 6266 54 0 0 15 0 8 0 146784152 176099328 19769 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 584.37
Current children cumulated vsize (KiB) 180672

[startup+222.325 s]
/proc/loadavg: 9.08 4.88 1.97 7/195 26102
/proc/meminfo: memFree=30758172/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
[pid=25980] ppid=25979 vsize=169924 CPUtime=808.99
/proc/25980/stat : 25980 (pb_cplex) S 25979 25979 25692 0 -1 4202496 131928 0 0 0 80190 709 0 0 15 0 8 0 146782115 174002176 19324 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/25980/statm: 42481 19324 1088 2985 0 39023 0
[pid=25980/tid=26091] ppid=25979 vsize=169924 CPUtime=90.96
/proc/25980/task/26091/stat : 26091 (pb_cplex) S 25979 25979 25692 0 -1 4202560 6236 0 0 0 9019 77 0 0 15 0 8 0 146784152 174002176 19324 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 4 0 0 0
[pid=25980/tid=26092] ppid=25979 vsize=169924 CPUtime=90.74
/proc/25980/task/26092/stat : 26092 (pb_cplex) R 25979 25979 25692 0 -1 4202560 10047 0 0 0 8998 76 0 0 16 0 8 0 146784152 174002176 19324 4089446400 134512640 146736320 4289238160 18446744073709551615 136403117 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=25980/tid=26093] ppid=25979 vsize=169924 CPUtime=90.76
/proc/25980/task/26093/stat : 26093 (pb_cplex) S 25979 25979 25692 0 -1 4202560 9499 0 0 0 9005 71 0 0 15 0 8 0 146784152 174002176 19324 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 6 0 0 0
[pid=25980/tid=26094] ppid=25979 vsize=169924 CPUtime=90.58
/proc/25980/task/26094/stat : 26094 (pb_cplex) S 25979 25979 25692 0 -1 4202560 13098 0 0 0 8983 75 0 0 15 0 8 0 146784152 174002176 19324 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 5 0 0 0
[pid=25980/tid=26095] ppid=25979 vsize=169924 CPUtime=90.78
/proc/25980/task/26095/stat : 26095 (pb_cplex) S 25979 25979 25692 0 -1 4202560 11397 0 0 0 8994 84 0 0 15 0 8 0 146784152 174002176 19324 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 3 0 0 0
[pid=25980/tid=26096] ppid=25979 vsize=169924 CPUtime=93.82
/proc/25980/task/26096/stat : 26096 (pb_cplex) S 25979 25979 25692 0 -1 4202560 6291 0 0 0 9299 83 0 0 15 0 8 0 146784152 174002176 19324 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 1 0 0 0
[pid=25980/tid=26097] ppid=25979 vsize=169924 CPUtime=91.17
/proc/25980/task/26097/stat : 26097 (pb_cplex) S 25979 25979 25692 0 -1 4202560 11108 0 0 0 9038 79 0 0 15 0 8 0 146784152 174002176 19324 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 808.99
Current children cumulated vsize (KiB) 178624

[startup+282.324 s]
/proc/loadavg: 9.23 5.69 2.43 11/195 26104
/proc/meminfo: memFree=30758128/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
[pid=25980] ppid=25979 vsize=168900 CPUtime=1035.16
/proc/25980/stat : 25980 (pb_cplex) R 25979 25979 25692 0 -1 4202496 147807 0 0 0 102613 903 0 0 15 0 8 0 146782115 172953600 19201 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0
/proc/25980/statm: 42225 19201 1106 2985 0 38767 0
[pid=25980/tid=26091] ppid=25979 vsize=168900 CPUtime=119.06
/proc/25980/task/26091/stat : 26091 (pb_cplex) R 25979 25979 25692 0 -1 4202560 7291 0 0 0 11807 99 0 0 15 0 8 0 146784152 172953600 19201 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=25980/tid=26092] ppid=25979 vsize=168900 CPUtime=118.74
/proc/25980/task/26092/stat : 26092 (pb_cplex) R 25979 25979 25692 0 -1 4202560 11023 0 0 0 11774 100 0 0 15 0 8 0 146784152 172953600 19201 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=25980/tid=26093] ppid=25979 vsize=168900 CPUtime=118.85
/proc/25980/task/26093/stat : 26093 (pb_cplex) S 25979 25979 25692 0 -1 4202560 12265 0 0 0 11791 94 0 0 15 0 8 0 146784152 172953600 19201 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 7 0 0 0
[pid=25980/tid=26094] ppid=25979 vsize=168900 CPUtime=118.7
/proc/25980/task/26094/stat : 26094 (pb_cplex) R 25979 25979 25692 0 -1 4202560 15903 0 0 0 11771 99 0 0 15 0 8 0 146784152 172953600 19201 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=25980/tid=26095] ppid=25979 vsize=168900 CPUtime=118.72
/proc/25980/task/26095/stat : 26095 (pb_cplex) R 25979 25979 25692 0 -1 4202560 14753 0 0 0 11765 107 0 0 15 0 8 0 146784152 172953600 19201 4089446400 134512640 146736320 4289238160 18446744073709551615 136384857 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=25980/tid=26096] ppid=25979 vsize=168900 CPUtime=121.89
/proc/25980/task/26096/stat : 26096 (pb_cplex) R 25979 25979 25692 0 -1 4202560 8196 0 0 0 12081 108 0 0 15 0 8 0 146784152 172953600 19201 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=25980/tid=26097] ppid=25979 vsize=168900 CPUtime=119.02
/proc/25980/task/26097/stat : 26097 (pb_cplex) R 25979 25979 25692 0 -1 4202560 12152 0 0 0 11798 104 0 0 15 0 8 0 146784152 172953600 19201 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1035.16
Current children cumulated vsize (KiB) 177600

[startup+342.301 s]
/proc/loadavg: 8.92 6.23 2.82 10/195 26106
/proc/meminfo: memFree=30759524/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
[pid=25980] ppid=25979 vsize=166852 CPUtime=1259.12
/proc/25980/stat : 25980 (pb_cplex) R 25979 25979 25692 0 -1 4202496 166238 0 0 0 124816 1096 0 0 16 0 8 0 146782115 170856448 18811 4089446400 134512640 146736320 4289238160 18446744073709551615 136017489 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/25980/statm: 41713 18811 1106 2985 0 38255 0
[pid=25980/tid=26091] ppid=25979 vsize=166852 CPUtime=146.93
/proc/25980/task/26091/stat : 26091 (pb_cplex) S 25979 25979 25692 0 -1 4202560 9157 0 0 0 14572 121 0 0 15 0 8 0 146784152 170856448 18811 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 0 0 0 0
[pid=25980/tid=26092] ppid=25979 vsize=166852 CPUtime=146.21
/proc/25980/task/26092/stat : 26092 (pb_cplex) S 25979 25979 25692 0 -1 4202560 13989 0 0 0 14496 125 0 0 15 0 8 0 146784152 170856448 18811 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 5 0 0 0
[pid=25980/tid=26093] ppid=25979 vsize=166852 CPUtime=146.35
/proc/25980/task/26093/stat : 26093 (pb_cplex) R 25979 25979 25692 0 -1 4202560 14338 0 0 0 14518 117 0 0 16 0 8 0 146784152 170856448 18811 4089446400 134512640 146736320 4289238160 18446744073709551615 136017757 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=25980/tid=26094] ppid=25979 vsize=166852 CPUtime=146.67
/proc/25980/task/26094/stat : 26094 (pb_cplex) S 25979 25979 25692 0 -1 4202560 18199 0 0 0 14545 122 0 0 15 0 8 0 146784152 170856448 18811 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 3 0 0 0
[pid=25980/tid=26095] ppid=25979 vsize=166852 CPUtime=146.33
/proc/25980/task/26095/stat : 26095 (pb_cplex) R 25979 25979 25692 0 -1 4202560 17168 0 0 0 14500 133 0 0 15 0 8 0 146784152 170856448 18811 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=25980/tid=26096] ppid=25979 vsize=166852 CPUtime=149.58
/proc/25980/task/26096/stat : 26096 (pb_cplex) S 25979 25979 25692 0 -1 4202560 10414 0 0 0 14823 135 0 0 15 0 8 0 146784152 170856448 18811 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 1 0 0 0
[pid=25980/tid=26097] ppid=25979 vsize=166852 CPUtime=146.76
/proc/25980/task/26097/stat : 26097 (pb_cplex) S 25979 25979 25692 0 -1 4202560 13442 0 0 0 14547 129 0 0 15 0 8 0 146784152 170856448 18811 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 1259.12
Current children cumulated vsize (KiB) 175552

[startup+402.301 s]
/proc/loadavg: 9.13 6.80 3.23 10/195 26108
/proc/meminfo: memFree=30758716/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
[pid=25980] ppid=25979 vsize=167876 CPUtime=1483.51
/proc/25980/stat : 25980 (pb_cplex) R 25979 25979 25692 0 -1 4202496 181279 0 0 0 147056 1295 0 0 16 0 8 0 146782115 171905024 19209 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/25980/statm: 41969 19209 1106 2985 0 38511 0
[pid=25980/tid=26091] ppid=25979 vsize=167876 CPUtime=174.64
/proc/25980/task/26091/stat : 26091 (pb_cplex) R 25979 25979 25692 0 -1 4202560 11894 0 0 0 17318 146 0 0 15 0 8 0 146784152 171905024 19209 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=25980/tid=26092] ppid=25979 vsize=167876 CPUtime=173.85
/proc/25980/task/26092/stat : 26092 (pb_cplex) R 25979 25979 25692 0 -1 4202560 14344 0 0 0 17236 149 0 0 15 0 8 0 146784152 171905024 19209 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=25980/tid=26093] ppid=25979 vsize=167876 CPUtime=173.93
/proc/25980/task/26093/stat : 26093 (pb_cplex) R 25979 25979 25692 0 -1 4202560 16653 0 0 0 17254 139 0 0 15 0 8 0 146784152 171905024 19209 4089446400 134512640 146736320 4289238160 18446744073709551615 139044581 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=25980/tid=26094] ppid=25979 vsize=167876 CPUtime=174.69
/proc/25980/task/26094/stat : 26094 (pb_cplex) R 25979 25979 25692 0 -1 4202560 19342 0 0 0 17322 147 0 0 15 0 8 0 146784152 171905024 19209 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=25980/tid=26095] ppid=25979 vsize=167876 CPUtime=174.27
/proc/25980/task/26095/stat : 26095 (pb_cplex) R 25979 25979 25692 0 -1 4202560 20333 0 0 0 17267 160 0 0 15 0 8 0 146784152 171905024 19209 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=25980/tid=26096] ppid=25979 vsize=167876 CPUtime=176.94
/proc/25980/task/26096/stat : 26096 (pb_cplex) R 25979 25979 25692 0 -1 4202560 11516 0 0 0 17533 161 0 0 15 0 8 0 146784152 171905024 19209 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=25980/tid=26097] ppid=25979 vsize=167876 CPUtime=174.72
/proc/25980/task/26097/stat : 26097 (pb_cplex) R 25979 25979 25692 0 -1 4202560 15292 0 0 0 17315 157 0 0 15 0 8 0 146784152 171905024 19209 4089446400 134512640 146736320 4289238160 18446744073709551615 136015727 0 2 4096 16387 0 0 0 -1 2 0 0 0
Current children cumulated CPU time (s) 1483.51
Current children cumulated vsize (KiB) 176576

[startup+462.301 s]
/proc/loadavg: 9.09 7.19 3.58 9/195 26109
/proc/meminfo: memFree=30758764/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
[pid=25980] ppid=25979 vsize=167876 CPUtime=1709.47
/proc/25980/stat : 25980 (pb_cplex) R 25979 25979 25692 0 -1 4202496 185470 0 0 0 169455 1492 0 0 16 0 8 0 146782115 171905024 19276 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/25980/statm: 41969 19276 1106 2985 0 38511 0
[pid=25980/tid=26091] ppid=25979 vsize=167876 CPUtime=202.98
/proc/25980/task/26091/stat : 26091 (pb_cplex) R 25979 25979 25692 0 -1 4202560 12403 0 0 0 20127 171 0 0 15 0 8 0 146784152 171905024 19276 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=25980/tid=26092] ppid=25979 vsize=167876 CPUtime=201.84
/proc/25980/task/26092/stat : 26092 (pb_cplex) R 25979 25979 25692 0 -1 4202560 14848 0 0 0 20012 172 0 0 15 0 8 0 146784152 171905024 19276 4089446400 134512640 146736320 4289238160 18446744073709551615 136017854 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=25980/tid=26093] ppid=25979 vsize=167876 CPUtime=201.79
/proc/25980/task/26093/stat : 26093 (pb_cplex) R 25979 25979 25692 0 -1 4202560 17556 0 0 0 20014 165 0 0 15 0 8 0 146784152 171905024 19276 4089446400 134512640 146736320 4289238160 18446744073709551615 136017757 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=25980/tid=26094] ppid=25979 vsize=167876 CPUtime=202.66
/proc/25980/task/26094/stat : 26094 (pb_cplex) R 25979 25979 25692 0 -1 4202560 19655 0 0 0 20096 170 0 0 15 0 8 0 146784152 171905024 19276 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=25980/tid=26095] ppid=25979 vsize=167876 CPUtime=202.08
/proc/25980/task/26095/stat : 26095 (pb_cplex) S 25979 25979 25692 0 -1 4202560 21187 0 0 0 20026 182 0 0 15 0 8 0 146784152 171905024 19276 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 7 0 0 0
[pid=25980/tid=26096] ppid=25979 vsize=167876 CPUtime=204.85
/proc/25980/task/26096/stat : 26096 (pb_cplex) S 25979 25979 25692 0 -1 4202560 11960 0 0 0 20299 186 0 0 15 0 8 0 146784152 171905024 19276 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 1 0 0 0
[pid=25980/tid=26097] ppid=25979 vsize=167876 CPUtime=202.7
/proc/25980/task/26097/stat : 26097 (pb_cplex) S 25979 25979 25692 0 -1 4202560 15597 0 0 0 20088 182 0 0 15 0 8 0 146784152 171905024 19276 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1709.47
Current children cumulated vsize (KiB) 176576



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+486.509 s]
/proc/loadavg: 8.63 7.24 3.69 8/195 26110
/proc/meminfo: memFree=30758568/32951124 swapFree=67111528/67111528
[pid=25979] ppid=25977 vsize=8700 CPUtime=0
/proc/25979/stat : 25979 (run) S 25977 25979 25692 0 -1 4202496 365 0 0 0 0 0 0 0 23 0 1 0 146782115 8908800 249 4089446400 4194304 4922060 140736253916368 18446744073709551615 212687494277 0 65536 4100 65538 18446744071562232103 0 0 17 3 0 0 0
/proc/25979/statm: 2175 249 208 178 0 68 0
[pid=25980] ppid=25979 vsize=167876 CPUtime=1800.15
/proc/25980/stat : 25980 (pb_cplex) S 25979 25979 25692 0 -1 4202496 186492 0 0 0 178436 1579 0 0 16 0 8 0 146782115 171905024 19279 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/25980/statm: 41969 19279 1106 2985 0 38511 0
[pid=25980/tid=26091] ppid=25979 vsize=167876 CPUtime=214.29
/proc/25980/task/26091/stat : 26091 (pb_cplex) S 25979 25979 25692 0 -1 4202560 12642 0 0 0 21247 182 0 0 15 0 8 0 146784152 171905024 19279 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 5 0 0 0
[pid=25980/tid=26092] ppid=25979 vsize=167876 CPUtime=213.03
/proc/25980/task/26092/stat : 26092 (pb_cplex) S 25979 25979 25692 0 -1 4202560 14897 0 0 0 21119 184 0 0 15 0 8 0 146784152 171905024 19279 4089446400 134512640 146736320 4289238160 18446744073709551615 144580073 0 2 4096 16387 18446604471165518272 0 0 -1 3 0 0 0
[pid=25980/tid=26093] ppid=25979 vsize=167876 CPUtime=213.03
/proc/25980/task/26093/stat : 26093 (pb_cplex) R 25979 25979 25692 0 -1 4202560 17592 0 0 0 21126 177 0 0 15 0 8 0 146784152 171905024 19279 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=25980/tid=26094] ppid=25979 vsize=167876 CPUtime=213.84
/proc/25980/task/26094/stat : 26094 (pb_cplex) R 25979 25979 25692 0 -1 4202560 19922 0 0 0 21203 181 0 0 15 0 8 0 146784152 171905024 19279 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=25980/tid=26095] ppid=25979 vsize=167876 CPUtime=213.26
/proc/25980/task/26095/stat : 26095 (pb_cplex) R 25979 25979 25692 0 -1 4202560 21316 0 0 0 21135 191 0 0 15 0 8 0 146784152 171905024 19279 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=25980/tid=26096] ppid=25979 vsize=167876 CPUtime=216.02
/proc/25980/task/26096/stat : 26096 (pb_cplex) R 25979 25979 25692 0 -1 4202560 11994 0 0 0 21407 195 0 0 15 0 8 0 146784152 171905024 19279 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=25980/tid=26097] ppid=25979 vsize=167876 CPUtime=213.92
/proc/25980/task/26097/stat : 26097 (pb_cplex) R 25979 25979 25692 0 -1 4202560 15823 0 0 0 21198 194 0 0 15 0 8 0 146784152 171905024 19279 4089446400 134512640 146736320 4289238160 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1800.15
Current children cumulated vsize (KiB) 176576

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child status: 0
Real time (s): 486.537
CPU time (s): 1800.25
CPU user time (s): 1784.45
CPU system time (s): 15.8046
CPU usage (%): 370.013
Max. virtual memory (cumulated for all children) (KiB): 182720

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1784.45
system time used= 15.8046
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 186864
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 345291
involuntary context switches= 28748

runsolver used 0.966853 second user time and 1.9567 second system time

The end

Launcher Data 

Begin job on node139 at 2010-07-02 09:14:26
IDJOB=2697871
IDBENCH=78923
IDSOLVER=1210
FILE ID=node139/2697871-1278054866
PBS_JOBID= 11198904
Free space on /tmp= 74156 MiB

SOLVER NAME= pb_cplex 2010-07-01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900577940--soft-33-100-0.wbo
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2697871-1278054866/watcher-2697871-1278054866 -o /tmp/evaluation-result-2697871-1278054866/solver-2697871-1278054866 -C 1800 -W 2000 -M 3800  run HOME/instance-2697871-1278054866.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 426e5957e411ffe2f76bd332943fd07d
RANDOM SEED=203732205

node139.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.78
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.840
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30911132 kB
Buffers:        225192 kB
Cached:        1602132 kB
SwapCached:          0 kB
Active:         822972 kB
Inactive:      1066752 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30911132 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           16984 kB
Writeback:           0 kB
AnonPages:       62336 kB
Mapped:          14428 kB
Slab:            87096 kB
PageTables:       4492 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   181536 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74124 MiB
End job on node139 at 2010-07-02 09:22:33