Trace number 2697961

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
pb_cplex 2010-07-01OPTIMUM 640.218 169.849

General information on the benchmark

Name/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/
normalized-t3002.11tsp11.1900570242--soft-66-100-0.wbo
MD5SUM404f4a35cd4ec5708f20e119eb7d26f2
Bench CategoryPARTIAL-SMALLINT-LIN (both soft and hard constraints, small integers, linear constraints)
Best result obtained on this benchmarkMOPT
Best cost obtained on this benchmark16
Best CPU time to get the best result obtained on this benchmark640.218
Max-Satisfiable
Max-(Un)Satisfiability was proved
Best value of the cost
Optimality of the best cost was proved
Number of variables231
Total number of constraints2707
Number of soft constraints899
Number of constraints which are clauses2684
Number of constraints which are cardinality constraints (but not clauses)22
Number of constraints which are nor clauses,nor cardinality constraints1
Minimum length of a constraint2
Maximum length of a constraint110
Top cost 46330
Min constraint cost 1
Max constraint cost 100
Sum of constraints costs 46329
Biggest number in a constraint 25
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 749
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing wbo file format. File HOME/instance-2697961-1278055086.wbo.
0.00/0.00	c Instance file HOME/instance-2697961-1278055086.wbo
0.00/0.00	c File size is 87876 bytes.
0.00/0.43	c Highest Coefficient sum: 749
0.00/0.43	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.43	c ============================[ Problem Statistics ]=============================
0.00/0.43	c |                                                                             |
0.00/0.43	c |  Parsing time:          0.18         s                                      |
0.00/0.43	c |  Number Variables:      1130                                                |
0.00/0.43	c |  Number Constraints:    2708                                                |
0.00/0.43	c ===============================================================================
640.15/169.84	c Remaining time 1799.82 sec.
640.15/169.84	s OPTIMUM FOUND
640.15/169.84	c Solution value = 16.00
640.15/169.84	v -x1 -x2 -x3 -x4 -x5 x6 x7 -x8 -x9 -x10 -x11 -x12 -x13 -x14 -x15 -x16 -x17 -x18 -x19 -x20 -x21 -x22 -x23 x24 -x25 -x26 -x27 -x28 -x29 -x30 -x31 -x32 -x33 -x34 -x35 -x36 -x37 x38 -x39 -x40 -x41 -x42 -x43 -x44 -x45 -x46 -x47 -x48 -x49 -x50 -x51 -x52 -x53 -x54 x55 -x56 -x57 -x58 -x59 -x60 -x61 -x62 -x63 x64 -x65 -x66 -x67 -x68 -x69 -x70 -x71 -x72 x73 -x74 -x75 -x76 -x77 x78 -x79 -x80 -x81 -x82 -x83 -x84 -x85 -x86 -x87 -x88 -x89 -x90 -x91 -x92 -x93 -x94 -x95 -x96 -x97 x98 -x99 -x100 -x101 -x102 -x103 -x104 x105 -x106 -x107 -x108 -x109 -x110 -x111 -x112 -x113 -x114 -x115 -x116 -x117 x118 -x119 -x120 -x121 -x122 -x123 -x124 -x125 -x126 -x127 -x128 -x129 -x130 -x131 -x132 x133 -x134 -x135 -x136 -x137 -x138 -x139 -x140 -x141 -x142 -x143 x144 -x145 -x146 -x147 -x148 -x149 -x150 -x151 -x152 -x153 -x154 -x155 -x156 -x157 x158 -x159 -x160 -x161 -x162 x163 -x164 -x165 -x166 -x167 -x168 -x169 -x170 -x171 -x172 -x173 -x174 -x175 -x176 -x177 -x178 -x179 x180 -x181 -x182 -x183 -x184 -x185 -x186 -x187 -x188 -x189 -x190 -x191 -x192 -x193 -x194 -x195 -x196 x197 -x198 -x199 -x200 -x201 -x202 -x203 -x204 -x205 -x206 -x207 -x208 -x209 -x210 -x211 x212 -x213 -x214 -x215 -x216 -x217 -x218 -x219 -x220 -x221 -x222 -x223 -x224 -x225 x226 -x227 -x228 -x229 -x230 -x231
640.15/169.84	c Total CPU time              : 634.927 s

Verifier Data 

OK	16

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2697961-1278055086/watcher-2697961-1278055086 -o /tmp/evaluation-result-2697961-1278055086/solver-2697961-1278055086 -C 1800 -W 2000 -M 3800 run HOME/instance-2697961-1278055086.wbo 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 3891200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 3942400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 9.26 4.77 1.92 6/186 24283
/proc/meminfo: memFree=30951636/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0

[startup+0.110807 s]
/proc/loadavg: 9.26 4.77 1.92 6/186 24283
/proc/meminfo: memFree=30951636/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.200357 s]
/proc/loadavg: 9.26 4.77 1.92 6/186 24283
/proc/meminfo: memFree=30951636/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.323335 s]
/proc/loadavg: 9.26 4.77 1.92 6/186 24283
/proc/meminfo: memFree=30951636/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.700263 s]
/proc/loadavg: 9.26 4.77 1.92 6/186 24283
/proc/meminfo: memFree=30951636/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.52211 s]
/proc/loadavg: 9.26 4.77 1.92 10/195 24299
/proc/meminfo: memFree=30919820/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
[pid=24284] ppid=24283 vsize=126088 CPUtime=2.43
/proc/24284/stat : 24284 (pb_cplex) S 24283 24283 23735 0 -1 4202496 15103 0 0 0 240 3 0 0 16 0 8 0 146803804 129114112 9553 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 3 0 0 0
/proc/24284/statm: 31522 9553 1074 2985 0 28064 0
[pid=24284/tid=24293] ppid=24283 vsize=126088 CPUtime=0.26
/proc/24284/task/24293/stat : 24293 (pb_cplex) R 24283 24283 23735 0 -1 4202560 566 0 0 0 26 0 0 0 15 0 8 0 146803887 129114112 9553 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=24284/tid=24294] ppid=24283 vsize=126088 CPUtime=0.19
/proc/24284/task/24294/stat : 24294 (pb_cplex) S 24283 24283 23735 0 -1 4202560 542 0 0 0 19 0 0 0 17 0 8 0 146803887 129114112 9553 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 0 0 0 0
[pid=24284/tid=24295] ppid=24283 vsize=126088 CPUtime=0.26
/proc/24284/task/24295/stat : 24295 (pb_cplex) S 24283 24283 23735 0 -1 4202560 671 0 0 0 26 0 0 0 17 0 8 0 146803887 129114112 9553 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 7 0 0 0
[pid=24284/tid=24296] ppid=24283 vsize=126088 CPUtime=0.23
/proc/24284/task/24296/stat : 24296 (pb_cplex) S 24283 24283 23735 0 -1 4202560 711 0 0 0 23 0 0 0 17 0 8 0 146803887 129114112 9553 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 5 0 0 0
[pid=24284/tid=24297] ppid=24283 vsize=126088 CPUtime=0.19
/proc/24284/task/24297/stat : 24297 (pb_cplex) S 24283 24283 23735 0 -1 4202560 526 0 0 0 19 0 0 0 16 0 8 0 146803887 129114112 9553 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 1 0 0 0
[pid=24284/tid=24298] ppid=24283 vsize=126088 CPUtime=0.22
/proc/24284/task/24298/stat : 24298 (pb_cplex) S 24283 24283 23735 0 -1 4202560 643 0 0 0 22 0 0 0 15 0 8 0 146803887 129114112 9553 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 6 0 0 0
[pid=24284/tid=24299] ppid=24283 vsize=126088 CPUtime=0.2
/proc/24284/task/24299/stat : 24299 (pb_cplex) S 24283 24283 23735 0 -1 4202560 611 0 0 0 20 0 0 0 16 0 8 0 146803887 129114112 9553 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.43
Current children cumulated vsize (KiB) 134788

[startup+3.10089 s]
/proc/loadavg: 9.26 4.77 1.92 3/188 24299
/proc/meminfo: memFree=30920868/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
[pid=24284] ppid=24283 vsize=132876 CPUtime=4.3
/proc/24284/stat : 24284 (pb_cplex) R 24283 24283 23735 0 -1 4202496 21269 0 0 0 423 7 0 0 18 0 8 0 146803804 136065024 10982 4089446400 134512640 146736320 4287811904 18446744073709551615 136403109 0 0 4096 16387 18446744073709551615 0 0 17 2 0 0 0
/proc/24284/statm: 33219 10982 1081 2985 0 29761 0
Current children cumulated CPU time (s) 4.3
Current children cumulated vsize (KiB) 141576

[startup+6.34819 s]
/proc/loadavg: 9.24 4.84 1.95 11/195 24327
/proc/meminfo: memFree=30901468/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
[pid=24284] ppid=24283 vsize=139020 CPUtime=10.17
/proc/24284/stat : 24284 (pb_cplex) R 24283 24283 23735 0 -1 4202496 26413 0 0 0 1007 10 0 0 16 0 8 0 146803804 142356480 12676 4089446400 134512640 146736320 4287811904 18446744073709551615 136403112 0 0 4096 16387 18446744073709551615 0 0 17 5 0 0 0
/proc/24284/statm: 34755 12676 1081 2985 0 31297 0
[pid=24284/tid=24321] ppid=24283 vsize=139020 CPUtime=0.73
/proc/24284/task/24321/stat : 24321 (pb_cplex) R 24283 24283 23735 0 -1 4202560 714 0 0 0 73 0 0 0 16 0 8 0 146804066 142356480 12676 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=24284/tid=24322] ppid=24283 vsize=139020 CPUtime=0.51
/proc/24284/task/24322/stat : 24322 (pb_cplex) R 24283 24283 23735 0 -1 4202560 1381 0 0 0 51 0 0 0 16 0 8 0 146804066 142356480 12676 4089446400 134512640 146736320 4287811904 18446744073709551615 136000488 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=24284/tid=24323] ppid=24283 vsize=139020 CPUtime=0.91
/proc/24284/task/24323/stat : 24323 (pb_cplex) R 24283 24283 23735 0 -1 4202560 51 0 0 0 91 0 0 0 18 0 8 0 146804066 142356480 12676 4089446400 134512640 146736320 4287811904 18446744073709551615 137059708 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=24284/tid=24324] ppid=24283 vsize=139020 CPUtime=0.7
/proc/24284/task/24324/stat : 24324 (pb_cplex) R 24283 24283 23735 0 -1 4202560 575 0 0 0 70 0 0 0 18 0 8 0 146804066 142356480 12676 4089446400 134512640 146736320 4287811904 18446744073709551615 139042981 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=24284/tid=24325] ppid=24283 vsize=139020 CPUtime=0.63
/proc/24284/task/24325/stat : 24325 (pb_cplex) R 24283 24283 23735 0 -1 4202560 598 0 0 0 63 0 0 0 18 0 8 0 146804066 142356480 12676 4089446400 134512640 146736320 4287811904 18446744073709551615 136388598 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=24284/tid=24326] ppid=24283 vsize=139020 CPUtime=0.45
/proc/24284/task/24326/stat : 24326 (pb_cplex) R 24283 24283 23735 0 -1 4202560 39 0 0 0 45 0 0 0 16 0 8 0 146804066 142356480 12676 4089446400 134512640 146736320 4287811904 18446744073709551615 136475868 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=24284/tid=24327] ppid=24283 vsize=139020 CPUtime=0.46
/proc/24284/task/24327/stat : 24327 (pb_cplex) R 24283 24283 23735 0 -1 4202560 83 0 0 0 46 0 0 0 16 0 8 0 146804066 142356480 12676 4089446400 134512640 146736320 4287811904 18446744073709551615 136382023 0 2 4096 16387 0 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 10.17
Current children cumulated vsize (KiB) 147720

[startup+12.7113 s]
/proc/loadavg: 9.22 4.91 1.99 8/195 24327
/proc/meminfo: memFree=30897012/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
[pid=24284] ppid=24283 vsize=145164 CPUtime=34.73
/proc/24284/stat : 24284 (pb_cplex) R 24283 24283 23735 0 -1 4202496 33546 0 0 0 3438 35 0 0 15 0 8 0 146803804 148647936 13964 4089446400 134512640 146736320 4287811904 18446744073709551615 136674344 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/24284/statm: 36291 13964 1081 2985 0 32833 0
[pid=24284/tid=24321] ppid=24283 vsize=145164 CPUtime=3.75
/proc/24284/task/24321/stat : 24321 (pb_cplex) R 24283 24283 23735 0 -1 4202560 1953 0 0 0 372 3 0 0 15 0 8 0 146804066 148647936 13964 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=24284/tid=24322] ppid=24283 vsize=145164 CPUtime=3.6
/proc/24284/task/24322/stat : 24322 (pb_cplex) S 24283 24283 23735 0 -1 4202560 4972 0 0 0 356 4 0 0 15 0 8 0 146804066 148647936 13964 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 1 0 0 0
[pid=24284/tid=24323] ppid=24283 vsize=145164 CPUtime=4.03
/proc/24284/task/24323/stat : 24323 (pb_cplex) S 24283 24283 23735 0 -1 4202560 540 0 0 0 401 2 0 0 15 0 8 0 146804066 148647936 13964 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 1 0 0 0
[pid=24284/tid=24324] ppid=24283 vsize=145164 CPUtime=3.66
/proc/24284/task/24324/stat : 24324 (pb_cplex) S 24283 24283 23735 0 -1 4202560 789 0 0 0 363 3 0 0 15 0 8 0 146804066 148647936 13964 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 4 0 0 0
[pid=24284/tid=24325] ppid=24283 vsize=145164 CPUtime=3.66
/proc/24284/task/24325/stat : 24325 (pb_cplex) S 24283 24283 23735 0 -1 4202560 1044 0 0 0 363 3 0 0 15 0 8 0 146804066 148647936 13964 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 4 0 0 0
[pid=24284/tid=24326] ppid=24283 vsize=145164 CPUtime=3.46
/proc/24284/task/24326/stat : 24326 (pb_cplex) S 24283 24283 23735 0 -1 4202560 370 0 0 0 342 4 0 0 15 0 8 0 146804066 148647936 13964 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 4 0 0 0
[pid=24284/tid=24327] ppid=24283 vsize=145164 CPUtime=3.55
/proc/24284/task/24327/stat : 24327 (pb_cplex) S 24283 24283 23735 0 -1 4202560 172 0 0 0 352 3 0 0 15 0 8 0 146804066 148647936 13964 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 4 0 0 0
Current children cumulated CPU time (s) 34.73
Current children cumulated vsize (KiB) 153864

[startup+25.5006 s]
/proc/loadavg: 10.15 5.33 2.17 12/195 24327
/proc/meminfo: memFree=30880272/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
[pid=24284] ppid=24283 vsize=161892 CPUtime=68.34
/proc/24284/stat : 24284 (pb_cplex) R 24283 24283 23735 0 -1 4202496 47109 0 0 0 6772 62 0 0 18 0 8 0 146803804 165777408 17768 4089446400 134512640 146736320 4287811904 18446744073709551615 136403109 0 0 4096 16387 18446744073709551615 0 0 17 7 0 0 0
/proc/24284/statm: 40473 17768 1089 2985 0 37015 0
[pid=24284/tid=24321] ppid=24283 vsize=161892 CPUtime=7.66
/proc/24284/task/24321/stat : 24321 (pb_cplex) R 24283 24283 23735 0 -1 4202560 2993 0 0 0 761 5 0 0 18 0 8 0 146804066 165777408 17768 4089446400 134512640 146736320 4287811904 18446744073709551615 135846771 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=24284/tid=24322] ppid=24283 vsize=161892 CPUtime=7.88
/proc/24284/task/24322/stat : 24322 (pb_cplex) R 24283 24283 23735 0 -1 4202560 5914 0 0 0 781 7 0 0 18 0 8 0 146804066 165777408 17768 4089446400 134512640 146736320 4287811904 18446744073709551615 137118666 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=24284/tid=24323] ppid=24283 vsize=161892 CPUtime=8.27
/proc/24284/task/24323/stat : 24323 (pb_cplex) R 24283 24283 23735 0 -1 4202560 2703 0 0 0 820 7 0 0 18 0 8 0 146804066 165777408 17768 4089446400 134512640 146736320 4287811904 18446744073709551615 136002911 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=24284/tid=24324] ppid=24283 vsize=161892 CPUtime=7.72
/proc/24284/task/24324/stat : 24324 (pb_cplex) R 24283 24283 23735 0 -1 4202560 2986 0 0 0 766 6 0 0 18 0 8 0 146804066 165777408 17768 4089446400 134512640 146736320 4287811904 18446744073709551615 137361156 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=24284/tid=24325] ppid=24283 vsize=161892 CPUtime=8.02
/proc/24284/task/24325/stat : 24325 (pb_cplex) R 24283 24283 23735 0 -1 4202560 3535 0 0 0 794 8 0 0 18 0 8 0 146804066 165777408 17768 4089446400 134512640 146736320 4287811904 18446744073709551615 139044557 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=24284/tid=24326] ppid=24283 vsize=161892 CPUtime=7.6
/proc/24284/task/24326/stat : 24326 (pb_cplex) R 24283 24283 23735 0 -1 4202560 2164 0 0 0 753 7 0 0 18 0 8 0 146804066 165777408 17768 4089446400 134512640 146736320 4287811904 18446744073709551615 139042881 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=24284/tid=24327] ppid=24283 vsize=161892 CPUtime=7.87
/proc/24284/task/24327/stat : 24327 (pb_cplex) R 24283 24283 23735 0 -1 4202560 1618 0 0 0 781 6 0 0 18 0 8 0 146804066 165777408 17768 4089446400 134512640 146736320 4287811904 18446744073709551615 136388065 0 2 4096 16387 0 0 0 -1 3 0 0 0
Current children cumulated CPU time (s) 68.34
Current children cumulated vsize (KiB) 170592

[startup+51.1107 s]
/proc/loadavg: 9.71 5.64 2.36 6/195 24355
/proc/meminfo: memFree=30879220/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
[pid=24284] ppid=24283 vsize=154708 CPUtime=125.02
/proc/24284/stat : 24284 (pb_cplex) S 24283 24283 23735 0 -1 4202496 70282 0 0 0 12397 105 0 0 15 0 8 0 146803804 158420992 15963 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24284/statm: 38677 15963 1089 2985 0 35219 0
[pid=24284/tid=24349] ppid=24283 vsize=154708 CPUtime=0.62
/proc/24284/task/24349/stat : 24349 (pb_cplex) R 24283 24283 23735 0 -1 4202560 451 0 0 0 62 0 0 0 15 0 8 0 146808460 158420992 15963 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=24284/tid=24350] ppid=24283 vsize=154708 CPUtime=1.46
/proc/24284/task/24350/stat : 24350 (pb_cplex) S 24283 24283 23735 0 -1 4202560 963 0 0 0 146 0 0 0 19 0 8 0 146808460 158420992 15963 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 5 0 0 0
[pid=24284/tid=24351] ppid=24283 vsize=154708 CPUtime=0.66
/proc/24284/task/24351/stat : 24351 (pb_cplex) S 24283 24283 23735 0 -1 4202560 1595 0 0 0 66 0 0 0 15 0 8 0 146808460 158420992 15963 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 5 0 0 0
[pid=24284/tid=24352] ppid=24283 vsize=154708 CPUtime=0.47
/proc/24284/task/24352/stat : 24352 (pb_cplex) S 24283 24283 23735 0 -1 4202560 333 0 0 0 47 0 0 0 15 0 8 0 146808460 158420992 15963 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 5 0 0 0
[pid=24284/tid=24353] ppid=24283 vsize=154708 CPUtime=0.75
/proc/24284/task/24353/stat : 24353 (pb_cplex) S 24283 24283 23735 0 -1 4202560 429 0 0 0 75 0 0 0 15 0 8 0 146808460 158420992 15963 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 0 0 0 0
[pid=24284/tid=24354] ppid=24283 vsize=154708 CPUtime=1.88
/proc/24284/task/24354/stat : 24354 (pb_cplex) S 24283 24283 23735 0 -1 4202560 769 0 0 0 188 0 0 0 15 0 8 0 146808460 158420992 15963 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 0 0 0 0
[pid=24284/tid=24355] ppid=24283 vsize=154708 CPUtime=0.76
/proc/24284/task/24355/stat : 24355 (pb_cplex) S 24283 24283 23735 0 -1 4202560 714 0 0 0 76 0 0 0 15 0 8 0 146808460 158420992 15963 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 125.02
Current children cumulated vsize (KiB) 163408

[startup+102.344 s]
/proc/loadavg: 9.56 6.25 2.74 14/195 24364
/proc/meminfo: memFree=30861948/32951124 swapFree=67111528/67111528

################
# More data... #
################

[pid=24284/tid=24351] ppid=24283 vsize=164764 CPUtime=27.83
/proc/24284/task/24351/stat : 24351 (pb_cplex) R 24283 24283 23735 0 -1 4202560 9752 0 0 0 2761 22 0 0 15 0 8 0 146808460 168718336 18444 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=24284/tid=24352] ppid=24283 vsize=164764 CPUtime=27.84
/proc/24284/task/24352/stat : 24352 (pb_cplex) R 24283 24283 23735 0 -1 4202560 1175 0 0 0 2765 19 0 0 15 0 8 0 146808460 168718336 18444 4089446400 134512640 146736320 4287811904 18446744073709551615 135850014 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=24284/tid=24353] ppid=24283 vsize=164764 CPUtime=27.75
/proc/24284/task/24353/stat : 24353 (pb_cplex) R 24283 24283 23735 0 -1 4202560 2436 0 0 0 2751 24 0 0 15 0 8 0 146808460 168718336 18444 4089446400 134512640 146736320 4287811904 18446744073709551615 139046538 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=24284/tid=24354] ppid=24283 vsize=164764 CPUtime=29.09
/proc/24284/task/24354/stat : 24354 (pb_cplex) R 24283 24283 23735 0 -1 4202560 2490 0 0 0 2890 19 0 0 15 0 8 0 146808460 168718336 18444 4089446400 134512640 146736320 4287811904 18446744073709551615 138462755 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=24284/tid=24355] ppid=24283 vsize=164764 CPUtime=28.23
/proc/24284/task/24355/stat : 24355 (pb_cplex) R 24283 24283 23735 0 -1 4202560 4617 0 0 0 2799 24 0 0 15 0 8 0 146808460 168718336 18444 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 345.08
Current children cumulated vsize (KiB) 173464

[startup+162.301 s]
/proc/loadavg: 10.00 6.91 3.18 10/195 24436
/proc/meminfo: memFree=30865556/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
[pid=24284] ppid=24283 vsize=164764 CPUtime=600.4
/proc/24284/stat : 24284 (pb_cplex) R 24283 24283 23735 0 -1 4202496 93139 0 0 0 59556 484 0 0 16 0 8 0 146803804 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 139023098 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24284/statm: 41191 18517 1089 2985 0 37733 0
[pid=24284/tid=24349] ppid=24283 vsize=164764 CPUtime=60.24
/proc/24284/task/24349/stat : 24349 (pb_cplex) R 24283 24283 23735 0 -1 4202560 1222 0 0 0 5974 50 0 0 15 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=24284/tid=24350] ppid=24283 vsize=164764 CPUtime=60.32
/proc/24284/task/24350/stat : 24350 (pb_cplex) R 24283 24283 23735 0 -1 4202560 4199 0 0 0 5988 44 0 0 16 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=24284/tid=24351] ppid=24283 vsize=164764 CPUtime=59.4
/proc/24284/task/24351/stat : 24351 (pb_cplex) R 24283 24283 23735 0 -1 4202560 9879 0 0 0 5893 47 0 0 15 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=24284/tid=24352] ppid=24283 vsize=164764 CPUtime=59.47
/proc/24284/task/24352/stat : 24352 (pb_cplex) R 24283 24283 23735 0 -1 4202560 1373 0 0 0 5906 41 0 0 15 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=24284/tid=24353] ppid=24283 vsize=164764 CPUtime=59.46
/proc/24284/task/24353/stat : 24353 (pb_cplex) R 24283 24283 23735 0 -1 4202560 2769 0 0 0 5896 50 0 0 16 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
[pid=24284/tid=24354] ppid=24283 vsize=164764 CPUtime=60.73
/proc/24284/task/24354/stat : 24354 (pb_cplex) R 24283 24283 23735 0 -1 4202560 2518 0 0 0 6027 46 0 0 16 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 137461831 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=24284/tid=24355] ppid=24283 vsize=164764 CPUtime=59.92
/proc/24284/task/24355/stat : 24355 (pb_cplex) R 24283 24283 23735 0 -1 4202560 4649 0 0 0 5943 49 0 0 16 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
Current children cumulated CPU time (s) 600.4
Current children cumulated vsize (KiB) 173464

Solver just ended. Dumping a history of the last processes samples

[startup+166.401 s]
/proc/loadavg: 9.52 6.86 3.19 12/195 24436
/proc/meminfo: memFree=30874084/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
[pid=24284] ppid=24283 vsize=164764 CPUtime=619.62
/proc/24284/stat : 24284 (pb_cplex) S 24283 24283 23735 0 -1 4202496 93145 0 0 0 61459 503 0 0 15 0 8 0 146803804 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/24284/statm: 41191 18517 1089 2985 0 37733 0
[pid=24284/tid=24349] ppid=24283 vsize=164764 CPUtime=62.77
/proc/24284/task/24349/stat : 24349 (pb_cplex) S 24283 24283 23735 0 -1 4202560 1223 0 0 0 6224 53 0 0 15 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 6 0 0 0
[pid=24284/tid=24350] ppid=24283 vsize=164764 CPUtime=62.67
/proc/24284/task/24350/stat : 24350 (pb_cplex) S 24283 24283 23735 0 -1 4202560 4200 0 0 0 6220 47 0 0 15 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 2 0 0 0
[pid=24284/tid=24351] ppid=24283 vsize=164764 CPUtime=61.93
/proc/24284/task/24351/stat : 24351 (pb_cplex) R 24283 24283 23735 0 -1 4202560 9880 0 0 0 6143 50 0 0 16 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 4 0 0 0
[pid=24284/tid=24352] ppid=24283 vsize=164764 CPUtime=61.85
/proc/24284/task/24352/stat : 24352 (pb_cplex) S 24283 24283 23735 0 -1 4202560 1373 0 0 0 6142 43 0 0 15 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 7 0 0 0
[pid=24284/tid=24353] ppid=24283 vsize=164764 CPUtime=61.79
/proc/24284/task/24353/stat : 24353 (pb_cplex) S 24283 24283 23735 0 -1 4202560 2770 0 0 0 6127 52 0 0 15 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 1 0 0 0
[pid=24284/tid=24354] ppid=24283 vsize=164764 CPUtime=63.12
/proc/24284/task/24354/stat : 24354 (pb_cplex) S 24283 24283 23735 0 -1 4202560 2518 0 0 0 6264 48 0 0 15 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 3 0 0 0
[pid=24284/tid=24355] ppid=24283 vsize=164764 CPUtime=62.31
/proc/24284/task/24355/stat : 24355 (pb_cplex) S 24283 24283 23735 0 -1 4202560 4649 0 0 0 6179 52 0 0 15 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 619.62
Current children cumulated vsize (KiB) 173464

[startup+168.001 s]
/proc/loadavg: 9.52 6.86 3.19 4/195 24436
/proc/meminfo: memFree=30877308/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
[pid=24284] ppid=24283 vsize=164764 CPUtime=629.04
/proc/24284/stat : 24284 (pb_cplex) R 24283 24283 23735 0 -1 4202496 93148 0 0 0 62388 516 0 0 16 0 8 0 146803804 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/24284/statm: 41191 18517 1089 2985 0 37733 0
[pid=24284/tid=24349] ppid=24283 vsize=164764 CPUtime=63.91
/proc/24284/task/24349/stat : 24349 (pb_cplex) R 24283 24283 23735 0 -1 4202560 1223 0 0 0 6336 55 0 0 16 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 135443438 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=24284/tid=24350] ppid=24283 vsize=164764 CPUtime=63.86
/proc/24284/task/24350/stat : 24350 (pb_cplex) R 24283 24283 23735 0 -1 4202560 4201 0 0 0 6338 48 0 0 16 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=24284/tid=24351] ppid=24283 vsize=164764 CPUtime=63.05
/proc/24284/task/24351/stat : 24351 (pb_cplex) R 24283 24283 23735 0 -1 4202560 9881 0 0 0 6254 51 0 0 15 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=24284/tid=24352] ppid=24283 vsize=164764 CPUtime=63.11
/proc/24284/task/24352/stat : 24352 (pb_cplex) R 24283 24283 23735 0 -1 4202560 1373 0 0 0 6266 45 0 0 16 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=24284/tid=24353] ppid=24283 vsize=164764 CPUtime=62.96
/proc/24284/task/24353/stat : 24353 (pb_cplex) R 24283 24283 23735 0 -1 4202560 2771 0 0 0 6243 53 0 0 15 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 135468610 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=24284/tid=24354] ppid=24283 vsize=164764 CPUtime=64.37
/proc/24284/task/24354/stat : 24354 (pb_cplex) R 24283 24283 23735 0 -1 4202560 2518 0 0 0 6388 49 0 0 15 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 135468528 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=24284/tid=24355] ppid=24283 vsize=164764 CPUtime=63.42
/proc/24284/task/24355/stat : 24355 (pb_cplex) R 24283 24283 23735 0 -1 4202560 4649 0 0 0 6288 54 0 0 15 0 8 0 146808460 168718336 18517 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 629.04
Current children cumulated vsize (KiB) 173464

[startup+168.807 s]
/proc/loadavg: 9.52 6.86 3.19 6/195 24436
/proc/meminfo: memFree=30877556/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
[pid=24284] ppid=24283 vsize=161692 CPUtime=633.69
/proc/24284/stat : 24284 (pb_cplex) S 24283 24283 23735 0 -1 4202496 93210 0 0 0 62848 521 0 0 15 0 8 0 146803804 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/24284/statm: 40423 17987 1089 2985 0 36965 0
[pid=24284/tid=24349] ppid=24283 vsize=161692 CPUtime=64.5
/proc/24284/task/24349/stat : 24349 (pb_cplex) R 24283 24283 23735 0 -1 4202560 1223 0 0 0 6395 55 0 0 16 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 135526330 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=24284/tid=24350] ppid=24283 vsize=161692 CPUtime=64.42
/proc/24284/task/24350/stat : 24350 (pb_cplex) S 24283 24283 23735 0 -1 4202560 4202 0 0 0 6393 49 0 0 15 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 2 0 0 0
[pid=24284/tid=24351] ppid=24283 vsize=161692 CPUtime=63.64
/proc/24284/task/24351/stat : 24351 (pb_cplex) R 24283 24283 23735 0 -1 4202560 9941 0 0 0 6312 52 0 0 15 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 136017493 0 2 4096 16387 0 0 0 -1 6 0 0 0
[pid=24284/tid=24352] ppid=24283 vsize=161692 CPUtime=63.74
/proc/24284/task/24352/stat : 24352 (pb_cplex) R 24283 24283 23735 0 -1 4202560 1373 0 0 0 6328 46 0 0 15 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 135467307 0 2 4096 16387 0 0 0 -1 1 0 0 0
[pid=24284/tid=24353] ppid=24283 vsize=161692 CPUtime=63.52
/proc/24284/task/24353/stat : 24353 (pb_cplex) R 24283 24283 23735 0 -1 4202560 2771 0 0 0 6298 54 0 0 15 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 135453925 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=24284/tid=24354] ppid=24283 vsize=161692 CPUtime=64.92
/proc/24284/task/24354/stat : 24354 (pb_cplex) S 24283 24283 23735 0 -1 4202560 2519 0 0 0 6442 50 0 0 16 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 3 0 0 0
[pid=24284/tid=24355] ppid=24283 vsize=161692 CPUtime=64
/proc/24284/task/24355/stat : 24355 (pb_cplex) S 24283 24283 23735 0 -1 4202560 4649 0 0 0 6345 55 0 0 16 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 633.69
Current children cumulated vsize (KiB) 170392

[startup+169.601 s]
/proc/loadavg: 8.92 6.78 3.18 10/195 24436
/proc/meminfo: memFree=30879664/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
[pid=24284] ppid=24283 vsize=161692 CPUtime=639.04
/proc/24284/stat : 24284 (pb_cplex) S 24283 24283 23735 0 -1 4202496 93212 0 0 0 63377 527 0 0 15 0 8 0 146803804 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/24284/statm: 40423 17987 1089 2985 0 36965 0
[pid=24284/tid=24349] ppid=24283 vsize=161692 CPUtime=65.15
/proc/24284/task/24349/stat : 24349 (pb_cplex) R 24283 24283 23735 0 -1 4202560 1223 0 0 0 6459 56 0 0 15 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 138423591 0 2 4096 16387 0 0 0 -1 0 0 0 0
[pid=24284/tid=24350] ppid=24283 vsize=161692 CPUtime=65.11
/proc/24284/task/24350/stat : 24350 (pb_cplex) R 24283 24283 23735 0 -1 4202560 4203 0 0 0 6460 51 0 0 16 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 139044505 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=24284/tid=24351] ppid=24283 vsize=161692 CPUtime=64.33
/proc/24284/task/24351/stat : 24351 (pb_cplex) S 24283 24283 23735 0 -1 4202560 9941 0 0 0 6381 52 0 0 16 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 6 0 0 0
[pid=24284/tid=24352] ppid=24283 vsize=161692 CPUtime=64.42
/proc/24284/task/24352/stat : 24352 (pb_cplex) S 24283 24283 23735 0 -1 4202560 1373 0 0 0 6396 46 0 0 15 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 1 0 0 0
[pid=24284/tid=24353] ppid=24283 vsize=161692 CPUtime=64.21
/proc/24284/task/24353/stat : 24353 (pb_cplex) R 24283 24283 23735 0 -1 4202560 2772 0 0 0 6367 54 0 0 16 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 7 0 0 0
[pid=24284/tid=24354] ppid=24283 vsize=161692 CPUtime=65.59
/proc/24284/task/24354/stat : 24354 (pb_cplex) R 24283 24283 23735 0 -1 4202560 2519 0 0 0 6508 51 0 0 16 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 136017491 0 2 4096 16387 0 0 0 -1 3 0 0 0
[pid=24284/tid=24355] ppid=24283 vsize=161692 CPUtime=64.63
/proc/24284/task/24355/stat : 24355 (pb_cplex) S 24283 24283 23735 0 -1 4202560 4649 0 0 0 6408 55 0 0 16 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 639.04
Current children cumulated vsize (KiB) 170392

[startup+169.801 s]
/proc/loadavg: 8.92 6.78 3.18 10/195 24436
/proc/meminfo: memFree=30879664/32951124 swapFree=67111528/67111528
[pid=24283] ppid=24281 vsize=8700 CPUtime=0
/proc/24283/stat : 24283 (run) S 24281 24283 23735 0 -1 4202496 363 0 0 0 0 0 0 0 22 0 1 0 146803804 8908800 248 4089446400 4194304 4922060 140734763412464 18446744073709551615 264726224005 0 65536 4100 65538 18446744071562232103 0 0 17 6 0 0 0
/proc/24283/statm: 2175 248 208 178 0 68 0
[pid=24284] ppid=24283 vsize=161692 CPUtime=640.15
/proc/24284/stat : 24284 (pb_cplex) S 24283 24283 23735 0 -1 4202496 93212 0 0 0 63487 528 0 0 15 0 8 0 146803804 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 4 0 0 0
/proc/24284/statm: 40423 17987 1089 2985 0 36965 0
[pid=24284/tid=24349] ppid=24283 vsize=161692 CPUtime=65.29
/proc/24284/task/24349/stat : 24349 (pb_cplex) S 24283 24283 23735 0 -1 4202560 1223 0 0 0 6473 56 0 0 15 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 0 0 0 0
[pid=24284/tid=24350] ppid=24283 vsize=161692 CPUtime=65.24
/proc/24284/task/24350/stat : 24350 (pb_cplex) R 24283 24283 23735 0 -1 4202560 4203 0 0 0 6473 51 0 0 15 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 2 0 0 0
[pid=24284/tid=24351] ppid=24283 vsize=161692 CPUtime=64.49
/proc/24284/task/24351/stat : 24351 (pb_cplex) S 24283 24283 23735 0 -1 4202560 9941 0 0 0 6396 53 0 0 15 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 6 0 0 0
[pid=24284/tid=24352] ppid=24283 vsize=161692 CPUtime=64.56
/proc/24284/task/24352/stat : 24352 (pb_cplex) S 24283 24283 23735 0 -1 4202560 1373 0 0 0 6409 47 0 0 16 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 1 0 0 0
[pid=24284/tid=24353] ppid=24283 vsize=161692 CPUtime=64.35
/proc/24284/task/24353/stat : 24353 (pb_cplex) S 24283 24283 23735 0 -1 4202560 2772 0 0 0 6381 54 0 0 15 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 7 0 0 0
[pid=24284/tid=24354] ppid=24283 vsize=161692 CPUtime=65.77
/proc/24284/task/24354/stat : 24354 (pb_cplex) S 24283 24283 23735 0 -1 4202560 2519 0 0 0 6525 52 0 0 16 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 144580073 0 2 4096 16387 18446604453931524544 0 0 -1 3 0 0 0
[pid=24284/tid=24355] ppid=24283 vsize=161692 CPUtime=64.78
/proc/24284/task/24355/stat : 24355 (pb_cplex) R 24283 24283 23735 0 -1 4202560 4649 0 0 0 6422 56 0 0 15 0 8 0 146808460 165572608 17987 4089446400 134512640 146736320 4287811904 18446744073709551615 137341772 0 2 4096 16387 0 0 0 -1 5 0 0 0
Current children cumulated CPU time (s) 640.15
Current children cumulated vsize (KiB) 170392

Child status: 0
Real time (s): 169.849
CPU time (s): 640.218
CPU user time (s): 634.928
CPU system time (s): 5.29019
CPU usage (%): 376.933
Max. virtual memory (cumulated for all children) (KiB): 178948

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 634.927
system time used= 5.29019
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 93605
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 118017
involuntary context switches= 47420

runsolver used 0.299954 second user time and 0.695894 second system time

The end

Launcher Data 

Begin job on node141 at 2010-07-02 09:18:06
IDJOB=2697961
IDBENCH=78968
IDSOLVER=1210
FILE ID=node141/2697961-1278055086
PBS_JOBID= 11198900
Free space on /tmp= 74164 MiB

SOLVER NAME= pb_cplex 2010-07-01
BENCH NAME= PB10/normalized-PB10/PARTIAL-SMALLINT-LIN/PB06/submitted-PB06/namasivayam/tsp/normalized-t3002.11tsp11.1900570242--soft-66-100-0.wbo
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2697961-1278055086/watcher-2697961-1278055086 -o /tmp/evaluation-result-2697961-1278055086/solver-2697961-1278055086 -C 1800 -W 2000 -M 3800  run HOME/instance-2697961-1278055086.wbo

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 3800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 404f4a35cd4ec5708f20e119eb7d26f2
RANDOM SEED=203732205

node141.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.788
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.788
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.68
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.788
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.83
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.788
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.788
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.80
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.788
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.788
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.82
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.788
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx rdtscp lm constant_tsc ida nonstop_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr popcnt lahf_lm
bogomips	: 5332.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management: [8]


/proc/meminfo:
MemTotal:     32951124 kB
MemFree:      30952164 kB
Buffers:        224176 kB
Cached:        1499612 kB
SwapCached:          0 kB
Active:         760596 kB
Inactive:      1086680 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     32951124 kB
LowFree:      30952164 kB
SwapTotal:    67111528 kB
SwapFree:     67111528 kB
Dirty:           29532 kB
Writeback:           0 kB
AnonPages:      124088 kB
Mapped:          18896 kB
Slab:            84072 kB
PageTables:       4944 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:  83587088 kB
Committed_AS:   346880 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    296008 kB
VmallocChunk: 34359440975 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 74148 MiB
End job on node141 at 2010-07-02 09:20:56