Trace number 2696414

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pb_cplex 2010-06-29? (TO) 1800.12 1127.62

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/mps-v2-20-10/MIPLIB/
miplib2003/normalized-mps-v2-20-10-net12.opb
MD5SUM24a04ed274dd43d443428abf078e95f9
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark214
Best CPU time to get the best result obtained on this benchmark13.9989
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 214
Optimality of the best value was proved YES
Number of variables147395
Total number of constraints26533
Number of constraints which are clauses12
Number of constraints which are cardinality constraints (but not clauses)391
Number of constraints which are nor clauses,nor cardinality constraints26130
Minimum length of a constraint2
Maximum length of a constraint292
Number of terms in the objective function 39
Biggest coefficient in the objective function 20
Number of bits for the biggest coefficient in the objective function 5
Sum of the numbers in the objective function 337
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 12288
Number of bits of the biggest number in a constraint 14
Biggest sum of numbers in a constraint 137193
Number of bits of the biggest sum of numbers18
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-2696414-1278016635.opb.
0.00/0.00	c Instance file HOME/instance-2696414-1278016635.opb
0.00/0.00	c File size is 5998765 bytes.
14.29/14.37	c Highest Coefficient sum: 137193
14.29/14.37	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
14.48/14.51	c ============================[ Problem Statistics ]=============================
14.48/14.51	c |                                                                             |
14.48/14.51	c |  Parsing time:          14.43        s                                      |
14.48/14.51	c |  Number Variables:      147395                                              |
14.48/14.58	c |  Number Constraints:    26533                                               |
14.48/14.58	c ===============================================================================
1800.12/1127.61	c Remaining time 1785.52 sec.
1800.12/1127.61	c 
1800.12/1127.61	c *** INTERRUPTED ***
1800.12/1127.61	s UNKNOWN
1800.12/1127.61	c Total CPU time              : 1796.99 s
1800.12/1127.61	c Memory used           : 275.30 MB
1800.12/1127.61	c CPU time              : 1796.99 s
1800.12/1127.61	c 
1800.12/1127.61	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2696414-1278016635/watcher-2696414-1278016635 -o /tmp/evaluation-result-2696414-1278016635/solver-2696414-1278016635 -C 1800 -W 2000 -M 1800 run HOME/instance-2696414-1278016635.opb 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.92 2.01 1.62 3/106 28537
/proc/meminfo: memFree=1479260/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0

[startup+0.026021 s]
/proc/loadavg: 1.92 2.01 1.62 3/106 28537
/proc/meminfo: memFree=1479260/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.101027 s]
/proc/loadavg: 1.92 2.01 1.62 3/106 28537
/proc/meminfo: memFree=1479260/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.301045 s]
/proc/loadavg: 1.92 2.01 1.62 3/106 28537
/proc/meminfo: memFree=1479260/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.701081 s]
/proc/loadavg: 1.92 2.01 1.62 3/106 28537
/proc/meminfo: memFree=1479260/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50115 s]
/proc/loadavg: 1.85 2.00 1.62 2/108 28539
/proc/meminfo: memFree=1446880/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=56048 CPUtime=1.49
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 10360 0 0 0 145 4 0 0 25 0 1 0 142955072 57393152 9594 1992294400 134512640 146736320 4292499760 18446744073709551615 141028095 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/28538/statm: 14012 9594 902 2985 0 9481 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 64748

[startup+3.1013 s]
/proc/loadavg: 1.85 2.00 1.62 2/108 28539
/proc/meminfo: memFree=1443656/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=56444 CPUtime=3.09
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 10505 0 0 0 305 4 0 0 25 0 1 0 142955072 57798656 9739 1992294400 134512640 146736320 4292499760 18446744073709551615 141028044 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/28538/statm: 14111 9739 961 2985 0 9580 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 65144

[startup+6.30058 s]
/proc/loadavg: 1.78 1.98 1.62 2/108 28539
/proc/meminfo: memFree=1442664/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=57104 CPUtime=6.29
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 10799 0 0 0 625 4 0 0 25 0 1 0 142955072 58474496 10033 1992294400 134512640 146736320 4292499760 18446744073709551615 140683248 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/28538/statm: 14276 10033 1082 2985 0 9745 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 65804

[startup+12.7012 s]
/proc/loadavg: 1.72 1.96 1.61 2/108 28539
/proc/meminfo: memFree=1441300/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=58424 CPUtime=12.69
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 11386 0 0 0 1264 5 0 0 25 0 1 0 142955072 59826176 10620 1992294400 134512640 146736320 4292499760 18446744073709551615 140526593 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/28538/statm: 14606 10620 1325 2985 0 10075 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 67124

[startup+25.5013 s]
/proc/loadavg: 1.60 1.93 1.61 2/108 28539
/proc/meminfo: memFree=1372108/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=155796 CPUtime=25.48
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 68258 0 0 0 2521 27 0 0 25 0 1 0 142955072 159535104 27481 1992294400 134512640 146736320 4292499760 18446744073709551615 136017850 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/28538/statm: 38949 27481 966 2985 0 35491 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 164496

[startup+51.1006 s]
/proc/loadavg: 1.42 1.85 1.59 2/108 28541
/proc/meminfo: memFree=1364048/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=163656 CPUtime=51.07
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 140497 0 0 0 5054 53 0 0 25 0 1 0 142955072 167583744 29939 1992294400 134512640 146736320 4292499760 18446744073709551615 135523436 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/28538/statm: 40914 29939 1012 2985 0 37456 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 172356

[startup+102.308 s]
/proc/loadavg: 1.24 1.74 1.56 2/108 28541
/proc/meminfo: memFree=1366404/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=157060 CPUtime=102.27
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 290826 0 0 0 10118 109 0 0 25 0 1 0 142955072 160829440 28915 1992294400 134512640 146736320 4292499760 18446744073709551615 136207919 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/28538/statm: 39265 28915 1012 2985 0 35807 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 165760

[startup+162.301 s]
/proc/loadavg: 1.14 1.61 1.53 2/108 28543
/proc/meminfo: memFree=1358840/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=164472 CPUtime=162.24
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 367383 0 0 0 16087 137 0 0 25 0 1 0 142955072 168419328 30806 1992294400 134512640 146736320 4292499760 18446744073709551615 136017485 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/28538/statm: 41118 30806 1019 2985 0 37660 0
Current children cumulated CPU time (s) 162.24
Current children cumulated vsize (KiB) 173172

[startup+222.301 s]
/proc/loadavg: 1.10 1.52 1.50 2/108 28545
/proc/meminfo: memFree=1358840/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=164472 CPUtime=222.22
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 393593 0 0 0 22074 148 0 0 25 0 1 0 142955072 168419328 30806 1992294400 134512640 146736320 4292499760 18446744073709551615 136017787 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/28538/statm: 41118 30806 1019 2985 0 37660 0
Current children cumulated CPU time (s) 222.22
Current children cumulated vsize (KiB) 173172

[startup+282.301 s]
/proc/loadavg: 1.30 1.48 1.49 3/109 28548
/proc/meminfo: memFree=1295908/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=267992 CPUtime=289.33
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 434976 0 0 0 28767 166 0 0 25 0 2 0 142955072 274423808 46299 1992294400 134512640 146736320 4292499760 18446744073709551615 136403109 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/28538/statm: 66998 46299 1074 2985 0 63540 0
[pid=28538/tid=28546] ppid=28537 vsize=267992 CPUtime=7.13
/proc/28538/task/28546/stat : 28546 (pb_cplex) R 28537 28537 28406 0 -1 4202560 5797 0 0 0 710 3 0 0 25 0 2 0 142978133 274423808 46299 1992294400 134512640 146736320 4292499760 18446744073709551615 136400474 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 289.33
Current children cumulated vsize (KiB) 276692

[startup+342.301 s]
/proc/loadavg: 1.55 1.54 1.51 2/109 28550
/proc/meminfo: memFree=1291072/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=272796 CPUtime=396.06
/proc/28538/stat : 28538 (pb_cplex) S 28537 28537 28406 0 -1 4202496 468627 0 0 0 39422 184 0 0 25 0 2 0 142955072 279343104 47539 1992294400 134512640 146736320 4292499760 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/28538/statm: 68199 47539 1072 2985 0 64741 0
[pid=28538/tid=28546] ppid=28537 vsize=272796 CPUtime=66.75
/proc/28538/task/28546/stat : 28546 (pb_cplex) R 28537 28537 28406 0 -1 4202560 24070 0 0 0 6663 12 0 0 25 0 2 0 142978133 279343104 47539 1992294400 134512640 146736320 4292499760 18446744073709551615 136017769 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 396.06
Current children cumulated vsize (KiB) 281496

[startup+402.301 s]
/proc/loadavg: 1.37 1.48 1.49 2/109 28550
/proc/meminfo: memFree=1283384/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=284432 CPUtime=470.45
/proc/28538/stat : 28538 (pb_cplex) S 28537 28537 28406 0 -1 4202496 485221 0 0 0 46851 194 0 0 25 0 2 0 142955072 291258368 49401 1992294400 134512640 146736320 4292499760 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/28538/statm: 71108 49401 1076 2985 0 67650 0

################
# More data... #
################

[pid=28538] ppid=28537 vsize=284816 CPUtime=812.78
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 524347 0 0 0 81055 223 0 0 25 0 2 0 142955072 291651584 50152 1992294400 134512640 146736320 4292499760 18446744073709551615 136385183 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/28538/statm: 71204 50152 1072 2985 0 67746 0
[pid=28538/tid=28546] ppid=28537 vsize=284816 CPUtime=305.36
/proc/28538/task/28546/stat : 28546 (pb_cplex) R 28537 28537 28406 0 -1 4202560 59026 0 0 0 30500 36 0 0 25 0 2 0 142978133 291651584 50152 1992294400 134512640 146736320 4292499760 18446744073709551615 136007612 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 812.78
Current children cumulated vsize (KiB) 293516

[startup+642.302 s]
/proc/loadavg: 1.70 1.67 1.56 2/109 28558
/proc/meminfo: memFree=1279168/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=286536 CPUtime=913.8
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 544060 0 0 0 91146 234 0 0 25 0 2 0 142955072 293412864 50454 1992294400 134512640 146736320 4292499760 18446744073709551615 136007372 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/28538/statm: 71634 50454 1072 2985 0 68176 0
[pid=28538/tid=28546] ppid=28537 vsize=286536 CPUtime=346.39
/proc/28538/task/28546/stat : 28546 (pb_cplex) S 28537 28537 28406 0 -1 4202560 60957 0 0 0 34601 38 0 0 18 0 2 0 142978133 293412864 50454 1992294400 134512640 146736320 4292499760 18446744073709551615 144580073 0 2 4096 16387 18446604437837257536 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 913.8
Current children cumulated vsize (KiB) 295236

[startup+702.301 s]
/proc/loadavg: 1.78 1.69 1.57 3/109 28558
/proc/meminfo: memFree=1279168/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=278072 CPUtime=1018.25
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 555989 0 0 0 101580 245 0 0 25 0 2 0 142955072 284745728 50746 1992294400 134512640 146736320 4292499760 18446744073709551615 135983225 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/28538/statm: 69518 50746 1129 2985 0 66060 0
[pid=28538/tid=28546] ppid=28537 vsize=278072 CPUtime=390.87
/proc/28538/task/28546/stat : 28546 (pb_cplex) R 28537 28537 28406 0 -1 4202560 65110 0 0 0 39043 44 0 0 25 0 2 0 142978133 284745728 50746 1992294400 134512640 146736320 4292499760 18446744073709551615 135454014 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1018.25
Current children cumulated vsize (KiB) 286772

[startup+762.309 s]
/proc/loadavg: 1.92 1.74 1.59 3/109 28560
/proc/meminfo: memFree=1276812/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=279204 CPUtime=1137.79
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 570594 0 0 0 113524 255 0 0 25 0 2 0 142955072 285904896 51036 1992294400 134512640 146736320 4292499760 18446744073709551615 136403109 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/28538/statm: 69801 51036 1115 2985 0 66343 0
[pid=28538/tid=28546] ppid=28537 vsize=279204 CPUtime=450.41
/proc/28538/task/28546/stat : 28546 (pb_cplex) R 28537 28537 28406 0 -1 4202560 65923 0 0 0 44995 46 0 0 25 0 2 0 142978133 285904896 51036 1992294400 134512640 146736320 4292499760 18446744073709551615 136384857 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1137.79
Current children cumulated vsize (KiB) 287904

[startup+822.302 s]
/proc/loadavg: 1.60 1.68 1.57 3/109 28562
/proc/meminfo: memFree=1276688/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=277688 CPUtime=1216.88
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 592223 0 0 0 121423 265 0 0 25 0 2 0 142955072 284352512 51402 1992294400 134512640 146736320 4292499760 18446744073709551615 136008017 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/28538/statm: 69422 51402 1110 2985 0 65964 0
[pid=28538/tid=28546] ppid=28537 vsize=277688 CPUtime=469.52
/proc/28538/task/28546/stat : 28546 (pb_cplex) R 28537 28537 28406 0 -1 4202560 67830 0 0 0 46904 48 0 0 25 0 2 0 142978133 284352512 51402 1992294400 134512640 146736320 4292499760 18446744073709551615 136403117 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1216.88
Current children cumulated vsize (KiB) 286388

[startup+882.301 s]
/proc/loadavg: 1.91 1.75 1.60 3/109 28564
/proc/meminfo: memFree=1273340/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=279640 CPUtime=1336.39
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 606088 0 0 0 133363 276 0 0 25 0 2 0 142955072 286351360 51869 1992294400 134512640 146736320 4292499760 18446744073709551615 136007668 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/28538/statm: 69910 51869 1072 2985 0 66452 0
[pid=28538/tid=28546] ppid=28537 vsize=279640 CPUtime=529.06
/proc/28538/task/28546/stat : 28546 (pb_cplex) R 28537 28537 28406 0 -1 4202560 75711 0 0 0 52851 55 0 0 25 0 2 0 142978133 286351360 51869 1992294400 134512640 146736320 4292499760 18446744073709551615 139028328 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1336.39
Current children cumulated vsize (KiB) 288340

[startup+942.301 s]
/proc/loadavg: 2.02 1.81 1.63 3/109 28566
/proc/meminfo: memFree=1273092/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=279748 CPUtime=1455.93
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 616639 0 0 0 145306 287 0 0 25 0 2 0 142955072 286461952 51915 1992294400 134512640 146736320 4292499760 18446744073709551615 136017485 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/28538/statm: 69937 51915 1072 2985 0 66479 0
[pid=28538/tid=28546] ppid=28537 vsize=279748 CPUtime=588.61
/proc/28538/task/28546/stat : 28546 (pb_cplex) R 28537 28537 28406 0 -1 4202560 76990 0 0 0 58803 58 0 0 25 0 2 0 142978133 286461952 51915 1992294400 134512640 146736320 4292499760 18446744073709551615 136400717 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1455.93
Current children cumulated vsize (KiB) 288448

[startup+1002.3 s]
/proc/loadavg: 2.00 1.84 1.65 3/109 28566
/proc/meminfo: memFree=1272844/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=280072 CPUtime=1575.45
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 650644 0 0 0 157239 306 0 0 25 0 2 0 142955072 286793728 51966 1992294400 134512640 146736320 4292499760 18446744073709551615 136008303 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/28538/statm: 70018 51966 1072 2985 0 66560 0
[pid=28538/tid=28546] ppid=28537 vsize=280072 CPUtime=648.15
/proc/28538/task/28546/stat : 28546 (pb_cplex) R 28537 28537 28406 0 -1 4202560 95368 0 0 0 64745 70 0 0 25 0 2 0 142978133 286793728 51966 1992294400 134512640 146736320 4292499760 18446744073709551615 135854505 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1575.45
Current children cumulated vsize (KiB) 288772

[startup+1062.3 s]
/proc/loadavg: 1.79 1.79 1.64 3/109 28568
/proc/meminfo: memFree=1270488/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=282464 CPUtime=1670.04
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 661456 0 0 0 166693 311 0 0 25 0 2 0 142955072 289243136 52545 1992294400 134512640 146736320 4292499760 18446744073709551615 136007030 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/28538/statm: 70616 52545 1072 2985 0 67158 0
[pid=28538/tid=28546] ppid=28537 vsize=282464 CPUtime=682.76
/proc/28538/task/28546/stat : 28546 (pb_cplex) R 28537 28537 28406 0 -1 4202560 100344 0 0 0 68204 72 0 0 25 0 2 0 142978133 289243136 52545 1992294400 134512640 146736320 4292499760 18446744073709551615 136008245 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1670.04
Current children cumulated vsize (KiB) 291164

[startup+1122.3 s]
/proc/loadavg: 1.92 1.83 1.66 3/109 28570
/proc/meminfo: memFree=1270860/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=281904 CPUtime=1789.56
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 663413 0 0 0 178641 315 0 0 25 0 2 0 142955072 288669696 52464 1992294400 134512640 146736320 4292499760 18446744073709551615 136384857 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/28538/statm: 70476 52464 1072 2985 0 67018 0
[pid=28538/tid=28546] ppid=28537 vsize=281904 CPUtime=742.3
/proc/28538/task/28546/stat : 28546 (pb_cplex) R 28537 28537 28406 0 -1 4202560 101645 0 0 0 74155 75 0 0 25 0 2 0 142978133 288669696 52464 1992294400 134512640 146736320 4292499760 18446744073709551615 136405696 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1789.56
Current children cumulated vsize (KiB) 290604



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1127.6 s]
/proc/loadavg: 1.93 1.83 1.66 3/109 28570
/proc/meminfo: memFree=1270860/2059040 swapFree=4139744/4192956
[pid=28537] ppid=28535 vsize=8700 CPUtime=0
/proc/28537/stat : 28537 (run) S 28535 28537 28406 0 -1 4202496 365 0 0 0 0 0 0 0 19 0 1 0 142955072 8908800 249 1992294400 4194304 4922060 140733674489776 18446744073709551615 273490222213 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/28537/statm: 2175 249 208 178 0 68 0
[pid=28538] ppid=28537 vsize=281904 CPUtime=1800.12
/proc/28538/stat : 28538 (pb_cplex) R 28537 28537 28406 0 -1 4202496 663413 0 0 0 179697 315 0 0 25 0 2 0 142955072 288669696 52464 1992294400 134512640 146736320 4292499760 18446744073709551615 139042883 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/28538/statm: 70476 52464 1072 2985 0 67018 0
[pid=28538/tid=28546] ppid=28537 vsize=281904 CPUtime=747.56
/proc/28538/task/28546/stat : 28546 (pb_cplex) R 28537 28537 28406 0 -1 4202560 101645 0 0 0 74681 75 0 0 25 0 2 0 142978133 288669696 52464 1992294400 134512640 146736320 4292499760 18446744073709551615 136007292 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1800.12
Current children cumulated vsize (KiB) 290604

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 28537 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.001999
# while last known CPU time is 1800.12
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1127.62
CPU time (s): 1800.12
CPU user time (s): 1796.97
CPU system time (s): 3.15
CPU usage (%): 159.639
Max. virtual memory (cumulated for all children) (KiB): 298304

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 365
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 2

runsolver used 1.87771 second user time and 5.94909 second system time

The end

Launcher Data 

Begin job on node051 at 2010-07-01 22:37:16
IDJOB=2696414
IDBENCH=1876
IDSOLVER=1209
FILE ID=node051/2696414-1278016635
PBS_JOBID= 11198714
Free space on /tmp= 62480 MiB

SOLVER NAME= pb_cplex 2010-06-29
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/mps-v2-20-10/MIPLIB/miplib2003/normalized-mps-v2-20-10-net12.opb
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2696414-1278016635/watcher-2696414-1278016635 -o /tmp/evaluation-result-2696414-1278016635/solver-2696414-1278016635 -C 1800 -W 2000 -M 1800  run HOME/instance-2696414-1278016635.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 24a04ed274dd43d443428abf078e95f9
RANDOM SEED=1045644317

node051.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.255
cache size	: 2048 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6000.51
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.255
cache size	: 2048 KB
physical id	: 3
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5599.43
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2059040 kB
MemFree:       1479788 kB
Buffers:        141800 kB
Cached:         337792 kB
SwapCached:       6308 kB
Active:         215288 kB
Inactive:       277544 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2059040 kB
LowFree:       1479788 kB
SwapTotal:     4192956 kB
SwapFree:      4139744 kB
Dirty:           22492 kB
Writeback:           4 kB
AnonPages:       11748 kB
Mapped:          11948 kB
Slab:            64548 kB
PageTables:       4104 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   5222476 kB
Committed_AS:   182828 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    264948 kB
VmallocChunk: 34359471699 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62464 MiB
End job on node051 at 2010-07-01 22:56:06