Trace number 2696057

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pb_cplex 2010-06-29? (TO) 1800.04 992.919

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/mps-v2-20-10/MIPLIB/
miplib2003/normalized-mps-v2-20-10-seymour.opb
MD5SUM97ebaccbda37d5c570b4e2ec3cd7f8f0
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark425
Best CPU time to get the best result obtained on this benchmark1789.68
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 425
Optimality of the best value was proved NO
Number of variables1372
Total number of constraints4944
Number of constraints which are clauses4944
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints0
Minimum length of a constraint1
Maximum length of a constraint19
Number of terms in the objective function 1372
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1372
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 1
Number of bits of the biggest number in a constraint 1
Biggest sum of numbers in a constraint 1372
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-2696057-1278016594.opb.
0.00/0.00	c Instance file HOME/instance-2696057-1278016594.opb
0.00/0.00	c File size is 324105 bytes.
0.00/0.62	c Highest Coefficient sum: 20
0.00/0.62	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.64	c ============================[ Problem Statistics ]=============================
0.00/0.64	c |                                                                             |
0.00/0.64	c |  Parsing time:          0.63         s                                      |
0.00/0.64	c |  Number Variables:      1372                                                |
0.00/0.64	c |  Number Constraints:    4944                                                |
0.00/0.64	c ===============================================================================
1800.04/992.91	c Remaining time 1799.36 sec.
1800.04/992.91	c 
1800.04/992.91	c *** INTERRUPTED ***
1800.04/992.91	s UNKNOWN
1800.04/992.91	c Total CPU time              : 1794.98 s
1800.04/992.91	c Memory used           : 87.89 MB
1800.04/992.91	c CPU time              : 1794.98 s
1800.04/992.91	c 
1800.04/992.91	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2696057-1278016594/watcher-2696057-1278016594 -o /tmp/evaluation-result-2696057-1278016594/solver-2696057-1278016594 -C 1800 -W 2000 -M 1800 run HOME/instance-2696057-1278016594.opb 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.26 1.81 1.51 3/106 24506
/proc/meminfo: memFree=1781576/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0

[startup+0.0970721 s]
/proc/loadavg: 1.26 1.81 1.51 3/106 24506
/proc/meminfo: memFree=1781576/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.101073 s]
/proc/loadavg: 1.26 1.81 1.51 3/106 24506
/proc/meminfo: memFree=1781576/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.301109 s]
/proc/loadavg: 1.26 1.81 1.51 3/106 24506
/proc/meminfo: memFree=1781576/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.701195 s]
/proc/loadavg: 1.26 1.81 1.51 3/106 24506
/proc/meminfo: memFree=1781576/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50133 s]
/proc/loadavg: 1.26 1.81 1.51 2/108 24508
/proc/meminfo: memFree=1770772/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=30652 CPUtime=1.48
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 4767 0 0 0 147 1 0 0 18 0 1 0 177262899 31387648 3772 1992294400 134512640 146736320 4288035504 18446744073709551615 136403112 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/24507/statm: 7663 3772 940 2985 0 4205 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 39352

[startup+3.10063 s]
/proc/loadavg: 1.26 1.81 1.51 2/108 24508
/proc/meminfo: memFree=1769284/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=30668 CPUtime=3.08
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 4846 0 0 0 307 1 0 0 22 0 1 0 177262899 31404032 3851 1992294400 134512640 146736320 4288035504 18446744073709551615 136015700 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/24507/statm: 7667 3851 997 2985 0 4209 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 39368

[startup+6.30122 s]
/proc/loadavg: 1.24 1.79 1.50 2/108 24508
/proc/meminfo: memFree=1764696/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=34744 CPUtime=6.28
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 9875 0 0 0 624 4 0 0 25 0 1 0 177262899 35577856 4998 1992294400 134512640 146736320 4288035504 18446744073709551615 139023063 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/24507/statm: 8686 4998 1025 2985 0 5228 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 43444

[startup+12.7004 s]
/proc/loadavg: 1.22 1.78 1.50 2/108 24508
/proc/meminfo: memFree=1764572/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=34944 CPUtime=12.68
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 18671 0 0 0 1260 8 0 0 25 0 1 0 177262899 35782656 5044 1992294400 134512640 146736320 4288035504 18446744073709551615 136406061 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/24507/statm: 8736 5044 1010 2985 0 5278 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 43644

[startup+25.5018 s]
/proc/loadavg: 1.17 1.74 1.49 2/109 24509
/proc/meminfo: memFree=1752908/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=58040 CPUtime=27.38
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 23799 0 0 0 2726 12 0 0 21 0 2 0 177262899 59432960 8022 1992294400 134512640 146736320 4288035504 18446744073709551615 135983319 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24507/statm: 14510 8022 1045 2985 0 11052 0
[pid=24507/tid=24509] ppid=24506 vsize=58040 CPUtime=5.06
/proc/24507/task/24509/stat : 24509 (pb_cplex) S 24506 24506 24318 0 -1 4202560 1968 0 0 0 505 1 0 0 18 0 2 0 177264621 59432960 8022 1992294400 134512640 146736320 4288035504 18446744073709551615 144580073 0 2 4096 16387 18446604437850950592 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 27.38
Current children cumulated vsize (KiB) 66740

[startup+51.1015 s]
/proc/loadavg: 1.45 1.76 1.50 3/109 24509
/proc/meminfo: memFree=1751420/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=59812 CPUtime=72.85
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 28003 0 0 0 7264 21 0 0 23 0 2 0 177262899 61247488 8412 1992294400 134512640 146736320 4288035504 18446744073709551615 135854195 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24507/statm: 14953 8412 1045 2985 0 11495 0
[pid=24507/tid=24509] ppid=24506 vsize=59812 CPUtime=27.88
/proc/24507/task/24509/stat : 24509 (pb_cplex) R 24506 24506 24318 0 -1 4202560 5360 0 0 0 2781 7 0 0 23 0 2 0 177264621 61247488 8412 1992294400 134512640 146736320 4288035504 18446744073709551615 136000176 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 72.85
Current children cumulated vsize (KiB) 68512

[startup+102.309 s]
/proc/loadavg: 1.88 1.83 1.54 2/109 24513
/proc/meminfo: memFree=1746212/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=69616 CPUtime=150.56
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 34794 0 0 0 15024 32 0 0 20 0 2 0 177262899 71286784 9666 1992294400 134512640 146736320 4288035504 18446744073709551615 139023058 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24507/statm: 17404 9666 1080 2985 0 13946 0
[pid=24507/tid=24513] ppid=24506 vsize=69616 CPUtime=0
/proc/24507/task/24513/stat : 24513 (pb_cplex) S 24506 24506 24318 0 -1 4202560 0 0 0 0 0 0 0 0 20 0 2 0 177272939 71286784 9666 1992294400 134512640 146736320 4288035504 18446744073709551615 144580073 0 2 4096 16387 18446604437850950592 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 150.56
Current children cumulated vsize (KiB) 78316

[startup+162.301 s]
/proc/loadavg: 2.11 1.90 1.58 3/109 24515
/proc/meminfo: memFree=1739144/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=75936 CPUtime=252.75
/proc/24507/stat : 24507 (pb_cplex) S 24506 24506 24318 0 -1 4202496 73198 0 0 0 25215 60 0 0 25 0 2 0 177262899 77758464 11223 1992294400 134512640 146736320 4288035504 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24507/statm: 18984 11223 1084 2985 0 15526 0
[pid=24507/tid=24513] ppid=24506 vsize=75936 CPUtime=46.71
/proc/24507/task/24513/stat : 24513 (pb_cplex) R 24506 24506 24318 0 -1 4202560 20448 0 0 0 4657 14 0 0 25 0 2 0 177272939 77758464 11223 1992294400 134512640 146736320 4288035504 18446744073709551615 135468528 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 252.75
Current children cumulated vsize (KiB) 84636

[startup+222.301 s]
/proc/loadavg: 1.84 1.87 1.59 4/109 24515
/proc/meminfo: memFree=1738400/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=75588 CPUtime=362.7
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 145020 0 0 0 36161 109 0 0 25 0 2 0 177262899 77402112 11368 1992294400 134512640 146736320 4288035504 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24507/statm: 18897 11368 1083 2985 0 15439 0
[pid=24507/tid=24513] ppid=24506 vsize=75588 CPUtime=103.59
/proc/24507/task/24513/stat : 24513 (pb_cplex) R 24506 24506 24318 0 -1 4202560 57776 0 0 0 10318 41 0 0 19 0 2 0 177272939 77402112 11368 1992294400 134512640 146736320 4288035504 18446744073709551615 139044580 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 362.7
Current children cumulated vsize (KiB) 84288

[startup+282.301 s]
/proc/loadavg: 1.97 1.92 1.62 2/109 24517
/proc/meminfo: memFree=1737408/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=77192 CPUtime=473.96
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 194783 0 0 0 47247 149 0 0 18 0 2 0 177262899 79044608 11622 1992294400 134512640 146736320 4288035504 18446744073709551615 136385183 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24507/statm: 19298 11622 1083 2985 0 15840 0
[pid=24507/tid=24513] ppid=24506 vsize=77192 CPUtime=159.89
/proc/24507/task/24513/stat : 24513 (pb_cplex) R 24506 24506 24318 0 -1 4202560 103356 0 0 0 15919 70 0 0 19 0 2 0 177272939 79044608 11622 1992294400 134512640 146736320 4288035504 18446744073709551615 136008069 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 473.96
Current children cumulated vsize (KiB) 85892

[startup+342.301 s]
/proc/loadavg: 2.11 1.95 1.65 5/109 24519
/proc/meminfo: memFree=1735316/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=80796 CPUtime=582.38
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 239287 0 0 0 58050 188 0 0 20 0 2 0 177262899 82735104 12368 1992294400 134512640 146736320 4288035504 18446744073709551615 136009115 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24507/statm: 20199 12368 1083 2985 0 16741 0
[pid=24507/tid=24513] ppid=24506 vsize=80796 CPUtime=211.4
/proc/24507/task/24513/stat : 24513 (pb_cplex) R 24506 24506 24318 0 -1 4202560 140241 0 0 0 21043 97 0 0 18 0 2 0 177272939 82735104 12368 1992294400 134512640 146736320 4288035504 18446744073709551615 136474228 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 582.38
Current children cumulated vsize (KiB) 89496

################
# More data... #
################

[pid=24507] ppid=24506 vsize=82676 CPUtime=805.13
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 307622 0 0 0 80259 254 0 0 25 0 2 0 177262899 84660224 12836 1992294400 134512640 146736320 4288035504 18446744073709551615 136000326 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24507/statm: 20669 12836 1083 2985 0 17211 0
[pid=24507/tid=24513] ppid=24506 vsize=82676 CPUtime=321.13
/proc/24507/task/24513/stat : 24513 (pb_cplex) R 24506 24506 24318 0 -1 4202560 168036 0 0 0 31988 125 0 0 19 0 2 0 177272939 84660224 12836 1992294400 134512640 146736320 4288035504 18446744073709551615 135846449 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 805.13
Current children cumulated vsize (KiB) 91376

[startup+522.302 s]
/proc/loadavg: 2.42 2.18 1.79 3/109 24523
/proc/meminfo: memFree=1732216/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=81552 CPUtime=918.62
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 346307 0 0 0 91572 290 0 0 18 0 2 0 177262899 83509248 12588 1992294400 134512640 146736320 4288035504 18446744073709551615 135655923 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24507/statm: 20388 12588 1083 2985 0 16930 0
[pid=24507/tid=24513] ppid=24506 vsize=81552 CPUtime=376.99
/proc/24507/task/24513/stat : 24513 (pb_cplex) R 24506 24506 24318 0 -1 4202560 189224 0 0 0 37555 144 0 0 18 0 2 0 177272939 83509248 12588 1992294400 134512640 146736320 4288035504 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 918.62
Current children cumulated vsize (KiB) 90252

[startup+582.302 s]
/proc/loadavg: 2.05 2.14 1.80 3/109 24525
/proc/meminfo: memFree=1727008/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=87156 CPUtime=1029.56
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 370137 0 0 0 102641 315 0 0 19 0 2 0 177262899 89247744 13881 1992294400 134512640 146736320 4288035504 18446744073709551615 136008450 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24507/statm: 21789 13881 1084 2985 0 18331 0
[pid=24507/tid=24513] ppid=24506 vsize=87156 CPUtime=432.83
/proc/24507/task/24513/stat : 24513 (pb_cplex) R 24506 24506 24318 0 -1 4202560 201006 0 0 0 43126 157 0 0 25 0 2 0 177272939 89247744 13881 1992294400 134512640 146736320 4288035504 18446744073709551615 136403109 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1029.56
Current children cumulated vsize (KiB) 95856

[startup+642.301 s]
/proc/loadavg: 2.22 2.16 1.82 4/109 24527
/proc/meminfo: memFree=1727008/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=87160 CPUtime=1141.51
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 388148 0 0 0 113811 340 0 0 18 0 2 0 177262899 89251840 13883 1992294400 134512640 146736320 4288035504 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24507/statm: 21790 13883 1083 2985 0 18332 0
[pid=24507/tid=24513] ppid=24506 vsize=87160 CPUtime=489.52
/proc/24507/task/24513/stat : 24513 (pb_cplex) R 24506 24506 24318 0 -1 4202560 213133 0 0 0 48781 171 0 0 18 0 2 0 177272939 89251840 13883 1992294400 134512640 146736320 4288035504 18446744073709551615 136403114 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1141.51
Current children cumulated vsize (KiB) 95860

[startup+702.302 s]
/proc/loadavg: 2.52 2.25 1.87 2/109 24529
/proc/meminfo: memFree=1726264/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=87168 CPUtime=1255.48
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 416432 0 0 0 125180 368 0 0 17 0 2 0 177262899 89260032 13887 1992294400 134512640 146736320 4288035504 18446744073709551615 135456863 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24507/statm: 21792 13887 1083 2985 0 18334 0
[pid=24507/tid=24513] ppid=24506 vsize=87168 CPUtime=547.59
/proc/24507/task/24513/stat : 24513 (pb_cplex) R 24506 24506 24318 0 -1 4202560 230998 0 0 0 54573 186 0 0 21 0 2 0 177272939 89260032 13887 1992294400 134512640 146736320 4288035504 18446744073709551615 136385175 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1255.48
Current children cumulated vsize (KiB) 95868

[startup+762.309 s]
/proc/loadavg: 2.55 2.29 1.91 3/109 24531
/proc/meminfo: memFree=1727132/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=86820 CPUtime=1369.31
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 441182 0 0 0 136534 397 0 0 25 0 2 0 177262899 88903680 13830 1992294400 134512640 146736320 4288035504 18446744073709551615 136385174 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24507/statm: 21705 13830 1083 2985 0 18247 0
[pid=24507/tid=24513] ppid=24506 vsize=86820 CPUtime=604.47
/proc/24507/task/24513/stat : 24513 (pb_cplex) S 24506 24506 24318 0 -1 4202560 252086 0 0 0 60242 205 0 0 21 0 2 0 177272939 88903680 13830 1992294400 134512640 146736320 4288035504 18446744073709551615 144580073 0 2 4096 16387 18446604437850950592 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1369.31
Current children cumulated vsize (KiB) 95520

[startup+822.301 s]
/proc/loadavg: 2.91 2.43 1.98 3/109 24531
/proc/meminfo: memFree=1727008/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=86828 CPUtime=1481.31
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 470241 0 0 0 147706 425 0 0 18 0 2 0 177262899 88911872 13832 1992294400 134512640 146736320 4288035504 18446744073709551615 136400440 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24507/statm: 21707 13832 1083 2985 0 18249 0
[pid=24507/tid=24513] ppid=24506 vsize=86828 CPUtime=659.87
/proc/24507/task/24513/stat : 24513 (pb_cplex) R 24506 24506 24318 0 -1 4202560 252086 0 0 0 65775 212 0 0 22 0 2 0 177272939 88911872 13832 1992294400 134512640 146736320 4288035504 18446744073709551615 136385170 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1481.31
Current children cumulated vsize (KiB) 95528

[startup+882.301 s]
/proc/loadavg: 2.85 2.49 2.03 3/109 24533
/proc/meminfo: memFree=1726760/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=87112 CPUtime=1593.86
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 497733 0 0 0 158933 453 0 0 19 0 2 0 177262899 89202688 13891 1992294400 134512640 146736320 4288035504 18446744073709551615 136403109 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24507/statm: 21778 13891 1083 2985 0 18320 0
[pid=24507/tid=24513] ppid=24506 vsize=87112 CPUtime=716.7
/proc/24507/task/24513/stat : 24513 (pb_cplex) R 24506 24506 24318 0 -1 4202560 252086 0 0 0 71451 219 0 0 19 0 2 0 177272939 89202688 13891 1992294400 134512640 146736320 4288035504 18446744073709551615 135526134 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1593.86
Current children cumulated vsize (KiB) 95812

[startup+942.301 s]
/proc/loadavg: 2.47 2.45 2.04 3/109 24535
/proc/meminfo: memFree=1721428/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=94028 CPUtime=1708.23
/proc/24507/stat : 24507 (pb_cplex) R 24506 24506 24318 0 -1 4202496 523090 0 0 0 170345 478 0 0 25 0 2 0 177262899 96284672 15254 1992294400 134512640 146736320 4288035504 18446744073709551615 136008050 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24507/statm: 23507 15254 1084 2985 0 20049 0
[pid=24507/tid=24513] ppid=24506 vsize=94028 CPUtime=772.72
/proc/24507/task/24513/stat : 24513 (pb_cplex) R 24506 24506 24318 0 -1 4202560 256592 0 0 0 77043 229 0 0 25 0 2 0 177272939 96284672 15254 1992294400 134512640 146736320 4288035504 18446744073709551615 136000313 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1708.23
Current children cumulated vsize (KiB) 102728



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+992.9 s]
/proc/loadavg: 2.11 2.36 2.03 2/109 24537
/proc/meminfo: memFree=1723288/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=89996 CPUtime=1800.04
/proc/24507/stat : 24507 (pb_cplex) S 24506 24506 24318 0 -1 4202496 563489 0 0 0 179497 507 0 0 25 0 2 0 177262899 92155904 14771 1992294400 134512640 146736320 4288035504 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24507/statm: 22499 14771 1088 2985 0 19041 0
[pid=24507/tid=24513] ppid=24506 vsize=89996 CPUtime=823.3
/proc/24507/task/24513/stat : 24513 (pb_cplex) R 24506 24506 24318 0 -1 4202560 270231 0 0 0 82091 239 0 0 25 0 2 0 177272939 92155904 14771 1992294400 134512640 146736320 4288035504 18446744073709551615 136403112 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1800.04
Current children cumulated vsize (KiB) 98696

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+992.9 s]
/proc/loadavg: 2.11 2.36 2.03 2/109 24537
/proc/meminfo: memFree=1723288/2059040 swapFree=4139180/4192956
[pid=24506] ppid=24504 vsize=8700 CPUtime=0
/proc/24506/stat : 24506 (run) S 24504 24506 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177262898 8908800 249 1992294400 4194304 4922060 140734290941168 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24506/statm: 2175 249 208 178 0 68 0
[pid=24507] ppid=24506 vsize=89996 CPUtime=1800.04
/proc/24507/stat : 24507 (pb_cplex) S 24506 24506 24318 0 -1 4202496 563489 0 0 0 179497 507 0 0 25 0 2 0 177262899 92155904 14771 1992294400 134512640 146736320 4288035504 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/24507/statm: 22499 14771 1088 2985 0 19041 0
[pid=24507/tid=24513] ppid=24506 vsize=89996 CPUtime=823.3
/proc/24507/task/24513/stat : 24513 (pb_cplex) R 24506 24506 24318 0 -1 4202560 270231 0 0 0 82091 239 0 0 25 0 2 0 177272939 92155904 14771 1992294400 134512640 146736320 4288035504 18446744073709551615 136403112 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1800.04
Current children cumulated vsize (KiB) 98696

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24506 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.001998
# while last known CPU time is 1800.04
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 992.919
CPU time (s): 1800.04
CPU user time (s): 1794.97
CPU system time (s): 5.07
CPU usage (%): 181.288
Max. virtual memory (cumulated for all children) (KiB): 104908

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.000999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 365
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 2

runsolver used 1.9827 second user time and 5.15721 second system time

The end

Launcher Data 

Begin job on node007 at 2010-07-01 22:36:34
IDJOB=2696057
IDBENCH=1873
IDSOLVER=1209
FILE ID=node007/2696057-1278016594
PBS_JOBID= 11198747
Free space on /tmp= 62228 MiB

SOLVER NAME= pb_cplex 2010-06-29
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/mps-v2-20-10/MIPLIB/miplib2003/normalized-mps-v2-20-10-seymour.opb
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2696057-1278016594/watcher-2696057-1278016594 -o /tmp/evaluation-result-2696057-1278016594/solver-2696057-1278016594 -C 1800 -W 2000 -M 1800  run HOME/instance-2696057-1278016594.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 97ebaccbda37d5c570b4e2ec3cd7f8f0
RANDOM SEED=697111089

node007.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.264
cache size	: 2048 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6000.52
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.264
cache size	: 2048 KB
physical id	: 3
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5599.44
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2059040 kB
MemFree:       1782104 kB
Buffers:         65996 kB
Cached:         115396 kB
SwapCached:       7692 kB
Active:         103528 kB
Inactive:        92512 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2059040 kB
LowFree:       1782104 kB
SwapTotal:     4192956 kB
SwapFree:      4139180 kB
Dirty:           16928 kB
Writeback:           0 kB
AnonPages:       12268 kB
Mapped:          11784 kB
Slab:            58916 kB
PageTables:       4224 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   5222476 kB
Committed_AS:   181860 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    264948 kB
VmallocChunk: 34359471699 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62212 MiB
End job on node007 at 2010-07-01 22:53:09