Trace number 2695773

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pb_cplex 2010-06-29? (TO) 1800.05 1402.82

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-LIN/submittedPB07/
aksoy/decomp/normalized-matrix_5x3_9.opb
MD5SUMd90f6236f870e45ceb3cd4a6e4593f30
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark24
Best CPU time to get the best result obtained on this benchmark1800.45
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 24
Optimality of the best value was proved NO
Number of variables14352
Total number of constraints53247
Number of constraints which are clauses53237
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints9
Minimum length of a constraint1
Maximum length of a constraint1036
Number of terms in the objective function 1036
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 1036
Number of bits of the sum of numbers in the objective function 11
Biggest number in a constraint 32
Number of bits of the biggest number in a constraint 6
Biggest sum of numbers in a constraint 1068
Number of bits of the biggest sum of numbers11
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-2695773-1278021616.opb.
0.00/0.00	c Instance file HOME/instance-2695773-1278021616.opb
0.00/0.00	c File size is 1582828 bytes.
1.19/1.21	c Highest Coefficient sum: 1068
1.19/1.21	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
1.19/1.29	c ============================[ Problem Statistics ]=============================
1.19/1.29	c |                                                                             |
1.19/1.29	c |  Parsing time:          1.27         s                                      |
1.19/1.29	c |  Number Variables:      14352                                               |
1.28/1.31	c |  Number Constraints:    53247                                               |
1.28/1.31	c ===============================================================================
1800.05/1402.81	c Remaining time 1798.72 sec.
1800.05/1402.81	c 
1800.05/1402.81	c *** INTERRUPTED ***
1800.05/1402.81	s UNKNOWN
1800.05/1402.81	c Total CPU time              : 1797.14 s
1800.05/1402.81	c Memory used           : 273.77 MB
1800.05/1402.81	c CPU time              : 1797.14 s
1800.05/1402.81	c 
1800.05/1402.81	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2695773-1278021616/watcher-2695773-1278021616 -o /tmp/evaluation-result-2695773-1278021616/solver-2695773-1278021616 -C 1800 -W 2000 -M 1800 run HOME/instance-2695773-1278021616.opb 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.74 1.34 1.16 3/106 388
/proc/meminfo: memFree=1862256/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) R 386 388 32219 0 -1 4202496 349 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210369429 0 65538 4100 65536 0 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0

[startup+0.0683379 s]
/proc/loadavg: 1.74 1.34 1.16 3/106 388
/proc/meminfo: memFree=1862256/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.101339 s]
/proc/loadavg: 1.74 1.34 1.16 3/106 388
/proc/meminfo: memFree=1862256/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.301357 s]
/proc/loadavg: 1.74 1.34 1.16 3/106 388
/proc/meminfo: memFree=1862256/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.701391 s]
/proc/loadavg: 1.74 1.34 1.16 3/106 388
/proc/meminfo: memFree=1862256/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50147 s]
/proc/loadavg: 1.74 1.34 1.16 2/108 391
/proc/meminfo: memFree=1849592/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=47120 CPUtime=1.48
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 11631 0 0 0 145 3 0 0 18 0 1 0 143456133 48250880 8407 1992294400 134512640 146736320 4290099632 18446744073709551615 138736946 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/390/statm: 11780 8407 740 2985 0 8322 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 55820

[startup+3.1016 s]
/proc/loadavg: 1.74 1.34 1.16 2/108 391
/proc/meminfo: memFree=1829008/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=102716 CPUtime=3.09
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 19300 0 0 0 303 6 0 0 20 0 1 0 143456133 105181184 11553 1992294400 134512640 146736320 4290099632 18446744073709551615 136891163 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/390/statm: 25679 11553 790 2985 0 22221 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 111416

[startup+6.30087 s]
/proc/loadavg: 1.68 1.33 1.16 2/108 391
/proc/meminfo: memFree=1796520/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=136716 CPUtime=6.28
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 33638 0 0 0 616 12 0 0 25 0 1 0 143456133 139997184 17008 1992294400 134512640 146736320 4290099632 18446744073709551615 135854189 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/390/statm: 34179 17008 896 2985 0 30721 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 145416

[startup+12.7004 s]
/proc/loadavg: 1.63 1.33 1.16 2/108 393
/proc/meminfo: memFree=1795404/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=137204 CPUtime=12.68
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 36222 0 0 0 1255 13 0 0 25 0 1 0 143456133 140496896 17182 1992294400 134512640 146736320 4290099632 18446744073709551615 135454096 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/390/statm: 34301 17182 896 2985 0 30843 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 145904

[startup+25.5015 s]
/proc/loadavg: 1.49 1.31 1.16 2/108 393
/proc/meminfo: memFree=1793668/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=138756 CPUtime=25.48
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 44469 0 0 0 2531 17 0 0 25 0 1 0 143456133 142086144 17638 1992294400 134512640 146736320 4290099632 18446744073709551615 139028318 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/390/statm: 34689 17638 896 2985 0 31231 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 147456

[startup+51.1007 s]
/proc/loadavg: 1.32 1.28 1.15 2/108 403
/proc/meminfo: memFree=1792924/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=139032 CPUtime=51.05
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 55969 0 0 0 5083 22 0 0 25 0 1 0 143456133 142368768 17775 1992294400 134512640 146736320 4290099632 18446744073709551615 139028328 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/390/statm: 34758 17775 896 2985 0 31300 0
Current children cumulated CPU time (s) 51.05
Current children cumulated vsize (KiB) 147732

[startup+102.309 s]
/proc/loadavg: 1.14 1.24 1.14 2/108 405
/proc/meminfo: memFree=1785608/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=143584 CPUtime=102.25
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 96187 0 0 0 10188 37 0 0 25 0 1 0 143456133 147030016 19751 1992294400 134512640 146736320 4290099632 18446744073709551615 136403129 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/390/statm: 35896 19751 1008 2985 0 32438 0
Current children cumulated CPU time (s) 102.25
Current children cumulated vsize (KiB) 152284

[startup+162.301 s]
/proc/loadavg: 1.05 1.19 1.13 2/108 407
/proc/meminfo: memFree=1782384/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=146792 CPUtime=162.22
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 120795 0 0 0 16175 47 0 0 25 0 1 0 143456133 150315008 20566 1992294400 134512640 146736320 4290099632 18446744073709551615 136403116 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/390/statm: 36698 20566 1003 2985 0 33240 0
Current children cumulated CPU time (s) 162.22
Current children cumulated vsize (KiB) 155492

[startup+222.301 s]
/proc/loadavg: 1.02 1.15 1.12 2/108 407
/proc/meminfo: memFree=1782384/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=146792 CPUtime=222.21
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 143294 0 0 0 22165 56 0 0 25 0 1 0 143456133 150315008 20566 1992294400 134512640 146736320 4290099632 18446744073709551615 136400447 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/390/statm: 36698 20566 1003 2985 0 33240 0
Current children cumulated CPU time (s) 222.21
Current children cumulated vsize (KiB) 155492

[startup+282.302 s]
/proc/loadavg: 1.00 1.12 1.11 2/108 409
/proc/meminfo: memFree=1781392/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=146792 CPUtime=282.19
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 165788 0 0 0 28156 63 0 0 25 0 1 0 143456133 150315008 20819 1992294400 134512640 146736320 4290099632 18446744073709551615 136017481 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/390/statm: 36698 20819 1004 2985 0 33240 0
Current children cumulated CPU time (s) 282.19
Current children cumulated vsize (KiB) 155492

[startup+342.301 s]
/proc/loadavg: 1.00 1.10 1.10 2/108 411
/proc/meminfo: memFree=1781516/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=146792 CPUtime=342.18
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 196466 0 0 0 34143 75 0 0 25 0 1 0 143456133 150315008 20819 1992294400 134512640 146736320 4290099632 18446744073709551615 135854541 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/390/statm: 36698 20819 1004 2985 0 33240 0
Current children cumulated CPU time (s) 342.18
Current children cumulated vsize (KiB) 155492

[startup+402.301 s]
/proc/loadavg: 1.37 1.17 1.12 2/109 417
/proc/meminfo: memFree=1723476/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=244652 CPUtime=416.91
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 264463 0 0 0 41579 112 0 0 25 0 2 0 143456133 250523648 35365 1992294400 134512640 146736320 4290099632 18446744073709551615 139044509 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/390/statm: 61163 35365 1086 2985 0 57705 0
[pid=390/tid=417] ppid=388 vsize=244652 CPUtime=0
/proc/390/task/417/stat : 417 (pb_cplex) S 388 388 32219 0 -1 4202560 0 0 0 0 0 0 0 0 19 0 2 0 143495792 250523648 35365 1992294400 134512640 146736320 4290099632 18446744073709551615 144580073 0 2 4096 16387 18446604437839804416 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 416.91
Current children cumulated vsize (KiB) 253352

################
# More data... #
################

[pid=390] ppid=388 vsize=283068 CPUtime=945.73
/proc/390/stat : 390 (pb_cplex) S 388 388 32219 0 -1 4202496 401161 0 0 0 94392 181 0 0 25 0 2 0 143456133 289861632 43813 1992294400 134512640 146736320 4290099632 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/390/statm: 70767 43813 1124 2985 0 67309 0
[pid=390/tid=417] ppid=388 vsize=283068 CPUtime=235.9
/proc/390/task/417/stat : 417 (pb_cplex) R 388 388 32219 0 -1 4202560 63943 0 0 0 23556 34 0 0 25 0 2 0 143495792 289861632 43813 1992294400 134512640 146736320 4290099632 18446744073709551615 136008441 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 945.73
Current children cumulated vsize (KiB) 291768

[startup+882.301 s]
/proc/loadavg: 1.04 1.19 1.15 2/109 429
/proc/meminfo: memFree=1689252/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=282664 CPUtime=1005.71
/proc/390/stat : 390 (pb_cplex) S 388 388 32219 0 -1 4202496 423744 0 0 0 100379 192 0 0 25 0 2 0 143456133 289447936 43768 1992294400 134512640 146736320 4290099632 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/390/statm: 70666 43768 1125 2985 0 67208 0
[pid=390/tid=417] ppid=388 vsize=282664 CPUtime=295.87
/proc/390/task/417/stat : 417 (pb_cplex) R 388 388 32219 0 -1 4202560 86526 0 0 0 29542 45 0 0 25 0 2 0 143495792 289447936 43768 1992294400 134512640 146736320 4290099632 18446744073709551615 136000483 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1005.71
Current children cumulated vsize (KiB) 291364

[startup+942.302 s]
/proc/loadavg: 1.01 1.15 1.13 2/109 431
/proc/meminfo: memFree=1688508/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=289584 CPUtime=1065.69
/proc/390/stat : 390 (pb_cplex) S 388 388 32219 0 -1 4202496 439341 0 0 0 106371 198 0 0 25 0 2 0 143456133 296534016 44551 1992294400 134512640 146736320 4290099632 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/390/statm: 72396 44551 1125 2985 0 68938 0
[pid=390/tid=417] ppid=388 vsize=289584 CPUtime=355.86
/proc/390/task/417/stat : 417 (pb_cplex) R 388 388 32219 0 -1 4202560 102123 0 0 0 35535 51 0 0 25 0 2 0 143495792 296534016 44551 1992294400 134512640 146736320 4290099632 18446744073709551615 136000534 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1065.69
Current children cumulated vsize (KiB) 298284

[startup+1002.3 s]
/proc/loadavg: 1.60 1.28 1.18 3/109 434
/proc/meminfo: memFree=1688632/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=280128 CPUtime=1171.61
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 462957 0 0 0 116949 212 0 0 25 0 2 0 143456133 286851072 43833 1992294400 134512640 146736320 4290099632 18446744073709551615 136007970 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/390/statm: 70032 43833 1124 2985 0 66574 0
[pid=390/tid=417] ppid=388 vsize=280128 CPUtime=415.85
/proc/390/task/417/stat : 417 (pb_cplex) R 388 388 32219 0 -1 4202560 116039 0 0 0 41527 58 0 0 25 0 2 0 143495792 286851072 43833 1992294400 134512640 146736320 4290099632 18446744073709551615 136008163 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1171.61
Current children cumulated vsize (KiB) 288828

[startup+1062.3 s]
/proc/loadavg: 1.85 1.41 1.22 3/109 436
/proc/meminfo: memFree=1688260/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=286148 CPUtime=1291.13
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 488473 0 0 0 128885 228 0 0 25 0 2 0 143456133 293015552 44456 1992294400 134512640 146736320 4290099632 18446744073709551615 136400472 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/390/statm: 71537 44456 1124 2985 0 68079 0
[pid=390/tid=417] ppid=388 vsize=286148 CPUtime=475.83
/proc/390/task/417/stat : 417 (pb_cplex) R 388 388 32219 0 -1 4202560 128866 0 0 0 47517 66 0 0 25 0 2 0 143495792 293015552 44456 1992294400 134512640 146736320 4290099632 18446744073709551615 136008042 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1291.13
Current children cumulated vsize (KiB) 294848

[startup+1122.3 s]
/proc/loadavg: 1.83 1.47 1.26 3/109 436
/proc/meminfo: memFree=1688136/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=280308 CPUtime=1395.84
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 509615 0 0 0 139343 241 0 0 25 0 2 0 143456133 287035392 43906 1992294400 134512640 146736320 4290099632 18446744073709551615 136403112 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/390/statm: 70077 43906 1124 2985 0 66619 0
[pid=390/tid=417] ppid=388 vsize=280308 CPUtime=535.82
/proc/390/task/417/stat : 417 (pb_cplex) R 388 388 32219 0 -1 4202560 142011 0 0 0 53508 74 0 0 25 0 2 0 143495792 287035392 43906 1992294400 134512640 146736320 4290099632 18446744073709551615 136008396 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1395.84
Current children cumulated vsize (KiB) 289008

[startup+1182.3 s]
/proc/loadavg: 1.97 1.58 1.30 3/109 438
/proc/meminfo: memFree=1685036/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=286164 CPUtime=1515.37
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 533704 0 0 0 151282 255 0 0 25 0 2 0 143456133 293031936 44867 1992294400 134512640 146736320 4290099632 18446744073709551615 136403109 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/390/statm: 71541 44867 1124 2985 0 68083 0
[pid=390/tid=417] ppid=388 vsize=286164 CPUtime=595.81
/proc/390/task/417/stat : 417 (pb_cplex) R 388 388 32219 0 -1 4202560 154518 0 0 0 59500 81 0 0 25 0 2 0 143495792 293031936 44867 1992294400 134512640 146736320 4290099632 18446744073709551615 135983217 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1515.37
Current children cumulated vsize (KiB) 294864

[startup+1242.3 s]
/proc/loadavg: 1.36 1.47 1.28 2/109 440
/proc/meminfo: memFree=1685904/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=283968 CPUtime=1576.84
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 547855 0 0 0 157422 262 0 0 25 0 2 0 143456133 290783232 44558 1992294400 134512640 146736320 4290099632 18446744073709551615 136008050 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/390/statm: 70992 44558 1124 2985 0 67534 0
[pid=390/tid=417] ppid=388 vsize=283968 CPUtime=597.31
/proc/390/task/417/stat : 417 (pb_cplex) S 388 388 32219 0 -1 4202560 154805 0 0 0 59650 81 0 0 25 0 2 0 143495792 290783232 44558 1992294400 134512640 146736320 4290099632 18446744073709551615 144580073 0 2 4096 16387 18446604437839804416 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1576.84
Current children cumulated vsize (KiB) 292668

[startup+1302.3 s]
/proc/loadavg: 1.13 1.38 1.26 2/109 442
/proc/meminfo: memFree=1685780/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=283968 CPUtime=1636.83
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 563583 0 0 0 163414 269 0 0 25 0 2 0 143456133 290783232 44567 1992294400 134512640 146736320 4290099632 18446744073709551615 136388877 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/390/statm: 70992 44567 1123 2985 0 67534 0
[pid=390/tid=417] ppid=388 vsize=283968 CPUtime=597.31
/proc/390/task/417/stat : 417 (pb_cplex) S 388 388 32219 0 -1 4202560 154805 0 0 0 59650 81 0 0 25 0 2 0 143495792 290783232 44567 1992294400 134512640 146736320 4290099632 18446744073709551615 144580073 0 2 4096 16387 18446604437839804416 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1636.83
Current children cumulated vsize (KiB) 292668

[startup+1362.3 s]
/proc/loadavg: 1.33 1.37 1.26 3/109 444
/proc/meminfo: memFree=1685656/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=280340 CPUtime=1719.37
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 586762 0 0 0 171655 282 0 0 25 0 2 0 143456133 287068160 44489 1992294400 134512640 146736320 4290099632 18446744073709551615 136003493 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/390/statm: 70085 44489 1112 2985 0 66627 0
[pid=390/tid=417] ppid=388 vsize=280340 CPUtime=620.05
/proc/390/task/417/stat : 417 (pb_cplex) R 388 388 32219 0 -1 4202560 159219 0 0 0 61921 84 0 0 25 0 2 0 143495792 287068160 44489 1992294400 134512640 146736320 4290099632 18446744073709551615 136008423 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1719.37
Current children cumulated vsize (KiB) 289040



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1402.8 s]
/proc/loadavg: 1.65 1.45 1.29 3/109 444
/proc/meminfo: memFree=1685656/2059040 swapFree=4139368/4192956
[pid=388] ppid=386 vsize=8700 CPUtime=0
/proc/388/stat : 388 (run) S 386 388 32219 0 -1 4202496 365 0 0 0 0 0 0 0 17 0 1 0 143456133 8908800 249 1992294400 4194304 4922060 140734543230800 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/388/statm: 2175 249 208 178 0 68 0
[pid=390] ppid=388 vsize=280340 CPUtime=1800.05
/proc/390/stat : 390 (pb_cplex) R 388 388 32219 0 -1 4202496 604698 0 0 0 179712 293 0 0 25 0 2 0 143456133 287068160 44493 1992294400 134512640 146736320 4290099632 18446744073709551615 136384895 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/390/statm: 70085 44493 1112 2985 0 66627 0
[pid=390/tid=417] ppid=388 vsize=280340 CPUtime=660.55
/proc/390/task/417/stat : 417 (pb_cplex) R 388 388 32219 0 -1 4202560 168619 0 0 0 65965 90 0 0 25 0 2 0 143495792 287068160 44493 1992294400 134512640 146736320 4290099632 18446744073709551615 139042876 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1800.05
Current children cumulated vsize (KiB) 289040

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 388 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=2999
# CPU time returned by wait4() is 0.002999
# while last known CPU time is 1800.05
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1402.82
CPU time (s): 1800.05
CPU user time (s): 1797.12
CPU system time (s): 2.93
CPU usage (%): 128.316
Max. virtual memory (cumulated for all children) (KiB): 302756

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 365
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 2

runsolver used 2.46563 second user time and 6.86796 second system time

The end

Launcher Data 

Begin job on node031 at 2010-07-02 00:00:17
IDJOB=2695773
IDBENCH=25016
IDSOLVER=1209
FILE ID=node031/2695773-1278021616
PBS_JOBID= 11198731
Free space on /tmp= 62392 MiB

SOLVER NAME= pb_cplex 2010-06-29
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-LIN/submittedPB07/aksoy/decomp/normalized-matrix_5x3_9.opb
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2695773-1278021616/watcher-2695773-1278021616 -o /tmp/evaluation-result-2695773-1278021616/solver-2695773-1278021616 -C 1800 -W 2000 -M 1800  run HOME/instance-2695773-1278021616.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= d90f6236f870e45ceb3cd4a6e4593f30
RANDOM SEED=1796531899

node031.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.219
cache size	: 2048 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6000.43
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.219
cache size	: 2048 KB
physical id	: 3
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5599.53
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2059040 kB
MemFree:       1862908 kB
Buffers:          7332 kB
Cached:          95644 kB
SwapCached:       6868 kB
Active:         103084 kB
Inactive:        13880 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2059040 kB
LowFree:       1862908 kB
SwapTotal:     4192956 kB
SwapFree:      4139368 kB
Dirty:           18088 kB
Writeback:           0 kB
AnonPages:       12348 kB
Mapped:          12124 kB
Slab:            57060 kB
PageTables:       4144 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   5222476 kB
Committed_AS:   182056 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    264964 kB
VmallocChunk: 34359471699 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62376 MiB
End job on node031 at 2010-07-02 00:23:41