Trace number 2695769

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pb_cplex 2010-06-29? (TO) 1800.15 1088.52

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-LIN/submittedPB07/
aksoy/decomp/normalized-matrix_5x3_3.opb
MD5SUM82a3d84200b069df277c7f14e0e883d0
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark24
Best CPU time to get the best result obtained on this benchmark1800.07
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 23
Optimality of the best value was proved NO
Number of variables6076
Total number of constraints21401
Number of constraints which are clauses21392
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints8
Minimum length of a constraint1
Maximum length of a constraint666
Number of terms in the objective function 666
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 666
Number of bits of the sum of numbers in the objective function 10
Biggest number in a constraint 31
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 697
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-2695769-1278021515.opb.
0.00/0.00	c Instance file HOME/instance-2695769-1278021515.opb
0.00/0.00	c File size is 619623 bytes.
0.00/0.47	c Highest Coefficient sum: 697
0.00/0.47	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.50	c ============================[ Problem Statistics ]=============================
0.00/0.50	c |                                                                             |
0.00/0.50	c |  Parsing time:          0.49         s                                      |
0.00/0.50	c |  Number Variables:      6076                                                |
0.00/0.51	c |  Number Constraints:    21401                                               |
0.00/0.51	c ===============================================================================
1800.15/1088.51	c Remaining time 1799.51 sec.
1800.15/1088.51	c 
1800.15/1088.51	c *** INTERRUPTED ***
1800.15/1088.51	s UNKNOWN
1800.15/1088.51	c Total CPU time              : 1795.62 s
1800.15/1088.51	c Memory used           : 122.87 MB
1800.15/1088.51	c CPU time              : 1795.62 s
1800.15/1088.51	c 
1800.15/1088.51	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2695769-1278021515/watcher-2695769-1278021515 -o /tmp/evaluation-result-2695769-1278021515/solver-2695769-1278021515 -C 1800 -W 2000 -M 1800 run HOME/instance-2695769-1278021515.opb 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.07 1.43 1.60 3/106 29963
/proc/meminfo: memFree=1451648/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0

[startup+0.0220879 s]
/proc/loadavg: 1.07 1.43 1.60 3/106 29963
/proc/meminfo: memFree=1451648/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.101092 s]
/proc/loadavg: 1.07 1.43 1.60 3/106 29963
/proc/meminfo: memFree=1451648/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.301105 s]
/proc/loadavg: 1.07 1.43 1.60 3/106 29963
/proc/meminfo: memFree=1451648/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.701142 s]
/proc/loadavg: 1.07 1.43 1.60 3/106 29963
/proc/meminfo: memFree=1451648/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50118 s]
/proc/loadavg: 1.07 1.43 1.60 2/108 29965
/proc/meminfo: memFree=1430924/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=64964 CPUtime=1.48
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 11268 0 0 0 144 4 0 0 19 0 1 0 143446860 66523136 7888 1992294400 134512640 146736320 4288980336 18446744073709551615 136475777 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/29964/statm: 16241 7888 897 2985 0 12783 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 73664

[startup+3.1013 s]
/proc/loadavg: 1.06 1.42 1.59 2/108 29965
/proc/meminfo: memFree=1421748/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=65940 CPUtime=3.08
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 12601 0 0 0 303 5 0 0 22 0 1 0 143446860 67522560 8179 1992294400 134512640 146736320 4288980336 18446744073709551615 139046505 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/29964/statm: 16485 8179 897 2985 0 13027 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 74640

[startup+6.3005 s]
/proc/loadavg: 1.06 1.42 1.59 2/108 29965
/proc/meminfo: memFree=1420508/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=66060 CPUtime=6.29
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 14591 0 0 0 623 6 0 0 25 0 1 0 143446860 67645440 8264 1992294400 134512640 146736320 4288980336 18446744073709551615 136405932 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/29964/statm: 16515 8264 894 2985 0 13057 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 74760

[startup+12.7019 s]
/proc/loadavg: 1.05 1.41 1.59 2/108 29965
/proc/meminfo: memFree=1408976/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=83216 CPUtime=12.69
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 24469 0 0 0 1259 10 0 0 25 0 1 0 143446860 85213184 11482 1992294400 134512640 146736320 4288980336 18446744073709551615 136403116 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/29964/statm: 20804 11482 1036 2985 0 17346 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 91916

[startup+25.5007 s]
/proc/loadavg: 1.04 1.40 1.58 2/108 29965
/proc/meminfo: memFree=1418028/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=68308 CPUtime=25.48
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 39091 0 0 0 2532 16 0 0 25 0 1 0 143446860 69947392 9041 1992294400 134512640 146736320 4288980336 18446744073709551615 136017495 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/29964/statm: 17077 9041 997 2985 0 13619 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 77008

[startup+51.1014 s]
/proc/loadavg: 1.03 1.36 1.56 2/109 29966
/proc/meminfo: memFree=1399048/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=107312 CPUtime=51.07
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 65167 0 0 0 5080 27 0 0 25 0 2 0 143446860 109887488 13851 1992294400 134512640 146736320 4288980336 18446744073709551615 136008427 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 26828 13851 1050 2985 0 23370 0
[pid=29964/tid=29966] ppid=29963 vsize=107312 CPUtime=0
/proc/29964/task/29966/stat : 29966 (pb_cplex) S 29963 29963 28646 0 -1 4202560 6 0 0 0 0 0 0 0 18 0 2 0 143451362 109887488 13851 1992294400 134512640 146736320 4288980336 18446744073709551615 144580073 0 2 4096 16387 18446604437814000576 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 116012

[startup+102.309 s]
/proc/loadavg: 1.20 1.35 1.54 3/109 29968
/proc/meminfo: memFree=1386152/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=123020 CPUtime=118.11
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 93685 0 0 0 11768 43 0 0 25 0 2 0 143446860 125972480 17049 1992294400 134512640 146736320 4288980336 18446744073709551615 136008178 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 30755 17049 1050 2985 0 27297 0
[pid=29964/tid=29966] ppid=29963 vsize=123020 CPUtime=30.1
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 13524 0 0 0 3002 8 0 0 25 0 2 0 143451362 125972480 17049 1992294400 134512640 146736320 4288980336 18446744073709551615 136008050 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 118.11
Current children cumulated vsize (KiB) 131720

[startup+162.302 s]
/proc/loadavg: 1.44 1.39 1.54 3/109 29979
/proc/meminfo: memFree=1384540/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=123796 CPUtime=198.8
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 123020 0 0 0 19822 58 0 0 25 0 2 0 143446860 126767104 17500 1992294400 134512640 146736320 4288980336 18446744073709551615 136008443 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 30949 17500 1051 2985 0 27491 0
[pid=29964/tid=29966] ppid=29963 vsize=123796 CPUtime=50.81
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 14038 0 0 0 5072 9 0 0 25 0 2 0 143451362 126767104 17500 1992294400 134512640 146736320 4288980336 18446744073709551615 136008163 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 198.8
Current children cumulated vsize (KiB) 132496

[startup+222.302 s]
/proc/loadavg: 1.86 1.51 1.57 3/109 29981
/proc/meminfo: memFree=1382928/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=124896 CPUtime=318.32
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 148597 0 0 0 31755 77 0 0 25 0 2 0 143446860 127893504 17775 1992294400 134512640 146736320 4288980336 18446744073709551615 135854505 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 31224 17775 1051 2985 0 27766 0
[pid=29964/tid=29966] ppid=29963 vsize=124896 CPUtime=110.34
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 30342 0 0 0 11013 21 0 0 25 0 2 0 143451362 127893504 17775 1992294400 134512640 146736320 4288980336 18446744073709551615 135854535 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 318.32
Current children cumulated vsize (KiB) 133596

[startup+282.301 s]
/proc/loadavg: 1.92 1.58 1.59 3/109 29981
/proc/meminfo: memFree=1382184/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=124952 CPUtime=429.07
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 171126 0 0 0 42815 92 0 0 25 0 2 0 143446860 127950848 17987 1992294400 134512640 146736320 4288980336 18446744073709551615 135854186 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 31238 17987 1051 2985 0 27780 0
[pid=29964/tid=29966] ppid=29963 vsize=124952 CPUtime=169.95
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 32564 0 0 0 16970 25 0 0 25 0 2 0 143451362 127950848 17987 1992294400 134512640 146736320 4288980336 18446744073709551615 136008069 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 429.07
Current children cumulated vsize (KiB) 133652

[startup+342.301 s]
/proc/loadavg: 1.92 1.64 1.61 3/109 29983
/proc/meminfo: memFree=1382812/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=125108 CPUtime=542.51
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 201408 0 0 0 54140 111 0 0 25 0 2 0 143446860 128110592 17809 1992294400 134512640 146736320 4288980336 18446744073709551615 139023098 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 31277 17809 1051 2985 0 27819 0
[pid=29964/tid=29966] ppid=29963 vsize=125108 CPUtime=223.4
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 38523 0 0 0 22309 31 0 0 25 0 2 0 143451362 128110592 17809 1992294400 134512640 146736320 4288980336 18446744073709551615 136008363 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 542.51
Current children cumulated vsize (KiB) 133808

[startup+402.301 s]

################
# More data... #
################

[pid=29964] ppid=29963 vsize=126060 CPUtime=934
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 372673 0 0 0 93189 211 0 0 25 0 2 0 143446860 129085440 18158 1992294400 134512640 146736320 4288980336 18446744073709551615 136000483 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 31515 18158 1052 2985 0 28057 0
[pid=29964/tid=29966] ppid=29963 vsize=126060 CPUtime=374.96
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 102046 0 0 0 37426 70 0 0 25 0 2 0 143451362 129085440 18158 1992294400 134512640 146736320 4288980336 18446744073709551615 136008441 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 934
Current children cumulated vsize (KiB) 134760

[startup+642.301 s]
/proc/loadavg: 1.53 1.64 1.62 2/109 29991
/proc/meminfo: memFree=1381448/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=126864 CPUtime=1031.67
/proc/29964/stat : 29964 (pb_cplex) S 29963 29963 28646 0 -1 4202496 417345 0 0 0 102931 236 0 0 25 0 2 0 143446860 129908736 18129 1992294400 134512640 146736320 4288980336 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 31716 18129 1052 2985 0 28258 0
[pid=29964/tid=29966] ppid=29963 vsize=126864 CPUtime=434.66
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 132234 0 0 0 43379 87 0 0 25 0 2 0 143451362 129908736 18129 1992294400 134512640 146736320 4288980336 18446744073709551615 139042888 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1031.67
Current children cumulated vsize (KiB) 135564

[startup+702.302 s]
/proc/loadavg: 1.65 1.64 1.62 3/109 29993
/proc/meminfo: memFree=1381448/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=126060 CPUtime=1120.73
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 468341 0 0 0 111805 268 0 0 25 0 2 0 143446860 129085440 18099 1992294400 134512640 146736320 4288980336 18446744073709551615 136008017 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 31515 18099 1052 2985 0 28057 0
[pid=29964/tid=29966] ppid=29963 vsize=126060 CPUtime=494.42
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 167123 0 0 0 49334 108 0 0 25 0 2 0 143451362 129085440 18099 1992294400 134512640 146736320 4288980336 18446744073709551615 136007661 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1120.73
Current children cumulated vsize (KiB) 134760

[startup+762.31 s]
/proc/loadavg: 1.85 1.69 1.64 3/109 29995
/proc/meminfo: memFree=1381324/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=126060 CPUtime=1228.37
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 536430 0 0 0 122533 304 0 0 25 0 2 0 143446860 129085440 18133 1992294400 134512640 146736320 4288980336 18446744073709551615 136008645 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 31515 18133 1053 2985 0 28057 0
[pid=29964/tid=29966] ppid=29963 vsize=126060 CPUtime=554.05
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 211608 0 0 0 55274 131 0 0 25 0 2 0 143451362 129085440 18133 1992294400 134512640 146736320 4288980336 18446744073709551615 136403116 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1228.37
Current children cumulated vsize (KiB) 134760

[startup+822.301 s]
/proc/loadavg: 1.95 1.73 1.65 3/109 29997
/proc/meminfo: memFree=1381696/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=125660 CPUtime=1337.54
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 579211 0 0 0 133424 330 0 0 25 0 2 0 143446860 128675840 18032 1992294400 134512640 146736320 4288980336 18446744073709551615 136008653 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 31415 18032 1057 2985 0 27957 0
[pid=29964/tid=29966] ppid=29963 vsize=125660 CPUtime=607.95
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 234563 0 0 0 60651 144 0 0 25 0 2 0 143451362 128675840 18032 1992294400 134512640 146736320 4288980336 18446744073709551615 136007984 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1337.54
Current children cumulated vsize (KiB) 134360

[startup+882.301 s]
/proc/loadavg: 1.71 1.71 1.65 2/109 29997
/proc/meminfo: memFree=1381448/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=127096 CPUtime=1428.2
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 622758 0 0 0 142467 353 0 0 25 0 2 0 143446860 130146304 18105 1992294400 134512640 146736320 4288980336 18446744073709551615 136003493 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 31774 18105 1057 2985 0 28316 0
[pid=29964/tid=29966] ppid=29963 vsize=127096 CPUtime=638.64
/proc/29964/task/29966/stat : 29966 (pb_cplex) S 29963 29963 28646 0 -1 4202560 247754 0 0 0 63711 153 0 0 25 0 2 0 143451362 130146304 18105 1992294400 134512640 146736320 4288980336 18446744073709551615 144580073 0 2 4096 16387 18446604437814000576 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1428.2
Current children cumulated vsize (KiB) 135796

[startup+942.301 s]
/proc/loadavg: 1.93 1.76 1.66 3/109 29999
/proc/meminfo: memFree=1381696/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=125660 CPUtime=1535.48
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 667094 0 0 0 153169 379 0 0 25 0 2 0 143446860 128675840 18039 1992294400 134512640 146736320 4288980336 18446744073709551615 136403129 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 31415 18039 1057 2985 0 27957 0
[pid=29964/tid=29966] ppid=29963 vsize=125660 CPUtime=685.91
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 267835 0 0 0 68426 165 0 0 25 0 2 0 143451362 128675840 18039 1992294400 134512640 146736320 4288980336 18446744073709551615 136008441 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1535.48
Current children cumulated vsize (KiB) 134360

[startup+1002.3 s]
/proc/loadavg: 1.97 1.80 1.68 3/109 30001
/proc/meminfo: memFree=1381572/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=127976 CPUtime=1653.85
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 718542 0 0 0 164975 410 0 0 25 0 2 0 143446860 131047424 18282 1992294400 134512640 146736320 4288980336 18446744073709551615 135983225 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 31994 18282 1057 2985 0 28536 0
[pid=29964/tid=29966] ppid=29963 vsize=127976 CPUtime=744.31
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 292199 0 0 0 74250 181 0 0 25 0 2 0 143451362 131047424 18282 1992294400 134512640 146736320 4288980336 18446744073709551615 136000483 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1653.85
Current children cumulated vsize (KiB) 136676

[startup+1062.3 s]
/proc/loadavg: 1.62 1.74 1.67 2/109 30003
/proc/meminfo: memFree=1381200/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=129568 CPUtime=1748.17
/proc/29964/stat : 29964 (pb_cplex) S 29963 29963 28646 0 -1 4202496 768563 0 0 0 174378 439 0 0 25 0 2 0 143446860 132677632 18377 1992294400 134512640 146736320 4288980336 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 32392 18377 1057 2985 0 28934 0
[pid=29964/tid=29966] ppid=29963 vsize=129568 CPUtime=804.03
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 323685 0 0 0 80205 198 0 0 25 0 2 0 143451362 132677632 18377 1992294400 134512640 146736320 4288980336 18446744073709551615 135854505 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1748.17
Current children cumulated vsize (KiB) 138268



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1088.5 s]
/proc/loadavg: 1.75 1.76 1.68 3/109 30003
/proc/meminfo: memFree=1381448/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=125816 CPUtime=1800.15
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 792994 0 0 0 179561 454 0 0 25 0 2 0 143446860 128835584 18075 1992294400 134512640 146736320 4288980336 18446744073709551615 135854505 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 31454 18075 1057 2985 0 27996 0
[pid=29964/tid=29966] ppid=29963 vsize=125816 CPUtime=830.03
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 335502 0 0 0 82798 205 0 0 25 0 2 0 143451362 128835584 18075 1992294400 134512640 146736320 4288980336 18446744073709551615 136006331 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1800.15
Current children cumulated vsize (KiB) 134516

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1088.5 s]
/proc/loadavg: 1.75 1.76 1.68 3/109 30003
/proc/meminfo: memFree=1381448/2059040 swapFree=4139568/4192956
[pid=29963] ppid=29961 vsize=8700 CPUtime=0
/proc/29963/stat : 29963 (run) S 29961 29963 28646 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 143446860 8908800 249 1992294400 4194304 4922060 140733501720784 18446744073709551615 257906285701 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/29963/statm: 2175 249 208 178 0 68 0
[pid=29964] ppid=29963 vsize=125816 CPUtime=1800.15
/proc/29964/stat : 29964 (pb_cplex) R 29963 29963 28646 0 -1 4202496 792994 0 0 0 179561 454 0 0 25 0 2 0 143446860 128835584 18075 1992294400 134512640 146736320 4288980336 18446744073709551615 135854505 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/29964/statm: 31454 18075 1057 2985 0 27996 0
[pid=29964/tid=29966] ppid=29963 vsize=125816 CPUtime=830.03
/proc/29964/task/29966/stat : 29966 (pb_cplex) R 29963 29963 28646 0 -1 4202560 335502 0 0 0 82798 205 0 0 25 0 2 0 143451362 128835584 18075 1992294400 134512640 146736320 4288980336 18446744073709551615 136006331 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1800.15
Current children cumulated vsize (KiB) 134516

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 29963 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=999
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=999
# CPU time returned by wait4() is 0.001998
# while last known CPU time is 1800.15
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1088.52
CPU time (s): 1800.15
CPU user time (s): 1795.61
CPU system time (s): 4.54
CPU usage (%): 165.376
Max. virtual memory (cumulated for all children) (KiB): 139292

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0.000999
system time used= 0.000999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 365
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 2

runsolver used 2.06768 second user time and 5.54316 second system time

The end

Launcher Data 

Begin job on node030 at 2010-07-01 23:58:35
IDJOB=2695769
IDBENCH=25012
IDSOLVER=1209
FILE ID=node030/2695769-1278021515
PBS_JOBID= 11198732
Free space on /tmp= 62408 MiB

SOLVER NAME= pb_cplex 2010-06-29
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-LIN/submittedPB07/aksoy/decomp/normalized-matrix_5x3_3.opb
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2695769-1278021515/watcher-2695769-1278021515 -o /tmp/evaluation-result-2695769-1278021515/solver-2695769-1278021515 -C 1800 -W 2000 -M 1800  run HOME/instance-2695769-1278021515.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 82a3d84200b069df277c7f14e0e883d0
RANDOM SEED=1484239906

node030.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.244
cache size	: 2048 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6000.48
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.244
cache size	: 2048 KB
physical id	: 3
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5599.52
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2059040 kB
MemFree:       1452176 kB
Buffers:        142476 kB
Cached:         352336 kB
SwapCached:       7532 kB
Active:         228900 kB
Inactive:       280676 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2059040 kB
LowFree:       1452176 kB
SwapTotal:     4192956 kB
SwapFree:      4139568 kB
Dirty:           17480 kB
Writeback:           0 kB
AnonPages:       12860 kB
Mapped:          12104 kB
Slab:            75428 kB
PageTables:       4192 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   5222476 kB
Committed_AS:   181924 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    264948 kB
VmallocChunk: 34359471699 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62392 MiB
End job on node030 at 2010-07-02 00:16:46