Trace number 2695778

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pb_cplex 2010-06-29? (TO) 1800.06 1112.02

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-LIN/submittedPB07/
aksoy/decomp/normalized-matrix_5x3_5.opb
MD5SUM130be24ef6faf784c5a8bf386cbf11b2
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark22
Best CPU time to get the best result obtained on this benchmark1800.97
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 21
Optimality of the best value was proved NO
Number of variables5499
Total number of constraints19319
Number of constraints which are clauses19312
Number of constraints which are cardinality constraints (but not clauses)1
Number of constraints which are nor clauses,nor cardinality constraints6
Minimum length of a constraint1
Maximum length of a constraint613
Number of terms in the objective function 613
Biggest coefficient in the objective function 1
Number of bits for the biggest coefficient in the objective function 1
Sum of the numbers in the objective function 613
Number of bits of the sum of numbers in the objective function 10
Biggest number in a constraint 30
Number of bits of the biggest number in a constraint 5
Biggest sum of numbers in a constraint 643
Number of bits of the biggest sum of numbers10
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-2695778-1278021725.opb.
0.00/0.00	c Instance file HOME/instance-2695778-1278021725.opb
0.00/0.00	c File size is 560274 bytes.
0.00/0.41	c Highest Coefficient sum: 643
0.00/0.41	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.44	c ============================[ Problem Statistics ]=============================
0.00/0.44	c |                                                                             |
0.00/0.44	c |  Parsing time:          0.43         s                                      |
0.00/0.44	c |  Number Variables:      5499                                                |
0.00/0.45	c |  Number Constraints:    19319                                               |
0.00/0.45	c ===============================================================================
1800.06/1112.01	c Remaining time 1799.57 sec.
1800.06/1112.01	c 
1800.06/1112.01	c *** INTERRUPTED ***
1800.06/1112.01	s UNKNOWN
1800.06/1112.01	c Total CPU time              : 1795.16 s
1800.06/1112.01	c Memory used           : 68.10 MB
1800.06/1112.01	c CPU time              : 1795.16 s
1800.06/1112.01	c 
1800.06/1112.01	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2695778-1278021725/watcher-2695778-1278021725 -o /tmp/evaluation-result-2695778-1278021725/solver-2695778-1278021725 -C 1800 -W 2000 -M 1800 run HOME/instance-2695778-1278021725.opb 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.12 1.20 1.28 3/106 24933
/proc/meminfo: memFree=1772908/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0

[startup+0.050974 s]
/proc/loadavg: 1.12 1.20 1.28 3/106 24933
/proc/meminfo: memFree=1772908/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.100983 s]
/proc/loadavg: 1.12 1.20 1.28 3/106 24933
/proc/meminfo: memFree=1772908/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.301019 s]
/proc/loadavg: 1.12 1.20 1.28 3/106 24933
/proc/meminfo: memFree=1772908/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.702104 s]
/proc/loadavg: 1.12 1.20 1.28 3/106 24933
/proc/meminfo: memFree=1772908/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50024 s]
/proc/loadavg: 1.12 1.20 1.28 2/108 24935
/proc/meminfo: memFree=1756028/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=60796 CPUtime=1.48
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 10490 0 0 0 144 4 0 0 19 0 1 0 177776004 62255104 7306 1992294400 134512640 146736320 4294021312 18446744073709551615 136007303 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/24934/statm: 15199 7306 894 2985 0 11741 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 69496

[startup+3.10054 s]
/proc/loadavg: 1.12 1.20 1.28 2/108 24935
/proc/meminfo: memFree=1746108/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=60976 CPUtime=3.08
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 11417 0 0 0 303 5 0 0 22 0 1 0 177776004 62439424 7416 1992294400 134512640 146736320 4294021312 18446744073709551615 136008450 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/24934/statm: 15244 7416 894 2985 0 11786 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 69676

[startup+6.30213 s]
/proc/loadavg: 1.11 1.20 1.28 2/108 24935
/proc/meminfo: memFree=1744992/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=62008 CPUtime=6.28
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 12994 0 0 0 623 5 0 0 25 0 1 0 177776004 63496192 7771 1992294400 134512640 146736320 4294021312 18446744073709551615 136017755 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/24934/statm: 15502 7771 894 2985 0 12044 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 70708

[startup+12.7013 s]
/proc/loadavg: 1.10 1.19 1.28 2/108 24935
/proc/meminfo: memFree=1731600/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=80052 CPUtime=12.68
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 20035 0 0 0 1260 8 0 0 25 0 1 0 177776004 81973248 11085 1992294400 134512640 146736320 4294021312 18446744073709551615 136015579 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/24934/statm: 20013 11085 989 2985 0 16555 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 88752

[startup+25.5017 s]
/proc/loadavg: 1.08 1.18 1.27 2/108 24935
/proc/meminfo: memFree=1741148/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=64068 CPUtime=25.47
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 32301 0 0 0 2534 13 0 0 25 0 1 0 177776004 65605632 8790 1992294400 134512640 146736320 4294021312 18446744073709551615 136001882 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/24934/statm: 16017 8790 1016 2985 0 12559 0
Current children cumulated CPU time (s) 25.47
Current children cumulated vsize (KiB) 72768

[startup+51.1014 s]
/proc/loadavg: 1.05 1.17 1.26 2/108 24937
/proc/meminfo: memFree=1740404/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=64080 CPUtime=51.07
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 48598 0 0 0 5087 20 0 0 25 0 1 0 177776004 65617920 8811 1992294400 134512640 146736320 4294021312 18446744073709551615 136403136 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/24934/statm: 16020 8811 1018 2985 0 12562 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 72780

[startup+102.309 s]
/proc/loadavg: 1.07 1.15 1.25 2/109 24940
/proc/meminfo: memFree=1720928/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=101536 CPUtime=102.99
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 84553 0 0 0 10259 40 0 0 25 0 2 0 177776004 103972864 13738 1992294400 134512640 146736320 4294021312 18446744073709551615 136474228 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24934/statm: 25384 13738 1081 2985 0 21926 0
[pid=24934/tid=24940] ppid=24933 vsize=101536 CPUtime=0
/proc/24934/task/24940/stat : 24940 (pb_cplex) S 24933 24933 24318 0 -1 4202560 1 0 0 0 0 0 0 0 18 0 2 0 177783065 103972864 13738 1992294400 134512640 146736320 4294021312 18446744073709551615 144580073 0 2 4096 16387 18446604437833154880 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 102.99
Current children cumulated vsize (KiB) 110236

[startup+162.302 s]
/proc/loadavg: 1.55 1.26 1.29 3/109 24942
/proc/meminfo: memFree=1709272/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=115856 CPUtime=191.76
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 126962 0 0 0 19116 60 0 0 25 0 2 0 177776004 118636544 16552 1992294400 134512640 146736320 4294021312 18446744073709551615 136008450 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24934/statm: 28964 16552 1081 2985 0 25506 0
[pid=24934/tid=24940] ppid=24933 vsize=115856 CPUtime=28.8
/proc/24934/task/24940/stat : 24940 (pb_cplex) R 24933 24933 24318 0 -1 4202560 16438 0 0 0 2872 8 0 0 25 0 2 0 177783065 118636544 16552 1992294400 134512640 146736320 4294021312 18446744073709551615 135854505 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 191.76
Current children cumulated vsize (KiB) 124556

[startup+222.301 s]
/proc/loadavg: 1.91 1.41 1.33 2/109 24944
/proc/meminfo: memFree=1708404/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=117228 CPUtime=308.36
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 176983 0 0 0 30747 89 0 0 25 0 2 0 177776004 120041472 16728 1992294400 134512640 146736320 4294021312 18446744073709551615 136403116 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24934/statm: 29307 16728 1081 2985 0 25849 0
[pid=24934/tid=24940] ppid=24933 vsize=117228 CPUtime=85.41
/proc/24934/task/24940/stat : 24940 (pb_cplex) S 24933 24933 24318 0 -1 4202560 42140 0 0 0 8517 24 0 0 25 0 2 0 177783065 120041472 16728 1992294400 134512640 146736320 4294021312 18446744073709551615 144580073 0 2 4096 16387 18446604437833154880 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 308.36
Current children cumulated vsize (KiB) 125928

[startup+282.301 s]
/proc/loadavg: 2.00 1.52 1.37 3/109 24946
/proc/meminfo: memFree=1707040/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=117128 CPUtime=426.23
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 229773 0 0 0 42504 119 0 0 25 0 2 0 177776004 119939072 17034 1992294400 134512640 146736320 4294021312 18446744073709551615 139042981 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24934/statm: 29282 17034 1081 2985 0 25824 0
[pid=24934/tid=24940] ppid=24933 vsize=117128 CPUtime=143.31
/proc/24934/task/24940/stat : 24940 (pb_cplex) R 24933 24933 24318 0 -1 4202560 69796 0 0 0 14290 41 0 0 25 0 2 0 177783065 119939072 17034 1992294400 134512640 146736320 4294021312 18446744073709551615 135450751 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 426.23
Current children cumulated vsize (KiB) 125828

[startup+342.301 s]
/proc/loadavg: 2.09 1.62 1.41 3/109 24946
/proc/meminfo: memFree=1706792/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=117128 CPUtime=542.88
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 289107 0 0 0 54134 154 0 0 25 0 2 0 177776004 119939072 17087 1992294400 134512640 146736320 4294021312 18446744073709551615 136018123 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24934/statm: 29282 17087 1081 2985 0 25824 0
[pid=24934/tid=24940] ppid=24933 vsize=117128 CPUtime=199.97
/proc/24934/task/24940/stat : 24940 (pb_cplex) R 24933 24933 24318 0 -1 4202560 102976 0 0 0 19936 61 0 0 25 0 2 0 177783065 119939072 17087 1992294400 134512640 146736320 4294021312 18446744073709551615 136001936 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 542.88
Current children cumulated vsize (KiB) 125828

[startup+402.302 s]
/proc/loadavg: 2.02 1.67 1.44 3/109 24948
/proc/meminfo: memFree=1706296/2059040 swapFree=4139180/4192956

################
# More data... #
################

/proc/meminfo: memFree=1706048/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=117264 CPUtime=861.7
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 444536 0 0 0 85928 242 0 0 25 0 2 0 177776004 120078336 17237 1992294400 134512640 146736320 4294021312 18446744073709551615 136008065 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24934/statm: 29316 17237 1081 2985 0 25858 0
[pid=24934/tid=24940] ppid=24933 vsize=117264 CPUtime=338.86
/proc/24934/task/24940/stat : 24940 (pb_cplex) R 24933 24933 24318 0 -1 4202560 173171 0 0 0 33784 102 0 0 25 0 2 0 177783065 120078336 17237 1992294400 134512640 146736320 4294021312 18446744073709551615 135999610 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 861.7
Current children cumulated vsize (KiB) 125964

[startup+582.302 s]
/proc/loadavg: 1.86 1.73 1.50 3/109 24954
/proc/meminfo: memFree=1706048/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=117264 CPUtime=967.2
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 497049 0 0 0 96449 271 0 0 25 0 2 0 177776004 120078336 17237 1992294400 134512640 146736320 4294021312 18446744073709551615 136403121 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24934/statm: 29316 17237 1081 2985 0 25858 0
[pid=24934/tid=24940] ppid=24933 vsize=117264 CPUtime=398.49
/proc/24934/task/24940/stat : 24940 (pb_cplex) R 24933 24933 24318 0 -1 4202560 206668 0 0 0 39729 120 0 0 25 0 2 0 177783065 120078336 17237 1992294400 134512640 146736320 4294021312 18446744073709551615 135525510 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 967.2
Current children cumulated vsize (KiB) 125964

[startup+642.301 s]
/proc/loadavg: 1.92 1.78 1.53 3/109 24954
/proc/meminfo: memFree=1706048/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=117268 CPUtime=1081.66
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 544005 0 0 0 107864 302 0 0 25 0 2 0 177776004 120082432 17235 1992294400 134512640 146736320 4294021312 18446744073709551615 136403109 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24934/statm: 29317 17235 1081 2985 0 25859 0
[pid=24934/tid=24940] ppid=24933 vsize=117268 CPUtime=452.96
/proc/24934/task/24940/stat : 24940 (pb_cplex) R 24933 24933 24318 0 -1 4202560 231559 0 0 0 45158 138 0 0 25 0 2 0 177783065 120082432 17235 1992294400 134512640 146736320 4294021312 18446744073709551615 136403116 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1081.66
Current children cumulated vsize (KiB) 125968

[startup+702.301 s]
/proc/loadavg: 1.85 1.78 1.55 4/110 24959
/proc/meminfo: memFree=1693640/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=117624 CPUtime=1179.61
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 594397 0 0 0 117633 328 0 0 25 0 2 0 177776004 120446976 17374 1992294400 134512640 146736320 4294021312 18446744073709551615 136007977 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24934/statm: 29406 17374 1082 2985 0 25948 0
[pid=24934/tid=24940] ppid=24933 vsize=117624 CPUtime=512.64
/proc/24934/task/24940/stat : 24940 (pb_cplex) R 24933 24933 24318 0 -1 4202560 266448 0 0 0 51107 157 0 0 25 0 2 0 177783065 120446976 17374 1992294400 134512640 146736320 4294021312 18446744073709551615 135999702 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1179.61
Current children cumulated vsize (KiB) 126324

[startup+762.309 s]
/proc/loadavg: 1.82 1.83 1.58 2/109 24961
/proc/meminfo: memFree=1704808/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=118924 CPUtime=1268.16
/proc/24934/stat : 24934 (pb_cplex) S 24933 24933 24318 0 -1 4202496 631374 0 0 0 126466 350 0 0 25 0 2 0 177776004 121778176 17499 1992294400 134512640 146736320 4294021312 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24934/statm: 29731 17499 1082 2985 0 26273 0
[pid=24934/tid=24940] ppid=24933 vsize=118924 CPUtime=571.07
/proc/24934/task/24940/stat : 24940 (pb_cplex) R 24933 24933 24318 0 -1 4202560 302551 0 0 0 56930 177 0 0 25 0 2 0 177783065 121778176 17499 1992294400 134512640 146736320 4294021312 18446744073709551615 136008065 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1268.16
Current children cumulated vsize (KiB) 127624

[startup+822.302 s]
/proc/loadavg: 1.71 1.78 1.57 2/109 24963
/proc/meminfo: memFree=1705428/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=118528 CPUtime=1362.61
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 679005 0 0 0 135885 376 0 0 25 0 2 0 177776004 121372672 17352 1992294400 134512640 146736320 4294021312 18446744073709551615 136008924 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24934/statm: 29632 17352 1082 2985 0 26174 0
[pid=24934/tid=24940] ppid=24933 vsize=118528 CPUtime=622.26
/proc/24934/task/24940/stat : 24940 (pb_cplex) S 24933 24933 24318 0 -1 4202560 333211 0 0 0 62032 194 0 0 25 0 2 0 177783065 121372672 17352 1992294400 134512640 146736320 4294021312 18446744073709551615 144580073 0 2 4096 16387 18446604437833154880 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1362.61
Current children cumulated vsize (KiB) 127228

[startup+882.301 s]
/proc/loadavg: 1.79 1.79 1.58 3/109 24965
/proc/meminfo: memFree=1705428/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=117416 CPUtime=1468.66
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 733964 0 0 0 146460 406 0 0 25 0 2 0 177776004 120233984 17315 1992294400 134512640 146736320 4294021312 18446744073709551615 136000378 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24934/statm: 29354 17315 1082 2985 0 25896 0
[pid=24934/tid=24940] ppid=24933 vsize=117416 CPUtime=668.34
/proc/24934/task/24940/stat : 24940 (pb_cplex) R 24933 24933 24318 0 -1 4202560 359515 0 0 0 66623 211 0 0 25 0 2 0 177783065 120233984 17315 1992294400 134512640 146736320 4294021312 18446744073709551615 139044550 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1468.66
Current children cumulated vsize (KiB) 126116

[startup+942.301 s]
/proc/loadavg: 2.09 1.87 1.62 3/109 24965
/proc/meminfo: memFree=1704560/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=117520 CPUtime=1587.6
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 793648 0 0 0 158319 441 0 0 25 0 2 0 177776004 120340480 17426 1992294400 134512640 146736320 4294021312 18446744073709551615 136008446 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24934/statm: 29380 17426 1082 2985 0 25922 0
[pid=24934/tid=24940] ppid=24933 vsize=117520 CPUtime=727.3
/proc/24934/task/24940/stat : 24940 (pb_cplex) R 24933 24933 24318 0 -1 4202560 393373 0 0 0 72498 232 0 0 25 0 2 0 177783065 120340480 17426 1992294400 134512640 146736320 4294021312 18446744073709551615 136001989 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1587.6
Current children cumulated vsize (KiB) 126220

[startup+1002.3 s]
/proc/loadavg: 1.71 1.81 1.62 2/109 24967
/proc/meminfo: memFree=1705180/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=118348 CPUtime=1681.07
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 843011 0 0 0 167639 468 0 0 25 0 2 0 177776004 121188352 17389 1992294400 134512640 146736320 4294021312 18446744073709551615 135854505 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/24934/statm: 29587 17389 1082 2985 0 26129 0
[pid=24934/tid=24940] ppid=24933 vsize=118348 CPUtime=760.8
/proc/24934/task/24940/stat : 24940 (pb_cplex) S 24933 24933 24318 0 -1 4202560 413153 0 0 0 75835 245 0 0 25 0 2 0 177783065 121188352 17389 1992294400 134512640 146736320 4294021312 18446744073709551615 144580073 0 2 4096 16387 18446604437833154880 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1681.07
Current children cumulated vsize (KiB) 127048

[startup+1062.3 s]
/proc/loadavg: 1.36 1.69 1.59 2/108 24969
/proc/meminfo: memFree=1727384/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=69732 CPUtime=1750.36
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 876249 0 0 0 174547 489 0 0 25 0 1 0 177776004 71405568 11865 1992294400 134512640 146736320 4294021312 18446744073709551615 136388089 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/24934/statm: 17433 11865 1083 2985 0 13975 0
Current children cumulated CPU time (s) 1750.36
Current children cumulated vsize (KiB) 78432



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1112 s]
/proc/loadavg: 1.16 1.58 1.56 2/108 24971
/proc/meminfo: memFree=1727136/2059040 swapFree=4139180/4192956
[pid=24933] ppid=24931 vsize=8700 CPUtime=0
/proc/24933/stat : 24933 (run) S 24931 24933 24318 0 -1 4202496 365 0 0 0 0 0 0 0 18 0 1 0 177776004 8908800 249 1992294400 4194304 4922060 140737345509216 18446744073709551615 211173350533 0 65536 4100 65538 18446744071562232103 0 0 17 1 0 0 0
/proc/24933/statm: 2175 249 208 178 0 68 0
[pid=24934] ppid=24933 vsize=69732 CPUtime=1800.06
/proc/24934/stat : 24934 (pb_cplex) R 24933 24933 24318 0 -1 4202496 879156 0 0 0 179515 491 0 0 25 0 1 0 177776004 71405568 11907 1992294400 134512640 146736320 4294021312 18446744073709551615 139044505 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/24934/statm: 17433 11907 1084 2985 0 13975 0
Current children cumulated CPU time (s) 1800.06
Current children cumulated vsize (KiB) 78432

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 24933 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=1999
# CPU time returned by wait4() is 0.001999
# while last known CPU time is 1800.06
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1112.02
CPU time (s): 1800.06
CPU user time (s): 1795.15
CPU system time (s): 4.91
CPU usage (%): 161.872
Max. virtual memory (cumulated for all children) (KiB): 130744

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.001999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 365
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 2

runsolver used 1.9487 second user time and 5.80312 second system time

The end

Launcher Data 

Begin job on node007 at 2010-07-02 00:02:05
IDJOB=2695778
IDBENCH=25021
IDSOLVER=1209
FILE ID=node007/2695778-1278021725
PBS_JOBID= 11198747
Free space on /tmp= 62228 MiB

SOLVER NAME= pb_cplex 2010-06-29
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-LIN/submittedPB07/aksoy/decomp/normalized-matrix_5x3_5.opb
COMMAND LINE= run BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2695778-1278021725/watcher-2695778-1278021725 -o /tmp/evaluation-result-2695778-1278021725/solver-2695778-1278021725 -C 1800 -W 2000 -M 1800  run HOME/instance-2695778-1278021725.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 130be24ef6faf784c5a8bf386cbf11b2
RANDOM SEED=52249179

node007.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.264
cache size	: 2048 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6000.52
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.264
cache size	: 2048 KB
physical id	: 3
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5599.44
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2059040 kB
MemFree:       1773436 kB
Buffers:         70924 kB
Cached:         117756 kB
SwapCached:       8544 kB
Active:         105276 kB
Inactive:        99032 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2059040 kB
LowFree:       1773436 kB
SwapTotal:     4192956 kB
SwapFree:      4139180 kB
Dirty:           17140 kB
Writeback:           0 kB
AnonPages:       13016 kB
Mapped:          11968 kB
Slab:            59288 kB
PageTables:       4180 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   5222476 kB
Committed_AS:   181820 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    264948 kB
VmallocChunk: 34359471699 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

Free space on /tmp at the end= 62212 MiB
End job on node007 at 2010-07-02 00:20:40