Trace number 2696774

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pb_cplex 2010-06-29? (TO) 1800.07 1686.33

General information on the benchmark

Name/OPT-SMALLINT-LIN/oliveras/j120opt/
normalized-j12021_8.std.opb
MD5SUM33a0c5076a13a0bc08e55dbdcaafa3d4
Bench CategoryOPT-SMALLINT-LIN (optimisation, small integers, linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark127
Best CPU time to get the best result obtained on this benchmark8.84266
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables72842
Total number of constraints245119
Number of constraints which are clauses243919
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints1200
Minimum length of a constraint1
Maximum length of a constraint37
Number of terms in the objective function 300
Biggest coefficient in the objective function 300
Number of bits for the biggest coefficient in the objective function 9
Sum of the numbers in the objective function 45150
Number of bits of the sum of numbers in the objective function 16
Biggest number in a constraint 300
Number of bits of the biggest number in a constraint 9
Biggest sum of numbers in a constraint 45150
Number of bits of the biggest sum of numbers16
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-2696774-1278443763.opb.
0.00/0.00	c Instance file HOME/instance-2696774-1278443763.opb
0.00/0.00	c File size is 7235226 bytes.
2.59/2.68	c Highest Coefficient sum: 215
2.59/2.68	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
2.99/3.01	c ============================[ Problem Statistics ]=============================
2.99/3.01	c |                                                                             |
2.99/3.01	c |  Parsing time:          2.90         s                                      |
2.99/3.01	c |  Number Variables:      72842                                               |
2.99/3.08	c |  Number Constraints:    245119                                              |
2.99/3.08	c ===============================================================================
1800.07/1686.32	c Remaining time 1797.06 sec.
1800.07/1686.32	c 
1800.07/1686.32	c *** INTERRUPTED ***
1800.07/1686.32	s UNKNOWN
1800.07/1686.32	c Total CPU time              : 1792.51 s
1800.07/1686.32	c Memory used           : 665.84 MB
1800.07/1686.32	c CPU time              : 1792.51 s
1800.07/1686.32	c 
1800.07/1686.32	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2696774-1278443763/watcher-2696774-1278443763 -o /tmp/evaluation-result-2696774-1278443763/solver-2696774-1278443763 -C 1800 -W 2000 -M 1800 run HOME/instance-2696774-1278443763.opb 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.04 1.03 1.00 3/106 21961
/proc/meminfo: memFree=1358556/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) R 21959 21961 19731 0 -1 4202496 348 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210369429 0 65538 4100 65536 0 0 0 17 1 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0

[startup+0.067167 s]
/proc/loadavg: 1.04 1.03 1.00 3/106 21961
/proc/meminfo: memFree=1358556/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.101168 s]
/proc/loadavg: 1.04 1.03 1.00 3/106 21961
/proc/meminfo: memFree=1358556/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.301186 s]
/proc/loadavg: 1.04 1.03 1.00 3/106 21961
/proc/meminfo: memFree=1358556/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.70122 s]
/proc/loadavg: 1.04 1.03 1.00 3/106 21961
/proc/meminfo: memFree=1358556/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50129 s]
/proc/loadavg: 1.04 1.03 1.00 2/108 21963
/proc/meminfo: memFree=1331012/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=59732 CPUtime=1.48
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 11672 0 0 0 144 4 0 0 25 0 1 0 12586948 61165568 11102 1992294400 134512640 146736320 4292530576 18446744073709551615 140679011 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/21962/statm: 14933 11102 1421 2985 0 10100 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 68432

[startup+3.10144 s]
/proc/loadavg: 1.12 1.05 1.01 2/108 21963
/proc/meminfo: memFree=1304476/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=155152 CPUtime=3.09
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 37051 0 0 0 295 14 0 0 18 0 1 0 12586948 158875648 27869 1992294400 134512640 146736320 4292530576 18446744073709551615 135809342 0 0 4096 16387 0 0 0 17 0 0 0 0
/proc/21962/statm: 38788 27869 699 2985 0 35330 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 163852

[startup+6.3007 s]
/proc/loadavg: 1.12 1.05 1.01 2/108 21963
/proc/meminfo: memFree=1238756/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=314704 CPUtime=6.28
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 82274 0 0 0 601 27 0 0 25 0 1 0 12586948 322256896 40534 1992294400 134512640 146736320 4292530576 18446744073709551615 135765616 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/21962/statm: 78676 40534 790 2985 0 75218 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 323404

[startup+12.7013 s]
/proc/loadavg: 1.10 1.05 1.00 2/108 21963
/proc/meminfo: memFree=1122940/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=427912 CPUtime=12.68
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 135141 0 0 0 1215 53 0 0 25 0 1 0 12586948 438181888 59545 1992294400 134512640 146736320 4292530576 18446744073709551615 136405715 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/21962/statm: 106978 59545 900 2985 0 103520 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 436612

[startup+25.5014 s]
/proc/loadavg: 1.08 1.04 1.00 2/108 21964
/proc/meminfo: memFree=1116368/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=433452 CPUtime=25.48
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 146037 0 0 0 2490 58 0 0 25 0 1 0 12586948 443854848 61137 1992294400 134512640 146736320 4292530576 18446744073709551615 136405673 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/21962/statm: 108363 61137 899 2985 0 104905 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 442152

[startup+51.1016 s]
/proc/loadavg: 1.06 1.04 1.00 2/108 21964
/proc/meminfo: memFree=1109052/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=438576 CPUtime=51.06
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 163891 0 0 0 5040 66 0 0 25 0 1 0 12586948 449101824 62832 1992294400 134512640 146736320 4292530576 18446744073709551615 135526859 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/21962/statm: 109644 62832 899 2985 0 106186 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 447276

[startup+102.309 s]
/proc/loadavg: 1.02 1.03 1.00 2/108 21966
/proc/meminfo: memFree=1030312/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=578492 CPUtime=102.25
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 309766 0 0 0 10108 117 0 0 25 0 1 0 12586948 592375808 82575 1992294400 134512640 146736320 4292530576 18446744073709551615 136017481 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/21962/statm: 144623 82575 1022 2985 0 141165 0
Current children cumulated CPU time (s) 102.25
Current children cumulated vsize (KiB) 587192

[startup+162.301 s]
/proc/loadavg: 1.01 1.02 1.00 2/108 21967
/proc/meminfo: memFree=1110540/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=440888 CPUtime=162.23
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 415682 0 0 0 16068 155 0 0 25 0 1 0 12586948 451469312 62582 1992294400 134512640 146736320 4292530576 18446744073709551615 136017763 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/21962/statm: 110222 62582 1025 2985 0 106764 0
Current children cumulated CPU time (s) 162.23
Current children cumulated vsize (KiB) 449588

[startup+222.301 s]
/proc/loadavg: 1.04 1.03 1.00 2/108 21972
/proc/meminfo: memFree=1110044/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=440888 CPUtime=222.22
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 441478 0 0 0 22057 165 0 0 25 0 1 0 12586948 451469312 62602 1992294400 134512640 146736320 4292530576 18446744073709551615 136403428 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/21962/statm: 110222 62602 1025 2985 0 106764 0
Current children cumulated CPU time (s) 222.22
Current children cumulated vsize (KiB) 449588

[startup+282.302 s]
/proc/loadavg: 1.02 1.02 1.00 2/108 21973
/proc/meminfo: memFree=1109672/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=441904 CPUtime=282.21
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 584379 0 0 0 28002 219 0 0 25 0 1 0 12586948 452509696 62829 1992294400 134512640 146736320 4292530576 18446744073709551615 135999265 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/21962/statm: 110476 62829 1025 2985 0 107018 0
Current children cumulated CPU time (s) 282.21
Current children cumulated vsize (KiB) 450604

[startup+342.301 s]
/proc/loadavg: 1.00 1.02 1.00 2/108 21975
/proc/meminfo: memFree=1108928/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=441680 CPUtime=342.18
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 663631 0 0 0 33971 247 0 0 25 0 1 0 12586948 452280320 62926 1992294400 134512640 146736320 4292530576 18446744073709551615 135450617 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/21962/statm: 110420 62926 1025 2985 0 106962 0
Current children cumulated CPU time (s) 342.18
Current children cumulated vsize (KiB) 450380

[startup+402.301 s]
/proc/loadavg: 1.00 1.01 1.00 2/108 21977
/proc/meminfo: memFree=1108804/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=441716 CPUtime=402.17
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 688099 0 0 0 39960 257 0 0 25 0 1 0 12586948 452317184 62965 1992294400 134512640 146736320 4292530576 18446744073709551615 136002010 0 0 4096 16387 0 0 0 17 1 0 0 0
/proc/21962/statm: 110429 62965 1025 2985 0 106971 0
Current children cumulated CPU time (s) 402.17
Current children cumulated vsize (KiB) 450416

[startup+462.301 s]

################
# More data... #
################

[pid=21962] ppid=21961 vsize=524804 CPUtime=1259.5
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 1793849 0 0 0 125268 682 0 0 25 0 2 0 12586948 537399296 78238 1992294400 134512640 146736320 4292530576 18446744073709551615 135450582 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/21962/statm: 131201 78238 1112 2985 0 127743 0
[pid=21962/tid=21996] ppid=21961 vsize=524804 CPUtime=82.58
/proc/21962/task/21996/stat : 21996 (pb_cplex) R 21961 21961 19731 0 -1 4202560 20518 0 0 0 8244 14 0 0 25 0 2 0 12694426 537399296 78238 1992294400 134512640 146736320 4292530576 18446744073709551615 136008394 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1259.5
Current children cumulated vsize (KiB) 533504

[startup+1242.3 s]
/proc/loadavg: 1.68 1.35 1.13 2/109 22001
/proc/meminfo: memFree=951564/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=675932 CPUtime=1356.16
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 1849646 0 0 0 134910 706 0 0 25 0 2 0 12586948 692154368 102146 1992294400 134512640 146736320 4292530576 18446744073709551615 136382239 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/21962/statm: 168983 102146 1073 2985 0 165525 0
[pid=21962/tid=22001] ppid=21961 vsize=675932 CPUtime=0
/proc/21962/task/22001/stat : 22001 (pb_cplex) S 21961 21961 19731 0 -1 4202560 2 0 0 0 0 0 0 0 18 0 2 0 12710829 692154368 102146 1992294400 134512640 146736320 4292530576 18446744073709551615 144580073 0 2 4096 16387 18446604436669225984 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1356.16
Current children cumulated vsize (KiB) 684632

[startup+1302.3 s]
/proc/loadavg: 1.25 1.29 1.11 2/109 22003
/proc/meminfo: memFree=945736/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=677744 CPUtime=1416.16
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 1868235 0 0 0 140903 713 0 0 25 0 2 0 12586948 694009856 103583 1992294400 134512640 146736320 4292530576 18446744073709551615 136017485 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/21962/statm: 169436 103583 1073 2985 0 165978 0
[pid=21962/tid=22001] ppid=21961 vsize=677744 CPUtime=0
/proc/21962/task/22001/stat : 22001 (pb_cplex) S 21961 21961 19731 0 -1 4202560 2 0 0 0 0 0 0 0 18 0 2 0 12710829 694009856 103583 1992294400 134512640 146736320 4292530576 18446744073709551615 144580073 0 2 4096 16387 18446604436669225984 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1416.16
Current children cumulated vsize (KiB) 686444

[startup+1362.3 s]
/proc/loadavg: 1.09 1.23 1.10 2/109 22004
/proc/meminfo: memFree=943380/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=679960 CPUtime=1476.13
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 1888172 0 0 0 146893 720 0 0 25 0 2 0 12586948 696279040 104163 1992294400 134512640 146736320 4292530576 18446744073709551615 136006886 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/21962/statm: 169990 104163 1073 2985 0 166532 0
[pid=21962/tid=22001] ppid=21961 vsize=679960 CPUtime=0
/proc/21962/task/22001/stat : 22001 (pb_cplex) S 21961 21961 19731 0 -1 4202560 2 0 0 0 0 0 0 0 18 0 2 0 12710829 696279040 104163 1992294400 134512640 146736320 4292530576 18446744073709551615 144580073 0 2 4096 16387 18446604436669225984 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1476.13
Current children cumulated vsize (KiB) 688660

[startup+1422.31 s]
/proc/loadavg: 1.03 1.19 1.09 2/109 22006
/proc/meminfo: memFree=943380/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=679960 CPUtime=1536.12
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 1901239 0 0 0 152887 725 0 0 25 0 2 0 12586948 696279040 104163 1992294400 134512640 146736320 4292530576 18446744073709551615 136007313 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/21962/statm: 169990 104163 1073 2985 0 166532 0
[pid=21962/tid=22001] ppid=21961 vsize=679960 CPUtime=0
/proc/21962/task/22001/stat : 22001 (pb_cplex) S 21961 21961 19731 0 -1 4202560 2 0 0 0 0 0 0 0 18 0 2 0 12710829 696279040 104163 1992294400 134512640 146736320 4292530576 18446744073709551615 144580073 0 2 4096 16387 18446604436669225984 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1536.12
Current children cumulated vsize (KiB) 688660

[startup+1482.3 s]
/proc/loadavg: 1.01 1.15 1.08 2/109 22007
/proc/meminfo: memFree=943380/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=679960 CPUtime=1596.11
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 1914884 0 0 0 158880 731 0 0 25 0 2 0 12586948 696279040 104163 1992294400 134512640 146736320 4292530576 18446744073709551615 136006861 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/21962/statm: 169990 104163 1073 2985 0 166532 0
[pid=21962/tid=22001] ppid=21961 vsize=679960 CPUtime=0
/proc/21962/task/22001/stat : 22001 (pb_cplex) S 21961 21961 19731 0 -1 4202560 2 0 0 0 0 0 0 0 18 0 2 0 12710829 696279040 104163 1992294400 134512640 146736320 4292530576 18446744073709551615 144580073 0 2 4096 16387 18446604436669225984 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1596.11
Current children cumulated vsize (KiB) 688660

[startup+1542.3 s]
/proc/loadavg: 1.00 1.12 1.08 2/109 22009
/proc/meminfo: memFree=941520/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=681744 CPUtime=1656.09
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 1933100 0 0 0 164871 738 0 0 25 0 2 0 12586948 698105856 104618 1992294400 134512640 146736320 4292530576 18446744073709551615 136007284 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/21962/statm: 170436 104618 1073 2985 0 166978 0
[pid=21962/tid=22001] ppid=21961 vsize=681744 CPUtime=0
/proc/21962/task/22001/stat : 22001 (pb_cplex) S 21961 21961 19731 0 -1 4202560 2 0 0 0 0 0 0 0 18 0 2 0 12710829 698105856 104618 1992294400 134512640 146736320 4292530576 18446744073709551615 144580073 0 2 4096 16387 18446604436669225984 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1656.09
Current children cumulated vsize (KiB) 690444

[startup+1602.3 s]
/proc/loadavg: 1.00 1.10 1.07 2/109 22011
/proc/meminfo: memFree=943876/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=679196 CPUtime=1716.08
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 1951189 0 0 0 170863 745 0 0 25 0 2 0 12586948 695496704 104026 1992294400 134512640 146736320 4292530576 18446744073709551615 136007605 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/21962/statm: 169799 104026 1073 2985 0 166341 0
[pid=21962/tid=22001] ppid=21961 vsize=679196 CPUtime=0
/proc/21962/task/22001/stat : 22001 (pb_cplex) S 21961 21961 19731 0 -1 4202560 2 0 0 0 0 0 0 0 18 0 2 0 12710829 695496704 104026 1992294400 134512640 146736320 4292530576 18446744073709551615 144580073 0 2 4096 16387 18446604436669225984 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1716.08
Current children cumulated vsize (KiB) 687896

[startup+1662.3 s]
/proc/loadavg: 1.00 1.08 1.07 2/109 22012
/proc/meminfo: memFree=941396/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=681744 CPUtime=1776.06
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 1971702 0 0 0 176854 752 0 0 25 0 2 0 12586948 698105856 104651 1992294400 134512640 146736320 4292530576 18446744073709551615 136400469 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/21962/statm: 170436 104651 1073 2985 0 166978 0
[pid=21962/tid=22001] ppid=21961 vsize=681744 CPUtime=0
/proc/21962/task/22001/stat : 22001 (pb_cplex) S 21961 21961 19731 0 -1 4202560 2 0 0 0 0 0 0 0 18 0 2 0 12710829 698105856 104651 1992294400 134512640 146736320 4292530576 18446744073709551615 144580073 0 2 4096 16387 18446604436669225984 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1776.06
Current children cumulated vsize (KiB) 690444



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1686.31 s]
/proc/loadavg: 1.00 1.07 1.07 2/109 22013
/proc/meminfo: memFree=941272/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=681816 CPUtime=1800.07
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 1982697 0 0 0 179250 757 0 0 25 0 2 0 12586948 698179584 104672 1992294400 134512640 146736320 4292530576 18446744073709551615 136384857 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/21962/statm: 170454 104672 1073 2985 0 166996 0
[pid=21962/tid=22001] ppid=21961 vsize=681816 CPUtime=0
/proc/21962/task/22001/stat : 22001 (pb_cplex) S 21961 21961 19731 0 -1 4202560 2 0 0 0 0 0 0 0 18 0 2 0 12710829 698179584 104672 1992294400 134512640 146736320 4292530576 18446744073709551615 144580073 0 2 4096 16387 18446604436669225984 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 690516

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1686.31 s]
/proc/loadavg: 1.00 1.07 1.07 2/109 22013
/proc/meminfo: memFree=941272/2059040 swapFree=4192956/4192956
[pid=21961] ppid=21959 vsize=8700 CPUtime=0
/proc/21961/stat : 21961 (run) S 21959 21961 19731 0 -1 4202496 364 0 0 0 0 0 0 0 20 0 1 0 12586948 8908800 248 1992294400 4194304 4922060 140736436997200 18446744073709551615 215210368133 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/21961/statm: 2175 248 208 178 0 68 0
[pid=21962] ppid=21961 vsize=681816 CPUtime=1800.07
/proc/21962/stat : 21962 (pb_cplex) R 21961 21961 19731 0 -1 4202496 1982697 0 0 0 179250 757 0 0 25 0 2 0 12586948 698179584 104672 1992294400 134512640 146736320 4292530576 18446744073709551615 136384857 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/21962/statm: 170454 104672 1073 2985 0 166996 0
[pid=21962/tid=22001] ppid=21961 vsize=681816 CPUtime=0
/proc/21962/task/22001/stat : 22001 (pb_cplex) S 21961 21961 19731 0 -1 4202560 2 0 0 0 0 0 0 0 18 0 2 0 12710829 698179584 104672 1992294400 134512640 146736320 4292530576 18446744073709551615 144580073 0 2 4096 16387 18446604436669225984 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 690516

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 21961 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=2999
# CPU time returned by wait4() is 0.002999
# while last known CPU time is 1800.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1686.33
CPU time (s): 1800.07
CPU user time (s): 1792.5
CPU system time (s): 7.57
CPU usage (%): 106.745
Max. virtual memory (cumulated for all children) (KiB): 711140

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 364
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 3
involuntary context switches= 2

runsolver used 2.96455 second user time and 7.93879 second system time

The end

Launcher Data 

Begin job on node031 at 2010-07-06 21:16:03
IDJOB=2696774
IDBENCH=77130
IDSOLVER=1209
FILE ID=node031/2696774-1278443763
PBS_JOBID= 11233447
Free space on /tmp= 62552 MiB

SOLVER NAME= pb_cplex 2010-06-29
BENCH NAME= PB10/normalized-PB10/OPT-SMALLINT-LIN/oliveras/j120opt/normalized-j12021_8.std.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2696774-1278443763/watcher-2696774-1278443763 -o /tmp/evaluation-result-2696774-1278443763/solver-2696774-1278443763 -C 1800 -W 2000 -M 1800  run HOME/instance-2696774-1278443763.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= 33a0c5076a13a0bc08e55dbdcaafa3d4
RANDOM SEED=759723650

node031.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.220
cache size	: 2048 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6000.44
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.220
cache size	: 2048 KB
physical id	: 3
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5599.54
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2059040 kB
MemFree:       1359208 kB
Buffers:        117024 kB
Cached:         441536 kB
SwapCached:          0 kB
Active:         277628 kB
Inactive:       341700 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2059040 kB
LowFree:       1359208 kB
SwapTotal:     4192956 kB
SwapFree:      4192956 kB
Dirty:           23644 kB
Writeback:           4 kB
AnonPages:       60712 kB
Mapped:          14420 kB
Slab:            58352 kB
PageTables:       4120 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   5222476 kB
Committed_AS:   181184 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    264964 kB
VmallocChunk: 34359471699 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-2696774-1278443763.opb

Free space on /tmp at the end= 62536 MiB
End job on node031 at 2010-07-06 21:44:12