Trace number 2697014

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
pb_cplex 2010-06-29? (TO) 1800.07 1042.52

General information on the benchmark

Namenormalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/factor-mod-B/
factor-mod-size=9-P0=109-P1=191-P2=263-P3=37-P4=317-P5=89-P6=131-B.opb
MD5SUMd6ad4e57f9bd4d3660efa4691d3e45da
Bench CategoryOPT-SMALLINT-NLC (optimisation, small integers, non linear constraints)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark3
Best CPU time to get the best result obtained on this benchmark0.658899
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 3
Optimality of the best value was proved YES
Number of variables162
Total number of constraints13
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints13
Minimum length of a constraint9
Maximum length of a constraint99
Number of terms in the objective function 9
Biggest coefficient in the objective function 256
Number of bits for the biggest coefficient in the objective function 9
Sum of the numbers in the objective function 511
Number of bits of the sum of numbers in the objective function 9
Biggest number in a constraint 131072
Number of bits of the biggest number in a constraint 18
Biggest sum of numbers in a constraint 523264
Number of bits of the biggest sum of numbers19
Number of products (including duplicates)486
Sum of products size (including duplicates)972
Number of different products486
Sum of products size972

Solver Data 

0.00/0.00	c pb_cplex 1.0 - 20100701
0.00/0.00	c Parsing opb file format. File HOME/instance-2697014-1278048900.opb.
0.00/0.00	c Instance file HOME/instance-2697014-1278048900.opb
0.00/0.00	c File size is 36227 bytes.
0.00/0.02	c Highest Coefficient sum: 523264
0.00/0.02	c  IBM ILOG License Manager: "IBM ILOG Optimization Suite for Academic Initiative" is accessing CPLEX 12 with option(s): "e m b q ".
0.00/0.03	c ============================[ Problem Statistics ]=============================
0.00/0.03	c |                                                                             |
0.00/0.03	c |  Parsing time:          0.03         s                                      |
0.00/0.03	c |  Number Variables:      648                                                 |
0.00/0.03	c |  Number Constraints:    985                                                 |
0.00/0.03	c ===============================================================================
1800.07/1042.51	c Remaining time 1799.97 sec.
1800.07/1042.51	c 
1800.07/1042.51	c *** INTERRUPTED ***
1800.07/1042.51	s UNKNOWN
1800.07/1042.51	c Total CPU time              : 1779.04 s
1800.07/1042.51	c Memory used           : 100.00 MB
1800.07/1042.51	c CPU time              : 1779.04 s
1800.07/1042.51	c 
1800.07/1042.51	c *** INTERRUPTED ***

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver version 3.2.9 (svn:492) (c) roussel@cril.univ-artois.fr

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-2697014-1278048900/watcher-2697014-1278048900 -o /tmp/evaluation-result-2697014-1278048900/solver-2697014-1278048900 -C 1800 -W 2000 -M 1800 run HOME/instance-2697014-1278048900.opb 

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2000 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 1843200 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 1894400 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 1.58 1.56 1.34 3/105 704
/proc/meminfo: memFree=1650212/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) R 702 704 398 0 -1 4202496 349 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595514261 0 65538 4100 65536 0 0 0 17 1 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0

[startup+0.0235841 s]
/proc/loadavg: 1.58 1.56 1.34 3/105 704
/proc/meminfo: memFree=1650212/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.104585 s]
/proc/loadavg: 1.58 1.56 1.34 3/105 704
/proc/meminfo: memFree=1650212/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.300611 s]
/proc/loadavg: 1.58 1.56 1.34 3/105 704
/proc/meminfo: memFree=1650212/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+0.702654 s]
/proc/loadavg: 1.58 1.56 1.34 3/105 704
/proc/meminfo: memFree=1650212/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
Current children cumulated CPU time (s) 0
Current children cumulated vsize (KiB) 8700

[startup+1.50176 s]
/proc/loadavg: 1.58 1.56 1.34 2/108 709
/proc/meminfo: memFree=1640888/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=35972 CPUtime=2.04
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 5720 0 0 0 198 6 0 0 16 0 2 0 146183692 36835328 3496 1992294400 134512640 146736320 4294850176 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/705/statm: 8993 3496 1070 2985 0 5535 0
[pid=705/tid=709] ppid=704 vsize=35972 CPUtime=0.55
/proc/705/task/709/stat : 709 (pb_cplex) R 704 704 398 0 -1 4202560 401 0 0 0 55 0 0 0 17 0 2 0 146183777 36835328 3496 1992294400 134512640 146736320 4294850176 18446744073709551615 136441323 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 2.04
Current children cumulated vsize (KiB) 44672

[startup+3.10194 s]
/proc/loadavg: 1.58 1.56 1.34 2/108 709
/proc/meminfo: memFree=1639772/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=36288 CPUtime=4.85
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 8183 0 0 0 475 10 0 0 17 0 2 0 146183692 37158912 3659 1992294400 134512640 146736320 4294850176 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/705/statm: 9072 3659 1071 2985 0 5614 0
[pid=705/tid=709] ppid=704 vsize=36288 CPUtime=1.9
/proc/705/task/709/stat : 709 (pb_cplex) R 704 704 398 0 -1 4202560 1399 0 0 0 188 2 0 0 17 0 2 0 146183777 37158912 3659 1992294400 134512640 146736320 4294850176 18446744073709551615 136475824 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 4.85
Current children cumulated vsize (KiB) 44988

[startup+6.30128 s]
/proc/loadavg: 1.62 1.56 1.35 2/108 709
/proc/meminfo: memFree=1633448/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=41156 CPUtime=10.36
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 18491 0 0 0 1017 19 0 0 16 0 2 0 146183692 42143744 4824 1992294400 134512640 146736320 4294850176 18446744073709551615 144715689 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/705/statm: 10289 4824 1071 2985 0 6831 0
[pid=705/tid=709] ppid=704 vsize=41156 CPUtime=4.61
/proc/705/task/709/stat : 709 (pb_cplex) R 704 704 398 0 -1 4202560 8612 0 0 0 453 8 0 0 16 0 2 0 146183777 42143744 4824 1992294400 134512640 146736320 4294850176 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 10.36
Current children cumulated vsize (KiB) 49856

[startup+12.702 s]
/proc/loadavg: 1.65 1.57 1.35 3/108 709
/proc/meminfo: memFree=1629852/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=43768 CPUtime=21.06
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 39638 0 0 0 2069 37 0 0 16 0 2 0 146183692 44818432 5529 1992294400 134512640 146736320 4294850176 18446744073709551615 139028303 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/705/statm: 10942 5529 1071 2985 0 7484 0
[pid=705/tid=709] ppid=704 vsize=43768 CPUtime=9.87
/proc/705/task/709/stat : 709 (pb_cplex) R 704 704 398 0 -1 4202560 20727 0 0 0 970 17 0 0 16 0 2 0 146183777 44818432 5529 1992294400 134512640 146736320 4294850176 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 21.06
Current children cumulated vsize (KiB) 52468

[startup+25.5014 s]
/proc/loadavg: 1.50 1.54 1.34 2/108 711
/proc/meminfo: memFree=1627000/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=54728 CPUtime=41.82
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 106530 0 0 0 4101 81 0 0 15 0 2 0 146183692 56041472 7662 1992294400 134512640 146736320 4294850176 18446744073709551615 139023058 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/705/statm: 13682 7662 1071 2985 0 10224 0
[pid=705/tid=709] ppid=704 vsize=54728 CPUtime=20.28
/proc/705/task/709/stat : 709 (pb_cplex) R 704 704 398 0 -1 4202560 54054 0 0 0 1989 39 0 0 17 0 2 0 146183777 56041472 7662 1992294400 134512640 146736320 4294850176 18446744073709551615 135523326 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 41.82
Current children cumulated vsize (KiB) 63428

[startup+51.1012 s]
/proc/loadavg: 1.65 1.58 1.36 2/108 711
/proc/meminfo: memFree=1619064/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=56132 CPUtime=82.41
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 234926 0 0 0 8080 161 0 0 16 0 2 0 146183692 57479168 8040 1992294400 134512640 146736320 4294850176 18446744073709551615 136403109 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/705/statm: 14033 8040 1074 2985 0 10575 0
[pid=705/tid=709] ppid=704 vsize=56132 CPUtime=40.77
/proc/705/task/709/stat : 709 (pb_cplex) R 704 704 398 0 -1 4202560 108449 0 0 0 4003 74 0 0 16 0 2 0 146183777 57479168 8040 1992294400 134512640 146736320 4294850176 18446744073709551615 139041156 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 82.41
Current children cumulated vsize (KiB) 64832

[startup+102.309 s]
/proc/loadavg: 1.65 1.59 1.38 2/108 714
/proc/meminfo: memFree=1603812/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=75000 CPUtime=159.88
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 485693 0 0 0 15682 306 0 0 16 0 2 0 146183692 76800000 12600 1992294400 134512640 146736320 4294850176 18446744073709551615 136008450 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/705/statm: 18750 12600 1106 2985 0 15292 0
[pid=705/tid=712] ppid=704 vsize=75000 CPUtime=35.67
/proc/705/task/712/stat : 712 (pb_cplex) S 704 704 398 0 -1 4202560 107960 0 0 0 3503 64 0 0 18 0 2 0 146189862 76800000 12600 1992294400 134512640 146736320 4294850176 18446744073709551615 144580073 0 2 4096 16387 18446604437861737792 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 159.88
Current children cumulated vsize (KiB) 83700

[startup+162.302 s]
/proc/loadavg: 1.85 1.64 1.40 2/108 714
/proc/meminfo: memFree=1590544/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=86412 CPUtime=254.56
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 685594 0 0 0 25015 441 0 0 16 0 2 0 146183692 88485888 15539 1992294400 134512640 146736320 4294850176 18446744073709551615 136403116 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/705/statm: 21603 15539 1106 2985 0 18145 0
[pid=705/tid=712] ppid=704 vsize=86412 CPUtime=88.01
/proc/705/task/712/stat : 712 (pb_cplex) S 704 704 398 0 -1 4202560 200175 0 0 0 8673 128 0 0 19 0 2 0 146189862 88485888 15539 1992294400 134512640 146736320 4294850176 18446744073709551615 144580073 0 2 4096 16387 18446604437861737792 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 254.56
Current children cumulated vsize (KiB) 95112

[startup+222.301 s]
/proc/loadavg: 1.97 1.70 1.44 2/108 716
/proc/meminfo: memFree=1592404/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=84836 CPUtime=357.32
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 830056 0 0 0 35186 546 0 0 16 0 2 0 146183692 86872064 15139 1992294400 134512640 146736320 4294850176 18446744073709551615 135454096 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/705/statm: 21209 15139 1126 2985 0 17751 0
[pid=705/tid=712] ppid=704 vsize=84836 CPUtime=139.39
/proc/705/task/712/stat : 712 (pb_cplex) R 704 704 398 0 -1 4202560 272407 0 0 0 13759 180 0 0 16 0 2 0 146189862 86872064 15139 1992294400 134512640 146736320 4294850176 18446744073709551615 136737310 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 357.32
Current children cumulated vsize (KiB) 93536

[startup+282.301 s]
/proc/loadavg: 2.05 1.76 1.47 3/108 718
/proc/meminfo: memFree=1590172/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=86412 CPUtime=463.12
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 1023397 0 0 0 45625 687 0 0 18 0 2 0 146183692 88485888 15682 1992294400 134512640 146736320 4294850176 18446744073709551615 144757825 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/705/statm: 21603 15682 1126 2985 0 18145 0
[pid=705/tid=712] ppid=704 vsize=86412 CPUtime=192.42
/proc/705/task/712/stat : 712 (pb_cplex) R 704 704 398 0 -1 4202560 378463 0 0 0 18988 254 0 0 16 0 2 0 146189862 88485888 15682 1992294400 134512640 146736320 4294850176 18446744073709551615 135526881 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 463.12
Current children cumulated vsize (KiB) 95112

[startup+342.301 s]
/proc/loadavg: 1.99 1.80 1.50 3/108 720
/proc/meminfo: memFree=1590180/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0

################
# More data... #
################

[pid=705] ppid=704 vsize=90744 CPUtime=888.62
/proc/705/stat : 705 (pb_cplex) S 704 704 398 0 -1 4202496 1399019 0 0 0 87760 1102 0 0 15 0 2 0 146183692 92921856 16701 1992294400 134512640 146736320 4294850176 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/705/statm: 22686 16701 1126 2985 0 19228 0
[pid=705/tid=712] ppid=704 vsize=90744 CPUtime=406.6
/proc/705/task/712/stat : 712 (pb_cplex) R 704 704 398 0 -1 4202560 595729 0 0 0 40177 483 0 0 18 0 2 0 146189862 92921856 16701 1992294400 134512640 146736320 4294850176 18446744073709551615 136008176 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 888.62
Current children cumulated vsize (KiB) 99444

[startup+582.301 s]
/proc/loadavg: 1.72 1.75 1.55 2/108 726
/proc/meminfo: memFree=1586212/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=91076 CPUtime=992.44
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 1487651 0 0 0 98047 1197 0 0 18 0 2 0 146183692 93261824 16832 1992294400 134512640 146736320 4294850176 18446744073709551615 135468690 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/705/statm: 22769 16832 1126 2985 0 19311 0
[pid=705/tid=712] ppid=704 vsize=91076 CPUtime=458.92
/proc/705/task/712/stat : 712 (pb_cplex) R 704 704 398 0 -1 4202560 643620 0 0 0 45362 530 0 0 16 0 2 0 146189862 93261824 16832 1992294400 134512640 146736320 4294850176 18446744073709551615 136389849 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 992.44
Current children cumulated vsize (KiB) 99776

[startup+642.302 s]
/proc/loadavg: 1.75 1.76 1.56 3/108 728
/proc/meminfo: memFree=1583360/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=94284 CPUtime=1099.15
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 1672983 0 0 0 108554 1361 0 0 17 0 2 0 146183692 96546816 17486 1992294400 134512640 146736320 4294850176 18446744073709551615 136015694 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/705/statm: 23571 17486 1126 2985 0 20113 0
[pid=705/tid=712] ppid=704 vsize=94284 CPUtime=511.67
/proc/705/task/712/stat : 712 (pb_cplex) R 704 704 398 0 -1 4202560 767992 0 0 0 50531 636 0 0 16 0 2 0 146189862 96546816 17486 1992294400 134512640 146736320 4294850176 18446744073709551615 136015583 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1099.15
Current children cumulated vsize (KiB) 102984

[startup+702.301 s]
/proc/loadavg: 1.62 1.73 1.56 2/108 730
/proc/meminfo: memFree=1582492/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=94256 CPUtime=1204.7
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 1741540 0 0 0 119016 1454 0 0 16 0 2 0 146183692 96518144 17649 1992294400 134512640 146736320 4294850176 18446744073709551615 136402273 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/705/statm: 23564 17649 1126 2985 0 20106 0
[pid=705/tid=712] ppid=704 vsize=94256 CPUtime=563.94
/proc/705/task/712/stat : 712 (pb_cplex) R 704 704 398 0 -1 4202560 804073 0 0 0 55709 685 0 0 17 0 2 0 146189862 96518144 17649 1992294400 134512640 146736320 4294850176 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1204.7
Current children cumulated vsize (KiB) 102956

[startup+762.309 s]
/proc/loadavg: 1.79 1.76 1.58 3/108 730
/proc/meminfo: memFree=1581748/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=95468 CPUtime=1309.38
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 1834804 0 0 0 129371 1567 0 0 18 0 2 0 146183692 97759232 17941 1992294400 134512640 146736320 4294850176 18446744073709551615 135526786 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/705/statm: 23867 17941 1127 2985 0 20409 0
[pid=705/tid=712] ppid=704 vsize=95468 CPUtime=615.99
/proc/705/task/712/stat : 712 (pb_cplex) R 704 704 398 0 -1 4202560 876130 0 0 0 60843 756 0 0 17 0 2 0 146189862 97759232 17941 1992294400 134512640 146736320 4294850176 18446744073709551615 144757825 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1309.38
Current children cumulated vsize (KiB) 104168

[startup+822.301 s]
/proc/loadavg: 1.70 1.73 1.57 3/108 732
/proc/meminfo: memFree=1575548/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=102112 CPUtime=1411.52
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 2059082 0 0 0 139417 1735 0 0 18 0 2 0 146183692 104562688 19387 1992294400 134512640 146736320 4294850176 18446744073709551615 135850737 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/705/statm: 25528 19387 1126 2985 0 22070 0
[pid=705/tid=712] ppid=704 vsize=102112 CPUtime=666.05
/proc/705/task/712/stat : 712 (pb_cplex) R 704 704 398 0 -1 4202560 1003102 0 0 0 65759 846 0 0 15 0 2 0 146189862 104562688 19387 1992294400 134512640 146736320 4294850176 18446744073709551615 135454093 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1411.52
Current children cumulated vsize (KiB) 110812

[startup+882.301 s]
/proc/loadavg: 1.77 1.73 1.58 3/108 734
/proc/meminfo: memFree=1575052/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=101240 CPUtime=1518.32
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 2106527 0 0 0 150006 1826 0 0 17 0 2 0 146183692 103669760 19364 1992294400 134512640 146736320 4294850176 18446744073709551615 137371887 0 0 4096 16387 18446744073709551615 0 0 17 1 0 0 0
/proc/705/statm: 25310 19364 1126 2985 0 21852 0
[pid=705/tid=712] ppid=704 vsize=101240 CPUtime=718.64
/proc/705/task/712/stat : 712 (pb_cplex) R 704 704 398 0 -1 4202560 1006851 0 0 0 70986 878 0 0 16 0 2 0 146189862 103669760 19364 1992294400 134512640 146736320 4294850176 18446744073709551615 135468687 0 2 4096 16387 0 0 0 -1 0 0 0 0
Current children cumulated CPU time (s) 1518.32
Current children cumulated vsize (KiB) 109940

[startup+942.302 s]
/proc/loadavg: 1.64 1.70 1.58 3/108 736
/proc/meminfo: memFree=1574928/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=102396 CPUtime=1623.83
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 2180004 0 0 0 160455 1928 0 0 16 0 2 0 146183692 104853504 19426 1992294400 134512640 146736320 4294850176 18446744073709551615 135231716 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/705/statm: 25599 19426 1126 2985 0 22141 0
[pid=705/tid=712] ppid=704 vsize=102396 CPUtime=771.85
/proc/705/task/712/stat : 712 (pb_cplex) R 704 704 398 0 -1 4202560 1060545 0 0 0 76245 940 0 0 18 0 2 0 146189862 104853504 19426 1992294400 134512640 146736320 4294850176 18446744073709551615 136015725 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1623.83
Current children cumulated vsize (KiB) 111096

[startup+1002.3 s]
/proc/loadavg: 1.66 1.70 1.58 3/108 738
/proc/meminfo: memFree=1574804/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=102396 CPUtime=1728.39
/proc/705/stat : 705 (pb_cplex) S 704 704 398 0 -1 4202496 2271414 0 0 0 170802 2037 0 0 15 0 2 0 146183692 104853504 19452 1992294400 134512640 146736320 4294850176 18446744073709551615 144580073 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/705/statm: 25599 19452 1126 2985 0 22141 0
[pid=705/tid=712] ppid=704 vsize=102396 CPUtime=824.14
/proc/705/task/712/stat : 712 (pb_cplex) R 704 704 398 0 -1 4202560 1121901 0 0 0 81410 1004 0 0 16 0 2 0 146189862 104853504 19452 1992294400 134512640 146736320 4294850176 18446744073709551615 135846482 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1728.39
Current children cumulated vsize (KiB) 111096



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1042.5 s]
/proc/loadavg: 1.87 1.75 1.60 3/108 738
/proc/meminfo: memFree=1574928/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=102396 CPUtime=1800.07
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 2304878 0 0 0 177902 2105 0 0 17 0 2 0 146183692 104853504 19570 1992294400 134512640 146736320 4294850176 18446744073709551615 135850319 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/705/statm: 25599 19570 1126 2985 0 22141 0
[pid=705/tid=712] ppid=704 vsize=102396 CPUtime=860.15
/proc/705/task/712/stat : 712 (pb_cplex) R 704 704 398 0 -1 4202560 1152466 0 0 0 84969 1046 0 0 17 0 2 0 146189862 104853504 19570 1992294400 134512640 146736320 4294850176 18446744073709551615 138423264 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 111096

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended. Dumping a history of the last processes samples

[startup+1042.5 s]
/proc/loadavg: 1.87 1.75 1.60 3/108 738
/proc/meminfo: memFree=1574928/2059040 swapFree=4136052/4192956
[pid=704] ppid=702 vsize=8700 CPUtime=0
/proc/704/stat : 704 (run) S 702 704 398 0 -1 4202496 365 0 0 0 0 0 0 0 25 0 1 0 146183691 8908800 249 1992294400 4194304 4922060 140737424095584 18446744073709551615 219595512965 0 65536 4100 65538 18446744071562232103 0 0 17 0 0 0 0
/proc/704/statm: 2175 249 208 178 0 68 0
[pid=705] ppid=704 vsize=102396 CPUtime=1800.07
/proc/705/stat : 705 (pb_cplex) R 704 704 398 0 -1 4202496 2304878 0 0 0 177902 2105 0 0 17 0 2 0 146183692 104853504 19570 1992294400 134512640 146736320 4294850176 18446744073709551615 135850319 0 0 4096 16387 18446744073709551615 0 0 17 0 0 0 0
/proc/705/statm: 25599 19570 1126 2985 0 22141 0
[pid=705/tid=712] ppid=704 vsize=102396 CPUtime=860.15
/proc/705/task/712/stat : 712 (pb_cplex) R 704 704 398 0 -1 4202560 1152466 0 0 0 84969 1046 0 0 17 0 2 0 146189862 104853504 19570 1992294400 134512640 146736320 4294850176 18446744073709551615 138423264 0 2 4096 16387 0 0 0 -1 1 0 0 0
Current children cumulated CPU time (s) 1800.07
Current children cumulated vsize (KiB) 111096

Child ended because it received signal 15 (SIGTERM)

# WARNING:
# CPU time reported by wait4() is probably wrong !
# wait4(...,&childrusage) returns 704 and gives
#  childrusage.ru_utime.tv_sec=0
#  childrusage.ru_utime.tv_usec=0
#  childrusage.ru_stime.tv_sec=0
#  childrusage.ru_stime.tv_usec=2999
# CPU time returned by wait4() is 0.002999
# while last known CPU time is 1800.07
#
# Solver probably didn't/couldn't wait for its children
# Using CPU time of the last sample as value...

Real time (s): 1042.52
CPU time (s): 1800.07
CPU user time (s): 1779.02
CPU system time (s): 21.05
CPU usage (%): 172.665
Max. virtual memory (cumulated for all children) (KiB): 124576

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 0
system time used= 0.002999
maximum resident set size= 0
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 365
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 2
involuntary context switches= 2

runsolver used 2.15167 second user time and 5.40318 second system time

The end

Launcher Data 

Begin job on node086 at 2010-07-02 07:35:00
IDJOB=2697014
IDBENCH=48048
IDSOLVER=1209
FILE ID=node086/2697014-1278048900
PBS_JOBID= 11198829
Free space on /tmp= 62232 MiB

SOLVER NAME= pb_cplex 2010-06-29
BENCH NAME= PB07/normalized-PB07/OPT-SMALLINT-NLC/submittedPB07/roussel/factor-mod-B/factor-mod-size=9-P0=109-P1=191-P2=263-P3=37-P4=317-P5=89-P6=131-B.opb
COMMAND LINE= run BENCHNAME
CONVERSION SCRIPT= PBconversionToLinear BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-2697014-1278048900/watcher-2697014-1278048900 -o /tmp/evaluation-result-2697014-1278048900/solver-2697014-1278048900 -C 1800 -W 2000 -M 1800  run HOME/instance-2697014-1278048900.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 1800 MiB
MAX NB THREAD= 0

MD5SUM BENCH= d6ad4e57f9bd4d3660efa4691d3e45da
RANDOM SEED=2134635726

node086.alineos.net Linux 2.6.18-164.el5 #1 SMP Thu Sep 3 03:28:30 EDT 2009

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.244
cache size	: 2048 KB
physical id	: 0
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 6000.48
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 15
model		: 4
model name	:                   Intel(R) Xeon(TM) CPU 3.00GHz
stepping	: 3
cpu MHz		: 3000.244
cache size	: 2048 KB
physical id	: 3
siblings	: 1
core id		: 0
cpu cores	: 1
apicid		: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 5
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl cid cx16 xtpr
bogomips	: 5999.40
clflush size	: 64
cache_alignment	: 128
address sizes	: 36 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:      2059040 kB
MemFree:       1650988 kB
Buffers:         83720 kB
Cached:         219468 kB
SwapCached:      10276 kB
Active:         110072 kB
Inactive:       206660 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:      2059040 kB
LowFree:       1650988 kB
SwapTotal:     4192956 kB
SwapFree:      4136052 kB
Dirty:           16656 kB
Writeback:           0 kB
AnonPages:       11964 kB
Mapped:           8428 kB
Slab:            69544 kB
PageTables:       4148 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   5222476 kB
Committed_AS:   182236 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    264948 kB
VmallocChunk: 34359471699 kB
HugePages_Total:     0
HugePages_Free:      0
HugePages_Rsvd:      0
Hugepagesize:     2048 kB

CONVERSION COMMAND LINE= PBconversionToLinear HOME/instance-2697014-1278048900.opb

Free space on /tmp at the end= 62216 MiB
End job on node086 at 2010-07-02 07:52:24