Trace number 4100835

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
NaPS 1.02? (TO) 1800.03 1800.51

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-reduced-mps-v2-20-10-boeing1.opb
MD5SUMceb2e4b71eb9bdf9c63b27bfd911be00
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables8869
Total number of constraints561
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints561
Minimum length of a constraint11
Maximum length of a constraint6849
Number of terms in the objective function 6523
Biggest coefficient in the objective function 7301
Number of bits for the biggest coefficient in the objective function 13
Sum of the numbers in the objective function 529587
Number of bits of the sum of numbers in the objective function 20
Biggest number in a constraint 262145
Number of bits of the biggest number in a constraint 19
Biggest sum of numbers in a constraint 529932
Number of bits of the biggest sum of numbers20
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c NaPS 1.02b.
1800.01/1800.50	c 
1800.01/1800.50	c *** TERMINATED *** by signal 15
1800.01/1800.50	s UNKNOWN
1800.01/1800.50	c _____________________________________________________________________________
1800.01/1800.50	c 
1800.01/1800.50	c std/band forms        : 541,8
1800.01/1800.50	c 2cl/3cl ITE-codings   : 1201795,85421
1800.01/1800.50	c BDD/srt/adr Max costs : 38328,544844,0
1800.01/1800.50	c BDDraw/bin/mul/srt/adr: 251,0,294,4,0
1800.01/1800.50	c BDD nodes             : 4637676
1800.01/1800.50	c Es1/CC detections     : 0,0
1800.01/1800.50	c SAT/UNSAT calls       : 0,0
1800.01/1800.50	c restarts              : 0
1800.01/1800.50	c conflicts             : 0              (0 /sec)
1800.01/1800.50	c decisions             : 0              (0 /sec)
1800.01/1800.50	c propagations          : 0              (0 /sec)
1800.01/1800.50	c inspects              : 0              (0 /sec)
1800.01/1800.50	c CPU time (solving tm) : 1799 s        (0 s)
1800.01/1800.50	c Time for Opt-base     : 11.47 s
1800.01/1800.50	c _____________________________________________________________________________

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4100835-1466220894/watcher-4100835-1466220894 -o /tmp/evaluation-result-4100835-1466220894/solver-4100835-1466220894 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node121-1466206085-402 --watchdog 1960 naps-1.02 HOME/instance-4100835-1466220894.opb 

pid=3635
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.19 2.20 2.18 3/175 3638
/proc/meminfo: memFree=28680988/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=7936 CPUtime=0 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 654 0 0 0 0 0 0 0 20 0 1 0 24136308 8126464 529 33554432000 4194304 5796924 140737349444208 140735732430216 4621249 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 1984 529 114 392 0 1583 0

[startup+0.100157 s]
/proc/loadavg: 2.19 2.20 2.18 3/175 3638
/proc/meminfo: memFree=28680988/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=11564 CPUtime=0.09 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 1573 0 0 0 9 0 0 0 20 0 1 0 24136308 11841536 1348 33554432000 4194304 5796924 140737349444208 140735732430216 5183584 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 2891 1348 128 392 0 2490 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 11564

[startup+0.200252 s]
/proc/loadavg: 2.19 2.20 2.18 3/175 3638
/proc/meminfo: memFree=28680988/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=14284 CPUtime=0.19 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 2196 0 0 0 19 0 0 0 20 0 1 0 24136308 14626816 1971 33554432000 4194304 5796924 140737349444208 140735732430216 5095032 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 3571 1971 128 392 0 3170 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 14284

[startup+0.300266 s]
/proc/loadavg: 2.19 2.20 2.18 3/175 3638
/proc/meminfo: memFree=28680988/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=17200 CPUtime=0.29 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 3275 0 0 0 29 0 0 0 20 0 1 0 24136308 17612800 2592 33554432000 4194304 5796924 140737349444208 140735732430216 5095032 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 4300 2592 129 392 0 3899 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 17200

[startup+0.700193 s]
/proc/loadavg: 2.19 2.20 2.18 3/175 3638
/proc/meminfo: memFree=28680988/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=18908 CPUtime=0.69 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 4203 0 0 0 69 0 0 0 20 0 1 0 24136308 19361792 2996 33554432000 4194304 5796924 140737349444208 140737349440424 5087772 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 4727 2996 145 392 0 4326 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 18908

[startup+1.50022 s]
/proc/loadavg: 2.18 2.19 2.18 3/176 3639
/proc/meminfo: memFree=28669168/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=18908 CPUtime=1.49 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 4203 0 0 0 149 0 0 0 20 0 1 0 24136308 19361792 2996 33554432000 4194304 5796924 140737349444208 140737349440424 5087747 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 4727 2996 145 392 0 4326 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 18908

[startup+3.10027 s]
/proc/loadavg: 2.18 2.19 2.18 3/176 3639
/proc/meminfo: memFree=28668928/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=19456 CPUtime=3.09 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 4381 0 0 0 309 0 0 0 20 0 1 0 24136308 19922944 3132 33554432000 4194304 5796924 140737349444208 140737349440424 4863673 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 4864 3132 145 392 0 4463 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 19456

[startup+6.3002 s]
/proc/loadavg: 2.24 2.21 2.18 3/176 3639
/proc/meminfo: memFree=28665640/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=25732 CPUtime=6.29 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 6140 0 0 0 628 1 0 0 20 0 1 0 24136308 26349568 4643 33554432000 4194304 5796924 140737349444208 140737349440424 4432293 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 6433 4643 145 392 0 6032 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 25732

[startup+12.7003 s]
/proc/loadavg: 2.22 2.20 2.18 3/176 3639
/proc/meminfo: memFree=28623184/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=66620 CPUtime=12.69 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 14473 0 0 0 1266 3 0 0 20 0 1 0 24136308 68218880 14246 33554432000 4194304 5796924 140737349444208 140737349224776 5092509 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 16655 14246 145 392 0 16254 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 66620

[startup+25.5004 s]
/proc/loadavg: 2.17 2.19 2.18 3/176 3639
/proc/meminfo: memFree=28236564/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=460584 CPUtime=25.49 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 104862 0 0 0 2532 17 0 0 20 0 1 0 24136308 471638016 113078 33554432000 4194304 5796924 140737349444208 140737342669848 5095032 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 115146 113080 145 392 0 114745 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 460584

[startup+51.1004 s]
/proc/loadavg: 2.17 2.19 2.18 4/176 3639
/proc/meminfo: memFree=28100152/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=594796 CPUtime=51.09 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 133673 0 0 0 5087 22 0 0 20 0 1 0 24136308 609071104 144444 33554432000 4194304 5796924 140737349444208 140737349441192 4269222 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 148699 144444 152 392 0 148298 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 594796

[startup+102.3 s]
/proc/loadavg: 2.24 2.21 2.18 3/175 3640
/proc/meminfo: memFree=26929888/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1897280 CPUtime=102.28 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 223332 0 0 0 10171 57 0 0 20 0 1 0 24136308 1942814720 435645 33554432000 4194304 5796924 140737349444208 140737349442056 4606507 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 474320 435645 177 392 0 473919 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 1897280

[startup+162.3 s]
/proc/loadavg: 2.20 2.20 2.18 3/175 3686
/proc/meminfo: memFree=27807356/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1897280 CPUtime=162.26 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 223335 0 0 0 16169 57 0 0 20 0 1 0 24136308 1942814720 436670 33554432000 4194304 5796924 140737349444208 140737349442056 4606537 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 474320 436670 178 392 0 473919 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 1897280

[startup+222.307 s]
/proc/loadavg: 2.22 2.20 2.18 4/175 3687
/proc/meminfo: memFree=27773580/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=222.26 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 224010 0 0 0 22167 59 0 0 20 0 1 0 24136308 2026156032 438324 33554432000 4194304 5796924 140737349444208 140737349441848 4606420 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 438324 178 392 0 494266 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 1978668

[startup+282.3 s]
/proc/loadavg: 2.26 2.21 2.18 4/175 3689
/proc/meminfo: memFree=27710092/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=282.24 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 224013 0 0 0 28165 59 0 0 20 0 1 0 24136308 2026156032 439860 33554432000 4194304 5796924 140737349444208 140737349441848 4606480 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 439860 178 392 0 494266 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 1978668

[startup+342.3 s]
/proc/loadavg: 2.13 2.18 2.18 3/176 3693
/proc/meminfo: memFree=27701320/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=342.24 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 224015 0 0 0 34165 59 0 0 20 0 1 0 24136308 2026156032 440884 33554432000 4194304 5796924 140737349444208 140737349441848 4607232 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 440884 178 392 0 494266 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 1978668

[startup+402.3 s]
/proc/loadavg: 2.21 2.19 2.18 3/175 3694
/proc/meminfo: memFree=27693944/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=402.22 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 224017 0 0 0 40163 59 0 0 20 0 1 0 24136308 2026156032 441908 33554432000 4194304 5796924 140737349444208 140737349441848 4606847 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 441908 178 392 0 494266 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 1978668

[startup+462.3 s]
/proc/loadavg: 2.14 2.17 2.17 3/175 3695
/proc/meminfo: memFree=27687796/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=462.21 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 224020 0 0 0 46162 59 0 0 20 0 1 0 24136308 2026156032 443444 33554432000 4194304 5796924 140737349444208 140737349441848 4606507 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 443444 178 392 0 494266 0
Current children cumulated CPU time (s) 462.21
Current children cumulated vsize (KiB) 1978668

[startup+522.3 s]
/proc/loadavg: 2.19 2.18 2.18 3/175 3696
/proc/meminfo: memFree=26603208/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=522.2 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 224040 0 0 0 52160 60 0 0 20 0 1 0 24136308 2026156032 444478 33554432000 4194304 5796924 140737349444208 140737349441848 4606507 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 444478 178 392 0 494266 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 1978668

[startup+582.3 s]
/proc/loadavg: 2.17 2.18 2.18 3/175 3698
/proc/meminfo: memFree=26592864/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=582.17 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 224085 0 0 0 58157 60 0 0 20 0 1 0 24136308 2026156032 446014 33554432000 4194304 5796924 140737349444208 140737349441848 4606507 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 446014 178 392 0 494266 0
Current children cumulated CPU time (s) 582.17
Current children cumulated vsize (KiB) 1978668


################
# More data... #
################


[startup+942.3 s]
/proc/loadavg: 2.25 2.19 2.18 4/176 3709
/proc/meminfo: memFree=26575932/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=941.95 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 225506 0 0 0 94132 63 0 0 20 0 1 0 24136308 2026156032 445073 33554432000 4194304 5796924 140737349444208 140737349441848 4607232 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 445073 178 392 0 494266 0
Current children cumulated CPU time (s) 941.95
Current children cumulated vsize (KiB) 1978668

[startup+1002.3 s]
/proc/loadavg: 2.22 2.20 2.18 4/175 3710
/proc/meminfo: memFree=26567460/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1001.94 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 225509 0 0 0 100131 63 0 0 20 0 1 0 24136308 2026156032 446609 33554432000 4194304 5796924 140737349444208 140737349441848 4606555 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 446609 178 392 0 494266 0
Current children cumulated CPU time (s) 1001.94
Current children cumulated vsize (KiB) 1978668

[startup+1062.3 s]
/proc/loadavg: 2.12 2.17 2.17 4/175 3711
/proc/meminfo: memFree=26559372/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1061.93 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 225514 0 0 0 106130 63 0 0 20 0 1 0 24136308 2026156032 448145 33554432000 4194304 5796924 140737349444208 140737349441848 4606507 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 448145 178 392 0 494266 0
Current children cumulated CPU time (s) 1061.93
Current children cumulated vsize (KiB) 1978668

[startup+1122.3 s]
/proc/loadavg: 2.19 2.18 2.18 3/175 3712
/proc/meminfo: memFree=26588876/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1121.93 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 225888 0 0 0 112127 66 0 0 20 0 1 0 24136308 2026156032 439702 33554432000 4194304 5796924 140737349444208 140737349441672 4606480 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 439702 178 392 0 494266 0
Current children cumulated CPU time (s) 1121.93
Current children cumulated vsize (KiB) 1978668

[startup+1182.3 s]
/proc/loadavg: 2.24 2.19 2.18 3/175 3714
/proc/meminfo: memFree=26578168/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1181.92 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 225891 0 0 0 118126 66 0 0 20 0 1 0 24136308 2026156032 441238 33554432000 4194304 5796924 140737349444208 140737349441672 4606433 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 441238 178 392 0 494266 0
Current children cumulated CPU time (s) 1181.92
Current children cumulated vsize (KiB) 1978668

[startup+1242.3 s]
/proc/loadavg: 2.13 2.17 2.17 3/175 3715
/proc/meminfo: memFree=26567708/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1241.91 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 225894 0 0 0 124125 66 0 0 20 0 1 0 24136308 2026156032 442774 33554432000 4194304 5796924 140737349444208 140737349441672 4606744 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 442774 178 392 0 494266 0
Current children cumulated CPU time (s) 1241.91
Current children cumulated vsize (KiB) 1978668

[startup+1302.3 s]
/proc/loadavg: 2.14 2.17 2.17 3/175 3716
/proc/meminfo: memFree=26555476/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1301.89 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 225904 0 0 0 130123 66 0 0 20 0 1 0 24136308 2026156032 444822 33554432000 4194304 5796924 140737349444208 140737349441672 4607258 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 444822 178 392 0 494266 0
Current children cumulated CPU time (s) 1301.89
Current children cumulated vsize (KiB) 1978668

[startup+1362.3 s]
/proc/loadavg: 2.14 2.16 2.17 4/175 3717
/proc/meminfo: memFree=26547004/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1361.88 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 225918 0 0 0 136122 66 0 0 20 0 1 0 24136308 2026156032 446358 33554432000 4194304 5796924 140737349444208 140737349441672 4598026 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 446358 178 392 0 494266 0
Current children cumulated CPU time (s) 1361.88
Current children cumulated vsize (KiB) 1978668

[startup+1422.3 s]
/proc/loadavg: 2.17 2.16 2.17 3/175 3718
/proc/meminfo: memFree=26535092/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1421.87 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 225922 0 0 0 142121 66 0 0 20 0 1 0 24136308 2026156032 448406 33554432000 4194304 5796924 140737349444208 140737349441672 4606433 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 448406 178 392 0 494266 0
Current children cumulated CPU time (s) 1421.87
Current children cumulated vsize (KiB) 1978668

[startup+1482.3 s]
/proc/loadavg: 2.32 2.20 2.18 3/175 3720
/proc/meminfo: memFree=26522804/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1481.86 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 225925 0 0 0 148120 66 0 0 20 0 1 0 24136308 2026156032 450350 33554432000 4194304 5796924 140737349444208 140737349441672 4606531 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 450350 178 392 0 494266 0
Current children cumulated CPU time (s) 1481.86
Current children cumulated vsize (KiB) 1978668

[startup+1542.31 s]
/proc/loadavg: 2.24 2.20 2.18 3/176 3724
/proc/meminfo: memFree=26556684/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1541.85 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 226010 0 0 0 154117 68 0 0 20 0 1 0 24136308 2026156032 440977 33554432000 4194304 5796924 140737349444208 140737349441672 4606507 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 440977 178 392 0 494266 0
Current children cumulated CPU time (s) 1541.85
Current children cumulated vsize (KiB) 1978668

[startup+1602.3 s]
/proc/loadavg: 2.25 2.20 2.18 3/176 3748
/proc/meminfo: memFree=26544568/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1601.85 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 226014 0 0 0 160116 69 0 0 20 0 1 0 24136308 2026156032 442774 33554432000 4194304 5796924 140737349444208 140737349441672 4606433 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 442774 178 392 0 494266 0
Current children cumulated CPU time (s) 1601.85
Current children cumulated vsize (KiB) 1978668

[startup+1662.3 s]
/proc/loadavg: 2.20 2.20 2.18 3/175 3749
/proc/meminfo: memFree=26587940/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1661.84 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 226018 0 0 0 166115 69 0 0 20 0 1 0 24136308 2026156032 444822 33554432000 4194304 5796924 140737349444208 140737349441672 4569014 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 444822 178 392 0 494266 0
Current children cumulated CPU time (s) 1661.84
Current children cumulated vsize (KiB) 1978668

[startup+1722.3 s]
/proc/loadavg: 2.22 2.20 2.18 3/175 3750
/proc/meminfo: memFree=26577160/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1721.83 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 226022 0 0 0 172114 69 0 0 20 0 1 0 24136308 2026156032 446888 33554432000 4194304 5796924 140737349444208 140737349441672 4606816 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 446888 178 392 0 494266 0
Current children cumulated CPU time (s) 1721.83
Current children cumulated vsize (KiB) 1978668

[startup+1782.3 s]
/proc/loadavg: 2.12 2.18 2.17 3/175 3752
/proc/meminfo: memFree=26564592/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1781.82 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 226025 0 0 0 178113 69 0 0 20 0 1 0 24136308 2026156032 448424 33554432000 4194304 5796924 140737349444208 140737349441672 4606420 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 448424 178 392 0 494266 0
Current children cumulated CPU time (s) 1781.82
Current children cumulated vsize (KiB) 1978668



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.5 s]
/proc/loadavg: 2.09 2.17 2.17 3/175 3753
/proc/meminfo: memFree=26560324/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1800.01 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 226027 0 0 0 179932 69 0 0 20 0 1 0 24136308 2026156032 449448 33554432000 4194304 5796924 140737349444208 140737349441672 4606531 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 449448 178 392 0 494266 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1978668

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 3638 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+1800.5 s]
/proc/loadavg: 2.09 2.17 2.17 3/175 3753
/proc/meminfo: memFree=26560324/32872528 swapFree=1316768/1463936
[pid=3638] ppid=3635 vsize=1978668 CPUtime=1800.01 cores=0,2,4,6
/proc/3638/stat : 3638 (naps-1.02) R 3635 3638 386 0 -1 4202496 226027 0 0 0 179932 69 0 0 20 0 1 0 24136308 2026156032 449448 33554432000 4194304 5796924 140737349444208 140737349441672 4606531 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3638/statm: 494667 449448 178 392 0 494266 0
Current children cumulated CPU time (s) 1800.01
Current children cumulated vsize (KiB) 1978668

Child status: 0
Real time (s): 1800.51
CPU time (s): 1800.03
CPU user time (s): 1799.33
CPU system time (s): 0.701893
CPU usage (%): 99.9735
Max. virtual memory (cumulated for all children) (KiB): 2241156

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.33
system time used= 0.701893
maximum resident set size= 1981316
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 226039
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 338
involuntary context switches= 1843

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.95725 second user time and 8.5507 second system time

The end

Launcher Data 

Begin job on node121 at 2016-06-18 05:34:54
IDJOB=4100835
IDBENCH=1667
IDSOLVER=2544
FILE ID=node121/4100835-1466220894
RUNJOBID= node121-1466206085-402
PBS_JOBID= 19918156
Free space on /tmp= 71716 MiB

SOLVER NAME= NaPS 1.02
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-reduced-mps-v2-20-10-boeing1.opb
COMMAND LINE= naps-1.02 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4100835-1466220894/watcher-4100835-1466220894 -o /tmp/evaluation-result-4100835-1466220894/solver-4100835-1466220894 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node121-1466206085-402 --watchdog 1960  naps-1.02 HOME/instance-4100835-1466220894.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ceb2e4b71eb9bdf9c63b27bfd911be00
RANDOM SEED=1398781316

node121.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.38
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.691
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        28680988 kB
Buffers:          104084 kB
Cached:           148112 kB
SwapCached:         1900 kB
Active:          1784816 kB
Inactive:         187500 kB
Active(anon):    1720096 kB
Inactive(anon):     2792 kB
Active(file):      64720 kB
Inactive(file):   184708 kB
Unevictable:     1463936 kB
Mlocked:         1316768 kB
SwapTotal:      67108856 kB
SwapFree:       67101124 kB
Dirty:              5336 kB
Writeback:             0 kB
AnonPages:       3242100 kB
Mapped:             9476 kB
Shmem:                 0 kB
Slab:             606412 kB
SReclaimable:      50360 kB
SUnreclaim:       556052 kB
KernelStack:        1464 kB
PageTables:        10320 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    3435112 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1906688 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71712 MiB
End job on node121 at 2016-06-18 06:04:54