Trace number 4103783

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
NaPS 1.02? (TO) 1800.01 1802.3

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/
lp/data/normalized-mps-v2-20-10-share2b.opb
MD5SUM95fbceaf029492cffa0d3c545b3f551d
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark-39584070
Best CPU time to get the best result obtained on this benchmark1800.07
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function -36858196
Optimality of the best value was proved NO
Number of variables2370
Total number of constraints96
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints96
Minimum length of a constraint30
Maximum length of a constraint360
Number of terms in the objective function 870
Biggest coefficient in the objective function 204010946560
Number of bits for the biggest coefficient in the objective function 38
Sum of the numbers in the objective function 4534411718529
Number of bits of the sum of numbers in the objective function 43
Biggest number in a constraint 552977039360
Number of bits of the biggest number in a constraint 40
Biggest sum of numbers in a constraint 10976862656529
Number of bits of the biggest sum of numbers44
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c NaPS 1.02b.

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103783-1466266418/watcher-4103783-1466266418 -o /tmp/evaluation-result-4103783-1466266418/solver-4103783-1466266418 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node102-1466240351-7953 --watchdog 1960 naps-1.02 HOME/instance-4103783-1466266418.opb 

pid=11153
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 11156
/proc/meminfo: memFree=31577996/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=6820 CPUtime=0 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 393 0 0 0 0 0 0 0 20 0 1 0 28692376 6983680 267 33554432000 4194304 5796924 140735944023360 140735944022664 4802714 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 1705 267 128 392 0 1304 0

[startup+0.100159 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 11156
/proc/meminfo: memFree=31577996/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=9564 CPUtime=0.09 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 1069 0 0 0 9 0 0 0 20 0 1 0 28692376 9793536 943 33554432000 4194304 5796924 140735944023360 140735944022664 5183584 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 2391 943 128 392 0 1990 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 9564

[startup+0.200295 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 11156
/proc/meminfo: memFree=31577996/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=10244 CPUtime=0.19 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 1294 0 0 0 19 0 0 0 20 0 1 0 28692376 10489856 1148 33554432000 4194304 5796924 140735944023360 140735944022664 4313345 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 2561 1148 139 392 0 2160 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 10244

[startup+0.300266 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 11156
/proc/meminfo: memFree=31577996/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=10244 CPUtime=0.29 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 1295 0 0 0 29 0 0 0 20 0 1 0 28692376 10489856 1149 33554432000 4194304 5796924 140735944023360 140735944022664 5087743 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 2561 1149 140 392 0 2160 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 10244

[startup+0.700232 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 11156
/proc/meminfo: memFree=31577996/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=10244 CPUtime=0.69 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 1295 0 0 0 69 0 0 0 20 0 1 0 28692376 10489856 1149 33554432000 4194304 5796924 140735944023360 140735944022664 4840392 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 2561 1149 140 392 0 2160 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 10244

[startup+1.50023 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11157
/proc/meminfo: memFree=31573904/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=10244 CPUtime=1.49 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 1295 0 0 0 149 0 0 0 20 0 1 0 28692376 10489856 1149 33554432000 4194304 5796924 140735944023360 140735944019576 4808113 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 2561 1149 140 392 0 2160 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 10244

[startup+3.10023 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11157
/proc/meminfo: memFree=31573532/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=10380 CPUtime=3.09 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 1308 0 0 0 309 0 0 0 20 0 1 0 28692376 10629120 1162 33554432000 4194304 5796924 140735944023360 140735944017160 4865437 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 2595 1162 140 392 0 2194 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 10380

[startup+6.30023 s]
/proc/loadavg: 2.00 2.00 2.00 3/176 11157
/proc/meminfo: memFree=31573456/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=10536 CPUtime=6.29 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 1359 0 0 0 629 0 0 0 20 0 1 0 28692376 10788864 1213 33554432000 4194304 5796924 140735944023360 140735944017160 4865437 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 2634 1213 140 392 0 2233 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 10536

[startup+12.7002 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11158
/proc/meminfo: memFree=31573116/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=10672 CPUtime=12.69 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 1381 0 0 0 1269 0 0 0 20 0 1 0 28692376 10928128 1242 33554432000 4194304 5796924 140735944023360 140735944017080 4199805 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 2668 1242 140 392 0 2267 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 10672

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11158
/proc/meminfo: memFree=31573480/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=10852 CPUtime=25.49 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 1437 0 0 0 2549 0 0 0 20 0 1 0 28692376 11112448 1298 33554432000 4194304 5796924 140735944023360 140735944017160 4865437 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 2713 1298 140 392 0 2312 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 10852

[startup+51.1003 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11158
/proc/meminfo: memFree=31544664/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=40244 CPUtime=51.08 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 9076 0 0 0 5108 0 0 0 20 0 1 0 28692376 41209856 8628 33554432000 4194304 5796924 140735944023360 140735944019576 4806949 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 10061 8628 144 392 0 9660 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 40244

[startup+102.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11159
/proc/meminfo: memFree=31544776/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=42460 CPUtime=102.27 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 9978 0 0 0 10227 0 0 0 20 0 1 0 28692376 43479040 9200 33554432000 4194304 5796924 140735944023360 140735944019576 5092622 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 10615 9200 144 392 0 10214 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 42460

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11160
/proc/meminfo: memFree=31474960/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=51088 CPUtime=162.26 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 11703 0 0 0 16225 1 0 0 20 0 1 0 28692376 52314112 11288 33554432000 4194304 5796924 140735944023360 140735944017160 5092423 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 12772 11288 144 392 0 12371 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 51088

[startup+222.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11161
/proc/meminfo: memFree=31473520/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=51252 CPUtime=222.25 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 11760 0 0 0 22224 1 0 0 20 0 1 0 28692376 52482048 11332 33554432000 4194304 5796924 140735944023360 140735944017080 5087499 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 12813 11332 144 392 0 12412 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 51252

[startup+282.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/177 11162
/proc/meminfo: memFree=31449296/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=75960 CPUtime=282.24 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 17958 0 0 0 28222 2 0 0 20 0 1 0 28692376 77783040 17529 33554432000 4194304 5796924 140735944023360 140735944019576 5087532 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 18990 17529 144 392 0 18589 0
Current children cumulated CPU time (s) 282.24
Current children cumulated vsize (KiB) 75960

[startup+342.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 11164
/proc/meminfo: memFree=31449284/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=75960 CPUtime=342.23 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 17958 0 0 0 34221 2 0 0 20 0 1 0 28692376 77783040 17529 33554432000 4194304 5796924 140735944023360 140735944019576 4805600 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 18990 17529 144 392 0 18589 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 75960

[startup+402.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/178 11168
/proc/meminfo: memFree=31441440/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=85048 CPUtime=402.21 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 18794 0 0 0 40219 2 0 0 20 0 1 0 28692376 87089152 19602 33554432000 4194304 5796924 140735944023360 140735944019576 4863673 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 21262 19602 144 392 0 20861 0
Current children cumulated CPU time (s) 402.21
Current children cumulated vsize (KiB) 85048

[startup+462.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 11169
/proc/meminfo: memFree=31440924/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=85348 CPUtime=462.2 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 18856 0 0 0 46218 2 0 0 20 0 1 0 28692376 87396352 19659 33554432000 4194304 5796924 140735944023360 140735944017080 4865437 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 21337 19659 144 392 0 20936 0
Current children cumulated CPU time (s) 462.2
Current children cumulated vsize (KiB) 85348

[startup+522.3 s]
/proc/loadavg: 2.01 2.01 2.00 4/177 11170
/proc/meminfo: memFree=31431520/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=95772 CPUtime=522.2 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 21111 0 0 0 52217 3 0 0 20 0 1 0 28692376 98070528 21914 33554432000 4194304 5796924 140735944023360 140735944019576 5087606 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 23943 21914 144 392 0 23542 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 95772

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 11171
/proc/meminfo: memFree=31423264/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=101260 CPUtime=582.18 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 22643 0 0 0 58215 3 0 0 20 0 1 0 28692376 103690240 23957 33554432000 4194304 5796924 140735944023360 140735944019576 5087643 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 25315 23957 191 392 0 24914 0
Current children cumulated CPU time (s) 582.18
Current children cumulated vsize (KiB) 101260


################
# More data... #
################

[pid=11156] ppid=11153 vsize=174020 CPUtime=1122.1 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 32093 0 0 0 112204 6 0 0 20 0 1 0 28692376 178196480 41847 33554432000 4194304 5796924 140735944023360 140735944019576 5087637 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 43505 41847 191 392 0 43104 0
Current children cumulated CPU time (s) 1122.1
Current children cumulated vsize (KiB) 174020

[startup+1182.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/177 11277
/proc/meminfo: memFree=31455376/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=174020 CPUtime=1182.09 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 32093 0 0 0 118203 6 0 0 20 0 1 0 28692376 178196480 41847 33554432000 4194304 5796924 140735944023360 140735944019576 4313365 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 43505 41847 191 392 0 43104 0
Current children cumulated CPU time (s) 1182.09
Current children cumulated vsize (KiB) 174020

[startup+1242.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/176 11278
/proc/meminfo: memFree=31450128/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=183248 CPUtime=1242.09 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 32609 0 0 0 124202 7 0 0 20 0 1 0 28692376 187645952 42871 33554432000 4194304 5796924 140735944023360 140735944019576 5092735 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 45812 42871 191 392 0 45411 0
Current children cumulated CPU time (s) 1242.09
Current children cumulated vsize (KiB) 183248

[startup+1302.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/177 11280
/proc/meminfo: memFree=31449376/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=183248 CPUtime=1302.08 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 32609 0 0 0 130201 7 0 0 20 0 1 0 28692376 187645952 42871 33554432000 4194304 5796924 140735944023360 140735944019576 4839574 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 45812 42871 191 392 0 45411 0
Current children cumulated CPU time (s) 1302.08
Current children cumulated vsize (KiB) 183248

[startup+1362.3 s]
/proc/loadavg: 2.08 2.03 2.00 3/177 11281
/proc/meminfo: memFree=31446572/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=183248 CPUtime=1362.07 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 32610 0 0 0 136200 7 0 0 20 0 1 0 28692376 187645952 43383 33554432000 4194304 5796924 140735944023360 140735944019576 4199810 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 45812 43383 191 392 0 45411 0
Current children cumulated CPU time (s) 1362.07
Current children cumulated vsize (KiB) 183248

[startup+1422.3 s]
/proc/loadavg: 2.03 2.02 2.00 3/177 11282
/proc/meminfo: memFree=31442112/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=183248 CPUtime=1422.06 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 32612 0 0 0 142199 7 0 0 20 0 1 0 28692376 187645952 44407 33554432000 4194304 5796924 140735944023360 140735944019576 4865437 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 45812 44407 191 392 0 45411 0
Current children cumulated CPU time (s) 1422.06
Current children cumulated vsize (KiB) 183248

[startup+1482.3 s]
/proc/loadavg: 2.10 2.05 2.01 3/177 11283
/proc/meminfo: memFree=31435084/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=190244 CPUtime=1482.04 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 34368 0 0 0 148197 7 0 0 20 0 1 0 28692376 194809856 46163 33554432000 4194304 5796924 140735944023360 140735944019576 5096576 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 47561 46163 191 392 0 47160 0
Current children cumulated CPU time (s) 1482.04
Current children cumulated vsize (KiB) 190244

[startup+1542.31 s]
/proc/loadavg: 2.04 2.04 2.00 3/177 11284
/proc/meminfo: memFree=31431984/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=206196 CPUtime=1542.04 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 35083 0 0 0 154197 7 0 0 20 0 1 0 28692376 211144704 46878 33554432000 4194304 5796924 140735944023360 140735944019576 5087497 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 51549 46878 191 392 0 51148 0
Current children cumulated CPU time (s) 1542.04
Current children cumulated vsize (KiB) 206196

[startup+1602.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/178 11289
/proc/meminfo: memFree=31419408/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=215076 CPUtime=1602.03 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 37619 0 0 0 160195 8 0 0 20 0 1 0 28692376 220237824 49925 33554432000 4194304 5796924 140735944023360 140735944019576 5087724 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 53769 49925 191 392 0 53368 0
Current children cumulated CPU time (s) 1602.03
Current children cumulated vsize (KiB) 215076

[startup+1662.3 s]
/proc/loadavg: 2.08 2.04 2.01 3/177 11290
/proc/meminfo: memFree=31367140/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=265180 CPUtime=1662.02 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 40275 0 0 0 166192 10 0 0 20 0 1 0 28692376 271544320 62987 33554432000 4194304 5796924 140735944023360 140735944019576 5096549 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 66295 62987 191 392 0 65894 0
Current children cumulated CPU time (s) 1662.02
Current children cumulated vsize (KiB) 265180

[startup+1722.3 s]
/proc/loadavg: 2.11 2.04 2.01 3/177 11291
/proc/meminfo: memFree=31367008/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=265180 CPUtime=1722.01 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 40279 0 0 0 172191 10 0 0 20 0 1 0 28692376 271544320 62987 33554432000 4194304 5796924 140735944023360 140735944019576 4805768 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 66295 62987 191 392 0 65894 0
Current children cumulated CPU time (s) 1722.01
Current children cumulated vsize (KiB) 265180

[startup+1782.3 s]
/proc/loadavg: 2.12 2.05 2.01 3/177 11292
/proc/meminfo: memFree=31272824/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=265180 CPUtime=1782 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 40279 0 0 0 178190 10 0 0 20 0 1 0 28692376 271544320 62987 33554432000 4194304 5796924 140735944023360 140735944019576 5092604 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 66295 62987 191 392 0 65894 0
Current children cumulated CPU time (s) 1782
Current children cumulated vsize (KiB) 265180



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.3 s]
/proc/loadavg: 2.08 2.04 2.00 3/177 11292
/proc/meminfo: memFree=31269140/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=265576 CPUtime=1800 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) R 11153 11156 7936 0 -1 4202496 40383 0 0 0 179990 10 0 0 20 0 1 0 28692376 271949824 63602 33554432000 4194304 5796924 140735944023360 140735944019576 4809939 0 0 4096 17954 0 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 66394 63602 191 392 0 65993 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 265576

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -11156
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 11156 sig 9
??? end of watcher thread

Solver just ended.
Dumping a history of the last processes samples

[startup+1801.6 s]
/proc/loadavg: 2.08 2.04 2.00 2/177 11292
/proc/meminfo: memFree=31269016/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=265576 CPUtime=1800 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) S 11153 11156 7936 0 -1 4194304 40384 0 0 0 179990 10 0 0 20 0 1 0 28692376 271949824 63603 33554432000 4194304 5796924 140735944023360 140735944016008 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 66394 63603 192 392 0 65993 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 265576

[startup+1802 s]
/proc/loadavg: 2.08 2.04 2.00 2/177 11292
/proc/meminfo: memFree=31268644/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=265576 CPUtime=1800 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) S 11153 11156 7936 0 -1 4194304 40384 0 0 0 179990 10 0 0 20 0 1 0 28692376 271949824 63603 33554432000 4194304 5796924 140735944023360 140735944016008 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 66394 63603 192 392 0 65993 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 265576

[startup+1802.2 s]
/proc/loadavg: 2.08 2.04 2.00 2/177 11292
/proc/meminfo: memFree=31268644/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=265576 CPUtime=1800 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) S 11153 11156 7936 0 -1 4194304 40384 0 0 0 179990 10 0 0 20 0 1 0 28692376 271949824 63603 33554432000 4194304 5796924 140735944023360 140735944016008 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 66394 63603 192 392 0 65993 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 265576

[startup+1802.3 s]
/proc/loadavg: 2.08 2.04 2.00 2/177 11292
/proc/meminfo: memFree=31268644/32872528 swapFree=190484/190484
[pid=11156] ppid=11153 vsize=265576 CPUtime=1800 cores=1,3,5,7
/proc/11156/stat : 11156 (naps-1.02) S 11153 11156 7936 0 -1 4194304 40384 0 0 0 179990 10 0 0 20 0 1 0 28692376 271949824 63603 33554432000 4194304 5796924 140735944023360 140735944016008 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 5 0 0 0 0 0
/proc/11156/statm: 66394 63603 192 392 0 65993 0
Current children cumulated CPU time (s) 1800
Current children cumulated vsize (KiB) 265576

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.3
CPU time (s): 1800.01
CPU user time (s): 1799.9
CPU system time (s): 0.102984
CPU usage (%): 99.8727
Max. virtual memory (cumulated for all children) (KiB): 307360

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.9
system time used= 0.102984
maximum resident set size= 294128
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 40384
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 34
involuntary context switches= 1853

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.21421 second user time and 7.37288 second system time

The end

Launcher Data 

Begin job on node102 at 2016-06-18 18:13:39
IDJOB=4103783
IDBENCH=2459
IDSOLVER=2544
FILE ID=node102/4103783-1466266418
RUNJOBID= node102-1466240351-7953
PBS_JOBID= 19918190
Free space on /tmp= 71724 MiB

SOLVER NAME= NaPS 1.02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/ftp.netlib.org/lp/data/normalized-mps-v2-20-10-share2b.opb
COMMAND LINE= naps-1.02 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103783-1466266418/watcher-4103783-1466266418 -o /tmp/evaluation-result-4103783-1466266418/solver-4103783-1466266418 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node102-1466240351-7953 --watchdog 1960  naps-1.02 HOME/instance-4103783-1466266418.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 95fbceaf029492cffa0d3c545b3f551d
RANDOM SEED=895547774

node102.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        31578656 kB
Buffers:          132452 kB
Cached:           181348 kB
SwapCached:         2124 kB
Active:           139436 kB
Inactive:         222996 kB
Active(anon):      47084 kB
Inactive(anon):     4012 kB
Active(file):      92352 kB
Inactive(file):   218984 kB
Unevictable:      190484 kB
Mlocked:          190484 kB
SwapTotal:      67108856 kB
SwapFree:       67099164 kB
Dirty:              4296 kB
Writeback:             4 kB
AnonPages:        238796 kB
Mapped:             9512 kB
Shmem:                 0 kB
Slab:             608432 kB
SReclaimable:      52128 kB
SUnreclaim:       556304 kB
KernelStack:        1456 kB
PageTables:         4536 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:     358636 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:     34816 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71720 MiB
End job on node102 at 2016-06-18 18:43:41