Trace number 4101659

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
NaPS 1.02? (TO) 1800.08 1802.64

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/
MIPLIB/miplib2003/normalized-reduced-mps-v2-20-10-dano3mip.opb
MD5SUM14e6c259fcfc7693ea81c905b2ebcb59
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables399966
Total number of constraints3226
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)48
Number of constraints which are nor clauses,nor cardinality constraints3178
Minimum length of a constraint21
Maximum length of a constraint15900
Number of terms in the objective function 30
Biggest coefficient in the objective function 262145
Number of bits for the biggest coefficient in the objective function 19
Sum of the numbers in the objective function 524317
Number of bits of the sum of numbers in the objective function 20
Biggest number in a constraint 262145
Number of bits of the biggest number in a constraint 19
Biggest sum of numbers in a constraint 535830
Number of bits of the biggest sum of numbers20
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data

0.00/0.00	c NaPS 1.02b.

Verifier Data

ERROR: no interpretation found !

Watcher Data

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4101659-1466231434/watcher-4101659-1466231434 -o /tmp/evaluation-result-4101659-1466231434/solver-4101659-1466231434 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node107-1466206100-325 --watchdog 1960 naps-1.02 HOME/instance-4101659-1466231434.opb 

pid=3933
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 3936
/proc/meminfo: memFree=29986336/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=7120 CPUtime=0 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 480 0 0 0 0 0 0 0 20 0 1 0 25193512 7290880 355 33554432000 4194304 5796924 140737074036176 140735259530440 5095032 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 1780 355 124 392 0 1379 0

[startup+0.100159 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 3936
/proc/meminfo: memFree=29986336/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=12824 CPUtime=0.09 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 1930 0 0 0 9 0 0 0 20 0 1 0 25193512 13131776 1763 33554432000 4194304 5796924 140737074036176 140735259530440 5087589 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 3206 1763 124 392 0 2805 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 12824

[startup+0.200321 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 3936
/proc/meminfo: memFree=29986336/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=19792 CPUtime=0.19 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 3521 0 0 0 19 0 0 0 20 0 1 0 25193512 20267008 3271 33554432000 4194304 5796924 140737074036176 140735259530440 5087488 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 4948 3271 124 392 0 4547 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 19792

[startup+0.300319 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 3936
/proc/meminfo: memFree=29986336/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=26544 CPUtime=0.29 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 5272 0 0 0 28 1 0 0 20 0 1 0 25193512 27181056 4846 33554432000 4194304 5796924 140737074036176 140735259530440 4863673 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 6636 4846 124 392 0 6235 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 26544

[startup+0.700274 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 3936
/proc/meminfo: memFree=29986336/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=47956 CPUtime=0.69 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 10720 0 0 0 67 2 0 0 20 0 1 0 25193512 49106944 9938 33554432000 4194304 5796924 140737074036176 140737074033592 5096709 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 11989 9938 124 392 0 11588 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 47956

[startup+1.50025 s]
/proc/loadavg: 2.01 2.01 2.00 3/178 3937
/proc/meminfo: memFree=29932264/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=76200 CPUtime=1.49 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 18031 0 0 0 146 3 0 0 20 0 1 0 25193512 78028800 17249 33554432000 4194304 5796924 140737074036176 140737074033592 5100064 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 19050 17249 124 392 0 18649 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 76200

[startup+3.10024 s]
/proc/loadavg: 2.01 2.01 2.00 3/178 3937
/proc/meminfo: memFree=29890220/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=142868 CPUtime=3.09 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 34044 0 0 0 303 6 0 0 20 0 1 0 25193512 146296832 33016 33554432000 4194304 5796924 140737074036176 140737074033704 5092509 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 35717 33016 124 392 0 35316 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 142868

[startup+6.30024 s]
/proc/loadavg: 2.09 2.02 2.01 3/178 3937
/proc/meminfo: memFree=29762252/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=268112 CPUtime=6.29 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 62738 0 0 0 619 10 0 0 20 0 1 0 25193512 274546688 62643 33554432000 4194304 5796924 140737074036176 140737074033592 5100093 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 67028 62643 124 392 0 66627 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 268112

[startup+12.7002 s]
/proc/loadavg: 2.08 2.02 2.00 3/178 3937
/proc/meminfo: memFree=29558172/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=451952 CPUtime=12.69 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 108954 0 0 0 1252 17 0 0 20 0 1 0 25193512 462798848 110096 33554432000 4194304 5796924 140737074036176 140737074033640 4865437 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 112988 110096 128 392 0 112587 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 451952

[startup+25.5004 s]
/proc/loadavg: 2.07 2.02 2.00 3/178 3937
/proc/meminfo: memFree=29322652/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=668420 CPUtime=25.49 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 160538 0 0 0 2524 25 0 0 20 0 1 0 25193512 684462080 164235 33554432000 4194304 5796924 140737074036176 140737074034040 4802630 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 167105 164235 130 392 0 166704 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 668420

[startup+51.1004 s]
/proc/loadavg: 2.04 2.02 2.00 3/177 3937
/proc/meminfo: memFree=29139904/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=668420 CPUtime=51.09 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 160538 0 0 0 5084 25 0 0 20 0 1 0 25193512 684462080 164235 33554432000 4194304 5796924 140737074036176 140737074034040 4802604 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 167105 164235 130 392 0 166704 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 668420

[startup+102.3 s]
/proc/loadavg: 2.02 2.01 2.00 3/177 3939
/proc/meminfo: memFree=28833272/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=946264 CPUtime=102.28 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 199063 0 0 0 10196 32 0 0 20 0 1 0 25193512 968974336 231851 33554432000 4194304 5796924 140737074036176 140737074033160 5087780 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 236566 231851 151 392 0 236165 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 946264

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 3940
/proc/meminfo: memFree=28699344/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=1019300 CPUtime=162.27 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 212668 0 0 0 16192 35 0 0 20 0 1 0 25193512 1043763200 251588 33554432000 4194304 5796924 140737074036176 140737074033160 5092952 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 254825 251588 151 392 0 254424 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 1019300

[startup+222.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3941
/proc/meminfo: memFree=28530300/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=1188264 CPUtime=222.27 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 226811 0 0 0 22187 40 0 0 20 0 1 0 25193512 1216782336 292163 33554432000 4194304 5796924 140737074036176 140737073524808 5087747 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 297066 292163 151 392 0 296665 0
Current children cumulated CPU time (s) 222.27
Current children cumulated vsize (KiB) 1188264

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3942
/proc/meminfo: memFree=28415664/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=1287516 CPUtime=282.25 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 239992 0 0 0 28183 42 0 0 20 0 1 0 25193512 1318416384 311987 33554432000 4194304 5796924 140737074036176 140737074033160 4805602 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 321879 311987 151 392 0 321478 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 1287516

[startup+342.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 3943
/proc/meminfo: memFree=28163404/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=1506136 CPUtime=342.24 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 253030 0 0 0 34176 48 0 0 20 0 1 0 25193512 1542283264 372779 33554432000 4194304 5796924 140737074036176 140737074033160 5096588 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 376534 372779 151 392 0 376133 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 1506136

[startup+402.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 3945
/proc/meminfo: memFree=28066492/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=1626496 CPUtime=402.22 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 266105 0 0 0 40171 51 0 0 20 0 1 0 25193512 1665531904 391475 33554432000 4194304 5796924 140737074036176 140737074033160 4806832 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 406624 391475 151 392 0 406223 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 1626496

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 3946
/proc/meminfo: memFree=27984404/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=1679164 CPUtime=462.22 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 279293 0 0 0 46169 53 0 0 20 0 1 0 25193512 1719463936 411306 33554432000 4194304 5796924 140737074036176 140737074033160 5087497 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 419791 411306 151 392 0 419390 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 1679164

[startup+522.3 s]
/proc/loadavg: 1.94 1.98 1.99 3/177 3993
/proc/meminfo: memFree=29709500/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=1834564 CPUtime=522.21 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 291993 0 0 0 52166 55 0 0 20 0 1 0 25193512 1878593536 429627 33554432000 4194304 5796924 140737074036176 140737073066680 4806838 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 458641 429627 151 392 0 458240 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 1834564

[startup+582.3 s]
/proc/loadavg: 1.97 1.98 1.99 3/177 3997
/proc/meminfo: memFree=29417508/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=1885120 CPUtime=582.21 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 305058 0 0 0 58163 58 0 0 20 0 1 0 25193512 1930362880 448824 33554432000 4194304 5796924 140737074036176 140737073145512 5087632 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 471280 448824 151 392 0 470879 0
Current children cumulated CPU time (s) 582.21
Current children cumulated vsize (KiB) 1885120


################
# More data... #
################

[pid=3936] ppid=3933 vsize=2773324 CPUtime=1062.06 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 405172 0 0 0 106121 85 0 0 20 0 1 0 25193512 2839883776 679786 33554432000 4194304 5796924 140737074036176 140737074033160 5087579 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 693331 679786 151 392 0 692930 0
Current children cumulated CPU time (s) 1062.06
Current children cumulated vsize (KiB) 2773324

[startup+1122.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4009
/proc/meminfo: memFree=28405024/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=2823220 CPUtime=1122.03 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 417707 0 0 0 112116 87 0 0 20 0 1 0 25193512 2890977280 698412 33554432000 4194304 5796924 140737074036176 140737074033160 4243600 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 705805 698412 151 392 0 705404 0
Current children cumulated CPU time (s) 1122.03
Current children cumulated vsize (KiB) 2823220

[startup+1182.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/178 4013
/proc/meminfo: memFree=28338052/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=3108020 CPUtime=1182 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 430200 0 0 0 118108 92 0 0 20 0 1 0 25193512 3182612480 716485 33554432000 4194304 5796924 140737074036176 140737074033160 5092416 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 777005 716485 151 392 0 776604 0
Current children cumulated CPU time (s) 1182
Current children cumulated vsize (KiB) 3108020

[startup+1242.3 s]
/proc/loadavg: 2.05 2.01 2.00 3/177 4014
/proc/meminfo: memFree=28259608/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=3157916 CPUtime=1241.97 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 442741 0 0 0 124102 95 0 0 20 0 1 0 25193512 3233705984 735116 33554432000 4194304 5796924 140737074036176 140737074033160 5100293 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 789479 735116 151 392 0 789078 0
Current children cumulated CPU time (s) 1241.97
Current children cumulated vsize (KiB) 3157916

[startup+1302.3 s]
/proc/loadavg: 2.07 2.02 2.00 3/177 4016
/proc/meminfo: memFree=27514916/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=3876380 CPUtime=1301.93 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 454890 0 0 0 130076 117 0 0 20 0 1 0 25193512 3969413120 920355 33554432000 4194304 5796924 140737074036176 140737074033160 5092545 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 969095 920355 151 392 0 968694 0
Current children cumulated CPU time (s) 1301.93
Current children cumulated vsize (KiB) 3876380

[startup+1362.3 s]
/proc/loadavg: 2.02 2.02 2.00 3/177 4017
/proc/meminfo: memFree=27450744/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=3926672 CPUtime=1361.9 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 467514 0 0 0 136071 119 0 0 20 0 1 0 25193512 4020912128 938557 33554432000 4194304 5796924 140737074036176 140737074033160 5087650 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 981668 938557 151 392 0 981267 0
Current children cumulated CPU time (s) 1361.9
Current children cumulated vsize (KiB) 3926672

[startup+1422.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/177 4018
/proc/meminfo: memFree=27372216/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=3974588 CPUtime=1421.88 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 479548 0 0 0 142066 122 0 0 20 0 1 0 25193512 4069978112 956681 33554432000 4194304 5796924 140737074036176 140737074033160 4316816 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 993647 956681 151 392 0 993246 0
Current children cumulated CPU time (s) 1421.88
Current children cumulated vsize (KiB) 3974588

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 4019
/proc/meminfo: memFree=27293864/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=4024880 CPUtime=1481.84 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 492177 0 0 0 148060 124 0 0 20 0 1 0 25193512 4121477120 975406 33554432000 4194304 5796924 140737074036176 140737074033160 5087579 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 1006220 975406 151 392 0 1005819 0
Current children cumulated CPU time (s) 1481.84
Current children cumulated vsize (KiB) 4024880

[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4020
/proc/meminfo: memFree=27214344/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=4072532 CPUtime=1541.82 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 504133 0 0 0 154056 126 0 0 20 0 1 0 25193512 4170272768 993458 33554432000 4194304 5796924 140737074036176 140737074033160 5092526 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 1018133 993458 151 392 0 1017732 0
Current children cumulated CPU time (s) 1541.82
Current children cumulated vsize (KiB) 4072532

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4022
/proc/meminfo: memFree=27153884/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=4120844 CPUtime=1601.79 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 516257 0 0 0 160051 128 0 0 20 0 1 0 25193512 4219744256 1011162 33554432000 4194304 5796924 140737074036176 140737074033160 5100101 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 1030211 1011162 151 392 0 1029810 0
Current children cumulated CPU time (s) 1601.79
Current children cumulated vsize (KiB) 4120844

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 4023
/proc/meminfo: memFree=27073300/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=4170740 CPUtime=1661.76 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 528798 0 0 0 166046 130 0 0 20 0 1 0 25193512 4270837760 1029795 33554432000 4194304 5796924 140737074036176 140737073111352 4806859 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 1042685 1029795 151 392 0 1042284 0
Current children cumulated CPU time (s) 1661.76
Current children cumulated vsize (KiB) 4170740

[startup+1722.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 4024
/proc/meminfo: memFree=27031988/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=4195028 CPUtime=1721.74 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 534888 0 0 0 172042 132 0 0 20 0 1 0 25193512 4295708672 1038927 33554432000 4194304 5796924 140737074036176 140737074032392 4809129 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 1048757 1038927 151 392 0 1048356 0
Current children cumulated CPU time (s) 1721.74
Current children cumulated vsize (KiB) 4195028

[startup+1782.3 s]
/proc/loadavg: 2.06 2.02 2.00 3/178 4028
/proc/meminfo: memFree=27022280/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=4195028 CPUtime=1781.73 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 534893 0 0 0 178041 132 0 0 20 0 1 0 25193512 4295708672 1039439 33554432000 4194304 5796924 140737074036176 140737074032392 4806991 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 1048757 1039439 151 392 0 1048356 0
Current children cumulated CPU time (s) 1781.73
Current children cumulated vsize (KiB) 4195028



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.6 s]
/proc/loadavg: 2.05 2.02 2.00 3/178 4028
/proc/meminfo: memFree=27020960/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=4195028 CPUtime=1800.03 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) R 3933 3936 309 0 -1 4202496 534893 0 0 0 179871 132 0 0 20 0 1 0 25193512 4295708672 1039439 33554432000 4194304 5796924 140737074036176 140737074032392 5092651 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 1048757 1039439 151 392 0 1048356 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 4195028

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -3936
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 3936 sig 9
??? end of watcher thread

Solver just ended.
Dumping a history of the last processes samples

[startup+1801.6 s]
/proc/loadavg: 1.96 2.00 2.00 2/178 4028
/proc/meminfo: memFree=27020960/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=4195028 CPUtime=1800.03 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) S 3933 3936 309 0 -1 4194304 534894 0 0 0 179871 132 0 0 20 0 1 0 25193512 4295708672 1039440 33554432000 4194304 5796924 140737074036176 140737074028872 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 1048757 1039440 152 392 0 1048356 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 4195028

[startup+1802.4 s]
/proc/loadavg: 1.96 2.00 2.00 2/178 4028
/proc/meminfo: memFree=27020836/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=4195028 CPUtime=1800.03 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) S 3933 3936 309 0 -1 4194304 534894 0 0 0 179871 132 0 0 20 0 1 0 25193512 4295708672 1039440 33554432000 4194304 5796924 140737074036176 140737074028872 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 1048757 1039440 152 392 0 1048356 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 4195028

[startup+1802.6 s]
/proc/loadavg: 1.96 2.00 2.00 2/178 4028
/proc/meminfo: memFree=27020836/32872528 swapFree=241348/274052
[pid=3936] ppid=3933 vsize=4195028 CPUtime=1800.03 cores=0,2,4,6
/proc/3936/stat : 3936 (naps-1.02) S 3933 3936 309 0 -1 4194304 534894 0 0 0 179871 132 0 0 20 0 1 0 25193512 4295708672 1039440 33554432000 4194304 5796924 140737074036176 140737074028872 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/3936/statm: 1048757 1039440 152 392 0 1048356 0
Current children cumulated CPU time (s) 1800.03
Current children cumulated vsize (KiB) 4195028

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.64
CPU time (s): 1800.08
CPU user time (s): 1798.71
CPU system time (s): 1.36479
CPU usage (%): 99.8579
Max. virtual memory (cumulated for all children) (KiB): 4517492

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1798.71
system time used= 1.36479
maximum resident set size= 4304140
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 534894
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 573
involuntary context switches= 1832

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.57315 second user time and 8.20375 second system time

The end

Launcher Data

Begin job on node107 at 2016-06-18 08:30:35
IDJOB=4101659
IDBENCH=1778
IDSOLVER=2544
FILE ID=node107/4101659-1466231434
RUNJOBID= node107-1466206100-325
PBS_JOBID= 19918165
Free space on /tmp= 71576 MiB

SOLVER NAME= NaPS 1.02
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/miplib2003/normalized-reduced-mps-v2-20-10-dano3mip.opb
COMMAND LINE= naps-1.02 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4101659-1466231434/watcher-4101659-1466231434 -o /tmp/evaluation-result-4101659-1466231434/solver-4101659-1466231434 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node107-1466206100-325 --watchdog 1960  naps-1.02 HOME/instance-4101659-1466231434.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 14e6c259fcfc7693ea81c905b2ebcb59
RANDOM SEED=674600837

node107.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.90
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.953
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        29986600 kB
Buffers:           92240 kB
Cached:           270288 kB
SwapCached:         3136 kB
Active:          1710212 kB
Inactive:         159672 kB
Active(anon):    1506668 kB
Inactive(anon):     2864 kB
Active(file):     203544 kB
Inactive(file):   156808 kB
Unevictable:      274052 kB
Mlocked:          241348 kB
SwapTotal:      67108856 kB
SwapFree:       67099620 kB
Dirty:             28160 kB
Writeback:             0 kB
AnonPages:       1781632 kB
Mapped:             9412 kB
Shmem:                 0 kB
Slab:             609244 kB
SReclaimable:      52496 kB
SUnreclaim:       556748 kB
KernelStack:        1448 kB
PageTables:         7528 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    1918740 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   1396736 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71684 MiB
End job on node107 at 2016-06-18 09:00:38