Trace number 4103235

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
NaPS 1.02? (TO) 1800.1 1800.41

General information on the benchmark

Namenormalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/
pub/fctp/normalized-mps-v2-20-10-n3709.opb
MD5SUM7d8773951a908fd3c2652ff6acba65e8
Bench CategoryOPT-BIGINT (optimisation, big integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark7426019560
Best CPU time to get the best result obtained on this benchmark1800.86
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 4559348765
Optimality of the best value was proved NO
Number of variables155000
Total number of constraints5150
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints5150
Minimum length of a constraint31
Maximum length of a constraint3000
Number of terms in the objective function 155000
Biggest coefficient in the objective function 4294967296
Number of bits for the biggest coefficient in the objective function 33
Sum of the numbers in the objective function 29610373267604
Number of bits of the sum of numbers in the objective function 45
Biggest number in a constraint 4294967296
Number of bits of the biggest number in a constraint 33
Biggest sum of numbers in a constraint 29610373267604
Number of bits of the biggest sum of numbers45
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c NaPS 1.02b.
1800.08/1800.40	c 
1800.08/1800.40	c *** TERMINATED *** by signal 15
1800.08/1800.40	s UNKNOWN
1800.08/1800.40	c _____________________________________________________________________________
1800.08/1800.40	c 
1800.08/1800.40	c std/band forms        : 1554,150
1800.08/1800.40	c 2cl/3cl ITE-codings   : 0,0
1800.08/1800.40	c BDD/srt/adr Max costs : 219664,0,0
1800.08/1800.40	c BDDraw/bin/mul/srt/adr: 150,0,1553,0,0
1800.08/1800.40	c BDD nodes             : 15814191
1800.08/1800.40	c Es1/CC detections     : 0,0
1800.08/1800.40	c SAT/UNSAT calls       : 0,0
1800.08/1800.40	c restarts              : 0
1800.08/1800.40	c conflicts             : 0              (0 /sec)
1800.08/1800.40	c decisions             : 0              (0 /sec)
1800.08/1800.40	c propagations          : 0              (0 /sec)
1800.08/1800.40	c inspects              : 0              (0 /sec)
1800.08/1800.40	c CPU time (solving tm) : 1800 s        (0 s)
1800.08/1800.40	c Time for Opt-base     : 1573 s
1800.08/1800.40	c _____________________________________________________________________________

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4103235-1466247692/watcher-4103235-1466247692 -o /tmp/evaluation-result-4103235-1466247692/solver-4103235-1466247692 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node102-1466240351-7952 --watchdog 1960 naps-1.02 HOME/instance-4103235-1466247692.opb 

pid=8918
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 8921
/proc/meminfo: memFree=30952408/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=7456 CPUtime=0 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 535 0 0 0 0 0 0 0 20 0 1 0 26819769 7634944 410 33554432000 4194304 5796924 140737190644272 140734987191800 4600717 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 1864 410 114 392 0 1463 0

[startup+0.100205 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 8921
/proc/meminfo: memFree=30952408/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=25200 CPUtime=0.09 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 4912 0 0 0 9 0 0 0 20 0 1 0 26819769 25804800 4469 33554432000 4194304 5796924 140737190644272 140734987191800 5183584 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 6300 4469 114 392 0 5899 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 25200

[startup+0.200357 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 8921
/proc/meminfo: memFree=30952408/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=42392 CPUtime=0.19 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 9388 0 0 0 19 0 0 0 20 0 1 0 26819769 43409408 8589 33554432000 4194304 5796924 140737190644272 140734987191800 5183584 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 10598 8591 114 392 0 10197 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 42392

[startup+0.300333 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 8921
/proc/meminfo: memFree=30952408/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=55736 CPUtime=0.29 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 11928 0 0 0 28 1 0 0 20 0 1 0 26819769 57073664 11090 33554432000 4194304 5796924 140737190644272 140734987191800 4806835 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 13934 11090 116 392 0 13533 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 55736

[startup+0.700294 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 8921
/proc/meminfo: memFree=30952408/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=68308 CPUtime=0.69 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 15429 0 0 0 68 1 0 0 20 0 1 0 26819769 69947392 14288 33554432000 4194304 5796924 140737190644272 140734987191800 4806845 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 17077 14288 128 392 0 16676 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 68308

[startup+1.50027 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 8922
/proc/meminfo: memFree=30882780/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=78100 CPUtime=1.49 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 17809 0 0 0 147 2 0 0 20 0 1 0 26819769 79974400 16668 33554432000 4194304 5796924 140737190644272 140737190641688 5087664 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 19525 16668 128 392 0 19124 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 78100

[startup+3.1002 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 8922
/proc/meminfo: memFree=30863684/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=112920 CPUtime=3.09 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 26514 0 0 0 306 3 0 0 20 0 1 0 26819769 115630080 25373 33554432000 4194304 5796924 140737190644272 140737190641736 5183584 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 28230 25373 128 392 0 27829 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 112920

[startup+6.30029 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 8922
/proc/meminfo: memFree=30791900/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=205080 CPUtime=6.29 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 50191 0 0 0 622 7 0 0 20 0 1 0 26819769 210001920 48350 33554432000 4194304 5796924 140737190644272 140737189161384 5095032 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 51270 48350 139 392 0 50869 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 205080

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 8922
/proc/meminfo: memFree=30650956/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=295164 CPUtime=12.69 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 70187 0 0 0 1260 9 0 0 20 0 1 0 26819769 302247936 70605 33554432000 4194304 5796924 140737190644272 140737189112424 5087778 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 73791 70605 139 392 0 73390 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 295164

[startup+25.5004 s]
/proc/loadavg: 2.00 2.01 2.00 3/178 8922
/proc/meminfo: memFree=30581624/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=348932 CPUtime=25.49 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 75348 0 0 0 2537 12 0 0 20 0 1 0 26819769 357306368 84209 33554432000 4194304 5796924 140737190644272 140737188279224 5087774 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 87233 84209 139 392 0 86832 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 348932

[startup+51.1004 s]
/proc/loadavg: 2.00 2.01 2.00 3/177 8922
/proc/meminfo: memFree=30268880/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=469228 CPUtime=51.09 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 90726 0 0 0 5093 16 0 0 20 0 1 0 26819769 480489472 114081 33554432000 4194304 5796924 140737190644272 140737190126952 5092431 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 117307 114081 139 392 0 116906 0
Current children cumulated CPU time (s) 51.09
Current children cumulated vsize (KiB) 469228

[startup+102.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 8923
/proc/meminfo: memFree=30006944/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=683644 CPUtime=102.28 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 111712 0 0 0 10206 22 0 0 20 0 1 0 26819769 700051456 165587 33554432000 4194304 5796924 140737190644272 140737189902472 5077861 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 170911 165587 139 392 0 170510 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 683644

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 8925
/proc/meminfo: memFree=29723860/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=966008 CPUtime=162.27 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 130064 0 0 0 16197 30 0 0 20 0 1 0 26819769 989192192 236292 33554432000 4194304 5796924 140737190644272 140737190052920 5092871 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 241502 236292 139 392 0 241101 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 966008

[startup+222.307 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 8926
/proc/meminfo: memFree=29654780/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1065264 CPUtime=222.26 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 137894 0 0 0 22193 33 0 0 20 0 1 0 26819769 1090830336 252809 33554432000 4194304 5796924 140737190644272 140737190640488 4805616 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 266316 252809 144 392 0 265915 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 1065264

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 8927
/proc/meminfo: memFree=29647740/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1066632 CPUtime=282.25 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 138227 0 0 0 28192 33 0 0 20 0 1 0 26819769 1092231168 253653 33554432000 4194304 5796924 140737190644272 140737190638072 5087700 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 266658 253653 144 392 0 266257 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 1066632

[startup+342.3 s]
/proc/loadavg: 2.03 2.01 2.00 3/177 8928
/proc/meminfo: memFree=29644968/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1067840 CPUtime=342.24 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 138528 0 0 0 34191 33 0 0 20 0 1 0 26819769 1093468160 253954 33554432000 4194304 5796924 140737190644272 140737190640488 4865437 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 266960 253954 144 392 0 266559 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 1067840

[startup+402.3 s]
/proc/loadavg: 2.09 2.02 2.01 3/177 8929
/proc/meminfo: memFree=29641988/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1069376 CPUtime=402.23 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 138921 0 0 0 40190 33 0 0 20 0 1 0 26819769 1095041024 254347 33554432000 4194304 5796924 140737190644272 140737190640488 4809232 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 267344 254347 144 392 0 266943 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 1069376

[startup+462.3 s]
/proc/loadavg: 2.03 2.02 2.00 3/177 8931
/proc/meminfo: memFree=29634916/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1070892 CPUtime=462.22 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 139286 0 0 0 46188 34 0 0 20 0 1 0 26819769 1096593408 255223 33554432000 4194304 5796924 140737190644272 140737190640488 4865554 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 267723 255223 144 392 0 267322 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 1070892

[startup+522.3 s]
/proc/loadavg: 2.01 2.01 2.00 3/178 8935
/proc/meminfo: memFree=29631704/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1072228 CPUtime=522.21 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 139617 0 0 0 52187 34 0 0 20 0 1 0 26819769 1097961472 255554 33554432000 4194304 5796924 140737190644272 140737190640488 5096674 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 268057 255554 144 392 0 267656 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 1072228

[startup+582.3 s]
/proc/loadavg: 2.00 2.00 2.00 3/177 8936
/proc/meminfo: memFree=29629192/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1073528 CPUtime=582.2 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 139951 0 0 0 58186 34 0 0 20 0 1 0 26819769 1099292672 255888 33554432000 4194304 5796924 140737190644272 140737190640488 5100122 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 268382 255888 144 392 0 267981 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 1073528


################
# More data... #
################


[startup+882.307 s]
/proc/loadavg: 2.01 2.00 2.00 3/177 8942
/proc/meminfo: memFree=29605016/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1080748 CPUtime=882.13 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 141822 0 0 0 88178 35 0 0 20 0 1 0 26819769 1106685952 259076 33554432000 4194304 5796924 140737190644272 140737190640488 5096673 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 270187 259076 144 392 0 269786 0
Current children cumulated CPU time (s) 882.13
Current children cumulated vsize (KiB) 1080748

[startup+942.3 s]
/proc/loadavg: 2.12 2.04 2.01 3/177 8943
/proc/meminfo: memFree=29602060/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1082192 CPUtime=942.11 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 142164 0 0 0 94176 35 0 0 20 0 1 0 26819769 1108164608 259413 33554432000 4194304 5796924 140737190644272 140737190640488 5100746 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 270548 259413 144 392 0 270147 0
Current children cumulated CPU time (s) 942.11
Current children cumulated vsize (KiB) 1082192

[startup+1002.3 s]
/proc/loadavg: 2.08 2.05 2.01 3/177 8944
/proc/meminfo: memFree=29595276/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1083356 CPUtime=1002.1 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 142485 0 0 0 100175 35 0 0 20 0 1 0 26819769 1109356544 260245 33554432000 4194304 5796924 140737190644272 140737190640488 5087724 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 270839 260245 144 392 0 270438 0
Current children cumulated CPU time (s) 1002.1
Current children cumulated vsize (KiB) 1083356

[startup+1062.3 s]
/proc/loadavg: 2.03 2.04 2.00 3/177 8946
/proc/meminfo: memFree=29592788/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1084648 CPUtime=1062.09 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 142801 0 0 0 106174 35 0 0 20 0 1 0 26819769 1110679552 260561 33554432000 4194304 5796924 140737190644272 140737190640488 5087606 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 271162 260561 144 392 0 270761 0
Current children cumulated CPU time (s) 1062.09
Current children cumulated vsize (KiB) 1084648

[startup+1122.3 s]
/proc/loadavg: 2.01 2.03 2.00 3/178 8950
/proc/meminfo: memFree=29589516/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1086144 CPUtime=1122.08 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 143154 0 0 0 112173 35 0 0 20 0 1 0 26819769 1112211456 260914 33554432000 4194304 5796924 140737190644272 140737190637992 4313113 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 271536 260914 144 392 0 271135 0
Current children cumulated CPU time (s) 1122.08
Current children cumulated vsize (KiB) 1086144

[startup+1182.3 s]
/proc/loadavg: 2.00 2.02 2.00 3/177 8951
/proc/meminfo: memFree=29582292/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1088056 CPUtime=1182.07 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 143653 0 0 0 118172 35 0 0 20 0 1 0 26819769 1114169344 261924 33554432000 4194304 5796924 140737190644272 140737190640488 4865437 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 272014 261924 144 392 0 271613 0
Current children cumulated CPU time (s) 1182.07
Current children cumulated vsize (KiB) 1088056

[startup+1242.3 s]
/proc/loadavg: 2.12 2.05 2.01 3/177 8952
/proc/meminfo: memFree=29579336/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1089920 CPUtime=1242.07 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 144099 0 0 0 124171 36 0 0 20 0 1 0 26819769 1116078080 262370 33554432000 4194304 5796924 140737190644272 140737190640488 4865409 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 272480 262370 144 392 0 272079 0
Current children cumulated CPU time (s) 1242.07
Current children cumulated vsize (KiB) 1089920

[startup+1302.3 s]
/proc/loadavg: 2.04 2.03 2.00 3/177 8953
/proc/meminfo: memFree=29575792/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1091312 CPUtime=1302.06 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 144460 0 0 0 130170 36 0 0 20 0 1 0 26819769 1117503488 262731 33554432000 4194304 5796924 140737190644272 140737190640488 4199810 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 272828 262731 144 392 0 272427 0
Current children cumulated CPU time (s) 1302.06
Current children cumulated vsize (KiB) 1091312

[startup+1362.3 s]
/proc/loadavg: 2.09 2.04 2.00 3/177 8955
/proc/meminfo: memFree=29569280/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1092676 CPUtime=1362.05 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 144806 0 0 0 136169 36 0 0 20 0 1 0 26819769 1118900224 263588 33554432000 4194304 5796924 140737190644272 140737190640488 5092558 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 273169 263588 144 392 0 272768 0
Current children cumulated CPU time (s) 1362.05
Current children cumulated vsize (KiB) 1092676

[startup+1422.3 s]
/proc/loadavg: 2.03 2.03 2.00 3/177 8956
/proc/meminfo: memFree=29565808/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1094100 CPUtime=1422.05 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 145162 0 0 0 142169 36 0 0 20 0 1 0 26819769 1120358400 263944 33554432000 4194304 5796924 140737190644272 140737190637992 4199797 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 273525 263944 144 392 0 273124 0
Current children cumulated CPU time (s) 1422.05
Current children cumulated vsize (KiB) 1094100

[startup+1482.3 s]
/proc/loadavg: 2.01 2.02 2.00 3/177 8957
/proc/meminfo: memFree=29562708/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1095664 CPUtime=1482.03 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 145543 0 0 0 148167 36 0 0 20 0 1 0 26819769 1121959936 264325 33554432000 4194304 5796924 140737190644272 140737190640488 5087780 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 273916 264325 144 392 0 273515 0
Current children cumulated CPU time (s) 1482.03
Current children cumulated vsize (KiB) 1095664

[startup+1542.31 s]
/proc/loadavg: 2.05 2.03 2.00 3/177 8958
/proc/meminfo: memFree=29555396/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1097612 CPUtime=1542.03 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 146022 0 0 0 154167 36 0 0 20 0 1 0 26819769 1123954688 265315 33554432000 4194304 5796924 140737190644272 140737190640488 5096673 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 274403 265315 144 392 0 274002 0
Current children cumulated CPU time (s) 1542.03
Current children cumulated vsize (KiB) 1097612

[startup+1602.3 s]
/proc/loadavg: 2.09 2.05 2.01 3/177 8959
/proc/meminfo: memFree=29552668/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1098760 CPUtime=1602.01 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 146339 0 0 0 160165 36 0 0 20 0 1 0 26819769 1125130240 265632 33554432000 4194304 5796924 140737190644272 140737190640488 4806764 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 274690 265632 144 392 0 274289 0
Current children cumulated CPU time (s) 1602.01
Current children cumulated vsize (KiB) 1098760

[startup+1662.3 s]
/proc/loadavg: 2.03 2.04 2.00 3/177 8961
/proc/meminfo: memFree=29548144/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1100044 CPUtime=1662 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 146660 0 0 0 166164 36 0 0 20 0 1 0 26819769 1126445056 266464 33554432000 4194304 5796924 140737190644272 140737190640488 4840430 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 275011 266464 144 392 0 274610 0
Current children cumulated CPU time (s) 1662
Current children cumulated vsize (KiB) 1100044

[startup+1722.3 s]
/proc/loadavg: 2.06 2.05 2.00 3/178 9010
/proc/meminfo: memFree=30530148/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1101376 CPUtime=1721.99 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 146984 0 0 0 172163 36 0 0 20 0 1 0 26819769 1127809024 266788 33554432000 4194304 5796924 140737190644272 140737190640488 4865437 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 275344 266788 144 392 0 274943 0
Current children cumulated CPU time (s) 1721.99
Current children cumulated vsize (KiB) 1101376

[startup+1782.3 s]
/proc/loadavg: 2.02 2.03 2.00 3/177 9011
/proc/meminfo: memFree=29142140/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1102564 CPUtime=1781.98 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 147288 0 0 0 178162 36 0 0 20 0 1 0 26819769 1129025536 267092 33554432000 4194304 5796924 140737190644272 140737190640488 5087650 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 275641 267092 144 392 0 275240 0
Current children cumulated CPU time (s) 1781.98
Current children cumulated vsize (KiB) 1102564



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.17 2.06 2.01 3/177 9012
/proc/meminfo: memFree=29199256/32872528 swapFree=190484/190484
[pid=8921] ppid=8918 vsize=1102852 CPUtime=1800.08 cores=0,2,4,6
/proc/8921/stat : 8921 (naps-1.02) R 8918 8921 7936 0 -1 4202496 147356 0 0 0 179972 36 0 0 20 0 1 0 26819769 1129320448 267160 33554432000 4194304 5796924 140737190644272 140737190640488 5096544 0 0 4096 17954 0 0 0 17 4 0 0 0 0 0
/proc/8921/statm: 275713 267160 144 392 0 275312 0
Current children cumulated CPU time (s) 1800.08
Current children cumulated vsize (KiB) 1102852

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 8921 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 0
Real time (s): 1800.41
CPU time (s): 1800.1
CPU user time (s): 1799.72
CPU system time (s): 0.373943
CPU usage (%): 99.9828
Max. virtual memory (cumulated for all children) (KiB): 1134736

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.72
system time used= 0.373943
maximum resident set size= 1111848
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 147369
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 58
involuntary context switches= 1850

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 4.6183 second user time and 5.86111 second system time

The end

Launcher Data 

Begin job on node102 at 2016-06-18 13:01:32
IDJOB=4103235
IDBENCH=2305
IDSOLVER=2544
FILE ID=node102/4103235-1466247692
RUNJOBID= node102-1466240351-7952
PBS_JOBID= 19918190
Free space on /tmp= 71708 MiB

SOLVER NAME= NaPS 1.02
BENCH NAME= PB06//final/normalized-PB06/OPT-BIGINT/mps-v2-20-10/plato.asu.edu/pub/fctp/normalized-mps-v2-20-10-n3709.opb
COMMAND LINE= naps-1.02 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4103235-1466247692/watcher-4103235-1466247692 -o /tmp/evaluation-result-4103235-1466247692/solver-4103235-1466247692 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node102-1466240351-7952 --watchdog 1960  naps-1.02 HOME/instance-4103235-1466247692.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 7d8773951a908fd3c2652ff6acba65e8
RANDOM SEED=496432900

node102.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.49
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.746
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        30953068 kB
Buffers:          121696 kB
Cached:           145248 kB
SwapCached:         1828 kB
Active:           827380 kB
Inactive:         168396 kB
Active(anon):     729500 kB
Inactive(anon):     1508 kB
Active(file):      97880 kB
Inactive(file):   166888 kB
Unevictable:      190484 kB
Mlocked:          190484 kB
SwapTotal:      67108856 kB
SwapFree:       67099024 kB
Dirty:             12500 kB
Writeback:             0 kB
AnonPages:        920332 kB
Mapped:             7680 kB
Shmem:                 0 kB
Slab:             600916 kB
SReclaimable:      45116 kB
SUnreclaim:       555800 kB
KernelStack:        1464 kB
PageTables:         6052 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    1087612 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    204800 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71712 MiB
End job on node102 at 2016-06-18 13:31:33