Trace number 4101755

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
NaPS 1.02? (TO) 1800.12 1802.41

General information on the benchmark

Namenormalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/
miplib2003/normalized-reduced-mps-v2-20-10-liu.opb
MD5SUMd5cbc530e20e0da41254bd2567f4c2ba
Bench CategoryOPT-SMALLINT (optimisation, small integers)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark688
Best CPU time to get the best result obtained on this benchmark1800.61
Has Objective FunctionYES
SatisfiableYES
(Un)Satisfiability was provedYES
Best value of the objective function 34564
Optimality of the best value was proved NO
Number of variables3097
Total number of constraints2178
Number of constraints which are clauses0
Number of constraints which are cardinality constraints (but not clauses)0
Number of constraints which are nor clauses,nor cardinality constraints2178
Minimum length of a constraint60
Maximum length of a constraint63
Number of terms in the objective function 30
Biggest coefficient in the objective function 262145
Number of bits for the biggest coefficient in the objective function 19
Sum of the numbers in the objective function 524317
Number of bits of the sum of numbers in the objective function 20
Biggest number in a constraint 262145
Number of bits of the biggest number in a constraint 19
Biggest sum of numbers in a constraint 524328
Number of bits of the biggest sum of numbers20
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c NaPS 1.02b.

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4101755-1466233105/watcher-4101755-1466233105 -o /tmp/evaluation-result-4101755-1466233105/solver-4101755-1466233105 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node124-1466206079-966 --watchdog 1960 naps-1.02 HOME/instance-4101755-1466233105.opb 

pid=5597
running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.34 2.32 2.28 2/176 5600
/proc/meminfo: memFree=27740920/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=6696 CPUtime=0 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 356 0 0 0 0 0 0 0 20 0 1 0 25357341 6856704 231 33554432000 4194304 5796924 140733659821232 140737103546024 5183584 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 1674 231 124 392 0 1273 0

[startup+0.100159 s]
/proc/loadavg: 2.34 2.32 2.28 2/176 5600
/proc/meminfo: memFree=27740920/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=10324 CPUtime=0.09 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 1125 0 0 0 9 0 0 0 20 0 1 0 25357341 10571776 1000 33554432000 4194304 5796924 140733659821232 140737103546024 5095032 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 2581 1000 124 392 0 2180 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 10324

[startup+0.200293 s]
/proc/loadavg: 2.34 2.32 2.28 2/176 5600
/proc/meminfo: memFree=27740920/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=13836 CPUtime=0.19 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 1899 0 0 0 19 0 0 0 20 0 1 0 25357341 14168064 1774 33554432000 4194304 5796924 140733659821232 140737103546024 5095032 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 3459 1774 124 392 0 3058 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 13836

[startup+0.300267 s]
/proc/loadavg: 2.34 2.32 2.28 2/176 5600
/proc/meminfo: memFree=27740920/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=17460 CPUtime=0.29 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 2657 0 0 0 29 0 0 0 20 0 1 0 25357341 17879040 2532 33554432000 4194304 5796924 140733659821232 140733659820456 5095032 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 4365 2532 124 392 0 3964 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 17460

[startup+0.700256 s]
/proc/loadavg: 2.34 2.32 2.28 2/176 5600
/proc/meminfo: memFree=27740920/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=30060 CPUtime=0.69 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 5535 0 0 0 68 1 0 0 20 0 1 0 25357341 30781440 5263 33554432000 4194304 5796924 140733659821232 140733659820456 5096673 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 7515 5263 135 392 0 7114 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 30060

[startup+1.50023 s]
/proc/loadavg: 2.34 2.32 2.28 3/177 5601
/proc/meminfo: memFree=27717424/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=30060 CPUtime=1.49 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 5536 0 0 0 148 1 0 0 20 0 1 0 25357341 30781440 5264 33554432000 4194304 5796924 140733659821232 140733659817448 5087743 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 7515 5264 136 392 0 7114 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 30060

[startup+3.10027 s]
/proc/loadavg: 2.34 2.32 2.28 3/177 5601
/proc/meminfo: memFree=27714200/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=33880 CPUtime=3.09 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 6474 0 0 0 308 1 0 0 20 0 1 0 25357341 34693120 6202 33554432000 4194304 5796924 140733659821232 140733659817448 5096673 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 8470 6202 140 392 0 8069 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 33880

[startup+6.30023 s]
/proc/loadavg: 2.31 2.31 2.27 3/177 5601
/proc/meminfo: memFree=27711552/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=34824 CPUtime=6.29 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 6843 0 0 0 628 1 0 0 20 0 1 0 25357341 35659776 6446 33554432000 4194304 5796924 140733659821232 140733659817448 4865685 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 8706 6446 140 392 0 8305 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 34824

[startup+12.7002 s]
/proc/loadavg: 2.37 2.32 2.28 3/177 5601
/proc/meminfo: memFree=27706680/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=36544 CPUtime=12.69 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 7399 0 0 0 1268 1 0 0 20 0 1 0 25357341 37421056 6837 33554432000 4194304 5796924 140733659821232 140733659817448 5087579 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 9136 6837 140 392 0 8735 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 36544

[startup+25.5003 s]
/proc/loadavg: 2.35 2.32 2.28 3/177 5601
/proc/meminfo: memFree=27697688/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=39552 CPUtime=25.48 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 7923 0 0 0 2547 1 0 0 20 0 1 0 25357341 40501248 7611 33554432000 4194304 5796924 140733659821232 140733659817448 4805600 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 9888 7611 140 392 0 9487 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 39552

[startup+51.1003 s]
/proc/loadavg: 2.47 2.35 2.28 3/177 5647
/proc/meminfo: memFree=30119052/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=45908 CPUtime=51.07 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 9762 0 0 0 5105 2 0 0 20 0 1 0 25357341 47009792 10065 33554432000 4194304 5796924 140733659821232 140733659817448 5092416 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 11477 10065 140 392 0 11076 0
Current children cumulated CPU time (s) 51.07
Current children cumulated vsize (KiB) 45908

[startup+102.3 s]
/proc/loadavg: 2.43 2.35 2.29 4/178 5650
/proc/meminfo: memFree=29727760/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=59104 CPUtime=102.27 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 12170 0 0 0 10224 3 0 0 20 0 1 0 25357341 60522496 13199 33554432000 4194304 5796924 140733659821232 140733659817448 4863673 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 14776 13199 140 392 0 14375 0
Current children cumulated CPU time (s) 102.27
Current children cumulated vsize (KiB) 59104

[startup+162.3 s]
/proc/loadavg: 2.27 2.32 2.27 3/178 5674
/proc/meminfo: memFree=29391804/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=67248 CPUtime=162.25 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 14237 0 0 0 16222 3 0 0 20 0 1 0 25357341 68861952 15266 33554432000 4194304 5796924 140733659821232 140733659817448 5092651 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 16812 15266 140 392 0 16411 0
Current children cumulated CPU time (s) 162.25
Current children cumulated vsize (KiB) 67248

[startup+222.307 s]
/proc/loadavg: 2.30 2.32 2.27 3/177 5676
/proc/meminfo: memFree=29165192/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=87704 CPUtime=222.25 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 16757 0 0 0 22221 4 0 0 20 0 1 0 25357341 89808896 20260 33554432000 4194304 5796924 140733659821232 140733659817448 5096658 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 21926 20260 140 392 0 21525 0
Current children cumulated CPU time (s) 222.25
Current children cumulated vsize (KiB) 87704

[startup+282.3 s]
/proc/loadavg: 2.23 2.29 2.27 4/177 5677
/proc/meminfo: memFree=29144776/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=99540 CPUtime=282.23 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 18625 0 0 0 28219 4 0 0 20 0 1 0 25357341 101928960 22128 33554432000 4194304 5796924 140733659821232 140733659815032 5087766 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 24885 22128 140 392 0 24484 0
Current children cumulated CPU time (s) 282.23
Current children cumulated vsize (KiB) 99540

[startup+342.3 s]
/proc/loadavg: 2.22 2.27 2.26 3/177 5678
/proc/meminfo: memFree=29123356/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=126712 CPUtime=342.23 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 20783 0 0 0 34217 6 0 0 20 0 1 0 25357341 129753088 29744 33554432000 4194304 5796924 140733659821232 140733659817448 4865437 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 31678 29744 140 392 0 31277 0
Current children cumulated CPU time (s) 342.23
Current children cumulated vsize (KiB) 126712

[startup+402.3 s]
/proc/loadavg: 2.16 2.24 2.25 3/177 5679
/proc/meminfo: memFree=29108836/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=141900 CPUtime=402.22 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 22395 0 0 0 40216 6 0 0 20 0 1 0 25357341 145305600 31867 33554432000 4194304 5796924 140733659821232 140733659814952 5087650 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 35475 31867 140 392 0 35074 0
Current children cumulated CPU time (s) 402.22
Current children cumulated vsize (KiB) 141900

[startup+462.3 s]
/proc/loadavg: 2.22 2.24 2.25 3/177 5680
/proc/meminfo: memFree=29006408/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=147848 CPUtime=462.2 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 24269 0 0 0 46214 6 0 0 20 0 1 0 25357341 151396352 34252 33554432000 4194304 5796924 140733659821232 140733659817448 5092425 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 36962 34252 140 392 0 36561 0
Current children cumulated CPU time (s) 462.2
Current children cumulated vsize (KiB) 147848

[startup+522.3 s]
/proc/loadavg: 2.31 2.26 2.25 3/177 5682
/proc/meminfo: memFree=28650912/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=153840 CPUtime=522.2 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 25755 0 0 0 52213 7 0 0 20 0 1 0 25357341 157532160 36760 33554432000 4194304 5796924 140733659821232 140733659817448 4840392 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 38460 36760 140 392 0 38059 0
Current children cumulated CPU time (s) 522.2
Current children cumulated vsize (KiB) 153840

[startup+582.3 s]
/proc/loadavg: 2.36 2.28 2.26 3/177 5683
/proc/meminfo: memFree=28635776/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=173632 CPUtime=582.19 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 27556 0 0 0 58212 7 0 0 20 0 1 0 25357341 177799168 38561 33554432000 4194304 5796924 140733659821232 140733659817448 4313041 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 43408 38561 140 392 0 43007 0
Current children cumulated CPU time (s) 582.19
Current children cumulated vsize (KiB) 173632


################
# More data... #
################

[pid=5600] ppid=5597 vsize=283604 CPUtime=1062.12 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 40694 0 0 0 106200 12 0 0 20 0 1 0 25357341 290410496 66704 33554432000 4194304 5796924 140733659821232 140733659817448 4809398 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 70901 66704 140 392 0 70500 0
Current children cumulated CPU time (s) 1062.12
Current children cumulated vsize (KiB) 283604

[startup+1122.3 s]
/proc/loadavg: 2.25 2.26 2.26 3/177 5697
/proc/meminfo: memFree=28376616/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=289564 CPUtime=1122.1 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 42208 0 0 0 112197 13 0 0 20 0 1 0 25357341 296513536 69228 33554432000 4194304 5796924 140733659821232 140733659817448 5087664 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 72391 69228 140 392 0 71990 0
Current children cumulated CPU time (s) 1122.1
Current children cumulated vsize (KiB) 289564

[startup+1182.3 s]
/proc/loadavg: 2.18 2.24 2.26 4/177 5698
/proc/meminfo: memFree=28361884/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=295788 CPUtime=1182.09 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 43767 0 0 0 118196 13 0 0 20 0 1 0 25357341 302886912 71298 33554432000 4194304 5796924 140733659821232 140733659817448 5092467 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 73947 71298 140 392 0 73546 0
Current children cumulated CPU time (s) 1182.09
Current children cumulated vsize (KiB) 295788

[startup+1242.3 s]
/proc/loadavg: 2.17 2.23 2.25 3/177 5699
/proc/meminfo: memFree=28386616/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=301912 CPUtime=1242.08 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 45299 0 0 0 124194 14 0 0 20 0 1 0 25357341 309157888 73852 33554432000 4194304 5796924 140733659821232 140733659817448 5092545 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 75478 73852 140 392 0 75077 0
Current children cumulated CPU time (s) 1242.08
Current children cumulated vsize (KiB) 301912

[startup+1302.3 s]
/proc/loadavg: 2.14 2.21 2.24 3/178 5703
/proc/meminfo: memFree=28374736/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=339020 CPUtime=1302.08 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 47134 0 0 0 130193 15 0 0 20 0 1 0 25357341 347156480 75687 33554432000 4194304 5796924 140733659821232 140733659817448 5092526 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 84755 75687 140 392 0 84354 0
Current children cumulated CPU time (s) 1302.08
Current children cumulated vsize (KiB) 339020

[startup+1362.3 s]
/proc/loadavg: 2.20 2.22 2.24 4/177 5704
/proc/meminfo: memFree=28274444/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=429216 CPUtime=1362.06 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 49743 0 0 0 136188 18 0 0 20 0 1 0 25357341 439517184 99107 33554432000 4194304 5796924 140733659821232 140733659815160 4805619 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 107304 99107 140 392 0 106903 0
Current children cumulated CPU time (s) 1362.06
Current children cumulated vsize (KiB) 429216

[startup+1422.3 s]
/proc/loadavg: 2.28 2.23 2.25 3/176 5705
/proc/meminfo: memFree=28078912/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=434904 CPUtime=1422.06 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 51168 0 0 0 142188 18 0 0 20 0 1 0 25357341 445341696 101554 33554432000 4194304 5796924 140733659821232 140733659817448 5096658 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 108726 101554 140 392 0 108325 0
Current children cumulated CPU time (s) 1422.06
Current children cumulated vsize (KiB) 434904

[startup+1482.3 s]
/proc/loadavg: 2.23 2.23 2.25 4/177 5753
/proc/meminfo: memFree=29134008/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=440720 CPUtime=1482.05 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 52616 0 0 0 148186 19 0 0 20 0 1 0 25357341 451297280 103513 33554432000 4194304 5796924 140733659821232 140733659814952 4863673 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 110180 103513 140 392 0 109779 0
Current children cumulated CPU time (s) 1482.05
Current children cumulated vsize (KiB) 440720

[startup+1542.31 s]
/proc/loadavg: 2.18 2.22 2.24 5/177 5754
/proc/meminfo: memFree=29105552/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=446576 CPUtime=1542.04 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 54083 0 0 0 154184 20 0 0 20 0 1 0 25357341 457293824 105491 33554432000 4194304 5796924 140733659821232 140733659815160 4199797 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 111644 105491 140 392 0 111243 0
Current children cumulated CPU time (s) 1542.04
Current children cumulated vsize (KiB) 446576

[startup+1602.3 s]
/proc/loadavg: 2.29 2.25 2.25 4/177 5755
/proc/meminfo: memFree=29090420/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=452164 CPUtime=1602.02 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 55510 0 0 0 160182 20 0 0 20 0 1 0 25357341 463015936 107940 33554432000 4194304 5796924 140733659821232 140733659817448 4313074 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 113041 107940 140 392 0 112640 0
Current children cumulated CPU time (s) 1602.02
Current children cumulated vsize (KiB) 452164

[startup+1662.3 s]
/proc/loadavg: 2.22 2.23 2.24 4/177 5756
/proc/meminfo: memFree=29094916/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=458256 CPUtime=1662.01 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 57030 0 0 0 166181 20 0 0 20 0 1 0 25357341 469254144 109971 33554432000 4194304 5796924 140733659821232 140733659817448 4295645 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 114564 109971 140 392 0 114163 0
Current children cumulated CPU time (s) 1662.01
Current children cumulated vsize (KiB) 458256

[startup+1722.3 s]
/proc/loadavg: 2.12 2.20 2.23 5/177 5757
/proc/meminfo: memFree=29076176/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=464104 CPUtime=1722.01 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 58480 0 0 0 172180 21 0 0 20 0 1 0 25357341 475242496 112443 33554432000 4194304 5796924 140733659821232 140733659817448 5100089 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 116026 112443 140 392 0 115625 0
Current children cumulated CPU time (s) 1722.01
Current children cumulated vsize (KiB) 464104

[startup+1782.3 s]
/proc/loadavg: 2.14 2.19 2.22 4/177 5759
/proc/meminfo: memFree=29065520/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=468368 CPUtime=1782 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 59554 0 0 0 178179 21 0 0 20 0 1 0 25357341 479608832 114028 33554432000 4194304 5796924 140733659821232 140733659817448 5100101 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 117092 114028 140 392 0 116691 0
Current children cumulated CPU time (s) 1782
Current children cumulated vsize (KiB) 468368



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.17 2.20 2.22 4/177 5759
/proc/meminfo: memFree=29062540/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=469432 CPUtime=1800.09 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) R 5597 5600 950 0 -1 4202496 59831 0 0 0 179988 21 0 0 20 0 1 0 25357341 480698368 114305 33554432000 4194304 5796924 140733659821232 140733659817448 4809349 0 0 4096 17954 0 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 117358 114305 140 392 0 116957 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 469432

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -5600
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 5600 sig 9
??? end of watcher thread

Solver just ended.
Dumping a history of the last processes samples

[startup+1801.6 s]
/proc/loadavg: 2.17 2.20 2.22 3/177 5759
/proc/meminfo: memFree=29062292/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=469432 CPUtime=1800.09 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) S 5597 5600 950 0 -1 4194304 59832 0 0 0 179988 21 0 0 20 0 1 0 25357341 480698368 114306 33554432000 4194304 5796924 140733659821232 140733659813896 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 117358 114306 141 392 0 116957 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 469432

[startup+1802 s]
/proc/loadavg: 2.17 2.20 2.22 3/177 5759
/proc/meminfo: memFree=29060120/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=469432 CPUtime=1800.09 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) S 5597 5600 950 0 -1 4194304 59832 0 0 0 179988 21 0 0 20 0 1 0 25357341 480698368 114306 33554432000 4194304 5796924 140733659821232 140733659813896 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 117358 114306 141 392 0 116957 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 469432

[startup+1802.4 s]
/proc/loadavg: 2.17 2.20 2.22 3/177 5759
/proc/meminfo: memFree=29060120/32872528 swapFree=1497824/1644992
[pid=5600] ppid=5597 vsize=469432 CPUtime=1800.09 cores=0,2,4,6
/proc/5600/stat : 5600 (naps-1.02) S 5597 5600 950 0 -1 4194304 59832 0 0 0 179988 21 0 0 20 0 1 0 25357341 480698368 114306 33554432000 4194304 5796924 140733659821232 140733659813896 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 2 0 0 0 0 0
/proc/5600/statm: 117358 114306 141 392 0 116957 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 469432

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.41
CPU time (s): 1800.12
CPU user time (s): 1799.89
CPU system time (s): 0.227965
CPU usage (%): 99.8727
Max. virtual memory (cumulated for all children) (KiB): 508804

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.89
system time used= 0.227965
maximum resident set size= 473012
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 59832
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 30
involuntary context switches= 1857

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.15522 second user time and 7.57385 second system time

The end

Launcher Data 

Begin job on node124 at 2016-06-18 08:58:25
IDJOB=4101755
IDBENCH=1790
IDSOLVER=2544
FILE ID=node124/4101755-1466233105
RUNJOBID= node124-1466206079-966
PBS_JOBID= 19918153
Free space on /tmp= 71720 MiB

SOLVER NAME= NaPS 1.02
BENCH NAME= PB06//final/normalized-PB06/OPT-SMALLINT/reduced/mps-v2-20-10/MIPLIB/miplib2003/normalized-reduced-mps-v2-20-10-liu.opb
COMMAND LINE= naps-1.02 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4101755-1466233105/watcher-4101755-1466233105 -o /tmp/evaluation-result-4101755-1466233105/solver-4101755-1466233105 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node124-1466206079-966 --watchdog 1960  naps-1.02 HOME/instance-4101755-1466233105.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d5cbc530e20e0da41254bd2567f4c2ba
RANDOM SEED=530570842

node124.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.58
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.791
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.54
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        27741292 kB
Buffers:          119104 kB
Cached:           138940 kB
SwapCached:         3080 kB
Active:          2522516 kB
Inactive:         178056 kB
Active(anon):    2441848 kB
Inactive(anon):     2880 kB
Active(file):      80668 kB
Inactive(file):   175176 kB
Unevictable:     1644992 kB
Mlocked:         1497824 kB
SwapTotal:      67108856 kB
SwapFree:       67099796 kB
Dirty:              5060 kB
Writeback:             0 kB
AnonPages:       4230976 kB
Mapped:             9576 kB
Shmem:                 0 kB
Slab:             623960 kB
SReclaimable:      68260 kB
SUnreclaim:       555700 kB
KernelStack:        1472 kB
PageTables:        12112 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    4270056 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:   2629632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71712 MiB
End job on node124 at 2016-06-18 09:28:28