Trace number 4082496

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
NaPS 1.02? (TO) 1800.1 1802.4

General information on the benchmark

Name/OPT-BIGINT-LIN/zahidi/Base/
normalized-minisat70_4_22_4.opb
MD5SUMb9760eca078029bee17418839cb4525f
Bench CategoryOPT-BIGINT-LIN (optimisation, big integers, linear constraints)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark3447571
Best CPU time to get the best result obtained on this benchmark1800
Has Objective FunctionYES
Satisfiable
(Un)Satisfiability was proved
Best value of the objective function
Optimality of the best value was proved
Number of variables9940
Total number of constraints14846
Number of constraints which are clauses140
Number of constraints which are cardinality constraints (but not clauses)6
Number of constraints which are nor clauses,nor cardinality constraints14700
Minimum length of a constraint2
Maximum length of a constraint2415
Number of terms in the objective function 9730
Biggest coefficient in the objective function 153130375
Number of bits for the biggest coefficient in the objective function 28
Sum of the numbers in the objective function 77399784670
Number of bits of the sum of numbers in the objective function 37
Biggest number in a constraint 153130375
Number of bits of the biggest number in a constraint 28
Biggest sum of numbers in a constraint 77399784670
Number of bits of the biggest sum of numbers37
Number of products (including duplicates)0
Sum of products size (including duplicates)0
Number of different products0
Sum of products size0

Solver Data 

0.00/0.00	c NaPS 1.02b.

Verifier Data 

ERROR: no interpretation found !

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4082496-1465292525/watcher-4082496-1465292525 -o /tmp/evaluation-result-4082496-1465292525/solver-4082496-1465292525 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node141-1465273956-6604 --watchdog 1960 naps-1.02 HOME/instance-4082496-1465292525.opb 

pid=8404
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 1800 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 1830 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 1900 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 10240 KiB


[startup+0 s]
/proc/loadavg: 2.26 2.18 2.09 3/176 8407
/proc/meminfo: memFree=30499596/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=7456 CPUtime=0 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 536 0 0 0 0 0 0 0 20 0 1 0 111184317 7634944 411 33554432000 4194304 5796924 140736909523872 140735912331320 5183584 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 1864 411 114 392 0 1463 0

[startup+0.100159 s]
/proc/loadavg: 2.26 2.18 2.09 3/176 8407
/proc/meminfo: memFree=30499596/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=11272 CPUtime=0.09 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 1406 0 0 0 9 0 0 0 20 0 1 0 111184317 11542528 1281 33554432000 4194304 5796924 140736909523872 140735912331320 4808400 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 2818 1282 128 392 0 2417 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 11272

[startup+0.200316 s]
/proc/loadavg: 2.26 2.18 2.09 3/176 8407
/proc/meminfo: memFree=30499596/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=15096 CPUtime=0.19 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 2349 0 0 0 19 0 0 0 20 0 1 0 111184317 15458304 2220 33554432000 4194304 5796924 140736909523872 140735912331320 4377004 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 3774 2220 128 392 0 3373 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 15096

[startup+0.300319 s]
/proc/loadavg: 2.26 2.18 2.09 3/176 8407
/proc/meminfo: memFree=30499596/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=15872 CPUtime=0.29 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 2642 0 0 0 29 0 0 0 20 0 1 0 111184317 16252928 2492 33554432000 4194304 5796924 140736909523872 140735912331320 5087579 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 3968 2492 128 392 0 3567 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 15872

[startup+0.700283 s]
/proc/loadavg: 2.26 2.18 2.09 3/176 8407
/proc/meminfo: memFree=30499596/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=20620 CPUtime=0.69 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 4435 0 0 0 69 0 0 0 20 0 1 0 111184317 21114880 4184 33554432000 4194304 5796924 140736909523872 140736909484088 5092526 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 5155 4184 140 392 0 4754 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 20620

[startup+1.50027 s]
/proc/loadavg: 2.26 2.18 2.09 3/177 8408
/proc/meminfo: memFree=30478860/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=25324 CPUtime=1.49 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 5558 0 0 0 149 0 0 0 20 0 1 0 111184317 25931776 5323 33554432000 4194304 5796924 140736909523872 140736909484088 5096709 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 6331 5323 140 392 0 5930 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 25324

[startup+3.10032 s]
/proc/loadavg: 2.26 2.18 2.09 3/177 8408
/proc/meminfo: memFree=30450276/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=97816 CPUtime=3.09 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 23639 0 0 0 305 4 0 0 20 0 1 0 111184317 100163584 23256 33554432000 4194304 5796924 140736909523872 140736906018824 4453837 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 24454 23256 140 392 0 24053 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 97816

[startup+6.30028 s]
/proc/loadavg: 2.24 2.18 2.09 3/177 8408
/proc/meminfo: memFree=30242712/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=6.29 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51152 0 0 0 619 10 0 0 20 0 1 0 111184317 258498560 57260 33554432000 4194304 5796924 140736909523872 140736909521368 4592560 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 57260 155 392 0 62709 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 252440

[startup+12.7003 s]
/proc/loadavg: 2.22 2.17 2.09 3/177 8408
/proc/meminfo: memFree=30260816/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=12.69 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51154 0 0 0 1259 10 0 0 20 0 1 0 111184317 258498560 58284 33554432000 4194304 5796924 140736909523872 140736909521720 4592584 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 58284 155 392 0 62709 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 252440

[startup+25.5004 s]
/proc/loadavg: 2.17 2.16 2.09 3/177 8408
/proc/meminfo: memFree=30256604/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=25.49 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51170 0 0 0 2539 10 0 0 20 0 1 0 111184317 258498560 58811 33554432000 4194304 5796924 140736909523872 140736909520856 4865437 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 58811 170 392 0 62709 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 252440

[startup+51.1004 s]
/proc/loadavg: 2.18 2.17 2.09 3/177 8408
/proc/meminfo: memFree=30252600/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=51.08 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51171 0 0 0 5098 10 0 0 20 0 1 0 111184317 258498560 58812 33554432000 4194304 5796924 140736909523872 140736909520856 4805602 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 58812 171 392 0 62709 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 252440

[startup+102.3 s]
/proc/loadavg: 2.21 2.17 2.10 3/177 8409
/proc/meminfo: memFree=30242364/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=102.28 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51171 0 0 0 10218 10 0 0 20 0 1 0 111184317 258498560 58812 33554432000 4194304 5796924 140736909523872 140736909520856 5096553 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 58812 171 392 0 62709 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 252440

[startup+162.3 s]
/proc/loadavg: 2.12 2.15 2.09 3/177 8410
/proc/meminfo: memFree=30227932/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=162.27 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51171 0 0 0 16217 10 0 0 20 0 1 0 111184317 258498560 58812 33554432000 4194304 5796924 140736909523872 140736909520856 4295821 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 58812 171 392 0 62709 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 252440

[startup+222.307 s]
/proc/loadavg: 2.20 2.17 2.10 3/177 8411
/proc/meminfo: memFree=30211952/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=222.26 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51171 0 0 0 22216 10 0 0 20 0 1 0 111184317 258498560 58812 33554432000 4194304 5796924 140736909523872 140736909520856 4865437 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 58812 171 392 0 62709 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 252440

[startup+282.3 s]
/proc/loadavg: 2.18 2.16 2.09 3/177 8413
/proc/meminfo: memFree=30196516/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=282.25 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51171 0 0 0 28215 10 0 0 20 0 1 0 111184317 258498560 58812 33554432000 4194304 5796924 140736909523872 140736909520856 4806841 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 58812 171 392 0 62709 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 252440

[startup+342.3 s]
/proc/loadavg: 2.15 2.16 2.09 3/177 8414
/proc/meminfo: memFree=30179352/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=342.24 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51171 0 0 0 34214 10 0 0 20 0 1 0 111184317 258498560 58812 33554432000 4194304 5796924 140736909523872 140736909520856 5087589 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 58812 171 392 0 62709 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 252440

[startup+402.3 s]
/proc/loadavg: 2.28 2.19 2.10 3/177 8415
/proc/meminfo: memFree=30165076/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=402.23 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51171 0 0 0 40213 10 0 0 20 0 1 0 111184317 258498560 58812 33554432000 4194304 5796924 140736909523872 140736909520856 4806736 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 58812 171 392 0 62709 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 252440

[startup+462.3 s]
/proc/loadavg: 2.20 2.18 2.10 3/177 8416
/proc/meminfo: memFree=30148936/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=462.22 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51171 0 0 0 46212 10 0 0 20 0 1 0 111184317 258498560 58812 33554432000 4194304 5796924 140736909523872 140736909520856 5092604 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 58812 171 392 0 62709 0
Current children cumulated CPU time (s) 462.22
Current children cumulated vsize (KiB) 252440

[startup+522.3 s]
/proc/loadavg: 2.26 2.19 2.11 3/178 8420
/proc/meminfo: memFree=30148768/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=522.21 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51171 0 0 0 52211 10 0 0 20 0 1 0 111184317 258498560 58812 33554432000 4194304 5796924 140736909523872 140736909520856 4865385 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 58812 171 392 0 62709 0
Current children cumulated CPU time (s) 522.21
Current children cumulated vsize (KiB) 252440

[startup+582.3 s]
/proc/loadavg: 2.26 2.20 2.11 3/177 8422
/proc/meminfo: memFree=30148720/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=582.2 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51171 0 0 0 58210 10 0 0 20 0 1 0 111184317 258498560 58812 33554432000 4194304 5796924 140736909523872 140736909520856 5077954 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 58812 171 392 0 62709 0
Current children cumulated CPU time (s) 582.2
Current children cumulated vsize (KiB) 252440


################
# More data... #
################

[pid=8407] ppid=8404 vsize=252440 CPUtime=1062.1 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51209 0 0 0 106200 10 0 0 20 0 1 0 111184317 258498560 59606 33554432000 4194304 5796924 140736909523872 140736909520856 4865437 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59606 171 392 0 62709 0
Current children cumulated CPU time (s) 1062.1
Current children cumulated vsize (KiB) 252440

[startup+1122.3 s]
/proc/loadavg: 2.22 2.16 2.10 3/178 8435
/proc/meminfo: memFree=30145312/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1122.09 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51209 0 0 0 112199 10 0 0 20 0 1 0 111184317 258498560 59606 33554432000 4194304 5796924 140736909523872 140736909520856 4865437 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59606 171 392 0 62709 0
Current children cumulated CPU time (s) 1122.09
Current children cumulated vsize (KiB) 252440

[startup+1182.3 s]
/proc/loadavg: 2.26 2.17 2.10 3/178 8460
/proc/meminfo: memFree=30145764/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1182.08 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51209 0 0 0 118198 10 0 0 20 0 1 0 111184317 258498560 59606 33554432000 4194304 5796924 140736909523872 140736909520856 5087571 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59606 171 392 0 62709 0
Current children cumulated CPU time (s) 1182.08
Current children cumulated vsize (KiB) 252440

[startup+1242.3 s]
/proc/loadavg: 2.18 2.17 2.10 4/177 8461
/proc/meminfo: memFree=30145764/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1242.07 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51209 0 0 0 124197 10 0 0 20 0 1 0 111184317 258498560 59606 33554432000 4194304 5796924 140736909523872 140736909520856 4863673 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59606 171 392 0 62709 0
Current children cumulated CPU time (s) 1242.07
Current children cumulated vsize (KiB) 252440

[startup+1302.3 s]
/proc/loadavg: 2.18 2.17 2.10 3/177 8462
/proc/meminfo: memFree=30145516/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1302.06 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51209 0 0 0 130196 10 0 0 20 0 1 0 111184317 258498560 59606 33554432000 4194304 5796924 140736909523872 140736909520856 4809398 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59606 171 392 0 62709 0
Current children cumulated CPU time (s) 1302.06
Current children cumulated vsize (KiB) 252440

[startup+1362.3 s]
/proc/loadavg: 2.13 2.15 2.09 3/177 8463
/proc/meminfo: memFree=30145516/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1362.05 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51209 0 0 0 136195 10 0 0 20 0 1 0 111184317 258498560 59606 33554432000 4194304 5796924 140736909523872 140736909520856 5100064 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59606 171 392 0 62709 0
Current children cumulated CPU time (s) 1362.05
Current children cumulated vsize (KiB) 252440

[startup+1422.3 s]
/proc/loadavg: 2.09 2.13 2.09 3/177 8464
/proc/meminfo: memFree=30145636/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1422.05 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51209 0 0 0 142195 10 0 0 20 0 1 0 111184317 258498560 59606 33554432000 4194304 5796924 140736909523872 140736909520856 4806757 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59606 171 392 0 62709 0
Current children cumulated CPU time (s) 1422.05
Current children cumulated vsize (KiB) 252440

[startup+1482.3 s]
/proc/loadavg: 2.15 2.14 2.09 3/177 8466
/proc/meminfo: memFree=30145068/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1482.04 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51209 0 0 0 148193 11 0 0 20 0 1 0 111184317 258498560 59606 33554432000 4194304 5796924 140736909523872 140736909520856 4806736 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59606 171 392 0 62709 0
Current children cumulated CPU time (s) 1482.04
Current children cumulated vsize (KiB) 252440

[startup+1542.31 s]
/proc/loadavg: 2.12 2.13 2.09 3/177 8512
/proc/meminfo: memFree=30586676/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1542.04 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51209 0 0 0 154193 11 0 0 20 0 1 0 111184317 258498560 59606 33554432000 4194304 5796924 140736909523872 140736909520856 5092756 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59606 171 392 0 62709 0
Current children cumulated CPU time (s) 1542.04
Current children cumulated vsize (KiB) 252440

[startup+1602.3 s]
/proc/loadavg: 2.16 2.13 2.09 3/177 8513
/proc/meminfo: memFree=30586428/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1602.02 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51209 0 0 0 160191 11 0 0 20 0 1 0 111184317 258498560 59606 33554432000 4194304 5796924 140736909523872 140736909520856 5087771 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59606 171 392 0 62709 0
Current children cumulated CPU time (s) 1602.02
Current children cumulated vsize (KiB) 252440

[startup+1662.3 s]
/proc/loadavg: 2.23 2.15 2.10 3/177 8514
/proc/meminfo: memFree=30586216/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1662.02 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51209 0 0 0 166191 11 0 0 20 0 1 0 111184317 258498560 59606 33554432000 4194304 5796924 140736909523872 140736909520856 5094663 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59606 171 392 0 62709 0
Current children cumulated CPU time (s) 1662.02
Current children cumulated vsize (KiB) 252440

[startup+1722.3 s]
/proc/loadavg: 2.18 2.15 2.10 3/178 8518
/proc/meminfo: memFree=30585676/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1722.01 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51209 0 0 0 172190 11 0 0 20 0 1 0 111184317 258498560 59606 33554432000 4194304 5796924 140736909523872 140736909520856 5077954 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59606 171 392 0 62709 0
Current children cumulated CPU time (s) 1722.01
Current children cumulated vsize (KiB) 252440

[startup+1782.3 s]
/proc/loadavg: 2.16 2.15 2.10 3/177 8520
/proc/meminfo: memFree=30585900/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1782 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51209 0 0 0 178189 11 0 0 20 0 1 0 111184317 258498560 59606 33554432000 4194304 5796924 140736909523872 140736909520856 5087632 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59606 171 392 0 62709 0
Current children cumulated CPU time (s) 1782
Current children cumulated vsize (KiB) 252440



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+1800.4 s]
/proc/loadavg: 2.19 2.16 2.10 3/177 8521
/proc/meminfo: memFree=30585020/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1800.09 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) R 8404 8407 6587 0 -1 4202496 51209 0 0 0 179998 11 0 0 20 0 1 0 111184317 258498560 59606 33554432000 4194304 5796924 140736909523872 140736909520856 5087643 0 0 4096 17954 0 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59606 171 392 0 62709 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 252440

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Sending SIGKILL to process tree (bottom up)

Sending SIGKILL to -8407
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 8407 sig 9
??? end of watcher thread

Solver just ended.
Dumping a history of the last processes samples

[startup+1801.6 s]
/proc/loadavg: 2.19 2.16 2.10 2/177 8521
/proc/meminfo: memFree=30585024/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1800.09 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) S 8404 8407 6587 0 -1 4194304 51210 0 0 0 179998 11 0 0 20 0 1 0 111184317 258498560 59607 33554432000 4194304 5796924 140736909523872 140736909517192 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59607 172 392 0 62709 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 252440

[startup+1802 s]
/proc/loadavg: 2.19 2.16 2.10 2/177 8521
/proc/meminfo: memFree=30585024/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1800.09 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) S 8404 8407 6587 0 -1 4194304 51210 0 0 0 179998 11 0 0 20 0 1 0 111184317 258498560 59607 33554432000 4194304 5796924 140736909523872 140736909517192 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59607 172 392 0 62709 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 252440

[startup+1802.4 s]
/proc/loadavg: 2.19 2.16 2.10 2/177 8521
/proc/meminfo: memFree=30585024/32872528 swapFree=11252/530428
[pid=8407] ppid=8404 vsize=252440 CPUtime=1800.09 cores=1,3,5,7
/proc/8407/stat : 8407 (naps-1.02) S 8404 8407 6587 0 -1 4194304 51210 0 0 0 179998 11 0 0 20 0 1 0 111184317 258498560 59607 33554432000 4194304 5796924 140736909523872 140736909517192 5190702 0 16384 4096 17954 18446744071579510697 0 0 17 3 0 0 0 0 0
/proc/8407/statm: 63110 59607 172 392 0 62709 0
Current children cumulated CPU time (s) 1800.09
Current children cumulated vsize (KiB) 252440

Child ended because it received signal 9 (SIGKILL)
Real time (s): 1802.4
CPU time (s): 1800.1
CPU user time (s): 1799.99
CPU system time (s): 0.113982
CPU usage (%): 99.8724
Max. virtual memory (cumulated for all children) (KiB): 282792

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 1799.99
system time used= 0.113982
maximum resident set size= 258104
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 51210
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 42
involuntary context switches= 1852

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.2722 second user time and 7.57385 second system time

The end

Launcher Data 

Begin job on node141 at 2016-06-07 11:42:05
IDJOB=4082496
IDBENCH=92725
IDSOLVER=2544
FILE ID=node141/4082496-1465292525
RUNJOBID= node141-1465273956-6604
PBS_JOBID= 19843303
Free space on /tmp= 71744 MiB

SOLVER NAME= NaPS 1.02
BENCH NAME= PB12/normalized-PB12/OPT-BIGINT-LIN/zahidi/Base/normalized-minisat70_4_22_4.opb
COMMAND LINE= naps-1.02 BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4082496-1465292525/watcher-4082496-1465292525 -o /tmp/evaluation-result-4082496-1465292525/solver-4082496-1465292525 -C 1800 -W 1900 -M 15500 --bin-var /tmp/runsolver-exch-node141-1465273956-6604 --watchdog 1960  naps-1.02 HOME/instance-4082496-1465292525.opb

TIME LIMIT= 1800 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b9760eca078029bee17418839cb4525f
RANDOM SEED=1326936193

node141.alineos.net Linux 2.6.32-71.29.1.el6.x86_64 #1 SMP Mon Jun 27 19:49:27 BST 2011

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.876
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.876
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.876
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.876
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.876
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.876
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.876
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
cpu MHz		: 2666.876
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32872528 kB
MemFree:        30499596 kB
Buffers:          111688 kB
Cached:           241220 kB
SwapCached:         2212 kB
Active:           815960 kB
Inactive:         270056 kB
Active(anon):     732380 kB
Inactive(anon):     3072 kB
Active(file):      83580 kB
Inactive(file):   266984 kB
Unevictable:      530428 kB
Mlocked:           11252 kB
SwapTotal:      67108856 kB
SwapFree:       67098344 kB
Dirty:              4756 kB
Writeback:             0 kB
AnonPages:       1268968 kB
Mapped:             9116 kB
Shmem:                 0 kB
Slab:             617920 kB
SReclaimable:      61612 kB
SUnreclaim:       556308 kB
KernelStack:        1456 kB
PageTables:         6316 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83545120 kB
Committed_AS:    1481328 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      346412 kB
VmallocChunk:   34341988032 kB
HardwareCorrupted:     0 kB
AnonHugePages:    659456 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        7552 kB
DirectMap2M:    33538048 kB

Free space on /tmp at the end= 71740 MiB
End job on node141 at 2016-06-07 12:12:08