Trace number 4252563

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
miniBTD 2017-06-30? (TO) 2400.1 2400.19

General information on the benchmark

NamePropStress/PropStress-m1-s1/
PropStress-0150.xml
MD5SUMb9bf68be3b756b1f34bbd3d4e06d542d
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark128.82
Satisfiable
(Un)Satisfiability was proved
Number of variables302
Number of constraints11626
Number of domains1
Minimum domain size22501
Maximum domain size22501
Distribution of domain sizes[{"size":22501,"count":302}]
Minimum variable degree2
Maximum variable degree151
Distribution of variable degrees[{"degree":2,"count":1},{"degree":3,"count":149},{"degree":150,"count":149},{"degree":151,"count":3}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":11626}]
Number of extensional constraints0
Number of intensional constraints11626
Distribution of constraint types[{"type":"intension","count":11626}]
Optimization problemNO
Type of objective

Solver Data 

159.18/159.32	c Version: 2017-06-30

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4252563-1500930934/watcher-4252563-1500930934 -o /tmp/evaluation-result-4252563-1500930934/solver-4252563-1500930934 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node103-1500930934-4157 --watchdog 2560 miniBTD 2400 HOME/instance-4252563-1500930934.xml 

pid=4175
running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 1.00 1.03 1.05 4/180 4178
/proc/meminfo: memFree=32025040/32770624 swapFree=5836/147864
[pid=4178] ppid=4175 vsize=4396 CPUtime=0 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) D 4175 4178 4125 0 -1 4194304 167 0 1 0 0 0 0 0 20 0 1 0 2632296 4501504 35 33554432000 4194304 4832315 140734917799040 140734917796488 139733174840850 0 0 4096 0 18446744071580431491 0 0 17 3 0 0 0 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1099 35 26 156 0 39 0

[startup+0.100154 s]
/proc/loadavg: 1.00 1.03 1.05 4/180 4178
/proc/meminfo: memFree=32025040/32770624 swapFree=5836/147864
[pid=4178] ppid=4175 vsize=26828 CPUtime=0.08 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 1340 0 3 0 8 0 0 0 20 0 1 0 2632296 27471872 828 33554432000 4194304 4832315 140734917799040 140734917797104 4217329 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 6687 828 511 156 0 329 0
Current children cumulated CPU time (s) 0.08
Current children cumulated vsize (KiB) 26828

[startup+0.200279 s]
/proc/loadavg: 1.00 1.03 1.05 4/180 4178
/proc/meminfo: memFree=32025040/32770624 swapFree=5836/147864
[pid=4178] ppid=4175 vsize=27096 CPUtime=0.18 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 6684 0 3 0 17 1 0 0 20 0 1 0 2632296 27746304 874 33554432000 4194304 4832315 140734917799040 140734917797104 4217657 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 6774 874 511 156 0 416 0
Current children cumulated CPU time (s) 0.18
Current children cumulated vsize (KiB) 27096

[startup+0.300245 s]
/proc/loadavg: 1.00 1.03 1.05 4/180 4178
/proc/meminfo: memFree=32025040/32770624 swapFree=5836/147864
[pid=4178] ppid=4175 vsize=27332 CPUtime=0.28 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 18005 0 3 0 25 3 0 0 20 0 1 0 2632296 27987968 942 33554432000 4194304 4832315 140734917799040 140734917797104 4217001 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 6833 942 511 156 0 475 0
Current children cumulated CPU time (s) 0.28
Current children cumulated vsize (KiB) 27332

[startup+0.700219 s]
/proc/loadavg: 1.00 1.03 1.05 4/180 4178
/proc/meminfo: memFree=32025040/32770624 swapFree=5836/147864
[pid=4178] ppid=4175 vsize=28532 CPUtime=0.68 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 54350 0 3 0 61 7 0 0 20 0 1 0 2632296 29216768 1277 33554432000 4194304 4832315 140734917799040 140734917797104 139733152654316 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 7133 1277 512 156 0 775 0
Current children cumulated CPU time (s) 0.68
Current children cumulated vsize (KiB) 28532

[startup+1.50022 s]
/proc/loadavg: 1.00 1.03 1.05 3/185 4190
/proc/meminfo: memFree=32014960/32770624 swapFree=5836/136876
[pid=4178] ppid=4175 vsize=30492 CPUtime=1.48 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 145860 0 3 0 130 18 0 0 20 0 1 0 2632296 31223808 1767 33554432000 4194304 4832315 140734917799040 140734917795368 139733152654316 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 7665 1767 512 156 0 1307 0
Current children cumulated CPU time (s) 1.48
Current children cumulated vsize (KiB) 30492

[startup+3.10022 s]
/proc/loadavg: 1.00 1.03 1.05 3/185 4190
/proc/meminfo: memFree=32009504/32770624 swapFree=5836/136876
[pid=4178] ppid=4175 vsize=35588 CPUtime=3.08 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 305169 0 3 0 270 38 0 0 20 0 1 0 2632296 36442112 3035 33554432000 4194304 4832315 140734917799040 140734917795368 139733152654316 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 8897 3035 512 156 0 2539 0
Current children cumulated CPU time (s) 3.08
Current children cumulated vsize (KiB) 35588

[startup+6.30022 s]
/proc/loadavg: 1.00 1.03 1.05 3/185 4190
/proc/meminfo: memFree=31997044/32770624 swapFree=5836/136648
[pid=4178] ppid=4175 vsize=45428 CPUtime=6.28 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 597512 0 3 0 552 76 0 0 20 0 1 0 2632296 46518272 5467 33554432000 4194304 4832315 140734917799040 140734917795592 4217657 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 11353 5484 512 156 0 4995 0
Current children cumulated CPU time (s) 6.28
Current children cumulated vsize (KiB) 45428

[startup+12.7002 s]
/proc/loadavg: 1.08 1.05 1.05 3/185 4190
/proc/meminfo: memFree=31973976/32770624 swapFree=5836/136652
[pid=4178] ppid=4175 vsize=64276 CPUtime=12.68 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 1242319 0 3 0 1110 158 0 0 20 0 1 0 2632296 65818624 10195 33554432000 4194304 4832315 140734917799040 140734917795592 4216992 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 16069 10195 512 156 0 9711 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 64276

[startup+25.5003 s]
/proc/loadavg: 1.29 1.09 1.07 3/185 4190
/proc/meminfo: memFree=31931064/32770624 swapFree=5836/136676
[pid=4178] ppid=4175 vsize=103424 CPUtime=25.48 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 2458299 0 3 0 2239 309 0 0 20 0 1 0 2632296 105906176 19954 33554432000 4194304 4832315 140734917799040 140734917795368 4216673 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 25856 19954 512 156 0 19498 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 103424

[startup+51.1003 s]
/proc/loadavg: 1.53 1.17 1.09 3/185 4190
/proc/meminfo: memFree=31851712/32770624 swapFree=5836/136688
[pid=4178] ppid=4175 vsize=179868 CPUtime=51.06 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 4977100 0 3 0 4488 618 0 0 20 0 1 0 2632296 184184832 39067 33554432000 4194304 4832315 140734917799040 140734917795592 4215833 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 44918 39062 512 156 0 38560 0
Current children cumulated CPU time (s) 51.06
Current children cumulated vsize (KiB) 179868

[startup+102.3 s]
/proc/loadavg: 1.80 1.29 1.14 3/185 4191
/proc/meminfo: memFree=31690204/32770624 swapFree=5836/136708
[pid=4178] ppid=4175 vsize=334392 CPUtime=102.22 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 9935384 0 3 0 8996 1226 0 0 20 0 1 0 2632296 342417408 77742 33554432000 4194304 4832315 140734917799040 140734917795368 139733152654316 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 83635 77742 512 156 0 77277 0
Current children cumulated CPU time (s) 102.22
Current children cumulated vsize (KiB) 334392

[startup+162.3 s]
/proc/loadavg: 1.92 1.42 1.19 3/185 4192
/proc/meminfo: memFree=27428388/32770624 swapFree=5836/136736
[pid=4178] ppid=4175 vsize=4585148 CPUtime=162.18 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 15882396 0 3 0 14263 1955 0 0 20 0 1 0 2632296 4695191552 1140440 33554432000 4194304 4832315 140734917799040 140734917796216 4279048 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1146287 1140440 580 156 0 1139929 0
Current children cumulated CPU time (s) 162.18
Current children cumulated vsize (KiB) 4585148

[startup+222.306 s]
/proc/loadavg: 1.97 1.53 1.24 3/185 4193
/proc/meminfo: memFree=27405756/32770624 swapFree=5836/136756
[pid=4178] ppid=4175 vsize=4605080 CPUtime=222.18 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 15888629 0 3 0 20263 1955 0 0 20 0 1 0 2632296 4715601920 1145450 33554432000 4194304 4832315 140734917799040 140734917796216 4278721 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1151270 1145450 580 156 0 1144912 0
Current children cumulated CPU time (s) 222.18
Current children cumulated vsize (KiB) 4605080

[startup+282.3 s]
/proc/loadavg: 1.99 1.61 1.29 3/185 4201
/proc/meminfo: memFree=27370664/32770624 swapFree=5836/136792
[pid=4178] ppid=4175 vsize=4625012 CPUtime=282.18 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 15894842 0 3 0 26261 1957 0 0 20 0 1 0 2632296 4736012288 1150411 33554432000 4194304 4832315 140734917799040 140734917796216 4281202 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1156253 1150411 580 156 0 1149895 0
Current children cumulated CPU time (s) 282.18
Current children cumulated vsize (KiB) 4625012

[startup+342.3 s]
/proc/loadavg: 2.00 1.68 1.33 3/182 4202
/proc/meminfo: memFree=27342412/32770624 swapFree=5836/136812
[pid=4178] ppid=4175 vsize=4644812 CPUtime=342.17 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 15900589 0 3 0 32260 1957 0 0 20 0 1 0 2632296 4756287488 1155363 33554432000 4194304 4832315 140734917799040 140734917796216 4281030 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1161203 1155363 580 156 0 1154845 0
Current children cumulated CPU time (s) 342.17
Current children cumulated vsize (KiB) 4644812

[startup+402.3 s]
/proc/loadavg: 2.00 1.74 1.38 3/182 4203
/proc/meminfo: memFree=27321376/32770624 swapFree=5836/136832
[pid=4178] ppid=4175 vsize=4665008 CPUtime=402.17 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 15905645 0 3 0 38259 1958 0 0 20 0 1 0 2632296 4776968192 1160445 33554432000 4194304 4832315 140734917799040 140734917796216 4264056 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1166252 1160445 580 156 0 1159894 0
Current children cumulated CPU time (s) 402.17
Current children cumulated vsize (KiB) 4665008

[startup+462.3 s]
/proc/loadavg: 2.00 1.79 1.42 3/182 4204
/proc/meminfo: memFree=27286828/32770624 swapFree=5836/136860
[pid=4178] ppid=4175 vsize=4684940 CPUtime=462.17 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 15910613 0 3 0 44258 1959 0 0 20 0 1 0 2632296 4797378560 1165395 33554432000 4194304 4832315 140734917799040 140734917796216 4282001 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1171235 1165395 580 156 0 1164877 0
Current children cumulated CPU time (s) 462.17
Current children cumulated vsize (KiB) 4684940

[startup+522.3 s]
/proc/loadavg: 2.00 1.83 1.45 3/182 4205
/proc/meminfo: memFree=27259312/32770624 swapFree=5836/136880
[pid=4178] ppid=4175 vsize=4704608 CPUtime=522.18 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 15915530 0 3 0 50258 1960 0 0 20 0 1 0 2632296 4817518592 1170279 33554432000 4194304 4832315 140734917799040 140734917796216 4264091 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1176152 1170279 580 156 0 1169794 0
Current children cumulated CPU time (s) 522.18
Current children cumulated vsize (KiB) 4704608

[startup+582.3 s]
/proc/loadavg: 2.04 1.87 1.49 3/182 4207
/proc/meminfo: memFree=27236572/32770624 swapFree=5836/136904
[pid=4178] ppid=4175 vsize=4724540 CPUtime=582.18 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 15920514 0 3 0 56258 1960 0 0 20 0 1 0 2632296 4837928960 1175295 33554432000 4194304 4832315 140734917799040 140734917796216 4281145 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1181135 1175295 580 156 0 1174777 0
Current children cumulated CPU time (s) 582.18
Current children cumulated vsize (KiB) 4724540


################
# More data... #
################


[startup+1542.31 s]
/proc/loadavg: 2.00 2.00 1.82 3/183 4239
/proc/meminfo: memFree=26794948/32770624 swapFree=5836/137284
[pid=4178] ppid=4175 vsize=5043848 CPUtime=1542.2 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16005712 0 3 0 152244 1976 0 0 20 0 1 0 2632296 5164900352 1255135 33554432000 4194304 4832315 140734917799040 140734917796216 4281152 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1260962 1255135 580 156 0 1254604 0
Current children cumulated CPU time (s) 1542.2
Current children cumulated vsize (KiB) 5043848

[startup+1602.3 s]
/proc/loadavg: 2.00 2.00 1.84 3/183 4240
/proc/meminfo: memFree=26765196/32770624 swapFree=5836/137308
[pid=4178] ppid=4175 vsize=5063648 CPUtime=1602.19 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16011643 0 3 0 158242 1977 0 0 20 0 1 0 2632296 5185175552 1260104 33554432000 4194304 4832315 140734917799040 140734917796216 4278589 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1265912 1260104 580 156 0 1259554 0
Current children cumulated CPU time (s) 1602.19
Current children cumulated vsize (KiB) 5063648

[startup+1662.3 s]
/proc/loadavg: 2.00 2.00 1.85 3/183 4241
/proc/meminfo: memFree=26736524/32770624 swapFree=5836/137336
[pid=4178] ppid=4175 vsize=5083448 CPUtime=1662.19 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16017271 0 3 0 164240 1979 0 0 20 0 1 0 2632296 5205450752 1265043 33554432000 4194304 4832315 140734917799040 140734917796216 4281232 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1270862 1265043 580 156 0 1264504 0
Current children cumulated CPU time (s) 1662.19
Current children cumulated vsize (KiB) 5083448

[startup+1722.3 s]
/proc/loadavg: 2.00 2.00 1.86 3/183 4242
/proc/meminfo: memFree=26712836/32770624 swapFree=5836/137356
[pid=4178] ppid=4175 vsize=5103644 CPUtime=1722.2 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16023332 0 3 0 170239 1981 0 0 20 0 1 0 2632296 5226131456 1270101 33554432000 4194304 4832315 140734917799040 140734917796216 4279016 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1275911 1270101 580 156 0 1269553 0
Current children cumulated CPU time (s) 1722.2
Current children cumulated vsize (KiB) 5103644

[startup+1782.3 s]
/proc/loadavg: 2.05 2.02 1.87 3/182 4243
/proc/meminfo: memFree=26686552/32770624 swapFree=5836/137376
[pid=4178] ppid=4175 vsize=5123576 CPUtime=1782.19 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16029163 0 3 0 176237 1982 0 0 20 0 1 0 2632296 5246541824 1275064 33554432000 4194304 4832315 140734917799040 140734917796216 4278685 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1280894 1275064 580 156 0 1274536 0
Current children cumulated CPU time (s) 1782.19
Current children cumulated vsize (KiB) 5123576

[startup+1842.3 s]
/proc/loadavg: 2.09 2.03 1.88 3/182 4244
/proc/meminfo: memFree=26654092/32770624 swapFree=5836/137396
[pid=4178] ppid=4175 vsize=5143508 CPUtime=1842.2 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16034872 0 3 0 182236 1984 0 0 20 0 1 0 2632296 5266952192 1280061 33554432000 4194304 4832315 140734917799040 140734917796216 4264064 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1285877 1280061 580 156 0 1279519 0
Current children cumulated CPU time (s) 1842.2
Current children cumulated vsize (KiB) 5143508

[startup+1902.3 s]
/proc/loadavg: 2.03 2.02 1.89 3/182 4245
/proc/meminfo: memFree=26628944/32770624 swapFree=5836/137420
[pid=4178] ppid=4175 vsize=5163308 CPUtime=1902.2 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16040317 0 3 0 188235 1985 0 0 20 0 1 0 2632296 5287227392 1284989 33554432000 4194304 4832315 140734917799040 140734917796216 4281035 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1290827 1284989 580 156 0 1284469 0
Current children cumulated CPU time (s) 1902.2
Current children cumulated vsize (KiB) 5163308

[startup+1962.3 s]
/proc/loadavg: 2.01 2.02 1.90 3/182 4246
/proc/meminfo: memFree=26606996/32770624 swapFree=5836/137448
[pid=4178] ppid=4175 vsize=5183240 CPUtime=1962.2 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16046066 0 3 0 194234 1986 0 0 20 0 1 0 2632296 5307637760 1289943 33554432000 4194304 4832315 140734917799040 140734917796216 4282730 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1295810 1289943 580 156 0 1289452 0
Current children cumulated CPU time (s) 1962.2
Current children cumulated vsize (KiB) 5183240

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 1.90 3/182 4247
/proc/meminfo: memFree=26571156/32770624 swapFree=5836/137468
[pid=4178] ppid=4175 vsize=5203040 CPUtime=2022.2 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16051949 0 3 0 200232 1988 0 0 20 0 1 0 2632296 5327912960 1294891 33554432000 4194304 4832315 140734917799040 140734917796216 4282730 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1300760 1294891 580 156 0 1294402 0
Current children cumulated CPU time (s) 2022.2
Current children cumulated vsize (KiB) 5203040

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 1.91 3/182 4255
/proc/meminfo: memFree=26545712/32770624 swapFree=5836/137492
[pid=4178] ppid=4175 vsize=5222840 CPUtime=2082.2 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16057773 0 3 0 206231 1989 0 0 20 0 1 0 2632296 5348188160 1299888 33554432000 4194304 4832315 140734917799040 140734917796216 4264064 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1305710 1299888 580 156 0 1299352 0
Current children cumulated CPU time (s) 2082.2
Current children cumulated vsize (KiB) 5222840

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 1.91 3/182 4256
/proc/meminfo: memFree=26523272/32770624 swapFree=5836/137516
[pid=4178] ppid=4175 vsize=5243036 CPUtime=2142.2 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16063299 0 3 0 212230 1990 0 0 20 0 1 0 2632296 5368868864 1304893 33554432000 4194304 4832315 140734917799040 140734917796216 4281030 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1310759 1304893 580 156 0 1304401 0
Current children cumulated CPU time (s) 2142.2
Current children cumulated vsize (KiB) 5243036

[startup+2202.31 s]
/proc/loadavg: 2.04 2.03 1.92 3/182 4257
/proc/meminfo: memFree=26489512/32770624 swapFree=5836/137536
[pid=4178] ppid=4175 vsize=5262836 CPUtime=2202.2 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16068716 0 3 0 218228 1992 0 0 20 0 1 0 2632296 5389144064 1309833 33554432000 4194304 4832315 140734917799040 140734917796216 4278721 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1315709 1309833 580 156 0 1309351 0
Current children cumulated CPU time (s) 2202.2
Current children cumulated vsize (KiB) 5262836

[startup+2262.3 s]
/proc/loadavg: 2.12 2.05 1.94 3/182 4269
/proc/meminfo: memFree=26462492/32770624 swapFree=5836/137872
[pid=4178] ppid=4175 vsize=5282636 CPUtime=2262.21 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16074231 0 3 0 224227 1994 0 0 20 0 1 0 2632296 5409419264 1314830 33554432000 4194304 4832315 140734917799040 140734917796216 4278657 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1320659 1314830 580 156 0 1314301 0
Current children cumulated CPU time (s) 2262.21
Current children cumulated vsize (KiB) 5282636

[startup+2322.3 s]
/proc/loadavg: 2.08 2.06 1.95 3/182 4270
/proc/meminfo: memFree=26440024/32770624 swapFree=5836/137896
[pid=4178] ppid=4175 vsize=5302436 CPUtime=2322.2 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16080010 0 3 0 230225 1995 0 0 20 0 1 0 2632296 5429694464 1319808 33554432000 4194304 4832315 140734917799040 140734917796216 4278706 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1325609 1319808 580 156 0 1319251 0
Current children cumulated CPU time (s) 2322.2
Current children cumulated vsize (KiB) 5302436

[startup+2382.3 s]
/proc/loadavg: 2.14 2.08 1.96 3/182 4272
/proc/meminfo: memFree=26408228/32770624 swapFree=5836/137924
[pid=4178] ppid=4175 vsize=5322236 CPUtime=2382.2 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16085669 0 3 0 236224 1996 0 0 20 0 1 0 2632296 5449969664 1324722 33554432000 4194304 4832315 140734917799040 140734917796216 4281120 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1330559 1324722 580 156 0 1324201 0
Current children cumulated CPU time (s) 2382.2
Current children cumulated vsize (KiB) 5322236



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.1 s]
/proc/loadavg: 2.17 2.09 1.97 3/182 4272
/proc/meminfo: memFree=26398504/32770624 swapFree=5836/137932
[pid=4178] ppid=4175 vsize=5328044 CPUtime=2400.01 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16087453 0 3 0 238004 1997 0 0 20 0 1 0 2632296 5455917056 1326164 33554432000 4194304 4832315 140734917799040 140734917796216 4278706 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1332011 1326164 580 156 0 1325653 0
Current children cumulated CPU time (s) 2400.01
Current children cumulated vsize (KiB) 5328044

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 4178 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.1 s]
/proc/loadavg: 2.17 2.09 1.97 3/182 4272
/proc/meminfo: memFree=26398504/32770624 swapFree=5836/137932
[pid=4178] ppid=4175 vsize=5328044 CPUtime=2400.01 cores=1,3,5,7
/proc/4178/stat : 4178 (miniBTD) R 4175 4178 4125 0 -1 4202496 16087453 0 3 0 238004 1997 0 0 20 0 1 0 2632296 5455917056 1326164 33554432000 4194304 4832315 140734917799040 140734917796216 4278706 0 0 4096 0 0 0 0 17 3 0 0 1 0 0 6932504 6936608 16601088 140734917805298 140734917805378 140734917805378 140734917808077 0
/proc/4178/statm: 1332011 1326164 580 156 0 1325653 0
Current children cumulated CPU time (s) 2400.01
Current children cumulated vsize (KiB) 5328044

Child ended because it received signal 15 (SIGTERM)
Real time (s): 2400.19
CPU time (s): 2400.1
CPU user time (s): 2380.04
CPU system time (s): 20.0618
CPU usage (%): 99.9964
Max. virtual memory (cumulated for all children) (KiB): 5328044

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2380.04
system time used= 20.0618
maximum resident set size= 5304856
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 16087453
page faults= 3
swaps= 0
block input operations= 3320
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 330
involuntary context switches= 1629

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 5.3404 second user time and 8.23364 second system time

The end

Launcher Data 

Begin job on node103 at 2017-07-24 23:15:34
IDJOB=4252563
IDBENCH=126842
IDSOLVER=2632
FILE ID=node103/4252563-1500930934
RUNJOBID= node103-1500930934-4157
PBS_JOBID= 20625427
Free space on /tmp= 61700 MiB

SOLVER NAME= miniBTD 2017-06-30
BENCH NAME= XCSP17/PropStress/PropStress-m1-s1/PropStress-0150.xml
COMMAND LINE= miniBTD TIMEOUT BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4252563-1500930934/watcher-4252563-1500930934 -o /tmp/evaluation-result-4252563-1500930934/solver-4252563-1500930934 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node103-1500930934-4157 --watchdog 2560  miniBTD 2400 HOME/instance-4252563-1500930934.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b9bf68be3b756b1f34bbd3d4e06d542d
RANDOM SEED=1455222895

node103.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        32033720 kB
MemAvailable:   32061164 kB
Buffers:           33636 kB
Cached:           309072 kB
SwapCached:            0 kB
Active:           232044 kB
Inactive:         152740 kB
Active(anon):      45524 kB
Inactive(anon):     8584 kB
Active(file):     186520 kB
Inactive(file):   144156 kB
Unevictable:        5836 kB
Mlocked:            5836 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              9920 kB
Writeback:             0 kB
AnonPages:         45964 kB
Mapped:            26628 kB
Shmem:              8848 kB
Slab:              50304 kB
SReclaimable:      25204 kB
SUnreclaim:        25100 kB
KernelStack:        3056 kB
PageTables:         4888 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     273612 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      4096 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 61680 MiB
End job on node103 at 2017-07-24 23:55:34