Trace number 4391530

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
NACRE 1.0.5-Hybrid? (TO) 2400.22 2400.65

General information on the benchmark

NamePseudoBoolean/PseudoBoolean-dec-spng/
Pb-NG-K138.xml
MD5SUMd1127b901f05c0465fc5ca2bd763ec4c
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables16422
Number of constraints16700
Number of domains1
Minimum domain size2
Maximum domain size2
Distribution of domain sizes[{"size":2,"count":16422}]
Minimum variable degree3
Maximum variable degree12
Distribution of variable degrees[{"degree":3,"count":1},{"degree":4,"count":266},{"degree":5,"count":1687},{"degree":6,"count":7377},{"degree":7,"count":4501},{"degree":8,"count":1771},{"degree":9,"count":546},{"degree":10,"count":136},{"degree":11,"count":1},{"degree":12,"count":136}]
Minimum constraint arity1
Maximum constraint arity138
Distribution of constraint arities[{"arity":1,"count":2},{"arity":2,"count":1781},{"arity":3,"count":7398},{"arity":4,"count":4521},{"arity":5,"count":1918},{"arity":6,"count":411},{"arity":7,"count":137},{"arity":9,"count":137},{"arity":119,"count":276},{"arity":138,"count":119}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"sum","count":16700}]
Optimization problemNO
Type of objective

Solver Data 

0.31/0.39	c NACRE 1.0.5
2400.06/2400.50	c
2400.06/2400.50	c # time = 2400.06
2400.06/2400.50	c # Dec = 3366845
2400.06/2400.50	c # Propagate Calls = 1100203744
2400.06/2400.50	c # assignAt Calls = 14811840
2400.06/2400.50	c # removeAt Calls = 506153939
2400.06/2400.50	c # Run = 966
2400.06/2400.50	c # Conflicts = 401036
2400.06/2400.50	c # Memory used = 4092.78 Mb
2400.06/2400.50	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14680 MiB free)
  memory of node 1: 16384 MiB (13514 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4391530-1568317026/watcher-4391530-1568317026 -o /tmp/evaluation-result-4391530-1568317026/solver-4391530-1568317026 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node132-1568304897-11108 --watchdog 2560 nacre_mini_release HOME/instance-4391530-1568317026.xml -ca -l100 -cm 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=13803, runsolver pid=13800
Current StackSize limit: 8192 KiB


[startup+0.100216 s]*
/proc/loadavg: 2.00 2.02 2.05 3/205 13804
/proc/meminfo: memFree=28848632/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=50752 memory=25452 CPUtime=0.1 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 7269 0 0 0 9 1 0 0 20 0 1 0 407625373 51970048 6363 33554432000 4194304 4935366 140726133476640 140726133473640 4787981 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 12688 6363 578 181 0 6305 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 50752 KiB
Current children cumulated memory: 25452 KiB

[startup+0.210204 s]*
/proc/loadavg: 2.00 2.02 2.05 3/205 13804
/proc/meminfo: memFree=28846740/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=52640 memory=27300 CPUtime=0.21 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 7708 0 0 0 20 1 0 0 20 0 1 0 407625373 53903360 6825 33554432000 4194304 4935366 140726133476640 140726133473640 139911371807550 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 13160 6825 581 181 0 6777 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 52640 KiB
Current children cumulated memory: 27300 KiB

[startup+0.309942 s]*
/proc/loadavg: 2.00 2.02 2.05 3/205 13804
/proc/meminfo: memFree=28845004/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=54096 memory=28884 CPUtime=0.31 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 8079 0 0 0 30 1 0 0 20 0 1 0 407625373 55394304 7221 33554432000 4194304 4935366 140726133476640 140726133473640 139911371811813 0 0 4096 0 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 13524 7221 581 181 0 7141 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 54096 KiB
Current children cumulated memory: 28884 KiB

[startup+0.700363 s]
/proc/loadavg: 2.00 2.02 2.05 3/205 13804
/proc/meminfo: memFree=28840912/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=58296 memory=32844 CPUtime=0.69 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 9088 0 0 0 68 1 0 0 20 0 1 0 407625373 59695104 8211 33554432000 4194304 4935366 140726133476640 140726133473640 139911372673395 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 14574 8211 598 181 0 8191 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 58296 KiB
Current children cumulated memory: 32844 KiB

[startup+1.50044 s]
/proc/loadavg: 2.00 2.02 2.05 3/205 13804
/proc/meminfo: memFree=28840172/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=58552 memory=33108 CPUtime=1.49 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 9135 0 0 0 148 1 0 0 20 0 1 0 407625373 59957248 8277 33554432000 4194304 4935366 140726133476640 140726133474584 4365369 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 14638 8277 604 181 0 8255 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 58552 KiB
Current children cumulated memory: 33108 KiB

[startup+3.11004 s]
/proc/loadavg: 2.00 2.02 2.05 3/205 13804
/proc/meminfo: memFree=28837408/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=58552 memory=33180 CPUtime=3.1 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 15597 0 0 0 309 1 0 0 20 0 1 0 407625373 59957248 8295 33554432000 4194304 4935366 140726133476640 140726133474584 4460988 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 14638 8295 618 181 0 8255 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 58552 KiB
Current children cumulated memory: 33180 KiB

[startup+6.30042 s]
/proc/loadavg: 2.00 2.02 2.05 3/205 13804
/proc/meminfo: memFree=28835168/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=58816 memory=33500 CPUtime=6.29 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 22656 0 0 0 627 2 0 0 20 0 1 0 407625373 60227584 8375 33554432000 4194304 4935366 140726133476640 140726133474328 4365325 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 14704 8375 618 181 0 8321 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 58816 KiB
Current children cumulated memory: 33500 KiB

[startup+12.7004 s]
/proc/loadavg: 2.00 2.02 2.05 3/205 13804
/proc/meminfo: memFree=28823836/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=62316 memory=36836 CPUtime=12.68 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 30417 0 0 0 1266 2 0 0 20 0 1 0 407625373 63811584 9209 33554432000 4194304 4935366 140726133476640 140726133474392 4365329 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 15579 9209 618 181 0 9196 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 62316 KiB
Current children cumulated memory: 36836 KiB

[startup+25.5005 s]
/proc/loadavg: 2.00 2.02 2.05 3/205 13804
/proc/meminfo: memFree=28794984/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=71312 memory=45764 CPUtime=25.49 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 47924 0 0 0 2545 4 0 0 20 0 1 0 407625373 73023488 11441 33554432000 4194304 4935366 140726133476640 140726133474328 4429531 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 17828 11441 618 181 0 11445 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 71312 KiB
Current children cumulated memory: 45764 KiB

[startup+51.1103 s]
/proc/loadavg: 2.00 2.02 2.05 3/204 13807
/proc/meminfo: memFree=28703768/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=124780 memory=99380 CPUtime=51.1 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 71843 0 0 0 5103 7 0 0 20 0 1 0 407625373 127774720 24845 33554432000 4194304 4935366 140726133476640 140726133474328 4365325 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 31195 24845 618 181 0 24812 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 124780 KiB
Current children cumulated memory: 99380 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/206 13813
/proc/meminfo: memFree=28379592/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=352388 memory=326904 CPUtime=102.28 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 149432 0 0 0 10209 19 0 0 20 0 1 0 407625373 360845312 81726 33554432000 4194304 4935366 140726133476640 140726133474392 4329472 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 88097 81726 618 181 0 81714 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 352388 KiB
Current children cumulated memory: 326904 KiB

[startup+162.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/206 13819
/proc/meminfo: memFree=28042664/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=595640 memory=569684 CPUtime=162.27 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 237267 0 0 0 16195 32 0 0 20 0 1 0 407625373 609935360 142421 33554432000 4194304 4935366 140726133476640 140726133474328 4365342 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 148910 142421 618 181 0 142527 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 595640 KiB
Current children cumulated memory: 569684 KiB

[startup+222.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/206 13823
/proc/meminfo: memFree=27662228/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=896740 memory=871068 CPUtime=222.26 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 358675 0 0 0 22181 45 0 0 20 0 1 0 407625373 918261760 217767 33554432000 4194304 4935366 140726133476640 140726133474392 4461244 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 224185 217767 618 181 0 217802 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 896740 KiB
Current children cumulated memory: 871068 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/206 13832
/proc/meminfo: memFree=27337316/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=1128568 memory=1102928 CPUtime=282.26 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 460154 0 0 0 28167 59 0 0 20 0 1 0 407625373 1155653632 275732 33554432000 4194304 4935366 140726133476640 140726133474392 4425262 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 282142 275732 618 181 0 275759 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 1128568 KiB
Current children cumulated memory: 1102928 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/206 13838
/proc/meminfo: memFree=27087144/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=1306284 memory=1280728 CPUtime=342.25 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 543025 0 0 0 34158 67 0 0 20 0 1 0 407625373 1337634816 320182 33554432000 4194304 4935366 140726133476640 140726133474328 4417976 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 326571 320182 618 181 0 320188 0
Current children cumulated CPU time: 342.25 s
Current children cumulated vsize: 1306284 KiB
Current children cumulated memory: 1280728 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/205 13843
/proc/meminfo: memFree=26969448/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=1367580 memory=1342096 CPUtime=402.24 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 623276 0 0 0 40148 76 0 0 20 0 1 0 407625373 1400401920 335524 33554432000 4194304 4935366 140726133476640 140726133474328 139911372555632 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 341895 335524 618 181 0 335512 0
Current children cumulated CPU time: 402.24 s
Current children cumulated vsize: 1367580 KiB
Current children cumulated memory: 1342096 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/205 13848
/proc/meminfo: memFree=26771492/32770624 swapFree=67008592/67108860
[pid=13803] ppid=13800 vsize=1504504 memory=1479136 CPUtime=462.24 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 743948 0 0 0 46134 90 0 0 20 0 1 0 407625373 1540612096 369784 33554432000 4194304 4935366 140726133476640 140726133474328 4461238 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 376126 369784 618 181 0 369743 0
Current children cumulated CPU time: 462.24 s
Current children cumulated vsize: 1504504 KiB
Current children cumulated memory: 1479136 KiB


################
# More data... #
################

/proc/meminfo: memFree=23665984/32770624 swapFree=67008616/67108860
[pid=13803] ppid=13800 vsize=3477396 memory=3452020 CPUtime=1662.01 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 4728169 0 0 0 165790 411 0 0 20 0 1 0 407625373 3560853504 863005 33554432000 4194304 4935366 140726133476640 140726133474344 4429860 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 869349 863005 618 181 0 862966 0
Current children cumulated CPU time: 1662.01 s
Current children cumulated vsize: 3477396 KiB
Current children cumulated memory: 3452020 KiB

[startup+1722.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/205 13986
/proc/meminfo: memFree=23583952/32770624 swapFree=67008616/67108860
[pid=13803] ppid=13800 vsize=3507712 memory=3482444 CPUtime=1721.99 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 4949111 0 0 0 171771 428 0 0 20 0 1 0 407625373 3591897088 870611 33554432000 4194304 4935366 140726133476640 140726133474392 4429535 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 876928 870611 618 181 0 870545 0
Current children cumulated CPU time: 1721.99 s
Current children cumulated vsize: 3507712 KiB
Current children cumulated memory: 3482444 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/205 13992
/proc/meminfo: memFree=23499748/32770624 swapFree=67008616/67108860
[pid=13803] ppid=13800 vsize=3540916 memory=3515556 CPUtime=1781.98 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 5158050 0 0 0 177756 442 0 0 20 0 1 0 407625373 3625897984 878889 33554432000 4194304 4935366 140726133476640 140726133474344 4365325 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 885229 878889 618 181 0 878846 0
Current children cumulated CPU time: 1781.98 s
Current children cumulated vsize: 3540916 KiB
Current children cumulated memory: 3515556 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/205 14057
/proc/meminfo: memFree=26725000/32770624 swapFree=67008616/67108860
[pid=13803] ppid=13800 vsize=3572520 memory=3547168 CPUtime=1841.96 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 5396449 0 0 0 183737 459 0 0 20 0 1 0 407625373 3658260480 886792 33554432000 4194304 4935366 140726133476640 140726133474392 4331531 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 893130 886792 618 181 0 886747 0
Current children cumulated CPU time: 1841.96 s
Current children cumulated vsize: 3572520 KiB
Current children cumulated memory: 3547168 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/205 14061
/proc/meminfo: memFree=26248532/32770624 swapFree=67008616/67108860
[pid=13803] ppid=13800 vsize=3635504 memory=3610196 CPUtime=1901.96 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 5645469 0 0 0 189719 477 0 0 20 0 1 0 407625373 3722756096 902549 33554432000 4194304 4935366 140726133476640 140726133474328 4415839 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 908876 902549 618 181 0 902493 0
Current children cumulated CPU time: 1901.96 s
Current children cumulated vsize: 3635504 KiB
Current children cumulated memory: 3610196 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/205 14068
/proc/meminfo: memFree=25861676/32770624 swapFree=67008616/67108860
[pid=13803] ppid=13800 vsize=3710088 memory=3684836 CPUtime=1961.94 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 5856838 0 0 0 195699 495 0 0 20 0 1 0 407625373 3799130112 921209 33554432000 4194304 4935366 140726133476640 140726133474392 4450992 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 927522 921209 618 181 0 921139 0
Current children cumulated CPU time: 1961.94 s
Current children cumulated vsize: 3710088 KiB
Current children cumulated memory: 3684836 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/204 14072
/proc/meminfo: memFree=25579964/32770624 swapFree=67008616/67108860
[pid=13803] ppid=13800 vsize=3740952 memory=3715760 CPUtime=2021.94 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 6082158 0 0 0 201683 511 0 0 20 0 1 0 407625373 3830734848 928940 33554432000 4194304 4935366 140726133476640 140726133474344 139911378105808 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 935238 928940 618 181 0 928855 0
Current children cumulated CPU time: 2021.94 s
Current children cumulated vsize: 3740952 KiB
Current children cumulated memory: 3715760 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/204 14081
/proc/meminfo: memFree=25336780/32770624 swapFree=67008624/67108860
[pid=13803] ppid=13800 vsize=3769000 memory=3743764 CPUtime=2081.93 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 6297708 0 0 0 207666 527 0 0 20 0 1 0 407625373 3859456000 935941 33554432000 4194304 4935366 140726133476640 140726133474344 4429515 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 942250 935941 618 181 0 935867 0
Current children cumulated CPU time: 2081.93 s
Current children cumulated vsize: 3769000 KiB
Current children cumulated memory: 3743764 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/204 14087
/proc/meminfo: memFree=25100780/32770624 swapFree=67008624/67108860
[pid=13803] ppid=13800 vsize=3840988 memory=3815724 CPUtime=2141.91 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 6541971 0 0 0 213650 541 0 0 20 0 1 0 407625373 3933171712 953931 33554432000 4194304 4935366 140726133476640 140726133474392 4429134 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 960247 953931 618 181 0 953864 0
Current children cumulated CPU time: 2141.91 s
Current children cumulated vsize: 3840988 KiB
Current children cumulated memory: 3815724 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/205 14092
/proc/meminfo: memFree=24811612/32770624 swapFree=67008624/67108860
[pid=13803] ppid=13800 vsize=3911972 memory=3886828 CPUtime=2201.9 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 6788677 0 0 0 219633 557 0 0 20 0 1 0 407625373 4005859328 971707 33554432000 4194304 4935366 140726133476640 140726133474392 139911372667132 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 977993 971707 618 181 0 971610 0
Current children cumulated CPU time: 2201.9 s
Current children cumulated vsize: 3911972 KiB
Current children cumulated memory: 3886828 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/205 14097
/proc/meminfo: memFree=24587052/32770624 swapFree=67008624/67108860
[pid=13803] ppid=13800 vsize=3962684 memory=3937444 CPUtime=2261.89 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 6995814 0 0 0 225617 572 0 0 20 0 1 0 407625373 4057788416 984361 33554432000 4194304 4935366 140726133476640 140726133474344 4429744 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 990671 984361 618 181 0 984288 0
Current children cumulated CPU time: 2261.89 s
Current children cumulated vsize: 3962684 KiB
Current children cumulated memory: 3937444 KiB

[startup+2322.3 s]
/proc/loadavg: 2.08 2.04 2.05 3/205 14164
/proc/meminfo: memFree=26392552/32770624 swapFree=67008624/67108860
[pid=13803] ppid=13800 vsize=3980820 memory=3955640 CPUtime=2321.88 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 7196634 0 0 0 231602 586 0 0 20 0 1 0 407625373 4076359680 988910 33554432000 4194304 4935366 140726133476640 140726133474328 4475618 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 995205 988910 618 181 0 988822 0
Current children cumulated CPU time: 2321.88 s
Current children cumulated vsize: 3980820 KiB
Current children cumulated memory: 3955640 KiB

[startup+2382.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/205 14168
/proc/meminfo: memFree=25858576/32770624 swapFree=67008624/67108860
[pid=13803] ppid=13800 vsize=4084420 memory=4059260 CPUtime=2381.87 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 7409707 0 0 0 237583 604 0 0 20 0 1 0 407625373 4182446080 1014815 33554432000 4194304 4935366 140726133476640 140726133474392 139911378104768 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 1021105 1014815 618 181 0 1014722 0
Current children cumulated CPU time: 2381.87 s
Current children cumulated vsize: 4084420 KiB
Current children cumulated memory: 4059260 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.5 s]
/proc/loadavg: 2.02 2.03 2.05 3/205 14169
/proc/meminfo: memFree=25743316/32770624 swapFree=67008624/67108860
[pid=13803] ppid=13800 vsize=4117944 memory=4092684 CPUtime=2400.06 cores=0,2,4,6
/proc/13803/stat : 13803 (nacre_mini_rele) R 13800 13803 11077 0 -1 4202496 7488608 0 0 0 239396 610 0 0 20 0 1 0 407625373 4216774656 1023171 33554432000 4194304 4935366 140726133476640 140726133474392 139911371809565 0 0 4096 24578 0 0 0 17 2 0 0 0 0 0 7034520 7039168 11563008 140726133482497 140726133482597 140726133482597 140726133485506 0
/proc/13803/statm: 1029486 1023171 618 181 0 1023103 0
Current children cumulated CPU time: 2400.06 s
Current children cumulated vsize: 4117944 KiB
Current children cumulated memory: 4092684 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.65 s]
# the end of solver process 13803 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2393.97 s, system=6.24735 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.6 s]*
/proc/loadavg: 2.02 2.03 2.05 3/205 14169
/proc/meminfo: memFree=29012824/32770624 swapFree=67008624/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

Child status: 0
Real time (s): 2400.65
CPU time (s): 2400.22
CPU user time (s): 2393.97
CPU system time (s): 6.24735
CPU usage (%): 99.9822
Max. virtual memory (cumulated for all children) (KiB): 4117944
Max. memory (cumulated for all children) (KiB): 4092684

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2393.97
system time used= 6.24735
maximum resident set size= 4092788
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7488651
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 301
involuntary context switches= 2563


# summary of solver processes directly reported to runsolver:
#   pid: 13803
#   total CPU time (s): 2400.22
#   total CPU user time (s): 2393.97
#   total CPU system time (s): 6.24735

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.1494 second user time and 18.4443 second system time

The end

Launcher Data 

Begin job on node132 at 2019-09-12 21:36:17
IDJOB=4391530
IDBENCH=134794
IDSOLVER=2834
FILE ID=node132/4391530-1568317026
RUNJOBID= node132-1568304897-11108
PBS_JOBID= 21701117
Free space on /tmp= 60304 MiB

SOLVER NAME= NACRE 1.0.5-Hybrid
BENCH NAME= XCSP17/PseudoBoolean/PseudoBoolean-dec-spng/Pb-NG-K138.xml
COMMAND LINE= nacre_mini_release BENCHNAME -ca -l100 -cm
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4391530-1568317026/watcher-4391530-1568317026 -o /tmp/evaluation-result-4391530-1568317026/solver-4391530-1568317026 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node132-1568304897-11108 --watchdog 2560  nacre_mini_release HOME/instance-4391530-1568317026.xml -ca -l100 -cm

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d1127b901f05c0465fc5ca2bd763ec4c
RANDOM SEED=111003290

node132.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28872068 kB
MemAvailable:   30217884 kB
Buffers:          116104 kB
Cached:          1500488 kB
SwapCached:         8700 kB
Active:          2001892 kB
Inactive:        1314432 kB
Active(anon):    1699712 kB
Inactive(anon):    26968 kB
Active(file):     302180 kB
Inactive(file):  1287464 kB
Unevictable:      110200 kB
Mlocked:          110200 kB
SwapTotal:      67108860 kB
SwapFree:       67008592 kB
Dirty:              1896 kB
Writeback:            16 kB
AnonPages:       1805300 kB
Mapped:            30948 kB
Shmem:             18460 kB
Slab:             172928 kB
SReclaimable:     144016 kB
SUnreclaim:        28912 kB
KernelStack:        3584 kB
PageTables:         9044 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2196824 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    972800 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      136576 kB
DirectMap2M:    33409024 kB

Free space on /tmp at the end= 60300 MiB
End job on node132 at 2019-09-12 22:16:18