Trace number 4397262

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0SAT 610.67 610.69

General information on the benchmark

NameRandom/Random-RB-3-20-20f/
rand-3-20-20-60-632f-11.xml
MD5SUM2177eeb766f29dacd684113dff68ce63
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark33.0671
Satisfiable
(Un)Satisfiability was proved
Number of variables20
Number of constraints60
Number of domains1
Minimum domain size20
Maximum domain size20
Distribution of domain sizes[{"size":20,"count":20}]
Minimum variable degree3
Maximum variable degree14
Distribution of variable degrees[{"degree":3,"count":1},{"degree":7,"count":4},{"degree":8,"count":1},{"degree":9,"count":6},{"degree":10,"count":4},{"degree":11,"count":3},{"degree":14,"count":1}]
Minimum constraint arity3
Maximum constraint arity3
Distribution of constraint arities[{"arity":3,"count":60}]
Number of extensional constraints60
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":60}]
Optimization problemNO
Type of objective

Solver Data 

0.50/0.60	c root propagations     : 0           
0.50/0.60	c restarts enabled, print stats at every restarts
0.50/0.60	c
0.50/0.60	c
0.50/0.60	c
0.50/0.60	c This is cosoco 2.00 --  
0.50/0.60	c
0.50/0.60	c command line: cosoco -lc -model -restarts -stick HOME/instance-4397262-1568574099.xml 
0.50/0.60	c ========================================[ Problem Statistics ]===========================================
0.50/0.60	c |                                                                                                       
0.50/0.60	c |  Parse time        :         0.59 s 
0.50/0.60	c |
0.50/0.60	c |               Variables: 20
0.50/0.60	c |            Domain Sizes: 20..20
0.50/0.60	c |
0.50/0.60	c |             Constraints: 60
0.50/0.60	c |                   Arity: 3..3  -- Ternary: 60
0.50/0.60	c | 
0.50/0.60	c |                   Types: 
0.50/0.60	c |                          Extension: 60  (nb tuples: 2944..2944) -- (shared: 0)
0.50/0.60	c |                          
0.50/0.60	c =========================================================================================================
0.50/0.60	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.59/0.63	c 101            128            6534           8355           0              0              7   9   7      
0.59/0.68	c 211            314            16235          16886          0              0              6   11   7     
0.70/0.73	c 332            534            27572          26399          0              0              5   10   7     
0.80/0.80	c 465            721            36674          36854          0              0              6   9   6      
0.80/0.86	c 611            960            48739          48093          0              0              4   9   6      
0.90/0.93	c 771            1232           63427          60557          0              0              5   10   7     
1.00/1.02	c 947            1535           78422          75419          0              0              4   11   6     
1.10/1.12	c 1140           1835           94031          92876          0              0              5   10   6     
1.20/1.23	c 1352           2165           112620         110265         0              0              5   9   6      
1.30/1.34	c 1585           2554           131909         128191         0              0              4   10   6     
1.40/1.49	c 1841           2946           154151         151953         0              0              5   9   6      
1.60/1.60	c 2122           3413           179395         173554         0              0              4   9   6      
1.69/1.75	c 2431           3997           209766         199234         0              0              4   11   6     
1.89/1.93	c 2770           4531           236511         225950         0              0              4   10   6     
2.10/2.11	c 3142           5150           269668         255097         0              0              4   10   6     
2.19/2.24	c 3551           5768           300379         281991         0              0              4   10   6     
2.39/2.49	c 4000           6477           339578         318010         0              0              5   10   6     
2.69/2.76	c 4493           7345           385635         359246         0              0              4   11   6     
2.89/2.97	c 5035           8149           428925         397103         0              0              5   10   7     
3.19/3.29	c 5631           9185           486340         448586         0              0              4   10   6     
3.49/3.56	c 6286           10312          545530         499299         0              0              4   11   7     
3.89/3.95	c 7006           11423          602091         557339         0              0              4   10   6     
4.19/4.27	c 7798           12801          672077         617483         0              0              4   10   6     
4.69/4.75	c 8669           14225          748684         690148         0              0              4   11   6     
5.00/5.07	c 9627           15751          824453         756259         0              0              3   10   7     
5.39/5.44	c 10680          17409          913151         832797         0              0              4   10   7     
5.89/5.97	c 11838          19302          1020944        923417         0              0              4   12   7     
6.49/6.52	c 13111          21305          1119312        1019923        0              0              4   11   6     
7.10/7.15	c 14511          23585          1237747        1130581        0              0              4   11   6     
7.79/7.87	c 16051          26183          1384281        1258515        0              0              4   11   7     
8.49/8.50	c 17745          28905          1522997        1383602        0              0              4   12   6     
9.29/9.35	c 19608          32023          1686035        1531909        0              0              3   10   6     
10.19/10.24	c 21657          35492          1866895        1680725        0              0              4   11   6     
11.39/11.46	c 23910          39369          2089696        1877806        0              0              4   10   6     
12.39/12.49	c 26388          43564          2313433        2071543        0              0              4   11   6     
13.69/13.75	c 29113          47906          2556094        2278433        0              0              3   12   6     
15.39/15.41	c 32110          53048          2861394        2540368        0              0              4   10   6     
16.69/16.71	c 35406          58506          3139303        2785339        0              0              3   11   6     
18.49/18.55	c 39031          64432          3476653        3083841        0              0              3   11   6     
20.10/20.18	c 43018          70697          3841600        3412228        0              0              3   10   6     
22.59/22.61	c 47403          77757          4208032        3767131        0              0              4   11   6     
24.79/24.84	c 52226          85819          4650424        4155627        0              0              4   13   6     
27.69/27.76	c 57531          94249          5115756        4607433        0              0              4   11   6     
30.49/30.56	c 63366          103851         5645955        5088052        0              0              3   11   6     
33.19/33.22	c 69784          114082         6190660        5564848        0              0              4   10   6     
36.59/36.69	c 76843          125716         6797645        6134574        0              0              3   11   6     
40.39/40.46	c 84607          138172         7456161        6753698        0              0              4   10   6     
44.49/44.51	c 93147          152630         8220375        7442482        0              0              3   11   6     
49.59/49.64	c 102541         168458         9071201        8231688        0              0              4   12   6     
54.49/54.52	c 112874         185531         9985440        9060757        0              0              3   12   6     
59.59/59.63	c 124240         204598         10998867       9957558        0              0              3   11   6     
66.39/66.47	c 136742         226038         12201388       11034995       0              0              3   13   6     
72.39/72.48	c 150494         249318         13410366       12104371       0              0              3   13   6     
79.19/79.28	c 165621         273882         14714950       13289701       0              0              3   12   6     
87.99/88.01	c 182260         301360         16191241       14674606       0              0              3   12   6     
96.29/96.37	c 200562         332761         17837500       16134280       0              0              3   11   6     
106.29/106.37	c 220694         365808         19621716       17744781       0              0              3   13   6     
117.49/117.59	c 242839         403564         21815762       19654554       0              0              3   11   6     
127.89/127.96	c 267198         443398         23902157       21514681       0              0              3   15   6     
141.88/141.92	c 293992         485746         26138202       23641695       0              0              3   11   6     
154.88/154.98	c 323465         536246         28772173       25964804       0              0              3   15   6     
171.78/171.89	c 355885         589937         31819656       28602969       0              0              3   11   6     
187.28/187.38	c 391547         646353         34775701       31339165       0              0              3   13   6     
206.58/206.60	c 430775         710293         38144650       34446032       0              0              3   14   6     
226.18/226.20	c 473925         778149         41632507       37708919       0              0              3   13   6     
249.78/249.81	c 521390         858685         45949616       41580641       0              0              3   12   6     
277.38/277.44	c 573601         947336         50825813       45981538       1              0              2   15   6     
305.98/306.03	c 631033         1039157        55995589       50549443       1              0              3   12   6     
336.88/336.96	c 694208         1140932        61340656       55476187       1              0              3   13   6     
372.28/372.37	c 763700         1256649        67587466       60825868       1              0              3   12   6     
409.68/409.77	c 840141         1380924        74123413       66872517       1              0              3   11   6     
449.88/449.96	c 924226         1520084        81434389       73515579       1              0              3   12   6     
495.67/495.78	c 1016719        1678729        89952851       81049247       2              0              2   15   6     
545.27/545.34	c 1118461        1854177        99247506       89287430       2              0              2   13   6     
602.87/602.96	c 1230377        2044494        109559697      98493408       3              0              2   16   6     
610.57/610.68	c First solution is found
610.57/610.68	s SATISFIABLE
610.57/610.68	c restarts              : 75          
610.57/610.68	c conflicts             : 1245921      (2040 /sec)
610.57/610.68	c decisions             : 2070587      (3391 /sec)
610.57/610.68	c propagations          : 99773904    (163389 /sec)
610.57/610.68	c root propagations     : 0           
610.57/610.68	c filter calls          : 110977448      (181736 /sec)
610.57/610.68	c useless filter calls  : 83257011       (75 %)
610.57/610.68	c Memory used           : 36.57 MB
610.57/610.68	c CPU time              : 610.653 s
610.57/610.68	c real time             : 610.686 s
610.57/610.68	
610.57/610.68	c solution 1
610.57/610.68	
610.57/610.68	v <instantiation type='solution'>
610.57/610.68	v <list>x[0] x[1] x[2] x[3] x[4] x[5] x[6] x[7] x[8] x[9] x[10] x[11] x[12] x[13] x[14] x[15] x[16] x[17] x[18] x[19] </list>
610.57/610.68	v <values>18 8 11 15 13 7 0 13 13 7 14 14 7 9 2 18 12 11 8 6 </values>
610.57/610.68	v </instantiation>
610.57/610.68

Verifier Data 

OK

Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15052 MiB free)
  memory of node 1: 16384 MiB (15492 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397262-1568574099/watcher-4397262-1568574099 -o /tmp/evaluation-result-4397262-1568574099/solver-4397262-1568574099 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node121-1568572742-32493 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4397262-1568574099.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=308, runsolver pid=305

[startup+0.10016 s]*
/proc/loadavg: 2.60 2.20 1.61 3/200 309
/proc/meminfo: memFree=31275868/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=29068 memory=5272 CPUtime=0.09 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 1495 0 0 0 9 0 0 0 20 0 1 0 433672589 29765632 1318 33554432000 4194304 6211092 140733146247888 140733146244424 5484984 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 7267 1318 809 493 0 572 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 29068 KiB
Current children cumulated memory: 5272 KiB

[startup+0.209399 s]*
/proc/loadavg: 2.60 2.20 1.61 3/200 309
/proc/meminfo: memFree=31274380/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=30676 memory=6856 CPUtime=0.2 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 1892 0 0 0 20 0 0 0 20 0 1 0 433672589 31412224 1714 33554432000 4194304 6211092 140733146247888 140733146244424 140189902869632 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 7669 1714 809 493 0 974 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 30676 KiB
Current children cumulated memory: 6856 KiB

[startup+0.308919 s]*
/proc/loadavg: 2.60 2.20 1.61 3/200 309
/proc/meminfo: memFree=31272600/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=32032 memory=8176 CPUtime=0.3 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 2249 0 0 0 30 0 0 0 20 0 1 0 433672589 32800768 2044 33554432000 4194304 6211092 140733146247888 140733146244424 5240329 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 8008 2044 810 493 0 1313 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 32032 KiB
Current children cumulated memory: 8176 KiB

[startup+0.70038 s]
/proc/loadavg: 2.60 2.20 1.61 3/200 309
/proc/meminfo: memFree=31269624/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13892 CPUtime=0.7 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 3647 0 0 0 69 1 0 0 20 0 1 0 433672589 38342656 3473 33554432000 4194304 6211092 140733146247888 140733146244424 5037748 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3473 844 493 0 2666 0
Current children cumulated CPU time: 0.7 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13892 KiB

[startup+1.50036 s]
/proc/loadavg: 2.60 2.20 1.61 3/200 309
/proc/meminfo: memFree=31266708/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13892 CPUtime=1.5 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 3647 0 0 0 149 1 0 0 20 0 1 0 433672589 38342656 3473 33554432000 4194304 6211092 140733146247888 140733146245848 5037744 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3473 844 493 0 2666 0
Current children cumulated CPU time: 1.5 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13892 KiB

[startup+3.10948 s]
/proc/loadavg: 2.56 2.20 1.61 3/201 311
/proc/meminfo: memFree=31266532/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=3.1 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 6199 0 0 0 309 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5037801 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+6.30028 s]
/proc/loadavg: 2.56 2.20 1.61 3/201 335
/proc/meminfo: memFree=31265920/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=6.29 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 8751 0 0 0 628 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5038999 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+12.7003 s]
/proc/loadavg: 2.47 2.19 1.61 3/201 335
/proc/meminfo: memFree=31266044/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=12.69 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 11303 0 0 0 1268 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5038999 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+25.5003 s]
/proc/loadavg: 2.40 2.18 1.62 3/201 335
/proc/meminfo: memFree=31266044/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=25.49 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 16407 0 0 0 2548 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5038999 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+51.1095 s]
/proc/loadavg: 2.26 2.17 1.63 3/202 337
/proc/meminfo: memFree=31265740/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=51.1 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 16930 0 0 0 5109 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5038999 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+102.3 s]
/proc/loadavg: 2.10 2.14 1.65 3/201 343
/proc/meminfo: memFree=31265804/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=102.29 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 17449 0 0 0 10228 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5038992 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+162.3 s]
/proc/loadavg: 2.04 2.11 1.67 3/201 347
/proc/meminfo: memFree=31265476/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=162.28 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 17968 0 0 0 16227 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5038999 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+222.3 s]
/proc/loadavg: 1.97 2.08 1.69 3/201 351
/proc/meminfo: memFree=31264812/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=222.28 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 18487 0 0 0 22227 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5037876 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 2.06 1.71 3/200 357
/proc/meminfo: memFree=31264620/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=282.28 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 19006 0 0 0 28227 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5039561 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.05 1.72 3/199 361
/proc/meminfo: memFree=31264496/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=342.28 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 19525 0 0 0 34227 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5039536 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.04 1.74 3/199 365
/proc/meminfo: memFree=31264628/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=402.28 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 20044 0 0 0 40227 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5039029 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.04 1.76 3/199 371
/proc/meminfo: memFree=31264788/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=462.28 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 20563 0 0 0 46227 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5038999 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 462.28 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+522.3 s]
/proc/loadavg: 2.00 2.03 1.77 3/199 375
/proc/meminfo: memFree=31264896/32770624 swapFree=66984548/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=522.27 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 21082 0 0 0 52226 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5039328 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 522.27 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+582.3 s]
/proc/loadavg: 2.00 2.02 1.79 3/200 387
/proc/meminfo: memFree=31264852/32770624 swapFree=66984556/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=582.27 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 21601 0 0 0 58226 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5039026 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 582.27 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+610.689 s]
# the end of solver process 308 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=610.654 s, system=0.015999 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+588.8 s]
/proc/loadavg: 2.00 2.02 1.79 3/201 389
/proc/meminfo: memFree=31264300/32770624 swapFree=66984556/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=588.77 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 21601 0 0 0 58876 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5039536 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 588.77 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+601.6 s]
/proc/loadavg: 2.00 2.02 1.79 3/200 391
/proc/meminfo: memFree=31264864/32770624 swapFree=66984556/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=601.57 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 22051 0 0 0 60156 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5038990 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 601.57 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+604.8 s]
/proc/loadavg: 2.00 2.02 1.79 3/200 391
/proc/meminfo: memFree=31264864/32770624 swapFree=66984556/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=604.77 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 22119 0 0 0 60476 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5039185 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 604.77 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+608 s]*
/proc/loadavg: 2.00 2.02 1.79 3/200 391
/proc/meminfo: memFree=31264864/32770624 swapFree=66984556/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=607.97 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 22119 0 0 0 60796 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5038990 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 607.97 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+609.6 s]
/proc/loadavg: 2.00 2.02 1.79 3/200 391
/proc/meminfo: memFree=31264864/32770624 swapFree=66984556/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=609.57 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 22119 0 0 0 60956 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5038990 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 609.57 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+610.4 s]
/proc/loadavg: 2.00 2.02 1.79 3/200 391
/proc/meminfo: memFree=31264864/32770624 swapFree=66984556/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=610.37 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 22119 0 0 0 61036 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5039042 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 610.37 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

[startup+610.6 s]
/proc/loadavg: 2.00 2.02 1.79 3/200 391
/proc/meminfo: memFree=31264864/32770624 swapFree=66984556/67108860
[pid=308] ppid=305 vsize=37444 memory=13944 CPUtime=610.57 cores=1,3,5,7
/proc/308/stat : 308 (cosoco) R 305 308 32461 0 -1 4202496 22119 0 0 0 61056 1 0 0 20 0 1 0 433672589 38342656 3486 33554432000 4194304 6211092 140733146247888 140733146245848 5039022 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8312316 8317760 28733440 140733146252299 140733146252401 140733146252401 140733146255310 0
/proc/308/statm: 9361 3486 855 493 0 2666 0
Current children cumulated CPU time: 610.57 s
Current children cumulated vsize: 37444 KiB
Current children cumulated memory: 13944 KiB

Child status: 0
Real time (s): 610.69
CPU time (s): 610.67
CPU user time (s): 610.654
CPU system time (s): 0.015999
CPU usage (%): 99.9968
Max. virtual memory (cumulated for all children) (KiB): 37444
Max. memory (cumulated for all children) (KiB): 13944

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 610.654
system time used= 0.015999
maximum resident set size= 14016
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22161
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 10
involuntary context switches= 161


# summary of solver processes directly reported to runsolver:
#   pid: 308
#   total CPU time (s): 610.67
#   total CPU user time (s): 610.654
#   total CPU system time (s): 0.015999

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 2.14258 second user time and 4.24854 second system time

The end

Launcher Data 

Begin job on node121 at 2019-09-15 21:00:57
IDJOB=4397262
IDBENCH=122780
IDSOLVER=2849
FILE ID=node121/4397262-1568574099
RUNJOBID= node121-1568572742-32493
PBS_JOBID= 21703328
Free space on /tmp= 61404 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/Random/Random-RB-3-20-20f/rand-3-20-20-60-632f-11.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397262-1568574099/watcher-4397262-1568574099 -o /tmp/evaluation-result-4397262-1568574099/solver-4397262-1568574099 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node121-1568572742-32493 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4397262-1568574099.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2177eeb766f29dacd684113dff68ce63
RANDOM SEED=1662273607

node121.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31277328 kB
MemAvailable:   31886936 kB
Buffers:          190844 kB
Cached:           723992 kB
SwapCached:        16536 kB
Active:           481352 kB
Inactive:         470068 kB
Active(anon):      26140 kB
Inactive(anon):    52552 kB
Active(file):     455212 kB
Inactive(file):   417516 kB
Unevictable:      110664 kB
Mlocked:          110664 kB
SwapTotal:      67108860 kB
SwapFree:       66984548 kB
Dirty:              4336 kB
Writeback:             0 kB
AnonPages:        229368 kB
Mapped:            41796 kB
Shmem:             33108 kB
Slab:             134328 kB
SReclaimable:     105428 kB
SUnreclaim:        28900 kB
KernelStack:        3840 kB
PageTables:         5904 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     553992 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    182272 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      122240 kB
DirectMap2M:    33423360 kB

Free space on /tmp at the end= 61400 MiB
End job on node121 at 2019-09-15 21:11:08