Trace number 4389788

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerobjective functionCPU timeWall clock time
cosoco 2OPT804126 343.782 343.753

General information on the benchmark

NameWarehouse/Warehouse-m1-s1/
Warehouse-cap081.xml
MD5SUMb3bc9c910d0d9ad9cb0df62a165750df
Bench CategoryCOP (optimization problem)
Best result obtained on this benchmarkOPT
Best value of the objective obtained on this benchmark804126
Best CPU time to get the best result obtained on this benchmark98.5886
Satisfiable
(Un)Satisfiability was proved
Number of variables125
Number of constraints125
Number of domains52
Minimum domain size2
Maximum domain size25
Distribution of domain sizes[{"size":2,"count":25},{"size":24,"count":3},{"size":25,"count":97}]
Minimum variable degree2
Maximum variable degree51
Distribution of variable degrees[{"degree":2,"count":50},{"degree":27,"count":50},{"degree":51,"count":25}]
Minimum constraint arity2
Maximum constraint arity50
Distribution of constraint arities[{"arity":2,"count":50},{"arity":26,"count":50},{"arity":50,"count":25}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"count","count":25},{"type":"element","count":100}]
Optimization problemYES
Type of objectivemin SUM

Quality of the solution as a function of time


Download the above graph as a PDF file / as an EPS file

Solver Data

0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389788-1568323988.xml 
0.00/0.02	c enable optimization
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 125
0.00/0.02	c |            Domain Sizes: 2..25
0.00/0.02	c |
0.00/0.02	c |             Constraints: 126
0.00/0.02	c |                   Arity: 2..75  -- Binary: 50
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          At most: 25
0.00/0.02	c |                          Element Constant: 50
0.00/0.02	c |                          Extension: 50  (nb tuples: 25..25) -- (shared: 0)
0.00/0.02	c |                          Sum: 1
0.00/0.02	c |                          
0.00/0.02	c |               Objective: Minimize Sum
0.00/0.02	
0.00/0.02	c =========================================================================================================
0.00/0.02	o 2322888
0.00/0.02	c    1 calls to solver(id=0): best=2322888 lower=652269 upper=2322887 
0.00/0.03	o 2314063
0.00/0.04	o 2288279
0.00/0.04	c    3 calls to solver(id=0): best=2288279 lower=652269 upper=2288278 
0.00/0.04	o 2278505
0.00/0.05	o 2254865
0.00/0.05	c    5 calls to solver(id=0): best=2254865 lower=652269 upper=2254864 
0.00/0.06	o 2253249
0.00/0.07	o 2188179
0.00/0.07	c    7 calls to solver(id=0): best=2188179 lower=652269 upper=2188178 
0.00/0.08	o 2171648
0.00/0.09	o 2164789
0.00/0.09	c    9 calls to solver(id=0): best=2164789 lower=652269 upper=2164788 
0.00/0.10	o 2158252
0.10/0.11	o 2154331
0.10/0.11	c   11 calls to solver(id=0): best=2154331 lower=652269 upper=2154330 
0.10/0.12	o 2145315
0.10/0.13	o 2132441
0.10/0.13	c   13 calls to solver(id=0): best=2132441 lower=652269 upper=2132440 
0.10/0.14	o 2099855
0.10/0.15	o 2099059
0.10/0.15	c   15 calls to solver(id=0): best=2099059 lower=652269 upper=2099058 
0.10/0.16	o 2059769
0.10/0.16	o 2051960
0.10/0.16	c   17 calls to solver(id=0): best=2051960 lower=652269 upper=2051959 
0.10/0.17	o 2049068
0.10/0.18	o 2041259
0.10/0.18	c   19 calls to solver(id=0): best=2041259 lower=652269 upper=2041258 
0.10/0.19	o 2028726
0.10/0.20	o 2027570
0.10/0.20	c   21 calls to solver(id=0): best=2027570 lower=652269 upper=2027569 
0.10/0.21	o 1834283
0.21/0.22	o 1818207
0.21/0.22	c   23 calls to solver(id=0): best=1818207 lower=652269 upper=1818206 
0.21/0.23	o 1791562
0.21/0.24	o 1783612
0.21/0.24	c   25 calls to solver(id=0): best=1783612 lower=652269 upper=1783611 
0.21/0.25	o 1763855
0.21/0.26	o 1754956
0.21/0.26	c   27 calls to solver(id=0): best=1754956 lower=652269 upper=1754955 
0.21/0.27	o 1753619
0.21/0.28	o 1600083
0.21/0.28	c   29 calls to solver(id=0): best=1600083 lower=652269 upper=1600082 
0.21/0.29	o 1545156
0.21/0.30	o 1527397
0.21/0.30	c   31 calls to solver(id=0): best=1527397 lower=652269 upper=1527396 
0.21/0.31	o 1512406
0.21/0.32	o 1501534
0.21/0.32	c   33 calls to solver(id=0): best=1501534 lower=652269 upper=1501533 
0.31/0.33	o 1476735
0.31/0.33	o 1467062
0.31/0.33	c   35 calls to solver(id=0): best=1467062 lower=652269 upper=1467061 
0.31/0.34	o 1388234
0.31/0.35	o 1374916
0.31/0.35	c   37 calls to solver(id=0): best=1374916 lower=652269 upper=1374915 
0.31/0.36	o 1371855
0.31/0.37	o 1366565
0.31/0.37	c   39 calls to solver(id=0): best=1366565 lower=652269 upper=1366564 
0.31/0.38	o 1364842
0.31/0.39	o 1345003
0.31/0.39	c   41 calls to solver(id=0): best=1345003 lower=652269 upper=1345002 
0.31/0.40	o 1343912
0.31/0.41	o 1321376
0.31/0.41	c   43 calls to solver(id=0): best=1321376 lower=652269 upper=1321375 
0.41/0.42	o 1320250
0.41/0.43	o 1291618
0.41/0.43	c   45 calls to solver(id=0): best=1291618 lower=652269 upper=1291617 
0.41/0.44	o 1286482
0.41/0.45	o 1280096
0.41/0.45	c   47 calls to solver(id=0): best=1280096 lower=652269 upper=1280095 
0.41/0.46	o 1279963
0.41/0.47	o 1273374
0.41/0.47	c   49 calls to solver(id=0): best=1273374 lower=652269 upper=1273373 
0.41/0.47	o 1272698
0.41/0.48	o 1268802
0.41/0.48	c   51 calls to solver(id=0): best=1268802 lower=652269 upper=1268801 
0.41/0.49	o 1265806
0.41/0.50	o 1261844
0.41/0.50	c   53 calls to solver(id=0): best=1261844 lower=652269 upper=1261843 
0.41/0.51	o 1252882
0.51/0.52	o 1252581
0.51/0.52	c   55 calls to solver(id=0): best=1252581 lower=652269 upper=1252580 
0.51/0.53	o 1250179
0.51/0.54	o 1249583
0.51/0.54	c   57 calls to solver(id=0): best=1249583 lower=652269 upper=1249582 
0.51/0.55	o 1245823
0.51/0.55	o 1245724
0.51/0.55	c   59 calls to solver(id=0): best=1245724 lower=652269 upper=1245723 
0.51/0.56	o 1244249
0.51/0.57	o 1238024
0.51/0.57	c   61 calls to solver(id=0): best=1238024 lower=652269 upper=1238023 
0.51/0.58	o 1233755
0.51/0.59	o 1217733
0.51/0.59	c   63 calls to solver(id=0): best=1217733 lower=652269 upper=1217732 
0.51/0.60	o 1197792
0.60/0.61	o 1193656
0.60/0.61	c   65 calls to solver(id=0): best=1193656 lower=652269 upper=1193655 
0.60/0.61	o 1187539
0.60/0.62	o 1089246
0.60/0.62	c   67 calls to solver(id=0): best=1089246 lower=652269 upper=1089245 
0.60/0.63	o 1088320
0.60/0.64	o 1076203
0.60/0.64	c   69 calls to solver(id=0): best=1076203 lower=652269 upper=1076202 
0.60/0.65	o 1059521
0.60/0.66	o 1057021
0.60/0.66	c   71 calls to solver(id=0): best=1057021 lower=652269 upper=1057020 
0.60/0.67	o 1040634
0.60/0.67	o 1039632
0.60/0.67	c   73 calls to solver(id=0): best=1039632 lower=652269 upper=1039631 
0.60/0.68	o 1037363
0.60/0.69	o 1027682
0.60/0.69	c   75 calls to solver(id=0): best=1027682 lower=652269 upper=1027681 
0.69/0.70	o 1027182
0.69/0.71	o 1026015
0.69/0.71	c   77 calls to solver(id=0): best=1026015 lower=652269 upper=1026014 
0.69/0.71	o 1025166
0.69/0.72	o 1024697
0.69/0.72	c   79 calls to solver(id=0): best=1024697 lower=652269 upper=1024696 
0.69/0.73	o 1023525
0.69/0.74	o 1021976
0.69/0.74	c   81 calls to solver(id=0): best=1021976 lower=652269 upper=1021975 
0.69/0.75	o 1018824
0.69/0.75	o 1018414
0.69/0.75	c   83 calls to solver(id=0): best=1018414 lower=652269 upper=1018413 
0.69/0.76	o 1018291
0.69/0.77	o 1018190
0.69/0.77	c   85 calls to solver(id=0): best=1018190 lower=652269 upper=1018189 
0.69/0.78	o 1018144
0.69/0.78	o 1017527
0.69/0.78	c   87 calls to solver(id=0): best=1017527 lower=652269 upper=1017526 
0.69/0.79	o 1014364
0.79/0.80	o 1013211
0.79/0.80	c   89 calls to solver(id=0): best=1013211 lower=652269 upper=1013210 
0.79/0.80	o 1009314
0.79/0.81	o 1009265
0.79/0.81	c   91 calls to solver(id=0): best=1009265 lower=652269 upper=1009264 
0.79/0.82	o 1007077
0.79/0.83	o 1003933
0.79/0.83	c   93 calls to solver(id=0): best=1003933 lower=652269 upper=1003932 
0.79/0.83	o 998153
0.79/0.84	o 967141
0.79/0.84	c   95 calls to solver(id=0): best=967141 lower=652269 upper=967140 
0.79/0.85	o 952147
0.79/0.86	o 951922
0.79/0.86	c   97 calls to solver(id=0): best=951922 lower=652269 upper=951921 
0.79/0.86	o 947626
0.79/0.87	o 902635
0.79/0.87	c   99 calls to solver(id=0): best=902635 lower=652269 upper=902634 
0.79/0.88	o 900316
0.79/0.89	o 900215
0.79/0.89	c  101 calls to solver(id=0): best=900215 lower=652269 upper=900214 
0.79/0.89	o 899813
0.89/0.90	o 895192
0.89/0.90	c  103 calls to solver(id=0): best=895192 lower=652269 upper=895191 
0.89/0.91	o 894992
0.89/0.91	o 892740
0.89/0.91	c  105 calls to solver(id=0): best=892740 lower=652269 upper=892739 
0.89/0.92	o 888054
0.89/0.93	o 887198
0.89/0.93	c  107 calls to solver(id=0): best=887198 lower=652269 upper=887197 
0.89/0.93	o 841518
0.89/0.94	o 838437
0.89/0.94	c  109 calls to solver(id=0): best=838437 lower=652269 upper=838436 
0.89/0.95	o 837918
0.89/0.95	o 825345
0.89/0.95	c  111 calls to solver(id=0): best=825345 lower=652269 upper=825344 
0.89/0.96	o 818411
0.89/0.97	o 818008
0.89/0.97	c  113 calls to solver(id=0): best=818008 lower=652269 upper=818007 
0.89/0.97	o 817918
0.89/0.98	o 813104
0.89/0.98	c  115 calls to solver(id=0): best=813104 lower=652269 upper=813103 
0.89/0.98	o 810125
0.89/0.99	o 808944
0.89/0.99	c  117 calls to solver(id=0): best=808944 lower=652269 upper=808943 
0.89/1.00	o 807673
1.00/1.02	o 807483
1.00/1.02	c  119 calls to solver(id=0): best=807483 lower=652269 upper=807482 
1.19/1.21	o 807417
1.19/1.21	o 806622
1.19/1.21	c  121 calls to solver(id=0): best=806622 lower=652269 upper=806621 
1.39/1.42	o 805803
8.69/8.71	o 805350
8.69/8.71	c  123 calls to solver(id=0): best=805350 lower=652269 upper=805349 
8.69/8.71	o 805303
8.69/8.72	o 805248
8.69/8.72	c  125 calls to solver(id=0): best=805248 lower=652269 upper=805247 
8.69/8.72	o 805060
21.59/21.61	o 804126
21.59/21.61	c  127 calls to solver(id=0): best=804126 lower=652269 upper=804125 
343.72/343.75	s OPTIMUM FOUND
343.72/343.75	c call to solver        : 128
343.72/343.75	c
343.72/343.75	c restarts              : 127         
343.72/343.75	c conflicts             : 424070       (1234 /sec)
343.72/343.75	c decisions             : 1668550      (4854 /sec)
343.72/343.75	c propagations          : 519967483   (1512510 /sec)
343.72/343.75	c root propagations     : 2522        
343.72/343.75	c filter calls          : 872716278      (2538606 /sec)
343.72/343.75	c useless filter calls  : 769698987      (88 %)
343.72/343.75	c Memory used           : 27.23 MB
343.72/343.75	c Best bound time (wc)  : 21.608 s
343.72/343.75	c CPU time              : 343.778 s
343.72/343.75	c real time             : 343.748 s
343.72/343.75	
343.72/343.75	
343.72/343.75	v <instantiation type='solution' cost='804126'>
343.72/343.75	v <list>c[0] c[10] c[11] c[12] c[13] c[14] c[15] c[16] c[17] c[18] c[19] c[1] c[20] c[21] c[22] c[23] c[24] c[25] c[26] c[27] c[28] c[29] c[2] c[30] c[31] c[32] c[33] c[34] c[35] c[36] c[37] c[38] c[39] c[3] c[40] c[41] c[42] c[43] c[44] c[45] c[46] c[47] c[48] c[49] c[4] c[5] c[6] c[7] c[8] c[9] o[0] o[10] o[11] o[12] o[13] o[14] o[15] o[16] o[17] o[18] o[19] o[1] o[20] o[21] o[22] o[23] o[24] o[2] o[3] o[4] o[5] o[6] o[7] o[8] o[9] s[0] s[10] s[11] s[12] s[13] s[14] s[15] s[16] s[17] s[18] s[19] s[1] s[20] s[21] s[22] s[23] s[24] s[25] s[26] s[27] s[28] s[29] s[2] s[30] s[31] s[32] s[33] s[34] s[35] s[36] s[37] s[38] s[39] s[3] s[40] s[41] s[42] s[43] s[44] s[45] s[46] s[47] s[48] s[49] s[4] s[5] s[6] s[7] s[8] s[9] </list>
343.72/343.75	v <values>3847 12638 2463 5185 1953 7310 8135 2542 11423 3542 5467 1838 693 14919 0 4883 8099 3268 124051 1601 5121 12480 4914 3727 2398 13451 130895 5378 4886 32993 15076 23696 3636 12183 5043 13627 7885 9331 68042 21302 8172 1756 11949 3335 955 6421 28499 8861 1211 546 1 1 0 1 0 0 0 1 1 0 1 1 0 0 1 1 1 0 1 0 1 1 1 1 0 7 3 10 5 0 6 7 3 8 3 6 6 3 6 10 0 19 10 12 10 19 0 0 0 10 0 16 19 19 17 5 23 24 24 19 3 7 6 22 23 23 6 24 19 7 0 1 5 7 7 </values>
343.72/343.75	v </instantiation>
343.72/343.75	

Verifier Data

OK	804126

Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (13462 MiB free)
  memory of node 1: 16384 MiB (2115 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389788-1568323988/watcher-4389788-1568323988 -o /tmp/evaluation-result-4389788-1568323988/solver-4389788-1568323988 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node116-1568311136-6438 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389788-1568323988.xml 

running on 4 cores: 0-3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=9118, runsolver pid=9115
Current StackSize limit: 8192 KiB


[startup+0.100154 s]*
/proc/loadavg: 2.06 2.09 2.07 3/202 9119
/proc/meminfo: memFree=15949736/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4484 CPUtime=0.1 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 1303 0 0 0 10 0 0 0 20 0 1 0 408340499 28553216 1121 33554432000 4194304 6210612 140723380278496 140723380275032 5155856 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1121 875 493 0 276 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4484 KiB

[startup+0.210894 s]*
/proc/loadavg: 2.06 2.09 2.07 3/202 9119
/proc/meminfo: memFree=15948992/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4484 CPUtime=0.21 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 1305 0 0 0 21 0 0 0 20 0 1 0 408340499 28553216 1121 33554432000 4194304 6210612 140723380278496 140723380275032 5157738 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1121 875 493 0 276 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4484 KiB

[startup+0.310521 s]*
/proc/loadavg: 2.06 2.09 2.07 3/202 9119
/proc/meminfo: memFree=15948248/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4484 CPUtime=0.31 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 1306 0 0 0 31 0 0 0 20 0 1 0 408340499 28553216 1121 33554432000 4194304 6210612 140723380278496 140723380275032 5249664 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1121 875 493 0 276 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4484 KiB

[startup+0.700262 s]
/proc/loadavg: 2.06 2.09 2.07 3/202 9119
/proc/meminfo: memFree=15946884/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4484 CPUtime=0.69 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 1307 0 0 0 69 0 0 0 20 0 1 0 408340499 28553216 1121 33554432000 4194304 6210612 140723380278496 140723380275032 5157704 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1121 875 493 0 276 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4484 KiB

[startup+1.50029 s]
/proc/loadavg: 2.06 2.09 2.07 3/202 9119
/proc/meminfo: memFree=15943124/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4484 CPUtime=1.49 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 1308 0 0 0 149 0 0 0 20 0 1 0 408340499 28553216 1121 33554432000 4194304 6210612 140723380278496 140723380266376 5249712 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1121 875 493 0 276 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4484 KiB

[startup+3.1106 s]
/proc/loadavg: 2.06 2.09 2.07 3/202 9119
/proc/meminfo: memFree=15929740/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4588 CPUtime=3.1 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 1482 0 0 0 310 0 0 0 20 0 1 0 408340499 28553216 1147 33554432000 4194304 6210612 140723380278496 140723380276632 5249729 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1147 888 493 0 276 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4588 KiB

[startup+6.30028 s]
/proc/loadavg: 2.06 2.09 2.07 3/202 9119
/proc/meminfo: memFree=15909668/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4588 CPUtime=6.29 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 1656 0 0 0 629 0 0 0 20 0 1 0 408340499 28553216 1147 33554432000 4194304 6210612 140723380278496 140723380276632 5249712 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1147 888 493 0 276 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4588 KiB

[startup+12.7003 s]
/proc/loadavg: 2.05 2.09 2.07 3/202 9119
/proc/meminfo: memFree=15868996/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4588 CPUtime=12.69 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 1847 0 0 0 1269 0 0 0 20 0 1 0 408340499 28553216 1147 33554432000 4194304 6210612 140723380278496 140723380276632 5249727 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1147 888 493 0 276 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4588 KiB

[startup+25.5003 s]
/proc/loadavg: 2.04 2.08 2.07 3/202 9119
/proc/meminfo: memFree=15781824/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4588 CPUtime=25.49 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 2212 0 0 0 2549 0 0 0 20 0 1 0 408340499 28553216 1147 33554432000 4194304 6210612 140723380278496 140723380266376 5192928 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1147 888 493 0 276 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4588 KiB

[startup+51.1106 s]
/proc/loadavg: 2.03 2.08 2.07 3/202 9122
/proc/meminfo: memFree=15607388/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4588 CPUtime=51.11 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 2386 0 0 0 5111 0 0 0 20 0 1 0 408340499 28553216 1147 33554432000 4194304 6210612 140723380278496 140723380266376 5206688 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1147 888 493 0 276 0
Current children cumulated CPU time: 51.11 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4588 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 2.07 2.06 3/202 9125
/proc/meminfo: memFree=15262844/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4588 CPUtime=102.3 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 2560 0 0 0 10230 0 0 0 20 0 1 0 408340499 28553216 1147 33554432000 4194304 6210612 140723380278496 140723380266376 5397294 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1147 888 493 0 276 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4588 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/200 9129
/proc/meminfo: memFree=14857644/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4588 CPUtime=162.3 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 2734 0 0 0 16230 0 0 0 20 0 1 0 408340499 28553216 1147 33554432000 4194304 6210612 140723380278496 140723380266376 5185921 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1147 888 493 0 276 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4588 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 9135
/proc/meminfo: memFree=14452676/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4588 CPUtime=222.31 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 2908 0 0 0 22231 0 0 0 20 0 1 0 408340499 28553216 1147 33554432000 4194304 6210612 140723380278496 140723380266376 5155436 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1147 888 493 0 276 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4588 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 9139
/proc/meminfo: memFree=14048252/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4588 CPUtime=282.31 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 2908 0 0 0 28231 0 0 0 20 0 1 0 408340499 28553216 1147 33554432000 4194304 6210612 140723380278496 140723380266376 5008637 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1147 888 493 0 276 0
Current children cumulated CPU time: 282.31 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4588 KiB

[startup+342.3 s]
/proc/loadavg: 2.19 2.10 2.07 3/199 9207
/proc/meminfo: memFree=29393612/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4588 CPUtime=342.32 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 3082 0 0 0 34232 0 0 0 20 0 1 0 408340499 28553216 1147 33554432000 4194304 6210612 140723380278496 140723380266376 5098833 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1147 888 493 0 276 0
Current children cumulated CPU time: 342.32 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4588 KiB

[startup+343.753 s]
# the end of solver process 9118 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=343.778 s, system=0.004 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+342.4 s]
/proc/loadavg: 2.19 2.10 2.07 3/199 9207
/proc/meminfo: memFree=29393612/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4588 CPUtime=342.42 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 3082 0 0 0 34242 0 0 0 20 0 1 0 408340499 28553216 1147 33554432000 4194304 6210612 140723380278496 140723380266376 5249724 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1147 888 493 0 276 0
Current children cumulated CPU time: 342.42 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4588 KiB

[startup+343.2 s]
/proc/loadavg: 2.19 2.10 2.07 3/199 9207
/proc/meminfo: memFree=29382948/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4588 CPUtime=343.22 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 3082 0 0 0 34322 0 0 0 20 0 1 0 408340499 28553216 1147 33554432000 4194304 6210612 140723380278496 140723380266376 5249729 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1147 888 493 0 276 0
Current children cumulated CPU time: 343.22 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4588 KiB

[startup+343.6 s]
/proc/loadavg: 2.19 2.10 2.07 3/199 9207
/proc/meminfo: memFree=29382948/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4588 CPUtime=343.62 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 3082 0 0 0 34362 0 0 0 20 0 1 0 408340499 28553216 1147 33554432000 4194304 6210612 140723380278496 140723380266376 5249724 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1147 888 493 0 276 0
Current children cumulated CPU time: 343.62 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4588 KiB

[startup+343.7 s]
/proc/loadavg: 2.19 2.10 2.07 3/199 9207
/proc/meminfo: memFree=29382948/32770688 swapFree=66960952/67108860
[pid=9118] ppid=9115 vsize=27884 memory=4588 CPUtime=343.72 cores=0-3
/proc/9118/stat : 9118 (cosoco) R 9115 9118 6407 0 -1 4202496 3082 0 0 0 34372 0 0 0 20 0 1 0 408340499 28553216 1147 33554432000 4194304 6210612 140723380278496 140723380266376 5133234 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 34480128 140723380282379 140723380282481 140723380282481 140723380285390 0
/proc/9118/statm: 6971 1147 888 493 0 276 0
Current children cumulated CPU time: 343.72 s
Current children cumulated vsize: 27884 KiB
Current children cumulated memory: 4588 KiB

Child status: 0
Real time (s): 343.753
CPU time (s): 343.782
CPU user time (s): 343.778
CPU system time (s): 0.004
CPU usage (%): 100.008
Max. virtual memory (cumulated for all children) (KiB): 27884
Max. memory (cumulated for all children) (KiB): 4588

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 343.778
system time used= 0.004
maximum resident set size= 4660
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3134
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14
involuntary context switches= 90


# summary of solver processes directly reported to runsolver:
#   pid: 9118
#   total CPU time (s): 343.782
#   total CPU user time (s): 343.778
#   total CPU system time (s): 0.004

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 1.42242 second user time and 2.58643 second system time

The end

Launcher Data

Begin job on node116 at 2019-09-12 23:32:27
IDJOB=4389788
IDBENCH=123246
IDSOLVER=2829
FILE ID=node116/4389788-1568323988
RUNJOBID= node116-1568311136-6438
PBS_JOBID= 21701125
Free space on /tmp= 56884 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/Warehouse/Warehouse-m1-s1/Warehouse-cap081.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389788-1568323988/watcher-4389788-1568323988 -o /tmp/evaluation-result-4389788-1568323988/solver-4389788-1568323988 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node116-1568311136-6438 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389788-1568323988.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b3bc9c910d0d9ad9cb0df62a165750df
RANDOM SEED=608615907

node116.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        15951428 kB
MemAvailable:   17918544 kB
Buffers:           77124 kB
Cached:          2168028 kB
SwapCached:        46464 kB
Active:         14716976 kB
Inactive:        1482340 kB
Active(anon):   13906128 kB
Inactive(anon):    88648 kB
Active(file):     810848 kB
Inactive(file):  1393692 kB
Unevictable:      110244 kB
Mlocked:          110244 kB
SwapTotal:      67108860 kB
SwapFree:       66960952 kB
Dirty:              2608 kB
Writeback:             0 kB
AnonPages:      14036768 kB
Mapped:            44528 kB
Shmem:             31868 kB
Slab:             185872 kB
SReclaimable:     156820 kB
SUnreclaim:        29052 kB
KernelStack:        3808 kB
PageTables:        32336 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:   14444612 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:   3203072 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116160 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 56880 MiB
End job on node116 at 2019-09-12 23:38:11