Trace number 4397960

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.O parallelUNSAT 130.366 29.4377

General information on the benchmark

NameRandom/Random-m1-5-12-12/
rand-5-12-12-200-12442-22.xml
MD5SUM1f678c7b1175962864f0f6df2117d050
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark3.7944
Satisfiable
(Un)Satisfiability was proved
Number of variables12
Number of constraints200
Number of domains1
Minimum domain size12
Maximum domain size12
Distribution of domain sizes[{"size":12,"count":12}]
Minimum variable degree76
Maximum variable degree93
Distribution of variable degrees[{"degree":76,"count":2},{"degree":78,"count":1},{"degree":80,"count":1},{"degree":81,"count":2},{"degree":82,"count":1},{"degree":83,"count":1},{"degree":89,"count":1},{"degree":90,"count":1},{"degree":91,"count":1},{"degree":93,"count":1}]
Minimum constraint arity5
Maximum constraint arity5
Distribution of constraint arities[{"arity":5,"count":200}]
Number of extensional constraints200
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":200}]
Optimization problemNO
Type of objective

Solver Data 

15.01/14.96	c root propagations     : 0           
15.01/14.96	c restarts enabled, print stats at every restarts
15.01/14.96	c
15.01/14.96	c
15.01/14.96	c
15.01/14.96	c This is cosoco 2.00 --  
15.01/14.96	c
15.01/14.96	c command line: cosoco -model -nbcores=8 HOME/instance-4397960-1568598942.xml 
15.01/14.96	c ========================================[ Problem Statistics ]===========================================
15.01/14.96	c |                                                                                                       
15.01/14.96	c |  Parse time        :        14.51 s 
15.01/14.96	c |
15.01/14.96	c |               Variables: 12
15.01/14.96	c |            Domain Sizes: 12..12
15.01/14.96	c |
15.01/14.96	c |             Constraints: 200
15.01/14.96	c |                   Arity: 5..5
15.01/14.96	c | 
15.01/14.96	c |                   Types: 
15.01/14.96	c |                          Extension: 200  (nb tuples: 12442..12442) -- (shared: 0)
15.01/14.96	c |                          
15.01/14.96	c =========================================================================================================
15.01/14.96	c Parallel mode: Portfolio
15.01/14.96	c [pFactory][Group N°0] created (threads:8).
15.01/14.96	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
15.01/14.96	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
15.01/14.96	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
15.01/14.96	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
15.01/14.96	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
15.01/14.96	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
15.01/14.96	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
15.01/14.96	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
15.01/14.96	c [pFactory][Group N°0] concurrent mode: enabled.
15.01/14.96	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
15.01/14.96	c [pFactory][Group N°0] task 7 launched on thread 1.
15.01/14.96	c [pFactory][Group N°0] task 6 launched on thread 0.
15.01/14.96	c [pFactory][Group N°0] task 5 launched on thread 2.
15.01/14.96	c [pFactory][Group N°0] task 4 launched on thread 6.
15.01/14.96	c [pFactory][Group N°0] task 3 launched on thread 7.
15.01/14.96	c [pFactory][Group N°0] task 2 launched on thread 5.
15.01/14.96	c [pFactory][Group N°0] task 1 launched on thread 3.
15.01/14.96	c [pFactory][Group N°0] task 0 launched on thread 4.
15.01/14.96	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
15.01/14.97	c root propagations     : 0           
15.01/14.97	c restarts enabled, print stats at every restarts
15.01/14.97	c
15.01/14.97	c
15.01/14.97	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
15.01/14.97	c root propagations     : 0           
15.01/14.97	c restarts enabled, print stats at every restarts
15.01/14.97	c
15.01/14.97	c
15.01/14.97	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
15.71/15.04	c root propagations     : 0           
15.71/15.04	c restarts enabled, print stats at every restarts
15.71/15.04	c
15.71/15.04	c
15.71/15.04	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
15.71/15.06	c root propagations     : 0           
15.71/15.06	c restarts enabled, print stats at every restarts
15.71/15.06	c
15.71/15.06	c
15.71/15.06	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
15.71/15.06	c root propagations     : 0           
15.71/15.06	c restarts enabled, print stats at every restarts
15.71/15.06	c
15.71/15.06	c
15.71/15.06	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
15.71/15.07	c root propagations     : 0           
15.71/15.07	c restarts enabled, print stats at every restarts
15.71/15.07	c
15.71/15.07	c
15.71/15.07	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
16.58/15.13	c root propagations     : 0           
16.58/15.13	c restarts enabled, print stats at every restarts
16.58/15.13	c
16.58/15.13	c
16.58/15.13	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
24.56/16.13	c 32             38             6739           1989           0              0              3   3   2      
25.36/16.22	c 32             38             6823           1806           0              0              3   3   2      
25.36/16.22	c 33             41             7052           2019           0              0              3   3   1      
25.36/16.24	c 32             38             7817           2200           0              0              3   3   2      
26.09/16.31	c 33             41             8082           2270           0              0              3   3   1      
26.09/16.33	c 33             41             7136           1836           0              0              3   3   1      
27.69/16.57	c 32             38             6686           2125           0              0              3   3   2      
28.49/16.67	c 33             41             6946           2160           0              0              3   3   1      
34.08/17.39	c 64             78             13555          3855           0              0              3   3   2      
34.88/17.48	c 65             81             13868          3885           0              0              3   3   1      
35.68/17.55	c 64             78             15600          4387           0              0              3   3   2      
35.68/17.57	c 66             84             14184          3915           0              0              3   3   1      
36.47/17.62	c 65             81             15865          4457           0              0              3   3   1      
36.47/17.67	c 67             87             14497          3945           0              0              3   3   1      
37.28/17.70	c 66             84             16189          4505           0              0              3   3   1      
37.28/17.77	c 67             87             16454          4575           0              0              3   3   1      
38.07/17.83	c 64             78             14399          3646           0              0              3   3   2      
38.07/17.84	c 64             78             13390          4098           0              0              3   3   2      
38.88/17.93	c 65             81             13650          4133           0              0              3   3   1      
38.88/17.93	c 65             81             14700          3676           0              0              3   3   1      
39.67/18.04	c 66             84             15013          3706           0              0              3   3   1      
39.67/18.06	c 66             84             14010          4166           0              0              3   3   1      
40.54/18.14	c 67             87             14270          4201           0              0              3   3   1      
40.54/18.14	c 67             87             15329          3736           0              0              3   3   1      
43.66/18.51	c 101            114            18966          6108           0              0              3   3   2      
46.86/18.98	c 101            118            23411          5710           1              0              3   3   2      
50.05/19.32	c 101            118            23792          7648           3              0              3   3   2      
54.84/19.95	c 128            157            30177          8823           0              0              3   3   2      
55.64/20.01	c 101            120            25478          7106           4              0              3   3   2      
55.64/20.03	c 128            159            28125          7660           0              0              3   3   2      
56.51/20.13	c 129            160            30773          8882           4              0              3   3   1      
56.51/20.19	c 130            163            31032          8930           4              0              3   3   1      
57.31/20.23	c 129            162            28628          7694           4              0              3   3   1      
57.31/20.28	c 131            166            31451          8985           4              0              3   3   1      
58.04/20.32	c 130            165            28944          7723           4              0              3   3   1      
58.04/20.33	c 132            169            31710          9033           4              0              3   3   1      
58.83/20.40	c 128            158            27447          8162           1              0              3   3   2      
58.83/20.40	c 131            168            29257          7753           4              0              3   3   1      
58.83/20.42	c 133            172            32129          9088           4              0              3   3   1      
58.83/20.48	c 134            175            32388          9136           4              0              3   3   1      
58.83/20.49	c 132            171            29573          7782           4              0              3   3   1      
59.63/20.58	c 135            178            32807          9191           4              0              3   3   1      
59.63/20.59	c 133            174            29886          7812           4              0              3   3   1      
60.43/20.61	c 129            161            28003          8193           4              0              3   3   1      
60.43/20.68	c 134            177            30202          7841           4              0              3   3   1      
61.23/20.70	c 130            164            28331          8225           4              0              3   3   1      
61.23/20.76	c 135            180            30515          7871           4              0              3   3   1      
62.03/20.81	c 131            167            28713          8253           4              0              3   3   1      
62.83/20.90	c 132            170            29041          8285           4              0              3   3   1      
63.63/21.01	c 133            173            29423          8313           4              0              3   3   1      
63.63/21.02	c 128            159            29319          6950           1              0              3   3   2      
63.63/21.10	c 134            176            29751          8345           4              0              3   3   1      
65.30/21.21	c 135            179            30133          8373           4              0              3   3   1      
65.30/21.23	c 129            162            29826          7000           4              0              3   3   1      
66.02/21.34	c 130            165            30184          7046           4              0              3   3   1      
66.82/21.45	c 131            168            30517          7093           4              0              3   3   1      
67.62/21.56	c 132            171            30875          7139           4              0              3   3   1      
68.42/21.66	c 133            174            31191          7168           4              0              3   3   1      
69.22/21.76	c 134            177            31504          7198           4              0              3   3   1      
70.02/21.86	c 135            180            31820          7227           4              0              3   3   1      
81.26/23.25	c 211            248            46870          12158          5              0              3   3   2      
84.39/23.62	c 211            246            45680          13431          4              0              3   3   2      
87.59/24.02	c 211            250            52550          15405          5              0              3   3   2      
91.57/24.54	c 256            318            58045          17064          6              0              3   3   2      
93.17/24.70	c 257            321            58688          17145          7              0              3   3   1      
93.17/24.75	c 258            324            58949          17209          7              0              3   3   1      
93.97/24.85	c 259            327            59425          17287          7              0              3   3   1      
94.77/24.90	c 260            330            59686          17351          7              0              3   3   1      
94.77/24.99	c 261            333            60162          17429          7              0              3   3   1      
95.57/25.01	c 211            253            53106          15324          5              0              3   3   2      
95.57/25.05	c 262            336            60423          17493          7              0              3   3   1      
96.43/25.17	c 263            339            60975          17571          7              0              3   3   1      
97.23/25.23	c 256            323            57017          14682          6              0              3   3   2      
97.23/25.23	c 264            342            61236          17634          7              0              3   3   1      
97.96/25.32	c 265            345            61712          17711          7              0              3   3   1      
97.96/25.38	c 266            348            61973          17774          7              0              3   3   1      
97.96/25.38	c 257            326            57507          14710          7              0              3   3   1      
98.76/25.47	c 267            351            62449          17851          7              0              3   3   1      
98.76/25.48	c 258            329            57888          14746          7              0              3   3   1      
99.57/25.58	c 268            354            62854          17915          7              0              3   3   1      
100.35/25.62	c 259            332            58368          14773          7              0              3   3   1      
100.35/25.68	c 269            357            63406          17977          7              0              3   3   1      
101.15/25.71	c 260            335            58749          14808          7              0              3   3   1      
101.15/25.75	c 270            360            63722          18040          7              0              3   3   1      
101.95/25.81	c 261            338            59140          14834          7              0              3   3   1      
101.95/25.84	c 271            363            64274          18102          7              0              3   3   1      
102.75/25.90	c 262            341            59521          14869          7              0              3   3   1      
103.56/26.03	c 263            344            59993          14896          7              0              3   3   1      
104.42/26.17	c 264            347            60661          14945          7              0              3   3   1      
105.22/26.27	c 265            350            61071          14989          7              0              3   3   1      
105.95/26.38	c 266            353            61658          15037          7              0              3   3   1      
105.95/26.38	c 256            324            61007          15789          6              0              3   3   2      
106.74/26.47	c 267            356            62068          15081          7              0              3   3   1      
107.59/26.53	c 257            327            61453          15829          7              0              3   3   1      
107.59/26.58	c 268            359            62655          15129          7              0              3   3   1      
108.34/26.65	c 258            330            62003          15865          7              0              3   3   1      
108.34/26.67	c 269            362            63065          15173          7              0              3   3   1      
109.14/26.71	c 259            333            62263          15900          7              0              3   3   1      
109.14/26.79	c 270            365            63652          15221          7              0              3   3   1      
109.94/26.83	c 260            336            62813          15936          7              0              3   3   1      
109.94/26.90	c 271            368            64143          15266          7              0              3   3   1      
110.74/26.93	c 261            339            63271          15989          7              0              3   3   1      
112.40/27.11	c 262            342            64178          16093          7              0              3   3   1      
112.40/27.19	c 263            345            64530          16144          7              0              3   3   1      
113.20/27.27	c 256            329            66303          14795          7              0              3   3   2      
113.93/27.32	c 264            348            65344          16247          7              0              3   3   1      
114.73/27.41	c 257            332            66885          14854          7              0              3   3   1      
114.73/27.41	c 265            351            65777          16299          7              0              3   3   1      
115.61/27.53	c 258            335            67413          14899          7              0              3   3   1      
115.61/27.57	c 266            354            66673          16411          7              0              3   3   1      
116.32/27.62	c 259            338            67864          14955          7              0              3   3   1      
116.32/27.64	c 267            357            67025          16461          7              0              3   3   1      
117.12/27.71	c 260            341            68310          14999          7              0              3   3   1      
117.12/27.77	c 268            360            67839          16572          7              0              3   3   1      
117.12/27.79	c 261            344            68761          15055          7              0              3   3   1      
117.93/27.84	c 269            363            68191          16622          7              0              3   3   1      
117.93/27.88	c 262            347            69207          15099          7              0              3   3   1      
118.73/27.99	c 270            366            69119          16733          7              0              3   3   1      
119.53/28.01	c 263            350            69845          15178          7              0              3   3   1      
120.39/28.11	c 271            369            69714          16789          7              0              3   3   1      
120.39/28.14	c 264            353            70937          15321          7              0              3   3   1      
121.19/28.28	c 265            356            71685          15404          7              0              3   3   1      
121.92/28.36	c 266            359            72184          15560          7              0              3   3   1      
122.71/28.45	c 267            362            72652          15620          7              0              3   3   1      
123.51/28.53	c 268            364            73242          15707          7              0              2   2   1      
124.31/28.62	c 269            367            73712          15767          8              0              3   3   1      
125.11/28.71	c 270            369            74241          15843          8              0              2   2   1      
125.91/28.80	c 271            372            74721          15885          8              0              3   3   1      
129.90/29.36	c [pFactory][Group N°0] concurent mode: thread 7 has won with the task 3.
129.90/29.36	c [pFactory][Group N°0] Thread N°0 is joined.
129.90/29.36	c [pFactory][Group N°0] Thread N°1 is joined.
129.90/29.36	c [pFactory][Group N°0] Thread N°2 is joined.
129.90/29.36	c [pFactory][Group N°0] Thread N°3 is joined.
129.90/29.36	c [pFactory][Group N°0] Thread N°4 is joined.
129.90/29.36	c [pFactory][Group N°0] Thread N°5 is joined.
129.90/29.36	c [pFactory][Group N°0] Thread N°6 is joined.
129.90/29.36	c [pFactory][Group N°0] Thread N°7 is joined.
129.90/29.36	c [pFactory][Group N°0] Return Code of the winner:2 (Thread N°7)
129.90/29.36	s UNSATISFIABLE
129.90/29.36	c restarts              : 30          
129.90/29.36	c conflicts             : 285          (2 /sec)
129.90/29.36	c decisions             : 390          (3 /sec)
129.90/29.36	c propagations          : 17083       (133 /sec)
129.90/29.36	c root propagations     : 0           
129.90/29.36	c filter calls          : 79175          (619 /sec)
129.90/29.36	c useless filter calls  : 75014          (94 %)
129.90/29.36	c Memory used           : 1728.36 MB
129.90/29.36	c CPU time              : 127.969 s
129.90/29.36	c real time             : 29.3386 s
129.90/29.36

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15172 MiB free)
  memory of node 1: 16384 MiB (15374 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397960-1568598942/watcher-4397960-1568598942 -o /tmp/evaluation-result-4397960-1568598942/solver-4397960-1568598942 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node105-1568594482-28906 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4397960-1568598942.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=29050, runsolver pid=29047
Current StackSize limit: 8192 KiB


[startup+0.100172 s]*
/proc/loadavg: 1.89 1.22 1.34 2/193 29051
/proc/meminfo: memFree=31269128/32770624 swapFree=66938988/67108860
[pid=29050] ppid=29047 vsize=33592 memory=9400 CPUtime=0.08 cores=0-7
/proc/29050/stat : 29050 (cosoco) R 29047 29050 28879 0 -1 4202496 2633 0 1 0 8 0 0 0 20 0 1 0 436152582 34398208 2350 33554432000 4194304 6211092 140728180206016 140728180202552 5494428 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
/proc/29050/statm: 8398 2350 808 493 0 1703 0
Current children cumulated CPU time: 0.08 s
Current children cumulated vsize: 33592 KiB
Current children cumulated memory: 9400 KiB

[startup+0.209242 s]*
/proc/loadavg: 1.89 1.22 1.34 2/193 29051
/proc/meminfo: memFree=31248760/32770624 swapFree=66938988/67108860
[pid=29050] ppid=29047 vsize=39116 memory=14148 CPUtime=0.19 cores=0-7
/proc/29050/stat : 29050 (cosoco) R 29047 29050 28879 0 -1 4202496 3884 0 1 0 19 0 0 0 20 0 1 0 436152582 40054784 3537 33554432000 4194304 6211092 140728180206016 140728180202552 5818592 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
/proc/29050/statm: 9779 3537 808 493 0 3084 0
Current children cumulated CPU time: 0.19 s
Current children cumulated vsize: 39116 KiB
Current children cumulated memory: 14148 KiB

[startup+0.472817 s]*
/proc/loadavg: 1.89 1.22 1.34 2/193 29051
/proc/meminfo: memFree=31236092/32770624 swapFree=66938988/67108860
[pid=29050] ppid=29047 vsize=59684 memory=33156 CPUtime=0.46 cores=0-7
/proc/29050/stat : 29050 (cosoco) R 29047 29050 28879 0 -1 4202496 8589 0 1 0 45 1 0 0 20 0 1 0 436152582 61116416 8289 33554432000 4194304 6211092 140728180206016 140728180202552 5818385 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
/proc/29050/statm: 14921 8289 808 493 0 8226 0
Current children cumulated CPU time: 0.46 s
Current children cumulated vsize: 59684 KiB
Current children cumulated memory: 33156 KiB

[startup+0.708608 s]
/proc/loadavg: 1.89 1.22 1.34 2/193 29051
/proc/meminfo: memFree=31233088/32770624 swapFree=66938988/67108860
[pid=29050] ppid=29047 vsize=75108 memory=47148 CPUtime=0.68 cores=0-7
/proc/29050/stat : 29050 (cosoco) R 29047 29050 28879 0 -1 4202496 12120 0 1 0 67 1 0 0 20 0 1 0 436152582 76910592 11787 33554432000 4194304 6211092 140728180206016 140728180202552 140097638336080 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
/proc/29050/statm: 18777 11787 808 493 0 12082 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 75108 KiB
Current children cumulated memory: 47148 KiB

[startup+1.50031 s]
/proc/loadavg: 1.89 1.22 1.34 2/193 29051
/proc/meminfo: memFree=31207764/32770624 swapFree=66938988/67108860
[pid=29050] ppid=29047 vsize=131668 memory=98892 CPUtime=1.47 cores=0-7
/proc/29050/stat : 29050 (cosoco) R 29047 29050 28879 0 -1 4202496 25063 0 1 0 144 3 0 0 20 0 1 0 436152582 134828032 24723 33554432000 4194304 6211092 140728180206016 140728180203288 5484854 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
/proc/29050/statm: 32917 24723 808 493 0 26222 0
Current children cumulated CPU time: 1.47 s
Current children cumulated vsize: 131668 KiB
Current children cumulated memory: 98892 KiB

[startup+3.10031 s]*
/proc/loadavg: 1.82 1.22 1.34 2/193 29051
/proc/meminfo: memFree=31080028/32770624 swapFree=66938988/67108860
[pid=29050] ppid=29047 vsize=243084 memory=201032 CPUtime=3.09 cores=0-7
/proc/29050/stat : 29050 (cosoco) R 29047 29050 28879 0 -1 4202496 51029 0 1 0 303 6 0 0 20 0 1 0 436152582 248918016 50258 33554432000 4194304 6211092 140728180206016 140728180203288 5240329 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
/proc/29050/statm: 60771 50258 809 493 0 54076 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 243084 KiB
Current children cumulated memory: 201032 KiB

[startup+6.30031 s]
/proc/loadavg: 1.82 1.22 1.34 2/193 29051
/proc/meminfo: memFree=30887672/32770624 swapFree=66938988/67108860
[pid=29050] ppid=29047 vsize=465888 memory=404896 CPUtime=6.27 cores=0-7
/proc/29050/stat : 29050 (cosoco) R 29047 29050 28879 0 -1 4202496 102591 0 1 0 615 12 0 0 20 0 1 0 436152582 477069312 101224 33554432000 4194304 6211092 140728180206016 140728180201672 5567644 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
/proc/29050/statm: 116472 101224 809 493 0 109777 0
Current children cumulated CPU time: 6.27 s
Current children cumulated vsize: 465888 KiB
Current children cumulated memory: 404896 KiB

[startup+12.7003 s]
/proc/loadavg: 1.69 1.21 1.33 2/193 29051
/proc/meminfo: memFree=30501668/32770624 swapFree=66938988/67108860
[pid=29050] ppid=29047 vsize=913224 memory=814428 CPUtime=12.67 cores=0-7
/proc/29050/stat : 29050 (cosoco) R 29047 29050 28879 0 -1 4202496 205334 0 1 0 1242 25 0 0 20 0 1 0 436152582 935141376 203607 33554432000 4194304 6211092 140728180206016 140728180203288 5818663 0 0 4096 8405026 0 0 0 17 2 0 0 1 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
/proc/29050/statm: 228306 203607 809 493 0 221611 0
Current children cumulated CPU time: 12.67 s
Current children cumulated vsize: 913224 KiB
Current children cumulated memory: 814428 KiB

[startup+25.5034 s]
/proc/loadavg: 2.66 1.43 1.40 9/201 29059
/proc/meminfo: memFree=30174184/32770624 swapFree=66938988/67108860
[pid=29050] ppid=29047 vsize=1802620 memory=1102244 CPUtime=99.57 cores=0-7
/proc/29050/stat : 29050 (cosoco) S 29047 29050 28879 0 -1 1077944320 1568724 0 1 0 9738 219 0 0 20 0 9 0 436152582 1845882880 275561 33554432000 4194304 6211092 140728180206016 140728180204272 140097654378231 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 1 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
/proc/29050/statm: 450655 275561 825 493 0 443960 0
[pid=29050/tid=29052] ppid=29047 vsize=1802620 memory=-6092760743147456148 CPUtime=10.61 cores=0-7
/proc/29050/task/29052/stat : 29052 (cosoco) R 29047 29050 28879 0 -1 4202560 152808 0 0 0 1025 36 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097630448736 5038990 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29053] ppid=29047 vsize=1802620 memory=8514726395714820747 CPUtime=10.62 cores=0-7
/proc/29050/task/29053/stat : 29053 (cosoco) R 29047 29050 28879 0 -1 4202560 146281 0 0 0 1054 8 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097622056032 5038999 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29054] ppid=29047 vsize=1802620 memory=7755361966546056723 CPUtime=10.45 cores=0-7
/proc/29050/task/29054/stat : 29054 (cosoco) R 29047 29050 28879 0 -1 4202560 145984 0 0 0 1010 35 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097613663328 5038999 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29055] ppid=29047 vsize=1802620 memory=-1391509512798375272 CPUtime=10.61 cores=0-7
/proc/29050/task/29055/stat : 29055 (cosoco) R 29047 29050 28879 0 -1 4202560 163165 0 0 0 1053 8 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097605270624 5038990 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29056] ppid=29047 vsize=1802620 memory=6789802306324843961 CPUtime=10.57 cores=0-7
/proc/29050/task/29056/stat : 29056 (cosoco) R 29047 29050 28879 0 -1 4202560 158033 0 0 0 1044 13 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097596877920 5039070 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29057] ppid=29047 vsize=1802620 memory=288230574492221466 CPUtime=10.61 cores=0-7
/proc/29050/task/29057/stat : 29057 (cosoco) R 29047 29050 28879 0 -1 4202560 163609 0 0 0 1052 9 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097588485216 5038990 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29058] ppid=29047 vsize=1802620 memory=0 CPUtime=10.56 cores=0-7
/proc/29050/task/29058/stat : 29058 (cosoco) R 29047 29050 28879 0 -1 4202560 158102 0 0 0 1020 36 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097580092512 5038999 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29059] ppid=29047 vsize=1802620 memory=0 CPUtime=10.62 cores=0-7
/proc/29050/task/29059/stat : 29059 (cosoco) R 29047 29050 28879 0 -1 4202560 161975 0 0 0 1026 36 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097571699808 5038990 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
Current children cumulated CPU time: 99.57 s
Current children cumulated vsize: 1802620 KiB
Current children cumulated memory: 1102244 KiB

[startup+29.4376 s]
# the end of solver process 29050 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=127.97 s, system=2.39668 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+25.7014 s]
/proc/loadavg: 2.66 1.43 1.40 9/201 29059
/proc/meminfo: memFree=30174184/32770624 swapFree=66938988/67108860
[pid=29050] ppid=29047 vsize=1802620 memory=1102244 CPUtime=101.15 cores=0-7
/proc/29050/stat : 29050 (cosoco) S 29047 29050 28879 0 -1 1077944320 1569506 0 1 0 9896 219 0 0 20 0 9 0 436152582 1845882880 275561 33554432000 4194304 6211092 140728180206016 140728180204272 140097654378231 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 1 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
/proc/29050/statm: 450655 275561 825 493 0 443960 0
[pid=29050/tid=29052] ppid=29047 vsize=1802620 memory=590024333722744109 CPUtime=10.81 cores=0-7
/proc/29050/task/29052/stat : 29052 (cosoco) R 29047 29050 28879 0 -1 4202560 152808 0 0 0 1045 36 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097630448736 5038990 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29053] ppid=29047 vsize=1802620 memory=288284472154260269 CPUtime=10.82 cores=0-7
/proc/29050/task/29053/stat : 29053 (cosoco) R 29047 29050 28879 0 -1 4202560 146281 0 0 0 1074 8 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097622056032 5039022 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29054] ppid=29047 vsize=1802620 memory=6935054825532540783 CPUtime=10.64 cores=0-7
/proc/29050/task/29054/stat : 29054 (cosoco) R 29047 29050 28879 0 -1 4202560 146763 0 0 0 1029 35 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097613663328 5038990 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29055] ppid=29047 vsize=1802620 memory=1412 CPUtime=10.81 cores=0-7
/proc/29050/task/29055/stat : 29055 (cosoco) R 29047 29050 28879 0 -1 4202560 163165 0 0 0 1073 8 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097605270624 5038999 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29056] ppid=29047 vsize=1802620 memory=1548 CPUtime=10.77 cores=0-7
/proc/29050/task/29056/stat : 29056 (cosoco) R 29047 29050 28879 0 -1 4202560 158033 0 0 0 1064 13 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097596877920 5038999 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29057] ppid=29047 vsize=1802620 memory=7396 CPUtime=10.8 cores=0-7
/proc/29050/task/29057/stat : 29057 (cosoco) R 29047 29050 28879 0 -1 4202560 163612 0 0 0 1071 9 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097588485216 5038999 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29058] ppid=29047 vsize=1802620 memory=6935054825532540783 CPUtime=10.76 cores=0-7
/proc/29050/task/29058/stat : 29058 (cosoco) R 29047 29050 28879 0 -1 4202560 158102 0 0 0 1040 36 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097580092512 5038990 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29059] ppid=29047 vsize=1802620 memory=1102244 CPUtime=10.81 cores=0-7
/proc/29050/task/29059/stat : 29059 (cosoco) R 29047 29050 28879 0 -1 4202560 161975 0 0 0 1045 36 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097571699808 5039038 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
Current children cumulated CPU time: 101.15 s
Current children cumulated vsize: 1802620 KiB
Current children cumulated memory: 1102244 KiB

[startup+27.3014 s]
/proc/loadavg: 3.17 1.56 1.44 9/201 29059
/proc/meminfo: memFree=30174308/32770624 swapFree=66938988/67108860
[pid=29050] ppid=29047 vsize=1802620 memory=1102244 CPUtime=113.93 cores=0-7
/proc/29050/stat : 29050 (cosoco) S 29047 29050 28879 0 -1 1077944320 1652567 0 1 0 11169 224 0 0 20 0 9 0 436152582 1845882880 275561 33554432000 4194304 6211092 140728180206016 140728180204272 140097654378231 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 1 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
/proc/29050/statm: 450655 275561 825 493 0 443960 0
[pid=29050/tid=29052] ppid=29047 vsize=1802620 memory=1102244 CPUtime=12.41 cores=0-7
/proc/29050/task/29052/stat : 29052 (cosoco) R 29047 29050 28879 0 -1 4202560 160144 0 0 0 1205 36 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097630448736 5038990 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29053] ppid=29047 vsize=1802620 memory=4420 CPUtime=12.41 cores=0-7
/proc/29050/task/29053/stat : 29053 (cosoco) R 29047 29050 28879 0 -1 4202560 158349 0 0 0 1233 8 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097622056032 5038990 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29054] ppid=29047 vsize=1802620 memory=6935054825532540783 CPUtime=12.22 cores=0-7
/proc/29050/task/29054/stat : 29054 (cosoco) R 29047 29050 28879 0 -1 4202560 158787 0 0 0 1186 36 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097613663328 5039132 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29055] ppid=29047 vsize=1802620 memory=984 CPUtime=12.41 cores=0-7
/proc/29050/task/29055/stat : 29055 (cosoco) R 29047 29050 28879 0 -1 4202560 174577 0 0 0 1233 8 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097605270624 5039038 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29056] ppid=29047 vsize=1802620 memory=2016 CPUtime=12.37 cores=0-7
/proc/29050/task/29056/stat : 29056 (cosoco) R 29047 29050 28879 0 -1 4202560 171201 0 0 0 1223 14 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097596877920 5038995 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29057] ppid=29047 vsize=1802620 memory=1412 CPUtime=12.41 cores=0-7
/proc/29050/task/29057/stat : 29057 (cosoco) R 29047 29050 28879 0 -1 4202560 168559 0 0 0 1231 10 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097588485216 5038999 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29058] ppid=29047 vsize=1802620 memory=0 CPUtime=12.36 cores=0-7
/proc/29050/task/29058/stat : 29058 (cosoco) R 29047 29050 28879 0 -1 4202560 167592 0 0 0 1199 37 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097580092512 5037823 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29059] ppid=29047 vsize=1802620 memory=7014465749673337706 CPUtime=12.4 cores=0-7
/proc/29050/task/29059/stat : 29059 (cosoco) R 29047 29050 28879 0 -1 4202560 174591 0 0 0 1204 36 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097571699808 5039026 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
Current children cumulated CPU time: 113.93 s
Current children cumulated vsize: 1802620 KiB
Current children cumulated memory: 1102244 KiB

[startup+28.1014 s]*
/proc/loadavg: 3.17 1.56 1.44 9/201 29059
/proc/meminfo: memFree=30174432/32770624 swapFree=66938988/67108860
[pid=29050] ppid=29047 vsize=1802620 memory=1102244 CPUtime=120.39 cores=0-7
/proc/29050/stat : 29050 (cosoco) S 29047 29050 28879 0 -1 1077944320 1668330 0 1 0 11814 225 0 0 20 0 9 0 436152582 1845882880 275561 33554432000 4194304 6211092 140728180206016 140728180204272 140097654378231 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 1 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
/proc/29050/statm: 450655 275561 825 493 0 443960 0
[pid=29050/tid=29052] ppid=29047 vsize=1802620 memory=8317482817917895235 CPUtime=13.22 cores=0-7
/proc/29050/task/29052/stat : 29052 (cosoco) R 29047 29050 28879 0 -1 4202560 168252 0 0 0 1285 37 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097630448736 5038999 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29053] ppid=29047 vsize=1802620 memory=4872558044660077418 CPUtime=13.22 cores=0-7
/proc/29050/task/29053/stat : 29053 (cosoco) R 29047 29050 28879 0 -1 4202560 158735 0 0 0 1314 8 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097622056032 5389414 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29054] ppid=29047 vsize=1802620 memory=4641337035694168168 CPUtime=13.02 cores=0-7
/proc/29050/task/29054/stat : 29054 (cosoco) R 29047 29050 28879 0 -1 4202560 158787 0 0 0 1266 36 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097613663328 5038999 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29055] ppid=29047 vsize=1802620 memory=280943341000224 CPUtime=13.21 cores=0-7
/proc/29050/task/29055/stat : 29055 (cosoco) R 29047 29050 28879 0 -1 4202560 174603 0 0 0 1313 8 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097605270624 5039038 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29056] ppid=29047 vsize=1802620 memory=595151805469386523 CPUtime=13.18 cores=0-7
/proc/29050/task/29056/stat : 29056 (cosoco) R 29047 29050 28879 0 -1 4202560 171201 0 0 0 1304 14 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097596877920 5037748 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29057] ppid=29047 vsize=1802620 memory=1899947 CPUtime=13.22 cores=0-7
/proc/29050/task/29057/stat : 29057 (cosoco) R 29047 29050 28879 0 -1 4202560 175801 0 0 0 1312 10 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097588485216 5038999 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29058] ppid=29047 vsize=1802620 memory=3114315 CPUtime=13.17 cores=0-7
/proc/29050/task/29058/stat : 29058 (cosoco) R 29047 29050 28879 0 -1 4202560 167592 0 0 0 1280 37 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097580092512 5038990 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29059] ppid=29047 vsize=1802620 memory=8318255677412212789 CPUtime=13.21 cores=0-7
/proc/29050/task/29059/stat : 29059 (cosoco) R 29047 29050 28879 0 -1 4202560 174592 0 0 0 1285 36 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097571699808 5038999 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
Current children cumulated CPU time: 120.39 s
Current children cumulated vsize: 1802620 KiB
Current children cumulated memory: 1102244 KiB

[startup+28.9014 s]
/proc/loadavg: 3.17 1.56 1.44 9/201 29059
/proc/meminfo: memFree=30174432/32770624 swapFree=66938988/67108860
[pid=29050] ppid=29047 vsize=1802620 memory=1102244 CPUtime=126.71 cores=0-7
/proc/29050/stat : 29050 (cosoco) S 29047 29050 28879 0 -1 1077944320 1721921 0 1 0 12442 229 0 0 20 0 9 0 436152582 1845882880 275561 33554432000 4194304 6211092 140728180206016 140728180204272 140097654378231 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 1 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
/proc/29050/statm: 450655 275561 825 493 0 443960 0
[pid=29050/tid=29052] ppid=29047 vsize=1802620 memory=56 CPUtime=14.01 cores=0-7
/proc/29050/task/29052/stat : 29052 (cosoco) R 29047 29050 28879 0 -1 4202560 174773 0 0 0 1364 37 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097630448736 5039540 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29053] ppid=29047 vsize=1802620 memory=0 CPUtime=14.01 cores=0-7
/proc/29050/task/29053/stat : 29053 (cosoco) R 29047 29050 28879 0 -1 4202560 165286 0 0 0 1392 9 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097622056032 5038999 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29054] ppid=29047 vsize=1802620 memory=592557608513140013 CPUtime=13.81 cores=0-7
/proc/29050/task/29054/stat : 29054 (cosoco) R 29047 29050 28879 0 -1 4202560 165696 0 0 0 1344 37 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097613663328 5038999 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29055] ppid=29047 vsize=1802620 memory=3624 CPUtime=14.01 cores=0-7
/proc/29050/task/29055/stat : 29055 (cosoco) R 29047 29050 28879 0 -1 4202560 181163 0 0 0 1392 9 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097605270624 5038999 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29056] ppid=29047 vsize=1802620 memory=32016 CPUtime=13.97 cores=0-7
/proc/29050/task/29056/stat : 29056 (cosoco) R 29047 29050 28879 0 -1 4202560 177733 0 0 0 1383 14 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097596877920 5038999 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29057] ppid=29047 vsize=1802620 memory=984 CPUtime=14 cores=0-7
/proc/29050/task/29057/stat : 29057 (cosoco) R 29047 29050 28879 0 -1 4202560 180636 0 0 0 1390 10 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097588485216 5038990 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29058] ppid=29047 vsize=1802620 memory=2016 CPUtime=13.96 cores=0-7
/proc/29050/task/29058/stat : 29058 (cosoco) R 29047 29050 28879 0 -1 4202560 176762 0 0 0 1359 37 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097580092512 5038999 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29059] ppid=29047 vsize=1802620 memory=1412 CPUtime=14.01 cores=0-7
/proc/29050/task/29059/stat : 29059 (cosoco) R 29047 29050 28879 0 -1 4202560 181105 0 0 0 1364 37 0 0 20 0 9 0 436154070 1845882880 275561 33554432000 4194304 6211092 140728180206016 140097571699808 5038999 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
Current children cumulated CPU time: 126.71 s
Current children cumulated vsize: 1802620 KiB
Current children cumulated memory: 1102244 KiB

[startup+29.3014 s]
/proc/loadavg: 3.17 1.56 1.44 9/201 29059
/proc/meminfo: memFree=30174680/32770624 swapFree=66938988/67108860
[pid=29050] ppid=29047 vsize=1802620 memory=1102256 CPUtime=129.9 cores=0-7
/proc/29050/stat : 29050 (cosoco) S 29047 29050 28879 0 -1 1077944320 1771260 0 1 0 12759 231 0 0 20 0 9 0 436152582 1845882880 275564 33554432000 4194304 6211092 140728180206016 140728180204272 140097654378231 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 1 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
/proc/29050/statm: 450655 275564 825 493 0 443960 0
[pid=29050/tid=29052] ppid=29047 vsize=1802620 memory=6935054825532540783 CPUtime=14.41 cores=0-7
/proc/29050/task/29052/stat : 29052 (cosoco) R 29047 29050 28879 0 -1 4202560 180344 0 0 0 1404 37 0 0 20 0 9 0 436154070 1845882880 275564 33554432000 4194304 6211092 140728180206016 140097630448736 5038990 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29053] ppid=29047 vsize=1802620 memory=13316 CPUtime=14.41 cores=0-7
/proc/29050/task/29053/stat : 29053 (cosoco) R 29047 29050 28879 0 -1 4202560 171238 0 0 0 1432 9 0 0 20 0 9 0 436154070 1845882880 275564 33554432000 4194304 6211092 140728180206016 140097622056032 5038995 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29054] ppid=29047 vsize=1802620 memory=47108 CPUtime=14.2 cores=0-7
/proc/29050/task/29054/stat : 29054 (cosoco) R 29047 29050 28879 0 -1 4202560 169440 0 0 0 1383 37 0 0 20 0 9 0 436154070 1845882880 275564 33554432000 4194304 6211092 140728180206016 140097613663328 5038999 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29055] ppid=29047 vsize=1802620 memory=49316 CPUtime=14.41 cores=0-7
/proc/29050/task/29055/stat : 29055 (cosoco) R 29047 29050 28879 0 -1 4202560 187487 0 0 0 1432 9 0 0 20 0 9 0 436154070 1845882880 275564 33554432000 4194304 6211092 140728180206016 140097605270624 5038999 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29056] ppid=29047 vsize=1802620 memory=0 CPUtime=14.36 cores=0-7
/proc/29050/task/29056/stat : 29056 (cosoco) R 29047 29050 28879 0 -1 4202560 185965 0 0 0 1422 14 0 0 20 0 9 0 436154070 1845882880 275564 33554432000 4194304 6211092 140728180206016 140097596877920 5038999 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29057] ppid=29047 vsize=1802620 memory=265227115487991 CPUtime=14.41 cores=0-7
/proc/29050/task/29057/stat : 29057 (cosoco) R 29047 29050 28879 0 -1 4202560 188176 0 0 0 1430 11 0 0 20 0 9 0 436154070 1845882880 275564 33554432000 4194304 6211092 140728180206016 140097588485216 5038990 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29058] ppid=29047 vsize=1802620 memory=0 CPUtime=14.36 cores=0-7
/proc/29050/task/29058/stat : 29058 (cosoco) R 29047 29050 28879 0 -1 4202560 182811 0 0 0 1399 37 0 0 20 0 9 0 436154070 1845882880 275564 33554432000 4194304 6211092 140728180206016 140097580092512 5038990 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
[pid=29050/tid=29059] ppid=29047 vsize=1802620 memory=140471670180792 CPUtime=14.41 cores=0-7
/proc/29050/task/29059/stat : 29059 (cosoco) R 29047 29050 28879 0 -1 4202560 187032 0 0 0 1403 38 0 0 20 0 9 0 436154070 1845882880 275564 33554432000 4194304 6211092 140728180206016 140097571699808 5038999 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 21635072 140728180208657 140728180208749 140728180208749 140728180211662 0
Current children cumulated CPU time: 129.9 s
Current children cumulated vsize: 1802620 KiB
Current children cumulated memory: 1102256 KiB

[startup+29.4005 s]*
/proc/loadavg: 3.17 1.56 1.44 2/193 29059
/proc/meminfo: memFree=30715556/32770624 swapFree=66938988/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

Child status: 0
Real time (s): 29.4377
CPU time (s): 130.366
CPU user time (s): 127.97
CPU system time (s): 2.39668
CPU usage (%): 442.855
Max. virtual memory (cumulated for all children) (KiB): 1802620
Max. memory (cumulated for all children) (KiB): 1102256

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 127.97
system time used= 2.39668
maximum resident set size= 1102488
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1773971
page faults= 1
swaps= 0
block input operations= 9440
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 125
involuntary context switches= 1111


# summary of solver processes directly reported to runsolver:
#   pid: 29050
#   total CPU time (s): 130.366
#   total CPU user time (s): 127.97
#   total CPU system time (s): 2.39668

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 0.114495 second user time and 0.306275 second system time

The end

Launcher Data 

Begin job on node105 at 2019-09-16 02:54:07
IDJOB=4397960
IDBENCH=120983
IDSOLVER=2851
FILE ID=node105/4397960-1568598942
RUNJOBID= node105-1568594482-28906
PBS_JOBID= 21703417
Free space on /tmp= 61004 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/Random/Random-m1-5-12-12/rand-5-12-12-200-12442-22.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397960-1568598942/watcher-4397960-1568598942 -o /tmp/evaluation-result-4397960-1568598942/solver-4397960-1568598942 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node105-1568594482-28906 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4397960-1568598942.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= 1f678c7b1175962864f0f6df2117d050
RANDOM SEED=575008633

node105.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31229812 kB
MemAvailable:   31842796 kB
Buffers:          175224 kB
Cached:           736312 kB
SwapCached:        66296 kB
Active:           436076 kB
Inactive:         545460 kB
Active(anon):       7348 kB
Inactive(anon):   105836 kB
Active(file):     428728 kB
Inactive(file):   439624 kB
Unevictable:      109052 kB
Mlocked:          109052 kB
SwapTotal:      67108860 kB
SwapFree:       66938988 kB
Dirty:             32644 kB
Writeback:             0 kB
AnonPages:        113908 kB
Mapped:            42808 kB
Shmem:             34792 kB
Slab:             149960 kB
SReclaimable:     120936 kB
SUnreclaim:        29024 kB
KernelStack:        3440 kB
PageTables:         5620 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     499924 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 61000 MiB
End job on node105 at 2019-09-16 02:54:37