Trace number 4398106

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.O parallel? (TO) 19697.1 2520.83

General information on the benchmark

NamePropStress/PropStress-m1-s1/
PropStress-0450.xml
MD5SUMffc1a166c9e21b9812230f61f9b6f38e
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark73.796
Satisfiable
(Un)Satisfiability was proved
Number of variables902
Number of constraints102376
Number of domains1
Minimum domain size202501
Maximum domain size202501
Distribution of domain sizes[{"size":202501,"count":902}]
Minimum variable degree2
Maximum variable degree451
Distribution of variable degrees[{"degree":2,"count":1},{"degree":3,"count":449},{"degree":450,"count":449},{"degree":451,"count":3}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":102376}]
Number of extensional constraints0
Number of intensional constraints102376
Distribution of constraint types[{"type":"intension","count":102376}]
Optimization problemNO
Type of objective

Solver Data 

19696.22/2520.02	c
19696.22/2520.02	c This is cosoco 2.00 --  
19696.22/2520.02	c
19696.22/2520.02	c command line: cosoco -model -nbcores=8 HOME/instance-4398106-1568603678.xml 
19696.22/2520.02	c ========================================[ Problem Statistics ]===========================================
19696.22/2520.02	c |                                                                                                       
19696.22/2520.02	c |  Parse time        :        54.75 s 
19696.22/2520.02	c |
19696.22/2520.02	c |               Variables: 902
19696.22/2520.02	c |            Domain Sizes: 202501..202501
19696.22/2520.02	c |
19696.22/2520.02	c |             Constraints: 102376
19696.22/2520.02	c |                   Arity: 2..2  -- Binary: 102376
19696.22/2520.02	c | 
19696.22/2520.02	c |                   Types: 
19696.22/2520.02	c |                          (X -Y <= k): 102376
19696.22/2520.02	c |                          
19696.22/2520.02	c =========================================================================================================
19696.22/2520.02	c Parallel mode: Portfolio
19696.22/2520.02	c [pFactory][Group N°0] created (threads:8).
19696.22/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
19696.22/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
19696.22/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
19696.22/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
19696.22/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
19696.22/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
19696.22/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
19696.22/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
19696.22/2520.02	c [pFactory][Group N°0] concurrent mode: enabled.
19696.22/2520.02	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
19696.22/2520.02	c [pFactory][Group N°0] task 7 launched on thread 0.
19696.22/2520.02	c [pFactory][Group N°0] task 6 launched on thread 1.
19696.22/2520.02	c [pFactory][Group N°0] task 5 launched on thread 2.
19696.22/2520.02	c [pFactory][Group N°0] task 4 launched on thread 6.
19696.22/2520.02	c [pFactory][Group N°0] task 3 launched on thread 7.
19696.22/2520.02	c [pFactory][Group N°0] task 2 launched on thread 4.
19696.22/2520.02	c [pFactory][Group N°0] task 1 launched on thread 5.
19696.22/2520.02	c [pFactory][Group N°0] task 0 launched on thread 3.
19696.22/2520.02	
19696.22/2520.02	c *** INTERRUPTED ***
19696.22/2520.02	c restarts              : 0           
19696.22/2520.02	c conflicts             : 0            (0 /sec)
19696.22/2520.02	c decisions             : 0            (0 /sec)
19696.22/2520.02	c propagations          : 929930      (47 /sec)
19696.22/2520.02	c root propagations     : 0           
19696.22/2520.02	c filter calls          : 1780954        (91 /sec)
19696.22/2520.02	c useless filter calls  : 852929         (47 %)
19696.22/2520.02	c Memory used           : 16240.21 MB
19696.22/2520.02	c CPU time              : 19633.9 s
19696.22/2520.02	c real time             : 2520.02 s
19696.22/2520.02	
19696.22/2520.02	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13238 MiB free)
  memory of node 1: 16384 MiB (15813 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398106-1568603678/watcher-4398106-1568603678 -o /tmp/evaluation-result-4398106-1568603678/solver-4398106-1568603678 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node147-1568598287-9694 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398106-1568603678.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=10436, runsolver pid=10433

[startup+0.100165 s]*
/proc/loadavg: 8.08 8.18 8.27 2/192 10437
/proc/meminfo: memFree=29591564/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=199224 memory=174760 CPUtime=0.1 cores=0-7
/proc/10436/stat : 10436 (cosoco) R 10433 10436 9667 0 -1 4202496 43872 0 0 0 5 5 0 0 20 0 1 0 436281607 204005376 43690 33554432000 4194304 6211092 140736972629648 140736972625592 5231237 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 49806 43690 751 493 0 43111 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 199224 KiB
Current children cumulated memory: 174760 KiB

[startup+0.209666 s]*
/proc/loadavg: 8.08 8.18 8.27 2/192 10437
/proc/meminfo: memFree=29405668/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=384552 memory=360352 CPUtime=0.2 cores=0-7
/proc/10436/stat : 10436 (cosoco) R 10433 10436 9667 0 -1 4202496 90297 0 0 0 10 10 0 0 20 0 1 0 436281607 393781248 90088 33554432000 4194304 6211092 140736972629648 140736972625592 5231237 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 96138 90088 751 493 0 89443 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 384552 KiB
Current children cumulated memory: 360352 KiB

[startup+0.309623 s]*
/proc/loadavg: 8.08 8.18 8.27 2/192 10437
/proc/meminfo: memFree=29234548/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=555624 memory=530896 CPUtime=0.31 cores=0-7
/proc/10436/stat : 10436 (cosoco) R 10433 10436 9667 0 -1 4202496 132925 0 0 0 16 15 0 0 20 0 1 0 436281607 568958976 132724 33554432000 4194304 6211092 140736972629648 140736972625592 5231237 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 138906 132724 751 493 0 132211 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 555624 KiB
Current children cumulated memory: 530896 KiB

[startup+0.700391 s]
/proc/loadavg: 8.08 8.18 8.27 2/192 10437
/proc/meminfo: memFree=28890820/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=1212324 memory=1187992 CPUtime=0.69 cores=0-7
/proc/10436/stat : 10436 (cosoco) R 10433 10436 9667 0 -1 4202496 297175 0 0 0 34 35 0 0 20 0 1 0 436281607 1241419776 296998 33554432000 4194304 6211092 140736972629648 140736972625592 5231317 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 303081 296998 751 493 0 296386 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 1212324 KiB
Current children cumulated memory: 1187992 KiB

[startup+1.50039 s]
/proc/loadavg: 8.08 8.18 8.27 2/192 10437
/proc/meminfo: memFree=28043540/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=2592252 memory=2567920 CPUtime=1.49 cores=0-7
/proc/10436/stat : 10436 (cosoco) R 10433 10436 9667 0 -1 4202496 642146 0 0 0 75 74 0 0 20 0 1 0 436281607 2654466048 641980 33554432000 4194304 6211092 140736972629648 140736972625592 5231317 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 648063 641980 751 493 0 641368 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2592252 KiB
Current children cumulated memory: 2567920 KiB

[startup+3.10961 s]
/proc/loadavg: 7.51 8.06 8.24 2/192 10437
/proc/meminfo: memFree=24592624/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=5361612 memory=5337612 CPUtime=3.1 cores=0-7
/proc/10436/stat : 10436 (cosoco) R 10433 10436 9667 0 -1 4202496 1334941 0 0 0 158 152 0 0 20 0 1 0 436281607 5490290688 1334403 33554432000 4194304 6211092 140736972629648 140736972625592 5231317 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 1340403 1334403 751 493 0 1333708 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 5361612 KiB
Current children cumulated memory: 5337612 KiB

[startup+6.3004 s]
/proc/loadavg: 7.51 8.06 8.24 2/192 10437
/proc/meminfo: memFree=19433604/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=10840272 memory=10815644 CPUtime=6.29 cores=0-7
/proc/10436/stat : 10436 (cosoco) R 10433 10436 9667 0 -1 4202496 2704788 0 0 0 322 307 0 0 20 0 1 0 436281607 11100438528 2703911 33554432000 4194304 6211092 140736972629648 140736972625592 5231317 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 2710068 2703911 751 493 0 2703373 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 10840272 KiB
Current children cumulated memory: 10815644 KiB

[startup+12.7004 s]
/proc/loadavg: 6.51 7.83 8.16 2/192 10437
/proc/meminfo: memFree=17925708/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=11891248 memory=11866484 CPUtime=12.69 cores=0-7
/proc/10436/stat : 10436 (cosoco) R 10433 10436 9667 0 -1 4202496 2969150 0 0 0 928 341 0 0 20 0 1 0 436281607 12176637952 2966621 33554432000 4194304 6211092 140736972629648 140736972624168 140220978864888 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 2972812 2966621 822 493 0 2966117 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 11891248 KiB
Current children cumulated memory: 11866484 KiB

[startup+25.5004 s]
/proc/loadavg: 5.66 7.61 8.08 2/192 10440
/proc/meminfo: memFree=16773268/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=13024612 memory=12999856 CPUtime=25.48 cores=0-7
/proc/10436/stat : 10436 (cosoco) R 10433 10436 9667 0 -1 4202496 3253876 0 0 0 2164 384 0 0 20 0 1 0 436281607 13337202688 3249964 33554432000 4194304 6211092 140736972629648 140736972619208 140220968917989 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 3256153 3249964 822 493 0 3249458 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 13024612 KiB
Current children cumulated memory: 12999856 KiB

[startup+51.1094 s]
/proc/loadavg: 4.07 7.08 7.89 2/192 10440
/proc/meminfo: memFree=14460312/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=15300336 memory=15274412 CPUtime=51.07 cores=0-7
/proc/10436/stat : 10436 (cosoco) R 10433 10436 9667 0 -1 4202496 3825274 0 0 0 4629 478 0 0 20 0 1 0 436281607 15667544064 3818603 33554432000 4194304 6211092 140736972629648 140736972624168 140220968640277 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 3825117 3818603 822 493 0 3818422 0
Current children cumulated CPU time: 51.07 s
Current children cumulated vsize: 15300336 KiB
Current children cumulated memory: 15274412 KiB

[startup+102.301 s]
/proc/loadavg: 5.97 7.05 7.83 9/199 10451
/proc/meminfo: memFree=13710664/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=16629972 memory=16016448 CPUtime=395.56 cores=0-7
/proc/10436/stat : 10436 (cosoco) S 10433 10436 9667 0 -1 1077944320 8813913 0 0 0 38183 1373 0 0 20 0 9 0 436281607 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140736972627904 140220984958711 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 4157493 4004112 863 493 0 4150798 0
[pid=10436/tid=10441] ppid=10433 vsize=16629972 memory=13008800 CPUtime=41.98 cores=0-7
/proc/10436/task/10441/stat : 10441 (cosoco) R 10433 10436 9667 0 -1 4202560 482904 0 0 0 4023 175 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209258970296 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10442] ppid=10433 vsize=16629972 memory=6935054825532540783 CPUtime=41.75 cores=0-7
/proc/10436/task/10442/stat : 10442 (cosoco) R 10433 10436 9667 0 -1 4202560 482567 0 0 0 4144 31 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209250577592 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10443] ppid=10433 vsize=16629972 memory=16016448 CPUtime=41.98 cores=0-7
/proc/10436/task/10443/stat : 10443 (cosoco) R 10433 10436 9667 0 -1 4202560 480675 0 0 0 4019 179 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209242184888 5393063 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10444] ppid=10433 vsize=16629972 memory=16016448 CPUtime=41.81 cores=0-7
/proc/10436/task/10444/stat : 10444 (cosoco) R 10433 10436 9667 0 -1 4202560 480739 0 0 0 4150 31 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209233792184 5393063 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10445] ppid=10433 vsize=16629972 memory=281184664133440 CPUtime=41.9 cores=0-7
/proc/10436/task/10445/stat : 10445 (cosoco) R 10433 10436 9667 0 -1 4202560 482829 0 0 0 4157 33 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209225399480 5392343 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10446] ppid=10433 vsize=16629972 memory=281184663961832 CPUtime=41.84 cores=0-7
/proc/10436/task/10446/stat : 10446 (cosoco) R 10433 10436 9667 0 -1 4202560 482433 0 0 0 4152 32 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209217006776 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10447] ppid=10433 vsize=16629972 memory=16016448 CPUtime=41.99 cores=0-7
/proc/10436/task/10447/stat : 10447 (cosoco) R 10433 10436 9667 0 -1 4202560 480804 0 0 0 4021 178 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209208614072 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10448] ppid=10433 vsize=16629972 memory=281184663972384 CPUtime=41.99 cores=0-7
/proc/10436/task/10448/stat : 10448 (cosoco) R 10433 10436 9667 0 -1 4202560 482888 0 0 0 4035 164 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209200221368 5397368 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
Current children cumulated CPU time: 395.56 s
Current children cumulated vsize: 16629972 KiB
Current children cumulated memory: 16016448 KiB

[startup+162.301 s]
/proc/loadavg: 7.29 7.24 7.85 9/199 10456
/proc/meminfo: memFree=13710912/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=16629972 memory=16016448 CPUtime=874.32 cores=0-7
/proc/10436/stat : 10436 (cosoco) S 10433 10436 9667 0 -1 1077944320 10308997 0 0 0 85880 1552 0 0 20 0 9 0 436281607 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140736972627904 140220984958711 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 4157493 4004112 863 493 0 4150798 0
[pid=10436/tid=10441] ppid=10433 vsize=16629972 memory=16016448 CPUtime=101.94 cores=0-7
/proc/10436/task/10441/stat : 10441 (cosoco) R 10433 10436 9667 0 -1 4202560 676653 0 0 0 9988 206 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209258970296 5392352 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10442] ppid=10433 vsize=16629972 memory=0 CPUtime=101.7 cores=0-7
/proc/10436/task/10442/stat : 10442 (cosoco) R 10433 10436 9667 0 -1 4202560 662034 0 0 0 10127 43 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209250577592 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10443] ppid=10433 vsize=16629972 memory=16016448 CPUtime=101.94 cores=0-7
/proc/10436/task/10443/stat : 10443 (cosoco) R 10433 10436 9667 0 -1 4202560 672439 0 0 0 9983 211 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209242184888 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10444] ppid=10433 vsize=16629972 memory=16016448 CPUtime=101.27 cores=0-7
/proc/10436/task/10444/stat : 10444 (cosoco) R 10433 10436 9667 0 -1 4202560 667491 0 0 0 10082 45 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209233792184 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10445] ppid=10433 vsize=16629972 memory=16016448 CPUtime=101.78 cores=0-7
/proc/10436/task/10445/stat : 10445 (cosoco) R 10433 10436 9667 0 -1 4202560 667518 0 0 0 10130 48 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209225399480 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10446] ppid=10433 vsize=16629972 memory=16016448 CPUtime=101.5 cores=0-7
/proc/10436/task/10446/stat : 10446 (cosoco) R 10433 10436 9667 0 -1 4202560 666217 0 0 0 10105 45 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209217006776 5393063 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10447] ppid=10433 vsize=16629972 memory=16016448 CPUtime=101.93 cores=0-7
/proc/10436/task/10447/stat : 10447 (cosoco) R 10433 10436 9667 0 -1 4202560 662317 0 0 0 9986 207 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209208614072 5392343 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10448] ppid=10433 vsize=16629972 memory=16016448 CPUtime=101.94 cores=0-7
/proc/10436/task/10448/stat : 10448 (cosoco) R 10433 10436 9667 0 -1 4202560 676254 0 0 0 9997 197 0 0 20 0 9 0 436287634 17029091328 4004112 33554432000 4194304 6211092 140736972629648 140209200221368 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
Current children cumulated CPU time: 874.32 s
Current children cumulated vsize: 16629972 KiB
Current children cumulated memory: 16016448 KiB

[startup+222.301 s]
/proc/loadavg: 7.78 7.39 7.87 9/199 10459
/proc/meminfo: memFree=13705944/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=16629972 memory=16020104 CPUtime=1353.25 cores=0-7
/proc/10436/stat : 10436 (cosoco) S 10433 10436 9667 0 -1 1077944320 12932455 0 0 0 133503 1822 0 0 20 0 9 0 436281607 17029091328 4005026 33554432000 4194304 6211092 140736972629648 140736972627904 140220984958711 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 4157493 4005026 863 493 0 4150798 0
[pid=10436/tid=10441] ppid=10433 vsize=16629972 memory=16019908 CPUtime=161.9 cores=0-7
/proc/10436/task/10441/stat : 10441 (cosoco) R 10433 10436 9667 0 -1 4202560 1006136 0 0 0 15941 249 0 0 20 0 9 0 436287634 17029091328 4005026 33554432000 4194304 6211092 140736972629648 140209258970056 5397368 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10442] ppid=10433 vsize=16629972 memory=3512 CPUtime=160.89 cores=0-7
/proc/10436/task/10442/stat : 10442 (cosoco) R 10433 10436 9667 0 -1 4202560 987461 0 0 0 16029 60 0 0 20 0 9 0 436287634 17029091328 4005026 33554432000 4194304 6211092 140736972629648 140209250577352 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10443] ppid=10433 vsize=16629972 memory=16019696 CPUtime=161.91 cores=0-7
/proc/10436/task/10443/stat : 10443 (cosoco) R 10433 10436 9667 0 -1 4202560 1000045 0 0 0 15925 266 0 0 20 0 9 0 436287634 17029091328 4005026 33554432000 4194304 6211092 140736972629648 140209242184584 5392320 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10444] ppid=10433 vsize=16629972 memory=16019796 CPUtime=161.18 cores=0-7
/proc/10436/task/10444/stat : 10444 (cosoco) R 10433 10436 9667 0 -1 4202560 996437 0 0 0 16056 62 0 0 20 0 9 0 436287634 17029091328 4005026 33554432000 4194304 6211092 140736972629648 140209233791944 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10445] ppid=10433 vsize=16629972 memory=16019696 CPUtime=161.76 cores=0-7
/proc/10436/task/10445/stat : 10445 (cosoco) R 10433 10436 9667 0 -1 4202560 996844 0 0 0 16110 66 0 0 20 0 9 0 436287634 17029091328 4005026 33554432000 4194304 6211092 140736972629648 140209225399240 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10446] ppid=10433 vsize=16629972 memory=16020048 CPUtime=161.48 cores=0-7
/proc/10436/task/10446/stat : 10446 (cosoco) R 10433 10436 9667 0 -1 4202560 995106 0 0 0 16086 62 0 0 20 0 9 0 436287634 17029091328 4005026 33554432000 4194304 6211092 140736972629648 140209217006536 5397368 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0

################
# More data... #
################


[startup+2322.3 s]
/proc/loadavg: 8.04 8.23 8.25 9/201 10624
/proc/meminfo: memFree=13445088/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=16629972 memory=16282204 CPUtime=18118 cores=0-7
/proc/10436/stat : 10436 (cosoco) S 10433 10436 9667 0 -1 1077944320 64216309 0 0 0 1806063 5741 0 0 20 0 9 0 436281607 17029091328 4070551 33554432000 4194304 6211092 140736972629648 140736972627904 140220984958711 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 4157493 4070551 863 493 0 4150798 0
[pid=10436/tid=10441] ppid=10433 vsize=16629972 memory=16282152 CPUtime=2254.89 cores=0-7
/proc/10436/task/10441/stat : 10441 (cosoco) R 10433 10436 9667 0 -1 4202560 7416775 0 0 0 224768 721 0 0 20 0 9 0 436287634 17029091328 4070551 33554432000 4194304 6211092 140736972629648 140209258969960 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10442] ppid=10433 vsize=16629972 memory=0 CPUtime=2255.46 cores=0-7
/proc/10436/task/10442/stat : 10442 (cosoco) R 10433 10436 9667 0 -1 4202560 7395657 0 0 0 224871 675 0 0 20 0 9 0 436287634 17029091328 4070551 33554432000 4194304 6211092 140736972629648 140209250577352 5393040 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10443] ppid=10433 vsize=16629972 memory=16279556 CPUtime=2261.36 cores=0-7
/proc/10436/task/10443/stat : 10443 (cosoco) R 10433 10436 9667 0 -1 4202560 7409281 0 0 0 225550 586 0 0 20 0 9 0 436287634 17029091328 4070551 33554432000 4194304 6211092 140736972629648 140209242184648 5393040 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10444] ppid=10433 vsize=16629972 memory=16280368 CPUtime=2259.4 cores=0-7
/proc/10436/task/10444/stat : 10444 (cosoco) R 10433 10436 9667 0 -1 4202560 7406230 0 0 0 225423 517 0 0 20 0 9 0 436287634 17029091328 4070551 33554432000 4194304 6211092 140736972629648 140209233791944 5172229 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10445] ppid=10433 vsize=16629972 memory=6935054825532540783 CPUtime=2260.07 cores=0-7
/proc/10436/task/10445/stat : 10445 (cosoco) R 10433 10436 9667 0 -1 4202560 7409338 0 0 0 225469 538 0 0 20 0 9 0 436287634 17029091328 4070551 33554432000 4194304 6211092 140736972629648 140209225399176 5172256 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10446] ppid=10433 vsize=16629972 memory=16281668 CPUtime=2252.25 cores=0-7
/proc/10436/task/10446/stat : 10446 (cosoco) R 10433 10436 9667 0 -1 4202560 7407809 0 0 0 224554 671 0 0 20 0 9 0 436287634 17029091328 4070551 33554432000 4194304 6211092 140736972629648 140209217006472 5392320 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10447] ppid=10433 vsize=16629972 memory=16282160 CPUtime=2253.51 cores=0-7
/proc/10436/task/10447/stat : 10447 (cosoco) R 10433 10436 9667 0 -1 4202560 7395092 0 0 0 224593 758 0 0 20 0 9 0 436287634 17029091328 4070551 33554432000 4194304 6211092 140736972629648 140209208613832 5393072 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10448] ppid=10433 vsize=16629972 memory=16282152 CPUtime=2260.79 cores=0-7
/proc/10436/task/10448/stat : 10448 (cosoco) R 10433 10436 9667 0 -1 4202560 7418053 0 0 0 225354 725 0 0 20 0 9 0 436287634 17029091328 4070551 33554432000 4194304 6211092 140736972629648 140209200221128 5393072 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
Current children cumulated CPU time: 18118 s
Current children cumulated vsize: 16629972 KiB
Current children cumulated memory: 16282204 KiB

[startup+2382.3 s]
/proc/loadavg: 8.06 8.20 8.24 9/201 10627
/proc/meminfo: memFree=13437324/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=16629972 memory=16290544 CPUtime=18597.1 cores=0-7
/proc/10436/stat : 10436 (cosoco) S 10433 10436 9667 0 -1 1077944320 65656559 0 0 0 1853883 5822 0 0 20 0 9 0 436281607 17029091328 4072636 33554432000 4194304 6211092 140736972629648 140736972627904 140220984958711 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 4157493 4072636 863 493 0 4150798 0
[pid=10436/tid=10441] ppid=10433 vsize=16629972 memory=56 CPUtime=2314.7 cores=0-7
/proc/10436/task/10441/stat : 10441 (cosoco) R 10433 10436 9667 0 -1 4202560 7598430 0 0 0 230738 732 0 0 20 0 9 0 436287634 17029091328 4072636 33554432000 4194304 6211092 140736972629648 140209258970056 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10442] ppid=10433 vsize=16629972 memory=16290508 CPUtime=2315.45 cores=0-7
/proc/10436/task/10442/stat : 10442 (cosoco) R 10433 10436 9667 0 -1 4202560 7577221 0 0 0 230861 684 0 0 20 0 9 0 436287634 17029091328 4072636 33554432000 4194304 6211092 140736972629648 140209250577352 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10443] ppid=10433 vsize=16629972 memory=16290412 CPUtime=2321.35 cores=0-7
/proc/10436/task/10443/stat : 10443 (cosoco) R 10433 10436 9667 0 -1 4202560 7590950 0 0 0 231540 595 0 0 20 0 9 0 436287634 17029091328 4072636 33554432000 4194304 6211092 140736972629648 140209242184648 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10444] ppid=10433 vsize=16629972 memory=16287144 CPUtime=2319.39 cores=0-7
/proc/10436/task/10444/stat : 10444 (cosoco) R 10433 10436 9667 0 -1 4202560 7587706 0 0 0 231412 527 0 0 20 0 9 0 436287634 17029091328 4072636 33554432000 4194304 6211092 140736972629648 140209233791944 5393063 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10445] ppid=10433 vsize=16629972 memory=16290076 CPUtime=2320.07 cores=0-7
/proc/10436/task/10445/stat : 10445 (cosoco) R 10433 10436 9667 0 -1 4202560 7586757 0 0 0 231461 546 0 0 20 0 9 0 436287634 17029091328 4072636 33554432000 4194304 6211092 140736972629648 140209225399240 5393072 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10446] ppid=10433 vsize=16629972 memory=16286840 CPUtime=2312 cores=0-7
/proc/10436/task/10446/stat : 10446 (cosoco) R 10433 10436 9667 0 -1 4202560 7585206 0 0 0 230519 681 0 0 20 0 9 0 436287634 17029091328 4072636 33554432000 4194304 6211092 140736972629648 140209217006536 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10447] ppid=10433 vsize=16629972 memory=16286688 CPUtime=2313.44 cores=0-7
/proc/10436/task/10447/stat : 10447 (cosoco) R 10433 10436 9667 0 -1 4202560 7576603 0 0 0 230574 770 0 0 20 0 9 0 436287634 17029091328 4072636 33554432000 4194304 6211092 140736972629648 140209208613832 5393072 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10448] ppid=10433 vsize=16629972 memory=16285932 CPUtime=2320.35 cores=0-7
/proc/10436/task/10448/stat : 10448 (cosoco) R 10433 10436 9667 0 -1 4202560 7595612 0 0 0 231298 737 0 0 20 0 9 0 436287634 17029091328 4072636 33554432000 4194304 6211092 140736972629648 140209200221128 5392320 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
Current children cumulated CPU time: 18597.1 s
Current children cumulated vsize: 16629972 KiB
Current children cumulated memory: 16290544 KiB

[startup+2442.3 s]
/proc/loadavg: 8.08 8.18 8.23 9/201 10630
/proc/meminfo: memFree=13428128/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=16629972 memory=16298892 CPUtime=19076 cores=0-7
/proc/10436/stat : 10436 (cosoco) S 10433 10436 9667 0 -1 1077944320 67097088 0 0 0 1901695 5902 0 0 20 0 9 0 436281607 17029091328 4074723 33554432000 4194304 6211092 140736972629648 140736972627904 140220984958711 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 4157493 4074723 863 493 0 4150798 0
[pid=10436/tid=10441] ppid=10433 vsize=16629972 memory=1716 CPUtime=2374.68 cores=0-7
/proc/10436/task/10441/stat : 10441 (cosoco) R 10433 10436 9667 0 -1 4202560 7780049 0 0 0 236725 743 0 0 20 0 9 0 436287634 17029091328 4074723 33554432000 4194304 6211092 140736972629648 140209258970056 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10442] ppid=10433 vsize=16629972 memory=16297924 CPUtime=2375.45 cores=0-7
/proc/10436/task/10442/stat : 10442 (cosoco) R 10433 10436 9667 0 -1 4202560 7758756 0 0 0 236851 694 0 0 20 0 9 0 436287634 17029091328 4074723 33554432000 4194304 6211092 140736972629648 140209250577352 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10443] ppid=10433 vsize=16629972 memory=16298712 CPUtime=2381.31 cores=0-7
/proc/10436/task/10443/stat : 10443 (cosoco) R 10433 10436 9667 0 -1 4202560 7772491 0 0 0 237526 605 0 0 20 0 9 0 436287634 17029091328 4074723 33554432000 4194304 6211092 140736972629648 140209242184648 5393063 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10444] ppid=10433 vsize=16629972 memory=16298584 CPUtime=2378.74 cores=0-7
/proc/10436/task/10444/stat : 10444 (cosoco) R 10433 10436 9667 0 -1 4202560 7765339 0 0 0 237337 537 0 0 20 0 9 0 436287634 17029091328 4074723 33554432000 4194304 6211092 140736972629648 140209233791848 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10445] ppid=10433 vsize=16629972 memory=16295448 CPUtime=2380.05 cores=0-7
/proc/10436/task/10445/stat : 10445 (cosoco) R 10433 10436 9667 0 -1 4202560 7768437 0 0 0 237448 557 0 0 20 0 9 0 436287634 17029091328 4074723 33554432000 4194304 6211092 140736972629648 140209225399240 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10446] ppid=10433 vsize=16629972 memory=16298380 CPUtime=2371.8 cores=0-7
/proc/10436/task/10446/stat : 10446 (cosoco) R 10433 10436 9667 0 -1 4202560 7762853 0 0 0 236489 691 0 0 20 0 9 0 436287634 17029091328 4074723 33554432000 4194304 6211092 140736972629648 140209217006536 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10447] ppid=10433 vsize=16629972 memory=16298452 CPUtime=2373.4 cores=0-7
/proc/10436/task/10447/stat : 10447 (cosoco) R 10433 10436 9667 0 -1 4202560 7753965 0 0 0 236560 780 0 0 20 0 9 0 436287634 17029091328 4074723 33554432000 4194304 6211092 140736972629648 140209208613672 5193733 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10448] ppid=10433 vsize=16629972 memory=16298888 CPUtime=2380.25 cores=0-7
/proc/10436/task/10448/stat : 10448 (cosoco) R 10433 10436 9667 0 -1 4202560 7777124 0 0 0 237280 745 0 0 20 0 9 0 436287634 17029091328 4074723 33554432000 4194304 6211092 140736972629648 140209200221064 5392343 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
Current children cumulated CPU time: 19076 s
Current children cumulated vsize: 16629972 KiB
Current children cumulated memory: 16298892 KiB

[startup+2502.3 s]
/proc/loadavg: 8.58 8.30 8.26 9/200 10637
/proc/meminfo: memFree=13416464/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=16629972 memory=16307148 CPUtime=19554.8 cores=0-7
/proc/10436/stat : 10436 (cosoco) S 10433 10436 9667 0 -1 1077944320 68541396 0 0 0 1949360 6123 0 0 20 0 9 0 436281607 17029091328 4076787 33554432000 4194304 6211092 140736972629648 140736972627904 140220984958711 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 4157493 4076787 863 493 0 4150798 0
[pid=10436/tid=10441] ppid=10433 vsize=16629972 memory=1660 CPUtime=2434.64 cores=0-7
/proc/10436/task/10441/stat : 10441 (cosoco) R 10433 10436 9667 0 -1 4202560 7957696 0 0 0 242711 753 0 0 20 0 9 0 436287634 17029091328 4076787 33554432000 4194304 6211092 140736972629648 140209258969992 5392352 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10442] ppid=10433 vsize=16629972 memory=16307108 CPUtime=2435.41 cores=0-7
/proc/10436/task/10442/stat : 10442 (cosoco) R 10433 10436 9667 0 -1 4202560 7936185 0 0 0 242838 703 0 0 20 0 9 0 436287634 17029091328 4076787 33554432000 4194304 6211092 140736972629648 140209250577256 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10443] ppid=10433 vsize=16629972 memory=16305580 CPUtime=2441.3 cores=0-7
/proc/10436/task/10443/stat : 10443 (cosoco) R 10433 10436 9667 0 -1 4202560 7954259 0 0 0 243516 614 0 0 20 0 9 0 436287634 17029091328 4076787 33554432000 4194304 6211092 140736972629648 140209242184648 5393040 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10444] ppid=10433 vsize=16629972 memory=16306352 CPUtime=2437.79 cores=0-7
/proc/10436/task/10444/stat : 10444 (cosoco) R 10433 10436 9667 0 -1 4202560 7950946 0 0 0 243157 622 0 0 20 0 9 0 436287634 17029091328 4076787 33554432000 4194304 6211092 140736972629648 140209233791848 5172464 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10445] ppid=10433 vsize=16629972 memory=16306852 CPUtime=2440.03 cores=0-7
/proc/10436/task/10445/stat : 10445 (cosoco) R 10433 10436 9667 0 -1 4202560 7949918 0 0 0 243438 565 0 0 20 0 9 0 436287634 17029091328 4076787 33554432000 4194304 6211092 140736972629648 140209225399176 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10446] ppid=10433 vsize=16629972 memory=16306544 CPUtime=2431.79 cores=0-7
/proc/10436/task/10446/stat : 10446 (cosoco) R 10433 10436 9667 0 -1 4202560 7944122 0 0 0 242476 703 0 0 20 0 9 0 436287634 17029091328 4076787 33554432000 4194304 6211092 140736972629648 140209217006472 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10447] ppid=10433 vsize=16629972 memory=16306492 CPUtime=2433.33 cores=0-7
/proc/10436/task/10447/stat : 10447 (cosoco) R 10433 10436 9667 0 -1 4202560 7935656 0 0 0 242541 792 0 0 20 0 9 0 436287634 17029091328 4076787 33554432000 4194304 6211092 140736972629648 140209208613768 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10448] ppid=10433 vsize=16629972 memory=16307108 CPUtime=2440.23 cores=0-7
/proc/10436/task/10448/stat : 10448 (cosoco) R 10433 10436 9667 0 -1 4202560 7954540 0 0 0 243202 821 0 0 20 0 9 0 436287634 17029091328 4076787 33554432000 4194304 6211092 140736972629648 140209200221128 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
Current children cumulated CPU time: 19554.8 s
Current children cumulated vsize: 16629972 KiB
Current children cumulated memory: 16307148 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 8.75 8.35 8.28 9/200 10637
/proc/meminfo: memFree=13416684/32770624 swapFree=66957020/67108860
[pid=10436] ppid=10433 vsize=16629972 memory=16309344 CPUtime=19696.2 cores=0-7
/proc/10436/stat : 10436 (cosoco) S 10433 10436 9667 0 -1 1077944320 69081463 0 0 0 1963384 6238 0 0 20 0 9 0 436281607 17029091328 4077336 33554432000 4194304 6211092 140736972629648 140736972627904 140220984958711 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
/proc/10436/statm: 4157493 4077336 863 493 0 4150798 0
[pid=10436/tid=10441] ppid=10433 vsize=16629972 memory=6935054825532540783 CPUtime=2452.09 cores=0-7
/proc/10436/task/10441/stat : 10441 (cosoco) R 10433 10436 9667 0 -1 4202560 8028172 0 0 0 244452 757 0 0 20 0 9 0 436287634 17029091328 4077336 33554432000 4194304 6211092 140736972629648 140209258970056 5392343 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10442] ppid=10433 vsize=16629972 memory=4872558044660077418 CPUtime=2453.12 cores=0-7
/proc/10436/task/10442/stat : 10442 (cosoco) R 10433 10436 9667 0 -1 4202560 8006712 0 0 0 244605 707 0 0 20 0 9 0 436287634 17029091328 4077336 33554432000 4194304 6211092 140736972629648 140209250577288 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10443] ppid=10433 vsize=16629972 memory=896 CPUtime=2459 cores=0-7
/proc/10436/task/10443/stat : 10443 (cosoco) R 10433 10436 9667 0 -1 4202560 8020541 0 0 0 245284 616 0 0 20 0 9 0 436287634 17029091328 4077336 33554432000 4194304 6211092 140736972629648 140209242184648 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10444] ppid=10433 vsize=16629972 memory=1980 CPUtime=2455.49 cores=0-7
/proc/10436/task/10444/stat : 10444 (cosoco) R 10433 10436 9667 0 -1 12591168 8018490 0 0 0 244882 667 0 0 20 0 9 0 436287634 17029091328 4077336 33554432000 4194304 6211092 140736972629648 140209233791944 5393059 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10445] ppid=10433 vsize=16629972 memory=2520 CPUtime=2457.73 cores=0-7
/proc/10436/task/10445/stat : 10445 (cosoco) R 10433 10436 9667 0 -1 4202560 8012053 0 0 0 245205 568 0 0 20 0 9 0 436287634 17029091328 4077336 33554432000 4194304 6211092 140736972629648 140209225399240 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10446] ppid=10433 vsize=16629972 memory=1760 CPUtime=2449.5 cores=0-7
/proc/10436/task/10446/stat : 10446 (cosoco) R 10433 10436 9667 0 -1 4202560 8010658 0 0 0 244242 708 0 0 20 0 9 0 436287634 17029091328 4077336 33554432000 4194304 6211092 140736972629648 140209217006536 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10447] ppid=10433 vsize=16629972 memory=1660 CPUtime=2451.04 cores=0-7
/proc/10436/task/10447/stat : 10447 (cosoco) R 10433 10436 9667 0 -1 4202560 8001933 0 0 0 244308 796 0 0 20 0 9 0 436287634 17029091328 4077336 33554432000 4194304 6211092 140736972629648 140209208613832 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
[pid=10436/tid=10448] ppid=10433 vsize=16629972 memory=111632 CPUtime=2457.93 cores=0-7
/proc/10436/task/10448/stat : 10448 (cosoco) R 10433 10436 9667 0 -1 4202560 8024862 0 0 0 244925 868 0 0 20 0 9 0 436287634 17029091328 4077336 33554432000 4194304 6211092 140736972629648 140209200221032 5393040 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 13873152 140736972633105 140736972633197 140736972633197 140736972636110 0
Current children cumulated CPU time: 19696.2 s
Current children cumulated vsize: 16629972 KiB
Current children cumulated memory: 16309344 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.83 s]
# the end of solver process 10436 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=19633.9 s, system=63.1942 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2520.4 s]
/proc/loadavg: 8.75 8.35 8.28 2/193 10637
/proc/meminfo: memFree=18657628/32770624 swapFree=66957020/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

[startup+2520.8 s]
/proc/loadavg: 8.75 8.35 8.28 2/193 10637
/proc/meminfo: memFree=18657628/32770624 swapFree=66957020/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

Child status: 1
Real time (s): 2520.83
CPU time (s): 19697.1
CPU user time (s): 19633.9
CPU system time (s): 63.1942
CPU usage (%): 781.374
Max. virtual memory (cumulated for all children) (KiB): 16629972
Max. memory (cumulated for all children) (KiB): 16309344

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 19633.9
system time used= 63.1942
maximum resident set size= 16309732
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 69082920
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8470
involuntary context switches= 163636


# summary of solver processes directly reported to runsolver:
#   pid: 10436
#   total CPU time (s): 19697.1
#   total CPU user time (s): 19633.9
#   total CPU system time (s): 63.1942

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 12.5075 second user time and 23.1922 second system time

The end

Launcher Data 

Begin job on node147 at 2019-09-16 05:13:54
IDJOB=4398106
IDBENCH=126851
IDSOLVER=2851
FILE ID=node147/4398106-1568603678
RUNJOBID= node147-1568598287-9694
PBS_JOBID= 21703424
Free space on /tmp= 58876 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/PropStress/PropStress-m1-s1/PropStress-0450.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398106-1568603678/watcher-4398106-1568603678 -o /tmp/evaluation-result-4398106-1568603678/solver-4398106-1568603678 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node147-1568598287-9694 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398106-1568603678.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= ffc1a166c9e21b9812230f61f9b6f38e
RANDOM SEED=794978827

node147.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.52
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29748960 kB
MemAvailable:   31827784 kB
Buffers:          113232 kB
Cached:          2242160 kB
SwapCached:        48484 kB
Active:          1318816 kB
Inactive:        1088392 kB
Active(anon):       3944 kB
Inactive(anon):    96472 kB
Active(file):    1314872 kB
Inactive(file):   991920 kB
Unevictable:      108996 kB
Mlocked:          108996 kB
SwapTotal:      67108860 kB
SwapFree:       66957020 kB
Dirty:              6264 kB
Writeback:             0 kB
AnonPages:        112696 kB
Mapped:            47236 kB
Shmem:             40960 kB
Slab:             204500 kB
SReclaimable:     175732 kB
SUnreclaim:        28768 kB
KernelStack:        3408 kB
PageTables:         5308 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     505760 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 58876 MiB
End job on node147 at 2019-09-16 05:55:55