Trace number 4409380

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0 parallel? (TO) 19798.8 2520.55

General information on the benchmark

NamePropStress/PropStress-m1-s1/
PropStress-0400.xml
MD5SUMcd36f5a432e3b868ff7ac280438203b6
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark59.2496
Satisfiable
(Un)Satisfiability was proved
Number of variables802
Number of constraints81001
Number of domains1
Minimum domain size160001
Maximum domain size160001
Distribution of domain sizes[{"size":160001,"count":802}]
Minimum variable degree2
Maximum variable degree401
Distribution of variable degrees[{"degree":2,"count":1},{"degree":3,"count":399},{"degree":400,"count":399},{"degree":401,"count":3}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":81001}]
Number of extensional constraints0
Number of intensional constraints81001
Distribution of constraint types[{"type":"intension","count":81001}]
Optimization problemNO
Type of objective

Solver Data

19798.16/2520.02	c
19798.16/2520.02	c This is cosoco 2.00 --  
19798.16/2520.02	c
19798.16/2520.02	c command line: cosoco -model -nbcores=8 HOME/instance-4409380-1569825104.xml 
19798.16/2520.02	c ========================================[ Problem Statistics ]===========================================
19798.16/2520.02	c |                                                                                                       
19798.16/2520.02	c |  Parse time        :        42.00 s 
19798.16/2520.02	c |
19798.16/2520.02	c |               Variables: 802
19798.16/2520.02	c |            Domain Sizes: 160001..160001
19798.16/2520.02	c |
19798.16/2520.02	c |             Constraints: 81001
19798.16/2520.02	c |                   Arity: 2..2  -- Binary: 81001
19798.16/2520.02	c | 
19798.16/2520.02	c |                   Types: 
19798.16/2520.02	c |                          (X -Y <= k): 81001
19798.16/2520.02	c |                          
19798.16/2520.02	c =========================================================================================================
19798.16/2520.02	c Parallel mode: Portfolio
19798.16/2520.02	c [pFactory][Group N°0] created (threads:8).
19798.16/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
19798.16/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
19798.16/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
19798.16/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
19798.16/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
19798.16/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
19798.16/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
19798.16/2520.02	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
19798.16/2520.02	c [pFactory][Group N°0] concurrent mode: enabled.
19798.16/2520.02	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
19798.16/2520.02	c [pFactory][Group N°0] task 7 launched on thread 4.
19798.16/2520.02	c [pFactory][Group N°0] task 6 launched on thread 0.
19798.16/2520.02	c [pFactory][Group N°0] task 5 launched on thread 6.
19798.16/2520.02	c [pFactory][Group N°0] task 4 launched on thread 1.
19798.16/2520.02	c [pFactory][Group N°0] task 3 launched on thread 7.
19798.16/2520.02	c [pFactory][Group N°0] task 2 launched on thread 2.
19798.16/2520.02	c [pFactory][Group N°0] task 1 launched on thread 3.
19798.16/2520.02	c [pFactory][Group N°0] task 0 launched on thread 5.
19798.16/2520.02	
19798.16/2520.02	c *** INTERRUPTED ***
19798.16/2520.02	c restarts              : 0           
19798.16/2520.02	c conflicts             : 0            (0 /sec)
19798.16/2520.02	c decisions             : 0            (0 /sec)
19798.16/2520.02	c propagations          : 1240174     (63 /sec)
19798.16/2520.02	c root propagations     : 0           
19798.16/2520.02	c filter calls          : 2229561        (113 /sec)
19798.16/2520.02	c useless filter calls  : 991880         (44 %)
19798.16/2520.02	c Memory used           : 11761.52 MB
19798.16/2520.02	c CPU time              : 19761.6 s
19798.16/2520.02	c real time             : 2520.02 s
19798.16/2520.02	
19798.16/2520.02	s UNKNOWN

Verifier Data


Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13035 MiB free)
  memory of node 1: 16384 MiB (15700 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4409380-1569825104/watcher-4409380-1569825104 -o /tmp/evaluation-result-4409380-1569825104/solver-4409380-1569825104 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node148-1569816318-31364 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4409380-1569825104.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=32757, runsolver pid=32754

[startup+0.100158 s]*
/proc/loadavg: 1.00 1.81 2.83 2/191 32758
/proc/meminfo: memFree=29273544/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=193780 memory=169480 CPUtime=0.1 cores=0-7
/proc/32757/stat : 32757 (cosoco) R 32754 32757 31337 0 -1 4202496 42539 0 0 0 5 5 0 0 20 0 1 0 558671856 198430720 42370 33554432000 4194304 6211132 140731903365872 140731903362408 5231269 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 48445 42370 751 493 0 41750 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 193780 KiB
Current children cumulated memory: 169480 KiB

[startup+0.209283 s]*
/proc/loadavg: 1.00 1.81 2.83 2/191 32758
/proc/meminfo: memFree=29097440/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=368992 memory=345040 CPUtime=0.21 cores=0-7
/proc/32757/stat : 32757 (cosoco) R 32754 32757 31337 0 -1 4202496 86443 0 0 0 11 10 0 0 20 0 1 0 558671856 377847808 86260 33554432000 4194304 6211132 140731903365872 140731903361816 5231349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 92405 86260 751 493 0 85710 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 368992 KiB
Current children cumulated memory: 345040 KiB

[startup+0.308578 s]*
/proc/loadavg: 1.00 1.81 2.83 2/191 32758
/proc/meminfo: memFree=28932520/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=534156 memory=510040 CPUtime=0.31 cores=0-7
/proc/32757/stat : 32757 (cosoco) R 32754 32757 31337 0 -1 4202496 127716 0 0 0 15 16 0 0 20 0 1 0 558671856 546975744 127510 33554432000 4194304 6211132 140731903365872 140731903361816 5231269 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 133539 127510 751 493 0 126844 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 534156 KiB
Current children cumulated memory: 510040 KiB

[startup+0.700341 s]
/proc/loadavg: 1.00 1.81 2.83 2/191 32758
/proc/meminfo: memFree=28598836/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=1171840 memory=1147600 CPUtime=0.69 cores=0-7
/proc/32757/stat : 32757 (cosoco) R 32754 32757 31337 0 -1 4202496 287078 0 0 0 35 34 0 0 20 0 1 0 558671856 1199964160 286900 33554432000 4194304 6211132 140731903365872 140731903361816 5231349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 292960 286900 751 493 0 286265 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 1171840 KiB
Current children cumulated memory: 1147600 KiB

[startup+1.50034 s]
/proc/loadavg: 1.00 1.81 2.83 2/191 32758
/proc/meminfo: memFree=27777584/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=2518536 memory=2494528 CPUtime=1.49 cores=0-7
/proc/32757/stat : 32757 (cosoco) R 32754 32757 31337 0 -1 4202496 623787 0 0 0 73 76 0 0 20 0 1 0 558671856 2578980864 623566 33554432000 4194304 6211132 140731903365872 140731903361816 5231349 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 629634 623632 751 493 0 622939 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 2518536 KiB
Current children cumulated memory: 2494528 KiB

[startup+3.10855 s]
/proc/loadavg: 1.00 1.81 2.83 2/191 32758
/proc/meminfo: memFree=24362872/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=5264316 memory=5239972 CPUtime=3.09 cores=0-7
/proc/32757/stat : 32757 (cosoco) R 32754 32757 31337 0 -1 4202496 1310512 0 0 0 152 157 0 0 20 0 1 0 558671856 5390659584 1309927 33554432000 4194304 6211132 140731903365872 140731903361816 5231269 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 1316079 1309993 751 493 0 1309384 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 5264316 KiB
Current children cumulated memory: 5239972 KiB

[startup+6.30032 s]
/proc/loadavg: 1.00 1.80 2.82 2/191 32758
/proc/meminfo: memFree=21306892/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=8143020 memory=8117740 CPUtime=6.29 cores=0-7
/proc/32757/stat : 32757 (cosoco) R 32754 32757 31337 0 -1 4202496 2031713 0 0 0 387 242 0 0 20 0 1 0 558671856 8338452480 2029435 33554432000 4194304 6211132 140731903365872 140731903363144 139888687164222 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 2035755 2029435 822 493 0 2029060 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 8143020 KiB
Current children cumulated memory: 8117740 KiB

[startup+12.7003 s]
/proc/loadavg: 1.00 1.79 2.81 2/191 32758
/proc/meminfo: memFree=20814336/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=8682292 memory=8657104 CPUtime=12.68 cores=0-7
/proc/32757/stat : 32757 (cosoco) R 32754 32757 31337 0 -1 4202496 2167264 0 0 0 1004 264 0 0 20 0 1 0 558671856 8890667008 2164210 33554432000 4194304 6211132 140731903365872 140731903360392 139888687168485 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 2170573 2164276 822 493 0 2163878 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 8682292 KiB
Current children cumulated memory: 8657104 KiB

[startup+25.5003 s]
/proc/loadavg: 1.00 1.75 2.78 2/191 32759
/proc/meminfo: memFree=19713356/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=9767132 memory=9741196 CPUtime=25.49 cores=0-7
/proc/32757/stat : 32757 (cosoco) R 32754 32757 31337 0 -1 4202496 2440497 0 0 0 2243 306 0 0 20 0 1 0 558671856 10001543168 2435299 33554432000 4194304 6211132 140731903365872 140731903360392 139888687168485 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 2441783 2435299 822 493 0 2435088 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 9767132 KiB
Current children cumulated memory: 9741196 KiB

[startup+51.1107 s]
/proc/loadavg: 1.56 1.80 2.77 9/199 301
/proc/meminfo: memFree=17974704/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=12043796 memory=11430888 CPUtime=86.64 cores=0-7
/proc/32757/stat : 32757 (cosoco) S 32754 32757 31337 0 -1 1077944320 4944064 0 0 0 7769 895 0 0 20 0 9 0 558671856 12332847104 2857722 33554432000 4194304 6211132 140731903365872 140731903364128 139888703209207 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 3010949 2857722 857 493 0 3004254 0
[pid=32757/tid=32762] ppid=32754 vsize=12043796 memory=0 CPUtime=5.07 cores=0-7
/proc/32757/task/32762/stat : 32762 (cosoco) R 32754 32757 31337 0 -1 4202560 174198 0 0 0 399 108 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880429452472 5392384 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32763] ppid=32754 vsize=12043796 memory=11430468 CPUtime=5.08 cores=0-7
/proc/32757/task/32763/stat : 32763 (cosoco) R 32754 32757 31337 0 -1 4202560 191900 0 0 0 496 12 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880421059768 5193760 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32764] ppid=32754 vsize=12043796 memory=0 CPUtime=5.08 cores=0-7
/proc/32757/task/32764/stat : 32764 (cosoco) R 32754 32757 31337 0 -1 4202560 174986 0 0 0 396 112 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880412667064 5397400 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32765] ppid=32754 vsize=12043796 memory=11106820 CPUtime=5.08 cores=0-7
/proc/32757/task/32765/stat : 32765 (cosoco) R 32754 32757 31337 0 -1 4202560 191889 0 0 0 496 12 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880404274360 5392384 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32766] ppid=32754 vsize=12043796 memory=984 CPUtime=5.01 cores=0-7
/proc/32757/task/32766/stat : 32766 (cosoco) R 32754 32757 31337 0 -1 4202560 173703 0 0 0 391 110 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880395881656 5393072 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32767] ppid=32754 vsize=12043796 memory=1940 CPUtime=5.07 cores=0-7
/proc/32757/task/32767/stat : 32767 (cosoco) R 32754 32757 31337 0 -1 4202560 192678 0 0 0 495 12 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880387488952 5392375 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=300] ppid=32754 vsize=12043796 memory=11430888 CPUtime=5.08 cores=0-7
/proc/32757/task/300/stat : 300 (cosoco) R 32754 32757 31337 0 -1 4202560 192266 0 0 0 496 12 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880379096248 5392384 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=301] ppid=32754 vsize=12043796 memory=0 CPUtime=5.08 cores=0-7
/proc/32757/task/301/stat : 301 (cosoco) R 32754 32757 31337 0 -1 4202560 172937 0 0 0 395 113 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880370703544 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
Current children cumulated CPU time: 86.64 s
Current children cumulated vsize: 12043796 KiB
Current children cumulated memory: 11430888 KiB

[startup+102.301 s]
/proc/loadavg: 5.21 2.76 3.04 9/199 305
/proc/meminfo: memFree=17974260/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=12043796 memory=11430888 CPUtime=495.36 cores=0-7
/proc/32757/stat : 32757 (cosoco) S 32754 32757 31337 0 -1 1077944320 7346210 0 0 0 48452 1084 0 0 20 0 9 0 558671856 12332847104 2857722 33554432000 4194304 6211132 140731903365872 140731903364128 139888703209207 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 3010949 2857722 857 493 0 3004254 0
[pid=32757/tid=32762] ppid=32754 vsize=12043796 memory=11430888 CPUtime=56.22 cores=0-7
/proc/32757/task/32762/stat : 32762 (cosoco) R 32754 32757 31337 0 -1 4202560 478511 0 0 0 5480 142 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880429452472 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32763] ppid=32754 vsize=12043796 memory=11430888 CPUtime=56.25 cores=0-7
/proc/32757/task/32763/stat : 32763 (cosoco) R 32754 32757 31337 0 -1 4202560 484866 0 0 0 5598 27 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880421059768 5393095 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32764] ppid=32754 vsize=12043796 memory=11430888 CPUtime=56.24 cores=0-7
/proc/32757/task/32764/stat : 32764 (cosoco) R 32754 32757 31337 0 -1 4202560 469721 0 0 0 5481 143 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880412667064 5397400 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32765] ppid=32754 vsize=12043796 memory=0 CPUtime=56.26 cores=0-7
/proc/32757/task/32765/stat : 32765 (cosoco) R 32754 32757 31337 0 -1 4202560 495295 0 0 0 5593 33 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880404274360 5397400 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32766] ppid=32754 vsize=12043796 memory=54 CPUtime=55.67 cores=0-7
/proc/32757/task/32766/stat : 32766 (cosoco) R 32754 32757 31337 0 -1 4202560 473219 0 0 0 5430 137 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880395881656 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32767] ppid=32754 vsize=12043796 memory=33 CPUtime=56.25 cores=0-7
/proc/32757/task/32767/stat : 32767 (cosoco) R 32754 32757 31337 0 -1 4202560 493015 0 0 0 5597 28 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880387488952 5397400 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=300] ppid=32754 vsize=12043796 memory=3588 CPUtime=56.25 cores=0-7
/proc/32757/task/300/stat : 300 (cosoco) R 32754 32757 31337 0 -1 4202560 499066 0 0 0 5594 31 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880379096248 5397400 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=301] ppid=32754 vsize=12043796 memory=10552 CPUtime=56.12 cores=0-7
/proc/32757/task/301/stat : 301 (cosoco) R 32754 32757 31337 0 -1 4202560 473015 0 0 0 5473 139 0 0 20 0 9 0 558676459 12332847104 2857722 33554432000 4194304 6211132 140731903365872 139880370703544 5397400 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
Current children cumulated CPU time: 495.36 s
Current children cumulated vsize: 12043796 KiB
Current children cumulated memory: 11430888 KiB

[startup+162.301 s]
/proc/loadavg: 6.97 3.71 3.35 9/199 308
/proc/meminfo: memFree=17971968/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=12043796 memory=11435548 CPUtime=974.37 cores=0-7
/proc/32757/stat : 32757 (cosoco) S 32754 32757 31337 0 -1 1077944320 9751006 0 0 0 96121 1316 0 0 20 0 9 0 558671856 12332847104 2858887 33554432000 4194304 6211132 140731903365872 140731903364128 139888703209207 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 3010949 2858887 857 493 0 3004254 0
[pid=32757/tid=32762] ppid=32754 vsize=12043796 memory=11435496 CPUtime=116.08 cores=0-7
/proc/32757/task/32762/stat : 32762 (cosoco) R 32754 32757 31337 0 -1 4202560 790990 0 0 0 11420 188 0 0 20 0 9 0 558676459 12332847104 2858887 33554432000 4194304 6211132 140731903365872 139880429452072 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32763] ppid=32754 vsize=12043796 memory=11435068 CPUtime=116.25 cores=0-7
/proc/32757/task/32763/stat : 32763 (cosoco) R 32754 32757 31337 0 -1 4202560 772137 0 0 0 11585 40 0 0 20 0 9 0 558676459 12332847104 2858887 33554432000 4194304 6211132 140731903365872 139880421059432 5193760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32764] ppid=32754 vsize=12043796 memory=11435068 CPUtime=115.57 cores=0-7
/proc/32757/task/32764/stat : 32764 (cosoco) R 32754 32757 31337 0 -1 4202560 777035 0 0 0 11375 182 0 0 20 0 9 0 558676459 12332847104 2858887 33554432000 4194304 6211132 140731903365872 139880412666824 5393104 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32765] ppid=32754 vsize=12043796 memory=11435312 CPUtime=116.25 cores=0-7
/proc/32757/task/32765/stat : 32765 (cosoco) R 32754 32757 31337 0 -1 4202560 793317 0 0 0 11573 52 0 0 20 0 9 0 558676459 12332847104 2858887 33554432000 4194304 6211132 140731903365872 139880404274024 5193765 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32766] ppid=32754 vsize=12043796 memory=11435512 CPUtime=115.58 cores=0-7
/proc/32757/task/32766/stat : 32766 (cosoco) R 32754 32757 31337 0 -1 4202560 771199 0 0 0 11378 180 0 0 20 0 9 0 558676459 12332847104 2858887 33554432000 4194304 6211132 140731903365872 139880395881416 5393104 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32767] ppid=32754 vsize=12043796 memory=11435512 CPUtime=116.22 cores=0-7
/proc/32757/task/32767/stat : 32767 (cosoco) R 32754 32757 31337 0 -1 4202560 790551 0 0 0 11578 44 0 0 20 0 9 0 558676459 12332847104 2858887 33554432000 4194304 6211132 140731903365872 139880387488712 5193760 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=300] ppid=32754 vsize=12043796 memory=11434648 CPUtime=116.23 cores=0-7
/proc/32757/task/300/stat : 300 (cosoco) R 32754 32757 31337 0 -1 4202560 795928 0 0 0 11575 48 0 0 20 0 9 0 558676459 12332847104 2858887 33554432000 4194304 6211132 140731903365872 139880379095912 5392375 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=301] ppid=32754 vsize=12043796 memory=11435312 CPUtime=116.1 cores=0-7
/proc/32757/task/301/stat : 301 (cosoco) R 32754 32757 31337 0 -1 4202560 780342 0 0 0 11431 179 0 0 20 0 9 0 558676459 12332847104 2858887 33554432000 4194304 6211132 140731903365872 139880370703240 5392384 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
Current children cumulated CPU time: 974.37 s
Current children cumulated vsize: 12043796 KiB
Current children cumulated memory: 11435548 KiB

[startup+222.301 s]
/proc/loadavg: 7.68 4.51 3.65 9/199 313

################
# More data... #
################


[startup+2322.3 s]
/proc/loadavg: 8.79 8.39 7.83 9/199 494
/proc/meminfo: memFree=17618616/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=12043796 memory=11790936 CPUtime=18219.6 cores=0-7
/proc/32757/stat : 32757 (cosoco) S 32754 32757 31337 0 -1 1077944320 46748874 0 0 0 1818467 3492 0 0 20 0 9 0 558671856 12332847104 2947734 33554432000 4194304 6211132 140731903365872 140731903364128 139888703209207 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 3010949 2947734 857 493 0 3004254 0
[pid=32757/tid=32762] ppid=32754 vsize=12043796 memory=11790632 CPUtime=2273.38 cores=0-7
/proc/32757/task/32762/stat : 32762 (cosoco) R 32754 32757 31337 0 -1 4202560 5413323 0 0 0 226798 540 0 0 20 0 9 0 558676459 12332847104 2947734 33554432000 4194304 6211132 140731903365872 139880429452168 5392375 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32763] ppid=32754 vsize=12043796 memory=11790264 CPUtime=2275.76 cores=0-7
/proc/32757/task/32763/stat : 32763 (cosoco) R 32754 32757 31337 0 -1 4202560 5396850 0 0 0 227290 286 0 0 20 0 9 0 558676459 12332847104 2947734 33554432000 4194304 6211132 140731903365872 139880421059528 5193760 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32764] ppid=32754 vsize=12043796 memory=11789896 CPUtime=2267.85 cores=0-7
/proc/32757/task/32764/stat : 32764 (cosoco) R 32754 32757 31337 0 -1 4202560 5398828 0 0 0 226343 442 0 0 20 0 9 0 558676459 12332847104 2947734 33554432000 4194304 6211132 140731903365872 139880412666824 5393098 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32765] ppid=32754 vsize=12043796 memory=11790228 CPUtime=2275.83 cores=0-7
/proc/32757/task/32765/stat : 32765 (cosoco) R 32754 32757 31337 0 -1 4202560 5418824 0 0 0 227285 298 0 0 20 0 9 0 558676459 12332847104 2947734 33554432000 4194304 6211132 140731903365872 139880404274120 5193760 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32766] ppid=32754 vsize=12043796 memory=11790008 CPUtime=2266.09 cores=0-7
/proc/32757/task/32766/stat : 32766 (cosoco) R 32754 32757 31337 0 -1 4202560 5398879 0 0 0 226174 435 0 0 20 0 9 0 558676459 12332847104 2947734 33554432000 4194304 6211132 140731903365872 139880395881416 5393104 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32767] ppid=32754 vsize=12043796 memory=11790876 CPUtime=2275.66 cores=0-7
/proc/32757/task/32767/stat : 32767 (cosoco) R 32754 32757 31337 0 -1 4202560 5419153 0 0 0 227283 283 0 0 20 0 9 0 558676459 12332847104 2947734 33554432000 4194304 6211132 140731903365872 139880387488712 5193760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=300] ppid=32754 vsize=12043796 memory=11790476 CPUtime=2273.13 cores=0-7
/proc/32757/task/300/stat : 300 (cosoco) R 32754 32757 31337 0 -1 4202560 5422202 0 0 0 226938 375 0 0 20 0 9 0 558676459 12332847104 2947734 33554432000 4194304 6211132 140731903365872 139880379095848 5392375 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=301] ppid=32754 vsize=12043796 memory=11790664 CPUtime=2265.79 cores=0-7
/proc/32757/task/301/stat : 301 (cosoco) R 32754 32757 31337 0 -1 4202560 5401308 0 0 0 226150 429 0 0 20 0 9 0 558676459 12332847104 2947734 33554432000 4194304 6211132 140731903365872 139880370703304 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
Current children cumulated CPU time: 18219.6 s
Current children cumulated vsize: 12043796 KiB
Current children cumulated memory: 11790936 KiB

[startup+2382.3 s]
/proc/loadavg: 8.88 8.47 7.89 9/200 508
/proc/meminfo: memFree=17605692/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=12043796 memory=11801640 CPUtime=18698.6 cores=0-7
/proc/32757/stat : 32757 (cosoco) S 32754 32757 31337 0 -1 1077944320 47751239 0 0 0 1866314 3547 0 0 20 0 9 0 558671856 12332847104 2950410 33554432000 4194304 6211132 140731903365872 140731903364128 139888703209207 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 3010949 2950410 857 493 0 3004254 0
[pid=32757/tid=32762] ppid=32754 vsize=12043796 memory=11800344 CPUtime=2333.37 cores=0-7
/proc/32757/task/32762/stat : 32762 (cosoco) R 32754 32757 31337 0 -1 4202560 5535913 0 0 0 232791 546 0 0 20 0 9 0 558676459 12332847104 2950410 33554432000 4194304 6211132 140731903365872 139880429452136 5193760 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32763] ppid=32754 vsize=12043796 memory=188988 CPUtime=2335.75 cores=0-7
/proc/32757/task/32763/stat : 32763 (cosoco) R 32754 32757 31337 0 -1 4202560 5523596 0 0 0 233284 291 0 0 20 0 9 0 558676459 12332847104 2950410 33554432000 4194304 6211132 140731903365872 139880421059528 5393072 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32764] ppid=32754 vsize=12043796 memory=10600 CPUtime=2327.43 cores=0-7
/proc/32757/task/32764/stat : 32764 (cosoco) R 32754 32757 31337 0 -1 4202560 5525431 0 0 0 232294 449 0 0 20 0 9 0 558676459 12332847104 2950410 33554432000 4194304 6211132 140731903365872 139880412666824 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32765] ppid=32754 vsize=12043796 memory=11801640 CPUtime=2335.82 cores=0-7
/proc/32757/task/32765/stat : 32765 (cosoco) R 32754 32757 31337 0 -1 4202560 5545896 0 0 0 233276 306 0 0 20 0 9 0 558676459 12332847104 2950410 33554432000 4194304 6211132 140731903365872 139880404274120 5172252 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32766] ppid=32754 vsize=12043796 memory=11801420 CPUtime=2326.09 cores=0-7
/proc/32757/task/32766/stat : 32766 (cosoco) R 32754 32757 31337 0 -1 4202560 5521465 0 0 0 232167 442 0 0 20 0 9 0 558676459 12332847104 2950410 33554432000 4194304 6211132 140731903365872 139880395881416 5393072 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32767] ppid=32754 vsize=12043796 memory=3588 CPUtime=2335.66 cores=0-7
/proc/32757/task/32767/stat : 32767 (cosoco) R 32754 32757 31337 0 -1 4202560 5546153 0 0 0 233274 292 0 0 20 0 9 0 558676459 12332847104 2950410 33554432000 4194304 6211132 140731903365872 139880387488712 5393095 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=300] ppid=32754 vsize=12043796 memory=776 CPUtime=2332.91 cores=0-7
/proc/32757/task/300/stat : 300 (cosoco) R 32754 32757 31337 0 -1 4202560 5549421 0 0 0 232910 381 0 0 20 0 9 0 558676459 12332847104 2950410 33554432000 4194304 6211132 140731903365872 139880379095944 5393072 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=301] ppid=32754 vsize=12043796 memory=1160 CPUtime=2325.49 cores=0-7
/proc/32757/task/301/stat : 301 (cosoco) R 32754 32757 31337 0 -1 4202560 5523857 0 0 0 232113 436 0 0 20 0 9 0 558676459 12332847104 2950410 33554432000 4194304 6211132 140731903365872 139880370703304 5193765 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
Current children cumulated CPU time: 18698.6 s
Current children cumulated vsize: 12043796 KiB
Current children cumulated memory: 11801640 KiB

[startup+2442.3 s]
/proc/loadavg: 8.94 8.57 7.96 9/200 511
/proc/meminfo: memFree=17597292/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=12043796 memory=11812580 CPUtime=19177.7 cores=0-7
/proc/32757/stat : 32757 (cosoco) S 32754 32757 31337 0 -1 1077944320 48775222 0 0 0 1914169 3601 0 0 20 0 9 0 558671856 12332847104 2953145 33554432000 4194304 6211132 140731903365872 140731903364128 139888703209207 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 3010949 2953145 857 493 0 3004254 0
[pid=32757/tid=32762] ppid=32754 vsize=12043796 memory=11812496 CPUtime=2393.37 cores=0-7
/proc/32757/task/32762/stat : 32762 (cosoco) R 32754 32757 31337 0 -1 4202560 5667420 0 0 0 238784 553 0 0 20 0 9 0 558676459 12332847104 2953145 33554432000 4194304 6211132 140731903365872 139880429452232 5393072 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32763] ppid=32754 vsize=12043796 memory=11812144 CPUtime=2395.74 cores=0-7
/proc/32757/task/32763/stat : 32763 (cosoco) R 32754 32757 31337 0 -1 4202560 5651019 0 0 0 239276 298 0 0 20 0 9 0 558676459 12332847104 2953145 33554432000 4194304 6211132 140731903365872 139880421059528 5393104 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32764] ppid=32754 vsize=12043796 memory=11811608 CPUtime=2387.37 cores=0-7
/proc/32757/task/32764/stat : 32764 (cosoco) R 32754 32757 31337 0 -1 4202560 5652828 0 0 0 238282 455 0 0 20 0 9 0 558676459 12332847104 2953145 33554432000 4194304 6211132 140731903365872 139880412666728 5393072 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32765] ppid=32754 vsize=12043796 memory=11807140 CPUtime=2395.82 cores=0-7
/proc/32757/task/32765/stat : 32765 (cosoco) R 32754 32757 31337 0 -1 4202560 5673410 0 0 0 239269 313 0 0 20 0 9 0 558676459 12332847104 2953145 33554432000 4194304 6211132 140731903365872 139880404274120 5392352 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32766] ppid=32754 vsize=12043796 memory=11809588 CPUtime=2386.09 cores=0-7
/proc/32757/task/32766/stat : 32766 (cosoco) R 32754 32757 31337 0 -1 4202560 5648837 0 0 0 238158 451 0 0 20 0 9 0 558676459 12332847104 2953145 33554432000 4194304 6211132 140731903365872 139880395881416 5172264 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32767] ppid=32754 vsize=12043796 memory=11812368 CPUtime=2395.67 cores=0-7
/proc/32757/task/32767/stat : 32767 (cosoco) R 32754 32757 31337 0 -1 4202560 5673915 0 0 0 239271 296 0 0 20 0 9 0 558676459 12332847104 2953145 33554432000 4194304 6211132 140731903365872 139880387488552 5193760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=300] ppid=32754 vsize=12043796 memory=11812524 CPUtime=2392.9 cores=0-7
/proc/32757/task/300/stat : 300 (cosoco) R 32754 32757 31337 0 -1 4202560 5676782 0 0 0 238901 389 0 0 20 0 9 0 558676459 12332847104 2953145 33554432000 4194304 6211132 140731903365872 139880379096008 5393104 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=301] ppid=32754 vsize=12043796 memory=1556 CPUtime=2384.65 cores=0-7
/proc/32757/task/301/stat : 301 (cosoco) R 32754 32757 31337 0 -1 4202560 5651504 0 0 0 238023 442 0 0 20 0 9 0 558676459 12332847104 2953145 33554432000 4194304 6211132 140731903365872 139880370703240 5193760 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
Current children cumulated CPU time: 19177.7 s
Current children cumulated vsize: 12043796 KiB
Current children cumulated memory: 11812580 KiB

[startup+2502.3 s]
/proc/loadavg: 8.58 8.55 8.00 9/200 514
/proc/meminfo: memFree=17584072/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=12043796 memory=11824064 CPUtime=19656.8 cores=0-7
/proc/32757/stat : 32757 (cosoco) S 32754 32757 31337 0 -1 1077944320 49782118 0 0 0 1962016 3660 0 0 20 0 9 0 558671856 12332847104 2956016 33554432000 4194304 6211132 140731903365872 140731903364128 139888703209207 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 3010949 2956016 857 493 0 3004254 0
[pid=32757/tid=32762] ppid=32754 vsize=12043796 memory=11821716 CPUtime=2453.37 cores=0-7
/proc/32757/task/32762/stat : 32762 (cosoco) R 32754 32757 31337 0 -1 4202560 5794804 0 0 0 244775 562 0 0 20 0 9 0 558676459 12332847104 2956016 33554432000 4194304 6211132 140731903365872 139880429452232 5193760 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32763] ppid=32754 vsize=12043796 memory=11822752 CPUtime=2455.73 cores=0-7
/proc/32757/task/32763/stat : 32763 (cosoco) R 32754 32757 31337 0 -1 4202560 5774391 0 0 0 245267 306 0 0 20 0 9 0 558676459 12332847104 2956016 33554432000 4194304 6211132 140731903365872 139880421059432 5193760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32764] ppid=32754 vsize=12043796 memory=11823364 CPUtime=2447.33 cores=0-7
/proc/32757/task/32764/stat : 32764 (cosoco) R 32754 32757 31337 0 -1 4202560 5776102 0 0 0 244270 463 0 0 20 0 9 0 558676459 12332847104 2956016 33554432000 4194304 6211132 140731903365872 139880412666760 5193760 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32765] ppid=32754 vsize=12043796 memory=11823976 CPUtime=2455.81 cores=0-7
/proc/32757/task/32765/stat : 32765 (cosoco) R 32754 32757 31337 0 -1 4202560 5796626 0 0 0 245262 319 0 0 20 0 9 0 558676459 12332847104 2956016 33554432000 4194304 6211132 140731903365872 139880404274120 5392384 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32766] ppid=32754 vsize=12043796 memory=11820484 CPUtime=2446.07 cores=0-7
/proc/32757/task/32766/stat : 32766 (cosoco) R 32754 32757 31337 0 -1 4202560 5780378 0 0 0 244148 459 0 0 20 0 9 0 558676459 12332847104 2956016 33554432000 4194304 6211132 140731903365872 139880395881416 5392375 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32767] ppid=32754 vsize=12043796 memory=11823040 CPUtime=2455.65 cores=0-7
/proc/32757/task/32767/stat : 32767 (cosoco) R 32754 32757 31337 0 -1 4202560 5797216 0 0 0 245262 303 0 0 20 0 9 0 558676459 12332847104 2956016 33554432000 4194304 6211132 140731903365872 139880387488712 5193760 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=300] ppid=32754 vsize=12043796 memory=6935054825532540783 CPUtime=2452.64 cores=0-7
/proc/32757/task/300/stat : 300 (cosoco) R 32754 32757 31337 0 -1 4202560 5800127 0 0 0 244870 394 0 0 20 0 9 0 558676459 12332847104 2956016 33554432000 4194304 6211132 140731903365872 139880379096008 5193765 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=301] ppid=32754 vsize=12043796 memory=1416 CPUtime=2444.06 cores=0-7
/proc/32757/task/301/stat : 301 (cosoco) R 32754 32757 31337 0 -1 4202560 5782967 0 0 0 243957 449 0 0 20 0 9 0 558676459 12332847104 2956016 33554432000 4194304 6211132 140731903365872 139880370703304 5193760 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
Current children cumulated CPU time: 19656.8 s
Current children cumulated vsize: 12043796 KiB
Current children cumulated memory: 11824064 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 8.42 8.52 8.00 9/200 516
/proc/meminfo: memFree=17581156/32770624 swapFree=67002708/67108860
[pid=32757] ppid=32754 vsize=12043796 memory=11826600 CPUtime=19798.2 cores=0-7
/proc/32757/stat : 32757 (cosoco) S 32754 32757 31337 0 -1 1077944320 49814193 0 0 0 1976153 3663 0 0 20 0 9 0 558671856 12332847104 2956650 33554432000 4194304 6211132 140731903365872 140731903364128 139888703209207 0 0 4096 8405026 18446744073709551615 0 0 17 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
/proc/32757/statm: 3010949 2956650 857 493 0 3004254 0
[pid=32757/tid=32762] ppid=32754 vsize=12043796 memory=6935054825532540783 CPUtime=2471.07 cores=0-7
/proc/32757/task/32762/stat : 32762 (cosoco) R 32754 32757 31337 0 -1 4202560 5796046 0 0 0 246545 562 0 0 20 0 9 0 558676459 12332847104 2956650 33554432000 4194304 6211132 140731903365872 139880429452232 5392375 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32763] ppid=32754 vsize=12043796 memory=111632 CPUtime=2473.44 cores=0-7
/proc/32757/task/32763/stat : 32763 (cosoco) R 32754 32757 31337 0 -1 4202560 5780001 0 0 0 247037 307 0 0 20 0 9 0 558676459 12332847104 2956650 33554432000 4194304 6211132 140731903365872 139880421059528 5193760 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32764] ppid=32754 vsize=12043796 memory=804 CPUtime=2465.05 cores=0-7
/proc/32757/task/32764/stat : 32764 (cosoco) R 32754 32757 31337 0 -1 4202560 5782047 0 0 0 246041 464 0 0 20 0 9 0 558676459 12332847104 2956650 33554432000 4194304 6211132 140731903365872 139880412666824 5393072 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32765] ppid=32754 vsize=12043796 memory=1808 CPUtime=2473.52 cores=0-7
/proc/32757/task/32765/stat : 32765 (cosoco) R 32754 32757 31337 0 -1 4202560 5802170 0 0 0 247033 319 0 0 20 0 9 0 558676459 12332847104 2956650 33554432000 4194304 6211132 140731903365872 139880404274024 5392352 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32766] ppid=32754 vsize=12043796 memory=920 CPUtime=2463.78 cores=0-7
/proc/32757/task/32766/stat : 32766 (cosoco) R 32754 32757 31337 0 -1 4202560 5781678 0 0 0 245918 460 0 0 20 0 9 0 558676459 12332847104 2956650 33554432000 4194304 6211132 140731903365872 139880395881416 5193760 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=32767] ppid=32754 vsize=12043796 memory=4132 CPUtime=2473.36 cores=0-7
/proc/32757/task/32767/stat : 32767 (cosoco) R 32754 32757 31337 0 -1 4202560 5802744 0 0 0 247032 304 0 0 20 0 9 0 558676459 12332847104 2956650 33554432000 4194304 6211132 140731903365872 139880387488552 5392352 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=300] ppid=32754 vsize=12043796 memory=4108 CPUtime=2470.1 cores=0-7
/proc/32757/task/300/stat : 300 (cosoco) R 32754 32757 31337 0 -1 4202560 5805588 0 0 0 246615 395 0 0 20 0 9 0 558676459 12332847104 2956650 33554432000 4194304 6211132 140731903365872 139880379096008 5393104 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
[pid=32757/tid=301] ppid=32754 vsize=12043796 memory=1736 CPUtime=2461.75 cores=0-7
/proc/32757/task/301/stat : 301 (cosoco) R 32754 32757 31337 0 -1 4202560 5784412 0 0 0 245726 449 0 0 20 0 9 0 558676459 12332847104 2956650 33554432000 4194304 6211132 140731903365872 139880370703304 5393104 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 27365376 140731903374353 140731903374445 140731903374445 140731903377358 0
Current children cumulated CPU time: 19798.2 s
Current children cumulated vsize: 12043796 KiB
Current children cumulated memory: 11826600 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.55 s]
# the end of solver process 32757 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=19761.6 s, system=37.163 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2520.4 s]
/proc/loadavg: 8.42 8.52 8.00 2/193 516
/proc/meminfo: memFree=22770744/32770624 swapFree=67002708/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

[startup+2520.5 s]
/proc/loadavg: 8.42 8.52 8.00 2/193 516
/proc/meminfo: memFree=22770744/32770624 swapFree=67002708/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

Child status: 1
Real time (s): 2520.55
CPU time (s): 19798.8
CPU user time (s): 19761.6
CPU system time (s): 37.163
CPU usage (%): 785.494
Max. virtual memory (cumulated for all children) (KiB): 12043796
Max. memory (cumulated for all children) (KiB): 11826600

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 19761.6
system time used= 37.163
maximum resident set size= 11827568
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 49814239
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7123
involuntary context switches= 165553


# summary of solver processes directly reported to runsolver:
#   pid: 32757
#   total CPU time (s): 19798.8
#   total CPU user time (s): 19761.6
#   total CPU system time (s): 37.163

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 12.5375 second user time and 22.0486 second system time

The end

Launcher Data

Begin job on node148 at 2019-09-30 08:31:06
IDJOB=4409380
IDBENCH=126849
IDSOLVER=2877
FILE ID=node148/4409380-1569825104
RUNJOBID= node148-1569816318-31364
PBS_JOBID= 21705905
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0 parallel
BENCH NAME= XCSP17/PropStress/PropStress-m1-s1/PropStress-0400.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4409380-1569825104/watcher-4409380-1569825104 -o /tmp/evaluation-result-4409380-1569825104/solver-4409380-1569825104 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node148-1569816318-31364 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4409380-1569825104.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= cd36f5a432e3b868ff7ac280438203b6
RANDOM SEED=1503162854

node148.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        29425216 kB
MemAvailable:   31873740 kB
Buffers:          135556 kB
Cached:          2650832 kB
SwapCached:         3492 kB
Active:          1792964 kB
Inactive:         998692 kB
Active(anon):       2500 kB
Inactive(anon):    82664 kB
Active(file):    1790464 kB
Inactive(file):   916028 kB
Unevictable:      110988 kB
Mlocked:          110988 kB
SwapTotal:      67108860 kB
SwapFree:       67002708 kB
Dirty:              5348 kB
Writeback:             0 kB
AnonPages:        112832 kB
Mapped:            26692 kB
Shmem:             71772 kB
Slab:             144408 kB
SReclaimable:     115732 kB
SUnreclaim:        28676 kB
KernelStack:        3424 kB
PageTables:         5452 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     538564 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 62024 MiB
End job on node148 at 2019-09-30 09:13:07