Trace number 4398022

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.O parallelUNSAT 5714.61 723.209

General information on the benchmark

NamePropStress/PropStress-m1-s1/
PropStress-0150.xml
MD5SUMb9bf68be3b756b1f34bbd3d4e06d542d
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark19.599
Satisfiable
(Un)Satisfiability was proved
Number of variables302
Number of constraints11626
Number of domains1
Minimum domain size22501
Maximum domain size22501
Distribution of domain sizes[{"size":22501,"count":302}]
Minimum variable degree2
Maximum variable degree151
Distribution of variable degrees[{"degree":2,"count":1},{"degree":3,"count":149},{"degree":150,"count":149},{"degree":151,"count":3}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":11626}]
Number of extensional constraints0
Number of intensional constraints11626
Distribution of constraint types[{"type":"intension","count":11626}]
Optimization problemNO
Type of objective

Solver Data 

5714.32/723.10	c
5714.32/723.10	c This is cosoco 2.00 --  
5714.32/723.10	c
5714.32/723.10	c command line: cosoco -model -nbcores=8 HOME/instance-4398022-1568603633.xml 
5714.32/723.10	c ========================================[ Problem Statistics ]===========================================
5714.32/723.10	c |                                                                                                       
5714.32/723.10	c |  Parse time        :         5.96 s 
5714.32/723.10	c |
5714.32/723.10	c |               Variables: 302
5714.32/723.10	c |            Domain Sizes: 22501..22501
5714.32/723.10	c |
5714.32/723.10	c |             Constraints: 11626
5714.32/723.10	c |                   Arity: 2..2  -- Binary: 11626
5714.32/723.10	c | 
5714.32/723.10	c |                   Types: 
5714.32/723.10	c |                          (X -Y <= k): 11626
5714.32/723.10	c |                          
5714.32/723.10	c =========================================================================================================
5714.32/723.10	c Parallel mode: Portfolio
5714.32/723.10	c [pFactory][Group N°0] created (threads:8).
5714.32/723.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:1).
5714.32/723.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:2).
5714.32/723.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:3).
5714.32/723.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:4).
5714.32/723.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:5).
5714.32/723.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:6).
5714.32/723.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:7).
5714.32/723.10	c [pFactory][Group N°0] new task added (threads:8 - tasks:8).
5714.32/723.10	c [pFactory][Group N°0] concurrent mode: enabled.
5714.32/723.10	c [pFactory][Group N°0] computations in progress (threads:8 - tasks:8).
5714.32/723.10	c [pFactory][Group N°0] task 7 launched on thread 0.
5714.32/723.10	c [pFactory][Group N°0] task 6 launched on thread 2.
5714.32/723.10	c [pFactory][Group N°0] task 5 launched on thread 1.
5714.32/723.10	c [pFactory][Group N°0] task 4 launched on thread 6.
5714.32/723.10	c [pFactory][Group N°0] task 3 launched on thread 7.
5714.32/723.10	c [pFactory][Group N°0] task 2 launched on thread 3.
5714.32/723.10	c [pFactory][Group N°0] task 1 launched on thread 5.
5714.32/723.10	c [pFactory][Group N°0] task 0 launched on thread 4.
5714.32/723.10	c [pFactory][Group N°0] concurent mode: thread 0 has won with the task 7.
5714.32/723.10	c [pFactory][Group N°0] Thread N°0 is joined.
5714.32/723.10	c [pFactory][Group N°0] Thread N°1 is joined.
5714.32/723.10	c [pFactory][Group N°0] Thread N°2 is joined.
5714.32/723.10	c [pFactory][Group N°0] Thread N°3 is joined.
5714.32/723.10	c [pFactory][Group N°0] Thread N°4 is joined.
5714.32/723.10	c [pFactory][Group N°0] Thread N°5 is joined.
5714.32/723.10	c [pFactory][Group N°0] Thread N°6 is joined.
5714.32/723.10	c [pFactory][Group N°0] Thread N°7 is joined.
5714.32/723.10	c [pFactory][Group N°0] Return Code of the winner:2 (Thread N°0)
5714.32/723.10	s UNSATISFIABLE
5714.32/723.10	c restarts              : 0           
5714.32/723.10	c conflicts             : 0            (0 /sec)
5714.32/723.10	c decisions             : 0            (0 /sec)
5714.32/723.10	c propagations          : 5356662     (938 /sec)
5714.32/723.10	c root propagations     : 5356662     
5714.32/723.10	c filter calls          : 8699069        (1524 /sec)
5714.32/723.10	c useless filter calls  : 3365060        (38 %)
5714.32/723.10	c Memory used           : 2827.04 MB
5714.32/723.10	c CPU time              : 5708.37 s
5714.32/723.10	c real time             : 723.098 s
5714.32/723.10

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14698 MiB free)
  memory of node 1: 16384 MiB (15818 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4398022-1568603633/watcher-4398022-1568603633 -o /tmp/evaluation-result-4398022-1568603633/solver-4398022-1568603633 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node139-1568596036-1355 --watchdog 2580 cosoco -model -nbcores=8 HOME/instance-4398022-1568603633.xml 

running on 8 cores: 0,2,4,6,1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 20160 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 20190 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 31744000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 31795200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=2837, runsolver pid=2834

[startup+0.100169 s]*
/proc/loadavg: 1.86 1.22 1.54 2/189 2838
/proc/meminfo: memFree=31097348/32770624 swapFree=66921468/67108860
[pid=2837] ppid=2834 vsize=190480 memory=166576 CPUtime=0.1 cores=0-7
/proc/2837/stat : 2837 (cosoco) R 2834 2837 1328 0 -1 4202496 41817 0 0 0 5 5 0 0 20 0 1 0 436631817 195051520 41644 33554432000 4194304 6211092 140733785205200 140733785201736 5231317 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 47664 41644 751 493 0 40969 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 190480 KiB
Current children cumulated memory: 166576 KiB

[startup+0.209256 s]*
/proc/loadavg: 1.86 1.22 1.54 2/190 2840
/proc/meminfo: memFree=30924836/32770624 swapFree=66921468/67108860
[pid=2837] ppid=2834 vsize=362752 memory=338704 CPUtime=0.2 cores=0-7
/proc/2837/stat : 2837 (cosoco) R 2834 2837 1328 0 -1 4202496 84861 0 0 0 10 10 0 0 20 0 1 0 436631817 371458048 84676 33554432000 4194304 6211092 140733785205200 140733785201736 5231237 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 90688 84676 751 493 0 83993 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 362752 KiB
Current children cumulated memory: 338704 KiB

[startup+0.309193 s]*
/proc/loadavg: 1.86 1.22 1.54 2/190 2840
/proc/meminfo: memFree=30820676/32770624 swapFree=66921468/67108860
[pid=2837] ppid=2834 vsize=454960 memory=431308 CPUtime=0.3 cores=0-7
/proc/2837/stat : 2837 (cosoco) R 2834 2837 1328 0 -1 4202496 107998 0 0 0 18 12 0 0 20 0 1 0 436631817 465879040 107827 33554432000 4194304 6211092 140733785205200 140733785201736 140295036394469 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 113740 107827 821 493 0 107045 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 454960 KiB
Current children cumulated memory: 431308 KiB

[startup+0.700298 s]
/proc/loadavg: 1.86 1.22 1.54 2/190 2840
/proc/meminfo: memFree=30813608/32770624 swapFree=66921468/67108860
[pid=2837] ppid=2834 vsize=468932 memory=445112 CPUtime=0.69 cores=0-7
/proc/2837/stat : 2837 (cosoco) R 2834 2837 1328 0 -1 4202496 111520 0 0 0 56 13 0 0 20 0 1 0 436631817 480186368 111278 33554432000 4194304 6211092 140733785205200 140733785201736 140295036394469 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 117266 111278 822 493 0 110571 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 468932 KiB
Current children cumulated memory: 445112 KiB

[startup+1.50032 s]
/proc/loadavg: 1.86 1.22 1.54 2/190 2840
/proc/meminfo: memFree=30790552/32770624 swapFree=66921468/67108860
[pid=2837] ppid=2834 vsize=510676 memory=486824 CPUtime=1.49 cores=0-7
/proc/2837/stat : 2837 (cosoco) R 2834 2837 1328 0 -1 4202496 121952 0 0 0 135 14 0 0 20 0 1 0 436631817 522932224 121706 33554432000 4194304 6211092 140733785205200 140733785201736 140295036394469 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 127669 121706 822 493 0 120974 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 510676 KiB
Current children cumulated memory: 486824 KiB

[startup+3.10918 s]
/proc/loadavg: 1.86 1.22 1.54 2/190 2840
/proc/meminfo: memFree=30687304/32770624 swapFree=66921468/67108860
[pid=2837] ppid=2834 vsize=594440 memory=570448 CPUtime=3.1 cores=0-7
/proc/2837/stat : 2837 (cosoco) R 2834 2837 1328 0 -1 4202496 144189 0 0 0 291 19 0 0 20 0 1 0 436631817 608706560 142612 33554432000 4194304 6211092 140733785205200 140733785199720 140295036390206 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 148610 142612 822 493 0 141915 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 594440 KiB
Current children cumulated memory: 570448 KiB

[startup+6.30107 s]
/proc/loadavg: 1.79 1.22 1.54 2/189 2840
/proc/meminfo: memFree=30530536/32770624 swapFree=66921468/67108860
[pid=2837] ppid=2834 vsize=1278996 memory=731180 CPUtime=6.71 cores=0-7
/proc/2837/stat : 2837 (cosoco) S 2834 2837 1328 0 -1 1077944320 289906 0 0 0 627 44 0 0 20 0 9 0 436631817 1309691904 182795 33554432000 4194304 6211092 140733785205200 140733785203456 140295052435191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 319749 182795 849 493 0 313054 0
Current children cumulated CPU time: 6.71 s
Current children cumulated vsize: 1278996 KiB
Current children cumulated memory: 731180 KiB

[startup+12.7011 s]
/proc/loadavg: 2.29 1.33 1.57 9/197 2849
/proc/meminfo: memFree=30521116/32770624 swapFree=66921468/67108860
[pid=2837] ppid=2834 vsize=1344532 memory=735412 CPUtime=57.82 cores=0-7
/proc/2837/stat : 2837 (cosoco) S 2834 2837 1328 0 -1 1077944320 527391 0 0 0 5712 70 0 0 20 0 9 0 436631817 1376800768 183853 33554432000 4194304 6211092 140733785205200 140733785203456 140295052435191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 336133 183853 849 493 0 329438 0
[pid=2837/tid=2842] ppid=2834 vsize=1344532 memory=733784 CPUtime=6.46 cores=0-7
/proc/2837/task/2842/stat : 2842 (cosoco) R 2834 2837 1328 0 -1 4202560 34884 0 0 0 639 7 0 0 20 0 9 0 436632440 1376800768 183853 33554432000 4194304 6211092 140733785205200 140295029291976 5393063 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2843] ppid=2834 vsize=1344532 memory=735384 CPUtime=6.45 cores=0-7
/proc/2837/task/2843/stat : 2843 (cosoco) R 2834 2837 1328 0 -1 4202560 37150 0 0 0 644 1 0 0 20 0 9 0 436632440 1376800768 183853 33554432000 4194304 6211092 140733785205200 140295020899176 5393072 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2844] ppid=2834 vsize=1344532 memory=280442305683072 CPUtime=6.45 cores=0-7
/proc/2837/task/2844/stat : 2844 (cosoco) R 2834 2837 1328 0 -1 4202560 34281 0 0 0 637 8 0 0 20 0 9 0 436632440 1376800768 183853 33554432000 4194304 6211092 140733785205200 140295012506568 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2845] ppid=2834 vsize=1344532 memory=734668 CPUtime=6.37 cores=0-7
/proc/2837/task/2845/stat : 2845 (cosoco) R 2834 2837 1328 0 -1 4202560 34468 0 0 0 635 2 0 0 20 0 9 0 436632440 1376800768 183853 33554432000 4194304 6211092 140733785205200 140295004113768 5392320 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2846] ppid=2834 vsize=1344532 memory=0 CPUtime=6.43 cores=0-7
/proc/2837/task/2846/stat : 2846 (cosoco) R 2834 2837 1328 0 -1 4202560 34740 0 0 0 640 3 0 0 20 0 9 0 436632440 1376800768 183853 33554432000 4194304 6211092 140733785205200 140294995721160 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2847] ppid=2834 vsize=1344532 memory=732924 CPUtime=6.46 cores=0-7
/proc/2837/task/2847/stat : 2847 (cosoco) R 2834 2837 1328 0 -1 4202560 36790 0 0 0 643 3 0 0 20 0 9 0 436632440 1376800768 183853 33554432000 4194304 6211092 140733785205200 140294987328456 5392320 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2848] ppid=2834 vsize=1344532 memory=0 CPUtime=6.43 cores=0-7
/proc/2837/task/2848/stat : 2848 (cosoco) R 2834 2837 1328 0 -1 4202560 31860 0 0 0 636 7 0 0 20 0 9 0 436632440 1376800768 183853 33554432000 4194304 6211092 140733785205200 140294978935752 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2849] ppid=2834 vsize=1344532 memory=0 CPUtime=6.45 cores=0-7
/proc/2837/task/2849/stat : 2849 (cosoco) R 2834 2837 1328 0 -1 4202560 33386 0 0 0 638 7 0 0 20 0 9 0 436632440 1376800768 183853 33554432000 4194304 6211092 140733785205200 140294970543048 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
Current children cumulated CPU time: 57.82 s
Current children cumulated vsize: 1344532 KiB
Current children cumulated memory: 735412 KiB

[startup+25.5011 s]
/proc/loadavg: 3.77 1.71 1.69 9/197 2849
/proc/meminfo: memFree=30509252/32770624 swapFree=66921468/67108860
[pid=2837] ppid=2834 vsize=1344532 memory=749828 CPUtime=160 cores=0-7
/proc/2837/stat : 2837 (cosoco) S 2834 2837 1328 0 -1 1077944320 674167 0 0 0 15916 84 0 0 20 0 9 0 436631817 1376800768 187457 33554432000 4194304 6211092 140733785205200 140733785203456 140295052435191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 336133 187457 849 493 0 329438 0
[pid=2837/tid=2842] ppid=2834 vsize=1344532 memory=749728 CPUtime=19.24 cores=0-7
/proc/2837/task/2842/stat : 2842 (cosoco) R 2834 2837 1328 0 -1 4202560 53478 0 0 0 1916 8 0 0 20 0 9 0 436632440 1376800768 187457 33554432000 4194304 6211092 140733785205200 140295029291880 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2843] ppid=2834 vsize=1344532 memory=55 CPUtime=19.24 cores=0-7
/proc/2837/task/2843/stat : 2843 (cosoco) R 2834 2837 1328 0 -1 4202560 55497 0 0 0 1922 2 0 0 20 0 9 0 436632440 1376800768 187457 33554432000 4194304 6211092 140733785205200 140295020899208 5392352 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2844] ppid=2834 vsize=1344532 memory=0 CPUtime=19.24 cores=0-7
/proc/2837/task/2844/stat : 2844 (cosoco) R 2834 2837 1328 0 -1 4202560 52755 0 0 0 1913 11 0 0 20 0 9 0 436632440 1376800768 187457 33554432000 4194304 6211092 140733785205200 140295012506472 5393063 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2845] ppid=2834 vsize=1344532 memory=55 CPUtime=18.99 cores=0-7
/proc/2837/task/2845/stat : 2845 (cosoco) R 2834 2837 1328 0 -1 4202560 52879 0 0 0 1895 4 0 0 20 0 9 0 436632440 1376800768 187457 33554432000 4194304 6211092 140733785205200 140295004113768 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2846] ppid=2834 vsize=1344532 memory=280442305859280 CPUtime=19.23 cores=0-7
/proc/2837/task/2846/stat : 2846 (cosoco) R 2834 2837 1328 0 -1 4202560 53282 0 0 0 1918 5 0 0 20 0 9 0 436632440 1376800768 187457 33554432000 4194304 6211092 140733785205200 140294995721064 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2847] ppid=2834 vsize=1344532 memory=164 CPUtime=19.25 cores=0-7
/proc/2837/task/2847/stat : 2847 (cosoco) R 2834 2837 1328 0 -1 4202560 55245 0 0 0 1920 5 0 0 20 0 9 0 436632440 1376800768 187457 33554432000 4194304 6211092 140733785205200 140294987328456 5172464 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2848] ppid=2834 vsize=1344532 memory=744408 CPUtime=19.23 cores=0-7
/proc/2837/task/2848/stat : 2848 (cosoco) R 2834 2837 1328 0 -1 4202560 49542 0 0 0 1914 9 0 0 20 0 9 0 436632440 1376800768 187457 33554432000 4194304 6211092 140733785205200 140294978935752 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2849] ppid=2834 vsize=1344532 memory=10728 CPUtime=19.25 cores=0-7
/proc/2837/task/2849/stat : 2849 (cosoco) R 2834 2837 1328 0 -1 4202560 51657 0 0 0 1917 8 0 0 20 0 9 0 436632440 1376800768 187457 33554432000 4194304 6211092 140733785205200 140294970542952 5172229 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
Current children cumulated CPU time: 160 s
Current children cumulated vsize: 1344532 KiB
Current children cumulated memory: 749828 KiB

[startup+51.1101 s]
/proc/loadavg: 5.40 2.26 1.88 9/198 2851
/proc/meminfo: memFree=30477352/32770624 swapFree=66921468/67108860
[pid=2837] ppid=2834 vsize=1344532 memory=782528 CPUtime=364.46 cores=0-7
/proc/2837/stat : 2837 (cosoco) S 2834 2837 1328 0 -1 1077944320 747807 0 0 0 36347 99 0 0 20 0 9 0 436631817 1376800768 195632 33554432000 4194304 6211092 140733785205200 140733785203456 140295052435191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 336133 195632 849 493 0 329438 0
[pid=2837/tid=2842] ppid=2834 vsize=1344532 memory=0 CPUtime=44.83 cores=0-7
/proc/2837/task/2842/stat : 2842 (cosoco) R 2834 2837 1328 0 -1 4202560 62803 0 0 0 4474 9 0 0 20 0 9 0 436632440 1376800768 195632 33554432000 4194304 6211092 140733785205200 140295029291976 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2843] ppid=2834 vsize=1344532 memory=777148 CPUtime=44.84 cores=0-7
/proc/2837/task/2843/stat : 2843 (cosoco) R 2834 2837 1328 0 -1 4202560 64506 0 0 0 4480 4 0 0 20 0 9 0 436632440 1376800768 195632 33554432000 4194304 6211092 140733785205200 140295020899176 5392352 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2844] ppid=2834 vsize=1344532 memory=735412 CPUtime=44.85 cores=0-7
/proc/2837/task/2844/stat : 2844 (cosoco) R 2834 2837 1328 0 -1 4202560 62042 0 0 0 4472 13 0 0 20 0 9 0 436632440 1376800768 195632 33554432000 4194304 6211092 140733785205200 140295012506568 5392343 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2845] ppid=2834 vsize=1344532 memory=769644 CPUtime=44.24 cores=0-7
/proc/2837/task/2845/stat : 2845 (cosoco) R 2834 2837 1328 0 -1 4202560 61988 0 0 0 4417 7 0 0 20 0 9 0 436632440 1376800768 195632 33554432000 4194304 6211092 140733785205200 140295004113864 5193728 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2846] ppid=2834 vsize=1344532 memory=45100 CPUtime=44.83 cores=0-7
/proc/2837/task/2846/stat : 2846 (cosoco) R 2834 2837 1328 0 -1 4202560 62744 0 0 0 4476 7 0 0 20 0 9 0 436632440 1376800768 195632 33554432000 4194304 6211092 140733785205200 140294995721000 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2847] ppid=2834 vsize=1344532 memory=0 CPUtime=44.85 cores=0-7
/proc/2837/task/2847/stat : 2847 (cosoco) R 2834 2837 1328 0 -1 4202560 64537 0 0 0 4478 7 0 0 20 0 9 0 436632440 1376800768 195632 33554432000 4194304 6211092 140733785205200 140294987328456 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2848] ppid=2834 vsize=1344532 memory=-7035114785800479027 CPUtime=44.84 cores=0-7
/proc/2837/task/2848/stat : 2848 (cosoco) R 2834 2837 1328 0 -1 4202560 58787 0 0 0 4474 10 0 0 20 0 9 0 436632440 1376800768 195632 33554432000 4194304 6211092 140733785205200 140294978935656 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2849] ppid=2834 vsize=1344532 memory=2832 CPUtime=44.85 cores=0-7
/proc/2837/task/2849/stat : 2849 (cosoco) R 2834 2837 1328 0 -1 4202560 60568 0 0 0 4475 10 0 0 20 0 9 0 436632440 1376800768 195632 33554432000 4194304 6211092 140733785205200 140294970543048 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
Current children cumulated CPU time: 364.46 s
Current children cumulated vsize: 1344532 KiB
Current children cumulated memory: 782528 KiB

[startup+102.301 s]
/proc/loadavg: 6.91 3.16 2.20 9/197 2854
/proc/meminfo: memFree=30409632/32770624 swapFree=66921468/67108860
[pid=2837] ppid=2834 vsize=1344532 memory=850088 CPUtime=773.17 cores=0-7
/proc/2837/stat : 2837 (cosoco) S 2834 2837 1328 0 -1 1077944320 860614 0 0 0 77191 126 0 0 20 0 9 0 436631817 1376800768 212522 33554432000 4194304 6211092 140733785205200 140733785203456 140295052435191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 336133 212522 849 493 0 329438 0
[pid=2837/tid=2842] ppid=2834 vsize=1344532 memory=-7035114785800479027 CPUtime=96.02 cores=0-7
/proc/2837/task/2842/stat : 2842 (cosoco) R 2834 2837 1328 0 -1 4202560 76550 0 0 0 9589 13 0 0 20 0 9 0 436632440 1376800768 212522 33554432000 4194304 6211092 140733785205200 140295029291912 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2843] ppid=2834 vsize=1344532 memory=-7035114785800479027 CPUtime=96.02 cores=0-7
/proc/2837/task/2843/stat : 2843 (cosoco) R 2834 2837 1328 0 -1 4202560 78620 0 0 0 9593 9 0 0 20 0 9 0 436632440 1376800768 212522 33554432000 4194304 6211092 140733785205200 140295020899272 5172424 0 0 4096 8405026 0 0 0 -1 5 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2844] ppid=2834 vsize=1344532 memory=820684 CPUtime=96.04 cores=0-7
/proc/2837/task/2844/stat : 2844 (cosoco) R 2834 2837 1328 0 -1 4202560 76498 0 0 0 9588 16 0 0 20 0 9 0 436632440 1376800768 212522 33554432000 4194304 6211092 140733785205200 140295012506568 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2845] ppid=2834 vsize=1344532 memory=846228 CPUtime=94.72 cores=0-7
/proc/2837/task/2845/stat : 2845 (cosoco) R 2834 2837 1328 0 -1 4202560 76120 0 0 0 9461 11 0 0 20 0 9 0 436632440 1376800768 212522 33554432000 4194304 6211092 140733785205200 140295004113864 5172220 0 0 4096 8405026 0 0 0 -1 7 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2846] ppid=2834 vsize=1344532 memory=825096 CPUtime=96.02 cores=0-7
/proc/2837/task/2846/stat : 2846 (cosoco) R 2834 2837 1328 0 -1 4202560 77282 0 0 0 9592 10 0 0 20 0 9 0 436632440 1376800768 212522 33554432000 4194304 6211092 140733785205200 140294995721160 5392320 0 0 4096 8405026 0 0 0 -1 1 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2847] ppid=2834 vsize=1344532 memory=280442305528616 CPUtime=96.03 cores=0-7
/proc/2837/task/2847/stat : 2847 (cosoco) R 2834 2837 1328 0 -1 4202560 78663 0 0 0 9593 10 0 0 20 0 9 0 436632440 1376800768 212522 33554432000 4194304 6211092 140733785205200 140294987328296 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2848] ppid=2834 vsize=1344532 memory=809588 CPUtime=95.98 cores=0-7
/proc/2837/task/2848/stat : 2848 (cosoco) R 2834 2837 1328 0 -1 4202560 72581 0 0 0 9585 13 0 0 20 0 9 0 436632440 1376800768 212522 33554432000 4194304 6211092 140733785205200 140294978935656 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2849] ppid=2834 vsize=1344532 memory=2832 CPUtime=96.02 cores=0-7
/proc/2837/task/2849/stat : 2849 (cosoco) R 2834 2837 1328 0 -1 4202560 74468 0 0 0 9590 12 0 0 20 0 9 0 436632440 1376800768 212522 33554432000 4194304 6211092 140733785205200 140294970542952 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0

################
# More data... #
################

/proc/2837/task/2849/stat : 2849 (cosoco) R 2834 2837 1328 0 -1 4202560 160120 0 0 0 69280 69 0 0 20 0 9 0 436632440 2461061120 549116 33554432000 4194304 6211092 140733785205200 140294970542984 140295036390206 0 0 4096 8405026 0 0 0 -1 4 0 0 3 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
Current children cumulated CPU time: 5559.9 s
Current children cumulated vsize: 2403380 KiB
Current children cumulated memory: 2196464 KiB

[startup+723.209 s]
# the end of solver process 2837 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=5708.37 s, system=6.23855 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+704.001 s]*
/proc/loadavg: 8.32 7.78 5.18 9/197 2900
/proc/meminfo: memFree=29045584/32770624 swapFree=66921476/67108860
[pid=2837] ppid=2834 vsize=2403380 memory=2208248 CPUtime=5573.45 cores=0-7
/proc/2837/stat : 2837 (cosoco) S 2834 2837 1328 0 -1 1077944320 1565142 0 0 0 556767 578 0 0 20 0 9 0 436631817 2461061120 552062 33554432000 4194304 6211092 140733785205200 140733785203456 140295052435191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 600845 552062 849 493 0 594150 0
[pid=2837/tid=2842] ppid=2834 vsize=2403380 memory=23524 CPUtime=696.89 cores=0-7
/proc/2837/task/2842/stat : 2842 (cosoco) R 2834 2837 1328 0 -1 4202560 168211 0 0 0 69620 69 0 0 20 0 9 0 436632440 2461061120 552062 33554432000 4194304 6211092 140733785205200 140295029291912 140295036394469 0 0 4096 8405026 0 0 0 -1 0 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2843] ppid=2834 vsize=2403380 memory=2116 CPUtime=695.74 cores=0-7
/proc/2837/task/2843/stat : 2843 (cosoco) R 2834 2837 1328 0 -1 4202560 164663 0 0 0 69512 62 0 0 20 0 9 0 436632440 2461061120 552062 33554432000 4194304 6211092 140733785205200 140295020899272 5392343 0 0 4096 8405026 0 0 0 -1 3 0 0 6 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2844] ppid=2834 vsize=2403380 memory=12024 CPUtime=696.7 cores=0-7
/proc/2837/task/2844/stat : 2844 (cosoco) R 2834 2837 1328 0 -1 4202560 163142 0 0 0 69599 71 0 0 20 0 9 0 436632440 2461061120 552062 33554432000 4194304 6211092 140733785205200 140295012506568 140295036870231 0 0 4096 8405026 0 0 0 -1 0 0 0 3 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2845] ppid=2834 vsize=2403380 memory=4872558044660077418 CPUtime=695.43 cores=0-7
/proc/2837/task/2845/stat : 2845 (cosoco) R 2834 2837 1328 0 -1 4202560 162860 0 0 0 69473 70 0 0 20 0 9 0 436632440 2461061120 552062 33554432000 4194304 6211092 140733785205200 140295004113864 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2846] ppid=2834 vsize=2403380 memory=500 CPUtime=695.51 cores=0-7
/proc/2837/task/2846/stat : 2846 (cosoco) R 2834 2837 1328 0 -1 4202560 169431 0 0 0 69484 67 0 0 20 0 9 0 436632440 2461061120 552062 33554432000 4194304 6211092 140733785205200 140294995721096 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2847] ppid=2834 vsize=2403380 memory=928 CPUtime=695.22 cores=0-7
/proc/2837/task/2847/stat : 2847 (cosoco) R 2834 2837 1328 0 -1 4202560 166774 0 0 0 69453 69 0 0 20 0 9 0 436632440 2461061120 552062 33554432000 4194304 6211092 140733785205200 140294987328392 5193728 0 0 4096 8405026 0 0 0 -1 1 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2848] ppid=2834 vsize=2403380 memory=1804 CPUtime=696.49 cores=0-7
/proc/2837/task/2848/stat : 2848 (cosoco) R 2834 2837 1328 0 -1 4202560 159387 0 0 0 69579 70 0 0 20 0 9 0 436632440 2461061120 552062 33554432000 4194304 6211092 140733785205200 140294978935752 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 5 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2849] ppid=2834 vsize=2403380 memory=916 CPUtime=695.19 cores=0-7
/proc/2837/task/2849/stat : 2849 (cosoco) D 2834 2837 1328 0 -1 4202560 160843 0 0 0 69449 70 0 0 20 0 9 0 436632440 2461061120 552062 33554432000 4194304 6211092 140733785205200 140294970543048 140295036394469 0 0 4096 8405026 18446744071582151416 0 0 -1 6 0 0 3 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
Current children cumulated CPU time: 5573.45 s
Current children cumulated vsize: 2403380 KiB
Current children cumulated memory: 2208248 KiB

[startup+716.801 s]
/proc/loadavg: 8.25 7.79 5.22 9/197 2900
/proc/meminfo: memFree=28933776/32770624 swapFree=66921476/67108860
[pid=2837] ppid=2834 vsize=2927668 memory=2331364 CPUtime=5675.33 cores=0-7
/proc/2837/stat : 2837 (cosoco) S 2834 2837 1328 0 -1 1077944320 1606594 0 0 0 566931 602 0 0 20 0 9 0 436631817 2997932032 582841 33554432000 4194304 6211092 140733785205200 140733785203456 140295052435191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 731917 582841 849 493 0 725222 0
[pid=2837/tid=2842] ppid=2834 vsize=2927668 memory=10728 CPUtime=709.65 cores=0-7
/proc/2837/task/2842/stat : 2842 (cosoco) R 2834 2837 1328 0 -1 4202560 173831 0 0 0 70892 73 0 0 20 0 9 0 436632440 2997932032 582841 33554432000 4194304 6211092 140733785205200 140295029291976 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2843] ppid=2834 vsize=2927668 memory=988 CPUtime=708.44 cores=0-7
/proc/2837/task/2843/stat : 2843 (cosoco) R 2834 2837 1328 0 -1 4202560 169524 0 0 0 70780 64 0 0 20 0 9 0 436632440 2997932032 582841 33554432000 4194304 6211092 140733785205200 140295020899272 5393040 0 0 4096 8405026 0 0 0 -1 7 0 0 6 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2844] ppid=2834 vsize=2927668 memory=2016 CPUtime=709.41 cores=0-7
/proc/2837/task/2844/stat : 2844 (cosoco) R 2834 2837 1328 0 -1 4202560 168454 0 0 0 70867 74 0 0 20 0 9 0 436632440 2997932032 582841 33554432000 4194304 6211092 140733785205200 140295012506568 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 3 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2845] ppid=2834 vsize=2927668 memory=0 CPUtime=708.19 cores=0-7
/proc/2837/task/2845/stat : 2845 (cosoco) R 2834 2837 1328 0 -1 4202560 168153 0 0 0 70745 74 0 0 20 0 9 0 436632440 2997932032 582841 33554432000 4194304 6211092 140733785205200 140295004113864 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2846] ppid=2834 vsize=2927668 memory=3472328296227679313 CPUtime=708.26 cores=0-7
/proc/2837/task/2846/stat : 2846 (cosoco) R 2834 2837 1328 0 -1 4202560 174713 0 0 0 70755 71 0 0 20 0 9 0 436632440 2997932032 582841 33554432000 4194304 6211092 140733785205200 140294995721000 5172595 0 0 4096 8405026 0 0 0 -1 1 0 0 5 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2847] ppid=2834 vsize=2927668 memory=45116 CPUtime=707.95 cores=0-7
/proc/2837/task/2847/stat : 2847 (cosoco) R 2834 2837 1328 0 -1 4202560 171830 0 0 0 70724 71 0 0 20 0 9 0 436632440 2997932032 582841 33554432000 4194304 6211092 140733785205200 140294987328392 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2848] ppid=2834 vsize=2927668 memory=988 CPUtime=709.19 cores=0-7
/proc/2837/task/2848/stat : 2848 (cosoco) R 2834 2837 1328 0 -1 4202560 164587 0 0 0 70846 73 0 0 20 0 9 0 436632440 2997932032 582841 33554432000 4194304 6211092 140733785205200 140294978935688 5193728 0 0 4096 8405026 0 0 0 -1 0 0 0 5 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2849] ppid=2834 vsize=2927668 memory=1484 CPUtime=707.94 cores=0-7
/proc/2837/task/2849/stat : 2849 (cosoco) R 2834 2837 1328 0 -1 4202560 165670 0 0 0 70722 72 0 0 20 0 9 0 436632440 2997932032 582841 33554432000 4194304 6211092 140733785205200 140294970542984 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
Current children cumulated CPU time: 5675.33 s
Current children cumulated vsize: 2927668 KiB
Current children cumulated memory: 2331364 KiB

[startup+720.001 s]*
/proc/loadavg: 8.25 7.79 5.22 8/196 2900
/proc/meminfo: memFree=28875372/32770624 swapFree=66921476/67108860
[pid=2837] ppid=2834 vsize=2927668 memory=2380944 CPUtime=5700.34 cores=0-7
/proc/2837/stat : 2837 (cosoco) S 2834 2837 1328 0 -1 1077944320 1618949 0 0 0 569426 608 0 0 20 0 8 0 436631817 2997932032 595236 33554432000 4194304 6211092 140733785205200 140733785203456 140295052435191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 731917 595236 851 493 0 725222 0
[pid=2837/tid=2843] ppid=2834 vsize=2927668 memory=70724 CPUtime=711.6 cores=0-7
/proc/2837/task/2843/stat : 2843 (cosoco) R 2834 2837 1328 0 -1 4202560 170824 0 0 0 71096 64 0 0 20 0 8 0 436632440 2997932032 595236 33554432000 4194304 6211092 140733785205200 140295020899272 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 6 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2844] ppid=2834 vsize=2927668 memory=70634 CPUtime=712.61 cores=0-7
/proc/2837/task/2844/stat : 2844 (cosoco) R 2834 2837 1328 0 -1 4202560 170234 0 0 0 71186 75 0 0 20 0 8 0 436632440 2997932032 595236 33554432000 4194304 6211092 140733785205200 140295012506504 5193728 0 0 4096 8405026 0 0 0 -1 3 0 0 3 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2845] ppid=2834 vsize=2927668 memory=4872558044660077418 CPUtime=711.39 cores=0-7
/proc/2837/task/2845/stat : 2845 (cosoco) R 2834 2837 1328 0 -1 4202560 169680 0 0 0 71064 75 0 0 20 0 8 0 436632440 2997932032 595236 33554432000 4194304 6211092 140733785205200 140295004113864 5393040 0 0 4096 8405026 0 0 0 -1 6 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2846] ppid=2834 vsize=2927668 memory=-7035114785800479027 CPUtime=711.46 cores=0-7
/proc/2837/task/2846/stat : 2846 (cosoco) R 2834 2837 1328 0 -1 4202560 176316 0 0 0 71074 72 0 0 20 0 8 0 436632440 2997932032 595236 33554432000 4194304 6211092 140733785205200 140294995721064 5393063 0 0 4096 8405026 0 0 0 -1 1 0 0 5 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2847] ppid=2834 vsize=2927668 memory=6689 CPUtime=711.15 cores=0-7
/proc/2837/task/2847/stat : 2847 (cosoco) R 2834 2837 1328 0 -1 4202560 173193 0 0 0 71043 72 0 0 20 0 8 0 436632440 2997932032 595236 33554432000 4194304 6211092 140733785205200 140294987328392 5393063 0 0 4096 8405026 0 0 0 -1 2 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2848] ppid=2834 vsize=2927668 memory=4420 CPUtime=712.4 cores=0-7
/proc/2837/task/2848/stat : 2848 (cosoco) R 2834 2837 1328 0 -1 4202560 166274 0 0 0 71166 74 0 0 20 0 8 0 436632440 2997932032 595236 33554432000 4194304 6211092 140733785205200 140294978935592 5193733 0 0 4096 8405026 0 0 0 -1 0 0 0 5 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2849] ppid=2834 vsize=2927668 memory=6628 CPUtime=711.14 cores=0-7
/proc/2837/task/2849/stat : 2849 (cosoco) R 2834 2837 1328 0 -1 4202560 167024 0 0 0 71042 72 0 0 20 0 8 0 436632440 2997932032 595236 33554432000 4194304 6211092 140733785205200 140294970543048 5193733 0 0 4096 8405026 0 0 0 -1 4 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
Current children cumulated CPU time: 5700.34 s
Current children cumulated vsize: 2927668 KiB
Current children cumulated memory: 2380944 KiB

[startup+721.6 s]
/proc/loadavg: 8.15 7.78 5.23 7/196 2902
/proc/meminfo: memFree=28857280/32770624 swapFree=66921476/67108860
[pid=2837] ppid=2834 vsize=2927668 memory=2405572 CPUtime=5709.79 cores=0-7
/proc/2837/stat : 2837 (cosoco) S 2834 2837 1328 0 -1 1077944320 1625065 0 0 0 570369 610 0 0 20 0 5 0 436631817 2997932032 601393 33554432000 4194304 6211092 140733785205200 140733785203456 140295052435191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 731917 601393 851 493 0 725222 0
[pid=2837/tid=2843] ppid=2834 vsize=2927668 memory=2401740 CPUtime=713.2 cores=0-7
/proc/2837/task/2843/stat : 2843 (cosoco) R 2834 2837 1328 0 -1 4202560 171705 0 0 0 71255 65 0 0 20 0 5 0 436632440 2997932032 601393 33554432000 4194304 6211092 140733785205200 140295020899176 140295052438530 0 0 4096 8405026 0 0 0 -1 5 0 0 6 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2845] ppid=2834 vsize=2927668 memory=1176 CPUtime=712.97 cores=0-7
/proc/2837/task/2845/stat : 2845 (cosoco) R 2834 2837 1328 0 -1 4202560 170758 0 0 0 71222 75 0 0 20 0 5 0 436632440 2997932032 601393 33554432000 4194304 6211092 140733785205200 140295004113864 5193728 0 0 4096 8405026 0 0 0 -1 6 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2847] ppid=2834 vsize=2927668 memory=928 CPUtime=712.74 cores=0-7
/proc/2837/task/2847/stat : 2847 (cosoco) R 2834 2837 1328 0 -1 4202560 174069 0 0 0 71202 72 0 0 20 0 5 0 436632440 2997932032 601393 33554432000 4194304 6211092 140733785205200 140294987328456 5393072 0 0 4096 8405026 0 0 0 -1 2 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2849] ppid=2834 vsize=2927668 memory=2367268 CPUtime=712.73 cores=0-7
/proc/2837/task/2849/stat : 2849 (cosoco) R 2834 2837 1328 0 -1 4202560 167891 0 0 0 71200 73 0 0 20 0 5 0 436632440 2997932032 601393 33554432000 4194304 6211092 140733785205200 140294970543048 5393063 0 0 4096 8405026 0 0 0 -1 4 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
Current children cumulated CPU time: 5709.79 s
Current children cumulated vsize: 2927668 KiB
Current children cumulated memory: 2405572 KiB

[startup+722.4 s]
/proc/loadavg: 8.15 7.78 5.23 4/193 2902
/proc/meminfo: memFree=28845816/32770624 swapFree=66921476/67108860
[pid=2837] ppid=2834 vsize=2927668 memory=2413856 CPUtime=5712.5 cores=0-7
/proc/2837/stat : 2837 (cosoco) S 2834 2837 1328 0 -1 1077944320 1627191 0 0 0 570639 611 0 0 20 0 4 0 436631817 2997932032 603464 33554432000 4194304 6211092 140733785205200 140733785203456 140295052435191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 731917 603464 851 493 0 725222 0
[pid=2837/tid=2843] ppid=2834 vsize=2927668 memory=70781 CPUtime=713.99 cores=0-7
/proc/2837/task/2843/stat : 2843 (cosoco) R 2834 2837 1328 0 -1 4202560 172405 0 0 0 71334 65 0 0 20 0 4 0 436632440 2997932032 603464 33554432000 4194304 6211092 140733785205200 140295020899272 140295036394469 0 0 4096 8405026 0 0 0 -1 5 0 0 6 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2847] ppid=2834 vsize=2927668 memory=2400684 CPUtime=713.55 cores=0-7
/proc/2837/task/2847/stat : 2847 (cosoco) R 2834 2837 1328 0 -1 4202560 174649 0 0 0 71282 73 0 0 20 0 4 0 436632440 2997932032 603464 33554432000 4194304 6211092 140733785205200 140294987328456 5193728 0 0 4096 8405026 0 0 0 -1 2 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2849] ppid=2834 vsize=2927668 memory=2358820 CPUtime=713.53 cores=0-7
/proc/2837/task/2849/stat : 2849 (cosoco) R 2834 2837 1328 0 -1 4202560 168464 0 0 0 71280 73 0 0 20 0 4 0 436632440 2997932032 603464 33554432000 4194304 6211092 140733785205200 140294970543048 5393072 0 0 4096 8405026 0 0 0 -1 4 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
Current children cumulated CPU time: 5712.5 s
Current children cumulated vsize: 2927668 KiB
Current children cumulated memory: 2413856 KiB

[startup+722.8 s]
/proc/loadavg: 8.15 7.78 5.23 4/193 2902
/proc/meminfo: memFree=28845816/32770624 swapFree=66921476/67108860
[pid=2837] ppid=2834 vsize=2927668 memory=2417816 CPUtime=5713.7 cores=0-7
/proc/2837/stat : 2837 (cosoco) S 2834 2837 1328 0 -1 1077944320 1628198 0 0 0 570758 612 0 0 20 0 4 0 436631817 2997932032 604454 33554432000 4194304 6211092 140733785205200 140733785203456 140295052435191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 731917 604454 851 493 0 725222 0
[pid=2837/tid=2843] ppid=2834 vsize=2927668 memory=916 CPUtime=714.39 cores=0-7
/proc/2837/task/2843/stat : 2843 (cosoco) R 2834 2837 1328 0 -1 4202560 172747 0 0 0 71374 65 0 0 20 0 4 0 436632440 2997932032 604454 33554432000 4194304 6211092 140733785205200 140295020899272 140295036394469 0 0 4096 8405026 0 0 0 -1 5 0 0 6 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2847] ppid=2834 vsize=2927668 memory=4212 CPUtime=713.94 cores=0-7
/proc/2837/task/2847/stat : 2847 (cosoco) R 2834 2837 1328 0 -1 4202560 174986 0 0 0 71321 73 0 0 20 0 4 0 436632440 2997932032 604454 33554432000 4194304 6211092 140733785205200 140294987328360 140295036390206 0 0 4096 8405026 0 0 0 -1 2 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2849] ppid=2834 vsize=2927668 memory=1984 CPUtime=713.94 cores=0-7
/proc/2837/task/2849/stat : 2849 (cosoco) R 2834 2837 1328 0 -1 4202560 168794 0 0 0 71320 74 0 0 20 0 4 0 436632440 2997932032 604454 33554432000 4194304 6211092 140733785205200 140294970542888 140295036390206 0 0 4096 8405026 0 0 0 -1 4 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
Current children cumulated CPU time: 5713.7 s
Current children cumulated vsize: 2927668 KiB
Current children cumulated memory: 2417816 KiB

[startup+723 s]*
/proc/loadavg: 8.15 7.78 5.23 4/193 2902
/proc/meminfo: memFree=28835908/32770624 swapFree=66921476/67108860
[pid=2837] ppid=2834 vsize=2927668 memory=2420220 CPUtime=5714.32 cores=0-7
/proc/2837/stat : 2837 (cosoco) S 2834 2837 1328 0 -1 1077944320 1628777 0 0 0 570820 612 0 0 20 0 3 0 436631817 2997932032 605055 33554432000 4194304 6211092 140733785205200 140733785203456 140295052435191 0 0 4096 8405026 18446744073709551615 0 0 17 3 0 0 0 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
/proc/2837/statm: 731917 605055 851 493 0 725222 0
[pid=2837/tid=2843] ppid=2834 vsize=2927668 memory=-7035114785800479027 CPUtime=714.6 cores=0-7
/proc/2837/task/2843/stat : 2843 (cosoco) R 2834 2837 1328 0 -1 4202560 172946 0 0 0 71395 65 0 0 20 0 3 0 436632440 2997932032 605055 33554432000 4194304 6211092 140733785205200 140295020899272 5193728 0 0 4096 8405026 0 0 0 -1 5 0 0 6 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
[pid=2837/tid=2849] ppid=2834 vsize=2927668 memory=4872558044660077418 CPUtime=714.14 cores=0-7
/proc/2837/task/2849/stat : 2849 (cosoco) R 2834 2837 1328 0 -1 4202560 168982 0 0 0 71340 74 0 0 20 0 3 0 436632440 2997932032 605055 33554432000 4194304 6211092 140733785205200 140294970542984 5193728 0 0 4096 8405026 0 0 0 -1 4 0 0 4 0 0 8312316 8317760 9699328 140733785211921 140733785212013 140733785212013 140733785214926 0
Current children cumulated CPU time: 5714.32 s
Current children cumulated vsize: 2927668 KiB
Current children cumulated memory: 2420220 KiB

[startup+723.109 s]*
/proc/loadavg: 8.15 7.78 5.23 2/189 2902
/proc/meminfo: memFree=29633344/32770624 swapFree=66921476/67108860
Current children cumulated CPU time: 0 s
Current children cumulated vsize: 0 KiB
Current children cumulated memory: 0 KiB

Child status: 0
Real time (s): 723.209
CPU time (s): 5714.61
CPU user time (s): 5708.37
CPU system time (s): 6.23855
CPU usage (%): 790.174
Max. virtual memory (cumulated for all children) (KiB): 2927668
Max. memory (cumulated for all children) (KiB): 2420220

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 5708.37
system time used= 6.23855
maximum resident set size= 2421260
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 1628985
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 11666
involuntary context switches= 41015


# summary of solver processes directly reported to runsolver:
#   pid: 2837
#   total CPU time (s): 5714.61
#   total CPU user time (s): 5708.37
#   total CPU system time (s): 6.23855

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 3.46259 second user time and 6.45889 second system time

The end

Launcher Data 

Begin job on node139 at 2019-09-16 05:15:43
IDJOB=4398022
IDBENCH=126842
IDSOLVER=2851
FILE ID=node139/4398022-1568603633
RUNJOBID= node139-1568596036-1355
PBS_JOBID= 21703395
Free space on /tmp= 59556 MiB

SOLVER NAME= cosoco 2.O parallel
BENCH NAME= XCSP17/PropStress/PropStress-m1-s1/PropStress-0150.xml
COMMAND LINE= cosoco -model -nbcores=NBCORE BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4398022-1568603633/watcher-4398022-1568603633 -o /tmp/evaluation-result-4398022-1568603633/solver-4398022-1568603633 -C 20160 -W 2520 -M 31000 --bin-var /tmp/runsolver-exch-node139-1568596036-1355 --watchdog 2580  cosoco -model -nbcores=8 HOME/instance-4398022-1568603633.xml

TIME LIMIT= 20160 seconds
MEMORY LIMIT= 31000 MiB
NBCORE= 8

MD5SUM BENCH= b9bf68be3b756b1f34bbd3d4e06d542d
RANDOM SEED=493725542

node139.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.57
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31248816 kB
MemAvailable:   31825104 kB
Buffers:           92080 kB
Cached:           774632 kB
SwapCached:        78060 kB
Active:           517380 kB
Inactive:         431500 kB
Active(anon):       7376 kB
Inactive(anon):   116960 kB
Active(file):     510004 kB
Inactive(file):   314540 kB
Unevictable:      107864 kB
Mlocked:          107864 kB
SwapTotal:      67108860 kB
SwapFree:       66921468 kB
Dirty:              4164 kB
Writeback:             0 kB
AnonPages:        136024 kB
Mapped:            46420 kB
Shmem:             33424 kB
Slab:             163916 kB
SReclaimable:     135160 kB
SUnreclaim:        28756 kB
KernelStack:        3680 kB
PageTables:         5844 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     496620 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     90112 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 59556 MiB
End job on node139 at 2019-09-16 05:27:47