Trace number 4397423

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2400.05 2400.11

General information on the benchmark

NameCoveringArray/CoveringArray-elt-s1/
CoveringArray-elt-3-10-2-11.xml
MD5SUMc5b4e9c2e16defa9f5099964bd118207
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables2280
Number of constraints1091
Number of domains2
Minimum domain size8
Maximum domain size11
Distribution of domain sizes[{"size":8,"count":1320},{"size":11,"count":960}]
Minimum variable degree2
Maximum variable degree9
Distribution of variable degrees[{"degree":2,"count":960},{"degree":9,"count":1320}]
Minimum constraint arity8
Maximum constraint arity120
Distribution of constraint arities[{"arity":8,"count":120},{"arity":12,"count":960},{"arity":120,"count":11}]
Number of extensional constraints11
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":11},{"type":"allDifferent","count":120},{"type":"element","count":960}]
Optimization problemNO
Type of objective

Solver Data 

0.10/0.15	c root propagations     : 0           
0.10/0.15	c restarts enabled, print stats at every restarts
0.10/0.15	c
0.10/0.15	c
0.10/0.15	c
0.10/0.15	c This is cosoco 2.00 --  
0.10/0.15	c
0.10/0.15	c command line: cosoco -lc -model -restarts -stick HOME/instance-4397423-1568589600.xml 
0.10/0.15	c ========================================[ Problem Statistics ]===========================================
0.10/0.15	c |                                                                                                       
0.10/0.15	c |  Parse time        :         0.13 s 
0.10/0.15	c |
0.10/0.15	c |               Variables: 2280
0.10/0.15	c |            Domain Sizes: 8..11
0.10/0.15	c |
0.10/0.15	c |             Constraints: 1091
0.10/0.15	c |                   Arity: 8..120
0.10/0.15	c | 
0.10/0.15	c |                   Types: 
0.10/0.15	c |                          All Different: 120
0.10/0.15	c |                          Element Constant: 960
0.10/0.15	c |                          Extension: 11  (nb tuples: 1024..1024) -- (shared: 10)
0.10/0.15	c |                          
0.10/0.15	c =========================================================================================================
0.10/0.15	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.20/0.29	c 101            1021           162559         148765         0              0              688   813   782
0.50/0.59	c 211            3910           356369         506420         0              0              16   156   92  
0.78/0.82	c 332            5710           503247         788168         0              0              686   989   770
0.88/0.99	c 465            6329           626332         1024514        0              0              51   102   59  
1.18/1.20	c 611            6910           751429         1303705        0              0              35   50   39   
1.28/1.36	c 771            9433           832676         1461217        0              0              40   79   73   
1.58/1.67	c 947            10632          1035553        1926254        0              0              319   350   330
1.88/1.99	c 1140           12167          1230015        2342310        0              0              160   190   176
2.18/2.29	c 1352           13920          1416108        2693996        0              0              142   166   152
2.59/2.69	c 1585           16370          1653727        3227728        0              0              137   165   156
2.89/2.98	c 1841           18050          1878329        3557645        0              0              134   159   146
3.29/3.33	c 2122           19579          2101527        3988287        0              0              105   128   115
3.69/3.76	c 2431           21392          2376824        4538152        0              0              106   126   118
4.19/4.21	c 2770           23363          2662344        5107051        0              0              98   110   106 
4.69/4.71	c 3142           25187          2967281        5777779        0              0              65   77   73   
5.10/5.16	c 3551           26843          3261272        6366422        0              0              60   68   64   
5.69/5.76	c 4000           28491          3646340        7172772        0              0              60   76   67   
6.39/6.47	c 4493           30729          4076948        8206893        0              0              60   81   68   
7.19/7.23	c 5035           33208          4550066        9201588        0              0              59   71   67   
7.79/7.83	c 5631           35900          5102282        9938383        0              0              53   75   64   
8.69/8.74	c 6286           38640          5698062        11198258       0              0              60   72   67   
9.79/9.87	c 7006           42186          6454328        12922743       0              0              61   79   71   
10.79/10.84	c 7798           50098          6949234        14194178       0              0              72   157   99  
11.59/11.69	c 8669           60401          7370610        15166575       0              0              71   141   108 
13.00/13.08	c 9627           67192          8208805        17215017       0              0              77   103   91  
14.59/14.60	c 10680          74743          9206763        19411526       0              0              83   106   97  
15.99/16.08	c 11838          82797          10108498       21451032       0              0              85   109   101 
17.79/17.85	c 13111          92182          11256029       23771617       0              0              83   110   99  
19.79/19.88	c 14511          100027         12493785       26687013       0              0              74   108   92  
21.89/21.93	c 16051          110165         13850975       29406823       0              0              83   110   97  
24.09/24.17	c 17745          118794         15364543       32317447       0              0              75   96   89   
27.28/27.35	c 19608          128780         17339614       36768932       0              0              71   95   86   
30.48/30.50	c 21657          138533         19370704       41182482       0              0              69   93   81   
33.68/33.78	c 23910          150751         21396387       45875130       0              0              70   95   84   
36.78/36.89	c 26388          161844         22953408       50117200       0              0              64   102   76  
40.88/40.98	c 29113          177903         25325078       55438820       0              0              65   86   77   
44.78/44.80	c 32110          194614         27885366       60285400       0              0              61   80   72   
48.88/48.99	c 35406          210591         30190556       66273428       0              0              60   95   73   
53.78/53.88	c 39031          228743         32870286       72965390       0              0              56   88   67   
57.68/57.76	c 43018          242670         34578046       79096482       0              0              52   79   66   
63.18/63.26	c 47403          269404         38246027       86706670       0              0              44   64   55   
69.28/69.36	c 52226          300778         42708271       94708796       0              0              47   66   58   
76.28/76.35	c 57531          325221         46769281       104731003      0              0              42   65   55   
84.18/84.20	c 63366          353657         51166107       116244127      0              0              45   69   56   
90.28/90.30	c 69784          452983         53407432       122210607      0              0              48   147   122 
96.38/96.44	c 76843          549854         56566430       129116482      0              0              68   149   131 
103.38/103.49	c 84607          631894         60298498       138087382      0              0              74   161   131 
115.18/115.23	c 93147          683571         66922612       155784251      0              0              114   174   129
125.98/126.08	c 102541         726779         71670831       172329768      0              0              101   171   120
138.38/138.48	c 112874         783826         78039497       190739326      0              0              102   146   119
152.57/152.64	c 124240         859460         88558845       209960282      0              0              55   74   68   
170.77/170.87	c 136742         942824         99862510       235631135      0              0              51   75   66   
187.77/187.86	c 150494         1023060        112458632      258560330      0              0              47   68   60   
202.77/202.81	c 165621         1067376        117076713      281740445      0              0              53   76   70   
227.08/227.13	c 182260         1165427        131026351      319068106      0              0              48   78   65   
248.27/248.33	c 200562         1269786        141721466      353647411      0              0              50   146   74  
276.57/276.62	c 220694         1474729        158039620      392992322      0              0              59   146   92  
303.57/303.60	c 242839         1602850        174462565      431703409      0              0              55   98   77   
334.08/334.16	c 267198         1749848        193620090      475355457      0              0              59   100   76  
364.17/364.21	c 293992         1897652        217123316      517122984      0              0              49   72   64   
402.67/402.77	c 323465         2051990        239465936      573375705      0              0              49   84   67   
442.47/442.51	c 355885         2223982        264675313      631390393      0              0              49   81   66   
482.98/483.00	c 391547         2406728        291380790      688535145      0              0              43   75   60   
526.37/526.47	c 430775         2580341        315841959      753349266      0              0              42   66   56   
574.48/574.50	c 473925         2796438        351686653      815603246      0              0              34   66   53   
620.28/620.37	c 521390         2943584        369620539      880519545      0              0              38   68   58   
690.08/690.16	c 573601         3200244        414164182      981007319      0              0              36   65   53   
738.38/738.49	c 631033         3391721        435885832      1050523124     0              0              38   68   57   
803.47/803.52	c 694208         4187491        468222274      1124749436     0              0              39   168   107 
891.77/891.84	c 763700         4633005        523282939      1243414491     0              0              39   109   64  
990.57/990.66	c 840141         5102205        583019304      1379435730     0              0              35   110   61  
1100.67/1100.70	c 924226         5609254        656452635      1523332646     0              0              35   106   54  
1216.07/1216.18	c 1016719        6208997        736526158      1666165404     0              0              34   105   52  
1320.86/1320.99	c 1118461        7438966        791999102      1788093671     0              0              31   114   89  
1456.66/1456.72	c 1230377        8124273        887390658      1958111362     0              0              29   125   50  
1618.96/1619.06	c 1353484        10873102       967648935      2100663248     0              0              26   140   111 
1779.45/1779.50	c 1488901        11714074       1075872952     2299018178     0              0              28   130   47  
1967.14/1967.26	c 1637859        12738001       1171263267     2548484789     0              0              32   144   57  
2298.43/2298.57	c 1801712        18870789       1346194695     2813364252     0              0              24   153   114 
2400.04/2400.10	
2400.04/2400.10	c *** INTERRUPTED ***
2400.04/2400.10	c restarts              : 79          
2400.04/2400.10	c conflicts             : 1866578      (778 /sec)
2400.04/2400.10	c decisions             : 19996308     (8332 /sec)
2400.04/2400.10	c propagations          : 2907079765  (1211272 /sec)
2400.04/2400.10	c root propagations     : 0           
2400.04/2400.10	c filter calls          : 1391900130     (579953 /sec)
2400.04/2400.10	c useless filter calls  : 872137753      (62 %)
2400.04/2400.10	c Memory used           : 48.57 MB
2400.04/2400.10	c CPU time              : 2400.02 s
2400.04/2400.10	c real time             : 2400.1 s
2400.04/2400.10	
2400.04/2400.10	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (14586 MiB free)
  memory of node 1: 16384 MiB (15150 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4397423-1568589600/watcher-4397423-1568589600 -o /tmp/evaluation-result-4397423-1568589600/solver-4397423-1568589600 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node106-1568569106-4724 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4397423-1568589600.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=7923, runsolver pid=7920
Current StackSize limit: 8192 KiB


[startup+0.100144 s]*
/proc/loadavg: 2.00 2.01 2.05 3/198 7924
/proc/meminfo: memFree=30439532/32770624 swapFree=66999232/67108860
[pid=7923] ppid=7920 vsize=39456 memory=15824 CPUtime=0.1 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 4136 0 0 0 10 0 0 0 20 0 1 0 435214534 40402944 3956 33554432000 4194304 6211092 140722888044912 140722888041448 5483321 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 9864 3956 825 493 0 3169 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 39456 KiB
Current children cumulated memory: 15824 KiB

[startup+0.209526 s]*
/proc/loadavg: 2.00 2.01 2.05 3/198 7924
/proc/meminfo: memFree=30431596/32770624 swapFree=66999232/67108860
[pid=7923] ppid=7920 vsize=47448 memory=24008 CPUtime=0.2 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 6179 0 0 0 20 0 0 0 20 0 1 0 435214534 48586752 6002 33554432000 4194304 6211092 140722888044912 140722888041448 5099111 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 11862 6002 873 493 0 5167 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 47448 KiB
Current children cumulated memory: 24008 KiB

[startup+0.309519 s]*
/proc/loadavg: 2.00 2.01 2.05 3/198 7924
/proc/meminfo: memFree=30431596/32770624 swapFree=66999232/67108860
[pid=7923] ppid=7920 vsize=47448 memory=24008 CPUtime=0.3 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 6192 0 0 0 30 0 0 0 20 0 1 0 435214534 48586752 6002 33554432000 4194304 6211092 140722888044912 140722888041448 5039029 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 11862 6002 873 493 0 5167 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 47448 KiB
Current children cumulated memory: 24008 KiB

[startup+0.700296 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 7924
/proc/meminfo: memFree=30431424/32770624 swapFree=66999232/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26120 CPUtime=0.68 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 6754 0 0 0 68 0 0 0 20 0 1 0 435214534 50929664 6530 33554432000 4194304 6211092 140722888044912 140722888042872 5082224 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6530 875 493 0 5739 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26120 KiB

[startup+1.50029 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 7924
/proc/meminfo: memFree=30429192/32770624 swapFree=66999232/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26120 CPUtime=1.48 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 6754 0 0 0 148 0 0 0 20 0 1 0 435214534 50929664 6530 33554432000 4194304 6211092 140722888044912 140722888042872 5039170 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6530 875 493 0 5739 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26120 KiB

[startup+3.10908 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 7924
/proc/meminfo: memFree=30429068/32770624 swapFree=66999232/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26368 CPUtime=3.1 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 10737 0 0 0 309 1 0 0 20 0 1 0 435214534 50929664 6592 33554432000 4194304 6211092 140722888044912 140722888042872 5078740 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6592 875 493 0 5739 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26368 KiB

[startup+6.30027 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 7924
/proc/meminfo: memFree=30428752/32770624 swapFree=66999232/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26368 CPUtime=6.29 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 14588 0 0 0 628 1 0 0 20 0 1 0 435214534 50929664 6592 33554432000 4194304 6211092 140722888044912 140722888042872 5039121 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6592 875 493 0 5739 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26368 KiB

[startup+12.7003 s]
/proc/loadavg: 2.08 2.03 2.05 3/198 7924
/proc/meminfo: memFree=30429232/32770624 swapFree=66999232/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26368 CPUtime=12.69 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 18505 0 0 0 1268 1 0 0 20 0 1 0 435214534 50929664 6592 33554432000 4194304 6211092 140722888044912 140722888042872 5394464 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6592 875 493 0 5739 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26368 KiB

[startup+25.5003 s]
/proc/loadavg: 2.06 2.03 2.05 3/198 7924
/proc/meminfo: memFree=30428836/32770624 swapFree=66999232/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26368 CPUtime=25.48 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 26311 0 0 0 2547 1 0 0 20 0 1 0 435214534 50929664 6592 33554432000 4194304 6211092 140722888044912 140722888042872 5039038 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6592 875 493 0 5739 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26368 KiB

[startup+51.109 s]
/proc/loadavg: 2.04 2.03 2.05 3/198 7927
/proc/meminfo: memFree=30428216/32770624 swapFree=66999232/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26368 CPUtime=51.09 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 30046 0 0 0 5108 1 0 0 20 0 1 0 435214534 50929664 6592 33554432000 4194304 6211092 140722888044912 140722888042872 5397216 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6592 875 493 0 5739 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26368 KiB

[startup+102.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/199 7938
/proc/meminfo: memFree=30427304/32770624 swapFree=66999236/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=102.28 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 30495 0 0 0 10227 1 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5039199 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/199 7942
/proc/meminfo: memFree=30428052/32770624 swapFree=66999236/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=162.27 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 30923 0 0 0 16226 1 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5193728 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7946
/proc/meminfo: memFree=30428100/32770624 swapFree=66999236/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=222.27 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 31344 0 0 0 22226 1 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5409453 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7952
/proc/meminfo: memFree=30427272/32770624 swapFree=66999236/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=282.27 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 31771 0 0 0 28226 1 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5039038 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 7956
/proc/meminfo: memFree=30427628/32770624 swapFree=66999236/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=342.27 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 32190 0 0 0 34226 1 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5397235 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 7961
/proc/meminfo: memFree=30428252/32770624 swapFree=66999236/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=402.27 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 32607 0 0 0 40226 1 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5039022 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+462.3 s]
/proc/loadavg: 2.22 2.06 2.06 3/198 7967
/proc/meminfo: memFree=30427720/32770624 swapFree=66999236/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=462.27 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 33024 0 0 0 46226 1 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5039132 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB


################
# More data... #
################

/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 1662.25 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 8146
/proc/meminfo: memFree=30417180/32770624 swapFree=66999244/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=1722.25 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 41501 0 0 0 172223 2 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5394514 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 1722.25 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 8150
/proc/meminfo: memFree=30417576/32770624 swapFree=66999244/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=1782.25 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 41921 0 0 0 178223 2 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5078762 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 1782.25 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 8155
/proc/meminfo: memFree=30417376/32770624 swapFree=66999244/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=1842.24 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 42323 0 0 0 184222 2 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5039038 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 1842.24 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 8168
/proc/meminfo: memFree=30417192/32770624 swapFree=66999256/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=1902.24 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 42734 0 0 0 190222 2 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5039104 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 1902.24 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 8172
/proc/meminfo: memFree=30417700/32770624 swapFree=66999256/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=1962.24 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 43142 0 0 0 196222 2 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5039026 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 1962.24 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 8176
/proc/meminfo: memFree=30417160/32770624 swapFree=66999256/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=2022.24 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 43559 0 0 0 202222 2 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5409444 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 2022.24 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 8182
/proc/meminfo: memFree=30417380/32770624 swapFree=66999256/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=2082.24 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 43955 0 0 0 208222 2 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5039145 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 2082.24 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 8186
/proc/meminfo: memFree=30417632/32770624 swapFree=66999256/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=2142.24 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 44351 0 0 0 214222 2 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5035326 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 2142.24 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+2202.3 s]
/proc/loadavg: 1.93 2.00 2.04 3/198 8444
/proc/meminfo: memFree=30300548/32770624 swapFree=66999256/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=2202.23 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 44746 0 0 0 220221 2 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5409457 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 2202.23 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+2262.3 s]
/proc/loadavg: 2.27 2.08 2.07 3/198 8763
/proc/meminfo: memFree=30074672/32770624 swapFree=66999256/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=2262.23 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 45142 0 0 0 226221 2 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5009218 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 2262.23 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+2322.3 s]
/proc/loadavg: 2.22 2.09 2.07 3/198 8767
/proc/meminfo: memFree=30058596/32770624 swapFree=66999256/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=2322.23 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 45570 0 0 0 232221 2 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5039132 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 2322.23 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

[startup+2382.3 s]
/proc/loadavg: 2.08 2.07 2.06 3/198 8772
/proc/meminfo: memFree=30057064/32770624 swapFree=66999260/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=2382.23 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 45979 0 0 0 238221 2 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5039132 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 2382.23 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.11 s]
/proc/loadavg: 2.06 2.07 2.06 3/198 8775
/proc/meminfo: memFree=30056428/32770624 swapFree=66999260/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=2400.04 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 46388 0 0 0 240002 2 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5039536 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 2400.04 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.11 s]
# the end of solver process 7923 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2400.02 s, system=0.029999 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.11 s]
/proc/loadavg: 2.06 2.07 2.06 3/198 8775
/proc/meminfo: memFree=30056428/32770624 swapFree=66999260/67108860
[pid=7923] ppid=7920 vsize=49736 memory=26372 CPUtime=2400.04 cores=0,2,4,6
/proc/7923/stat : 7923 (cosoco) R 7920 7923 4693 0 -1 4202496 46388 0 0 0 240002 2 0 0 20 0 1 0 435214534 50929664 6593 33554432000 4194304 6211092 140722888044912 140722888042872 5039536 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12853248 140722888053771 140722888053873 140722888053873 140722888056782 0
/proc/7923/statm: 12434 6593 875 493 0 5739 0
Current children cumulated CPU time: 2400.04 s
Current children cumulated vsize: 49736 KiB
Current children cumulated memory: 26372 KiB

Child status: 1
Real time (s): 2400.11
CPU time (s): 2400.05
CPU user time (s): 2400.02
CPU system time (s): 0.029999
CPU usage (%): 99.9976
Max. virtual memory (cumulated for all children) (KiB): 49736
Max. memory (cumulated for all children) (KiB): 26372

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.02
system time used= 0.029999
maximum resident set size= 26436
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 46438
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 25
involuntary context switches= 604


# summary of solver processes directly reported to runsolver:
#   pid: 7923
#   total CPU time (s): 2400.05
#   total CPU user time (s): 2400.02
#   total CPU system time (s): 0.029999

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.28639 second user time and 14.568 second system time

The end

Launcher Data 

Begin job on node106 at 2019-09-16 00:18:42
IDJOB=4397423
IDBENCH=139772
IDSOLVER=2849
FILE ID=node106/4397423-1568589600
RUNJOBID= node106-1568569106-4724
PBS_JOBID= 21703334
Free space on /tmp= 59108 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/CoveringArray/CoveringArray-elt-s1/CoveringArray-elt-3-10-2-11.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4397423-1568589600/watcher-4397423-1568589600 -o /tmp/evaluation-result-4397423-1568589600/solver-4397423-1568589600 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node106-1568569106-4724 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4397423-1568589600.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c5b4e9c2e16defa9f5099964bd118207
RANDOM SEED=2049076970

node106.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.79
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30451068 kB
MemAvailable:   31894004 kB
Buffers:          204456 kB
Cached:          1528976 kB
SwapCached:         8148 kB
Active:           485720 kB
Inactive:        1263516 kB
Active(anon):      16424 kB
Inactive(anon):    43104 kB
Active(file):     469296 kB
Inactive(file):  1220412 kB
Unevictable:      107116 kB
Mlocked:          107116 kB
SwapTotal:      67108860 kB
SwapFree:       66999232 kB
Dirty:              3024 kB
Writeback:             0 kB
AnonPages:        114880 kB
Mapped:            44272 kB
Shmem:             35012 kB
Slab:             167416 kB
SReclaimable:     138128 kB
SUnreclaim:        29288 kB
KernelStack:        3536 kB
PageTables:         5716 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     529084 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     69632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      107904 kB
DirectMap2M:    33437696 kB

Free space on /tmp at the end= 59092 MiB
End job on node106 at 2019-09-16 00:58:42