Trace number 4408681

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2400.1 2399.9

General information on the benchmark

NameCoveringArray/CoveringArray-elt-s1/
CoveringArray-elt-3-11-2-11.xml
MD5SUMc0667791697b10c41f5c8efbba83a1bb
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables3135
Number of constraints1496
Number of domains2
Minimum domain size8
Maximum domain size11
Distribution of domain sizes[{"size":8,"count":1815},{"size":11,"count":1320}]
Minimum variable degree2
Maximum variable degree9
Distribution of variable degrees[{"degree":2,"count":1320},{"degree":9,"count":1815}]
Minimum constraint arity8
Maximum constraint arity165
Distribution of constraint arities[{"arity":8,"count":165},{"arity":12,"count":1320},{"arity":165,"count":11}]
Number of extensional constraints11
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":11},{"type":"allDifferent","count":165},{"type":"element","count":1320}]
Optimization problemNO
Type of objective

Solver Data 

0.41/0.43	c root propagations     : 0           
0.41/0.43	c restarts enabled, print stats at every restarts
0.41/0.43	c
0.41/0.43	c
0.41/0.43	c
0.41/0.43	c This is cosoco 2.00 --  
0.41/0.43	c
0.41/0.43	c command line: cosoco -lc -model -restarts -stick HOME/instance-4408681-1569808842.xml 
0.41/0.43	c ========================================[ Problem Statistics ]===========================================
0.41/0.43	c |                                                                                                       
0.41/0.43	c |  Parse time        :         0.37 s 
0.41/0.43	c |
0.41/0.43	c |               Variables: 3135
0.41/0.43	c |            Domain Sizes: 8..11
0.41/0.43	c |
0.41/0.43	c |             Constraints: 1496
0.41/0.43	c |                   Arity: 8..165
0.41/0.43	c | 
0.41/0.43	c |                   Types: 
0.41/0.43	c |                          All Different: 165
0.41/0.43	c |                          Element Constant: 1320
0.41/0.43	c |                          Extension: 11  (nb tuples: 2048..2048) -- (shared: 10)
0.41/0.43	c |                          
0.41/0.43	c =========================================================================================================
0.41/0.43	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.79/0.80	c 101            1350           184581         177791         0              0              1080   1108   1074
1.39/1.43	c 211            2959           374276         595112         0              0              20   94   54   
2.00/2.04	c 332            5045           522350         819921         0              0              506   924   738
3.10/3.16	c 465            5777           689021         1225184        0              0              209   253   228
4.49/4.57	c 611            6633           912886         1730499        0              0              295   308   298
5.49/5.55	c 771            7862           1124082        2153794        0              0              171   193   184
6.59/6.64	c 947            9013           1352326        2702290        0              0              360   375   366
8.10/8.11	c 1140           10427          1596154        3247943        0              0              248   278   258
9.29/9.39	c 1352           11968          1841897        3757355        0              0              228   251   237
10.19/10.22	c 1585           13121          2096395        4171012        0              0              194   242   214
11.29/11.30	c 1841           14282          2371562        4789668        0              0              123   146   130
12.39/12.44	c 2122           15373          2704777        5403715        0              0              128   141   133
13.19/13.26	c 2431           16562          2843653        5860376        0              0              131   159   144
14.59/14.68	c 2770           18220          3213851        6629816        0              0              44   63   54   
16.10/16.12	c 3142           19872          3610852        7379369        0              0              50   62   56   
16.89/16.94	c 3551           22579          3751459        7883369        0              0              34   80   64   
18.69/18.75	c 4000           25358          4116577        8925230        0              0              71   142   97  
20.10/20.12	c 4493           26907          4322500        9818180        0              0              87   107   99  
21.29/21.30	c 5035           30717          4613159        10645366       0              0              94   146   115 
23.00/23.09	c 5631           36544          4986966        11783621       0              0              84   183   142 
26.29/26.32	c 6286           43806          5784331        13848305       0              0              153   190   169
28.79/28.81	c 7006           48646          6558395        15146639       0              0              144   171   159
31.79/31.82	c 7798           53635          7205298        17140455       0              0              98   124   115 
35.49/35.53	c 8669           58138          8166342        19295554       0              0              74   101   86  
38.69/38.73	c 9627           65949          9058475        21118199       0              0              68   139   94  
41.79/41.81	c 10680          77653          9883749        22945542       0              0              91   152   130 
46.29/46.39	c 11838          85617          10782072       25652767       0              0              97   183   132 
51.39/51.48	c 13111          98173          11827366       28386149       0              0              139   187   165
56.79/56.81	c 14511          107225         12999963       32047113       0              0              140   177   161
61.79/61.84	c 16051          117180         13966772       35160981       0              0              156   192   174
69.60/69.63	c 17745          133401         16167672       40413802       0              0              140   168   160
76.80/76.85	c 19608          149651         17904384       45225253       0              0              144   184   162
85.60/85.67	c 21657          173604         20477347       51410229       0              0              137   163   158
95.00/95.01	c 23910          197848         22876575       57347394       0              0              133   171   156
100.60/100.69	c 26388          214358         25297719       60838805       0              0              119   161   141
110.40/110.45	c 29113          227738         28204724       67540156       0              0              112   135   126
122.50/122.53	c 32110          243905         31841654       75789926       0              0              115   135   129
133.60/133.68	c 35406          257087         36101836       83571675       0              0              92   125   108 
147.50/147.50	c 39031          291423         38824164       90003794       0              0              101   152   125
165.40/165.48	c 43018          321790         41570529       98611868       0              0              105   145   129
179.60/179.64	c 47403          350020         45303438       107502708      0              0              97   141   121 
197.01/197.06	c 52226          379371         49845595       119158062      0              0              102   140   124
212.90/212.90	c 57531          405143         53594362       129520932      0              0              96   140   125 
227.70/227.76	c 63366          442258         59000559       138788348      0              0              99   149   123 
249.41/249.45	c 69784          475069         64466397       152453281      0              0              99   153   120 
275.51/275.59	c 76843          518558         72467471       169121741      0              0              95   128   113 
306.41/306.43	c 84607          572769         81485485       189306421      0              0              92   119   110 
338.02/338.01	c 93147          626244         89706193       209908623      0              0              92   153   116 
367.41/367.49	c 102541         670358         95155632       230073085      0              0              96   152   118 
403.32/403.34	c 112874         740812         105891620      252777918      0              0              64   100   85  
447.03/447.08	c 124240         809335         117386131      281896874      0              0              67   104   84  
487.82/487.81	c 136742         882012         127235591      309141585      0              0              68   102   89  
536.04/536.06	c 150494         987076         143117949      339519830      0              0              63   96   84   
584.93/584.98	c 165621         1075820        159942216      370711371      0              0              58   86   74   
634.34/634.31	c 182260         1144016        175391627      398805027      0              0              56   81   71   
703.84/703.89	c 200562         1223562        196058751      442085297      0              0              48   74   64   
743.94/743.92	c 220694         1343460        208569455      471795294      0              0              45   166   119 
780.45/780.49	c 242839         1664524        217288841      496943278      0              0              75   166   151 
846.65/846.61	c 267198         2264893        233730515      530572610      0              0              62   153   134 
911.96/911.97	c 293992         2694654        252600791      571211373      0              0              64   142   122 
1006.97/1006.98	c 323465         3001320        274613144      630448226      0              0              68   180   126 
1112.68/1112.65	c 355885         3194988        309615924      698950157      0              0              55   127   81  
1240.10/1240.02	c 391547         3390456        341501057      780586909      0              0              58   128   83  
1364.90/1364.85	c 430775         3550050        363016547      861398673      0              0              62   101   89  
1516.02/1515.97	c 473925         3807241        403615782      962959440      0              0              61   145   84  
1677.53/1677.47	c 521390         4027012        439837678      1072335459     0              0              59   100   84  
1822.54/1822.49	c 573601         4256245        468083286      1173088906     0              0              57   99   87   
2027.76/2027.66	c 631033         4586751        525451125      1308144286     0              0              56   96   77   
2220.88/2220.77	c 694208         5056748        583837507      1440969813     0              0              52   142   87  
2400.09/2399.90	
2400.09/2399.90	c *** INTERRUPTED ***
2400.09/2399.90	c restarts              : 69          
2400.09/2399.90	c conflicts             : 747910       (312 /sec)
2400.09/2399.90	c decisions             : 5330682      (2221 /sec)
2400.09/2399.90	c propagations          : 1558013104  (649157 /sec)
2400.09/2399.90	c root propagations     : 0           
2400.09/2399.90	c filter calls          : 634629457      (264423 /sec)
2400.09/2399.90	c useless filter calls  : 374695334      (59 %)
2400.09/2399.90	c Memory used           : 65.08 MB
2400.09/2399.90	c CPU time              : 2400.06 s
2400.09/2399.90	c real time             : 2399.9 s
2400.09/2399.90	
2400.09/2399.90	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (15422 MiB free)
  memory of node 1: 16384 MiB (15334 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408681-1569808842/watcher-4408681-1569808842 -o /tmp/evaluation-result-4408681-1569808842/solver-4408681-1569808842 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node116-1569787351-26363 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4408681-1569808842.xml 

running on 4 cores: 0-3

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=30202, runsolver pid=30199
Current StackSize limit: 8192 KiB


[startup+0.10016 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 30203
/proc/meminfo: memFree=31473656/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=48796 memory=25064 CPUtime=0.1 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 6452 0 0 0 10 0 0 0 20 0 1 0 556825709 49967104 6266 33554432000 4194304 6211132 140722264699984 140722264696520 5814717 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 12199 6266 825 493 0 5504 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 48796 KiB
Current children cumulated memory: 25064 KiB

[startup+0.21087 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 30203
/proc/meminfo: memFree=31472632/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=49212 memory=25592 CPUtime=0.21 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 6577 0 0 0 21 0 0 0 20 0 1 0 556825709 50393088 6398 33554432000 4194304 6211132 140722264699984 140722264696520 140024802567296 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 12303 6398 825 493 0 5608 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 49212 KiB
Current children cumulated memory: 25592 KiB

[startup+0.310082 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 30203
/proc/meminfo: memFree=31472260/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=49740 memory=25856 CPUtime=0.31 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 6689 0 0 0 31 0 0 0 20 0 1 0 556825709 50933760 6464 33554432000 4194304 6211132 140722264699984 140722264696520 140024786504677 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 12435 6464 825 493 0 5740 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 49740 KiB
Current children cumulated memory: 25856 KiB

[startup+0.700325 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 30203
/proc/meminfo: memFree=31458124/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=65048 memory=41696 CPUtime=0.69 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 10587 0 0 0 68 1 0 0 20 0 1 0 556825709 66609152 10424 33554432000 4194304 6211132 140722264699984 140722264697544 5039217 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16262 10424 873 493 0 9567 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 65048 KiB
Current children cumulated memory: 41696 KiB

[startup+1.50032 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 30203
/proc/meminfo: memFree=31456084/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=65316 memory=41696 CPUtime=1.49 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 10645 0 0 0 148 1 0 0 20 0 1 0 556825709 66883584 10424 33554432000 4194304 6211132 140722264699984 140722264697544 5038947 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16329 10424 873 493 0 9634 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 65316 KiB
Current children cumulated memory: 41696 KiB

[startup+3.11056 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 30212
/proc/meminfo: memFree=31454188/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43304 CPUtime=3.1 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 18222 0 0 0 309 1 0 0 20 0 1 0 556825709 68239360 10826 33554432000 4194304 6211132 140722264699984 140722264697944 5038992 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10826 875 493 0 9965 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43304 KiB

[startup+6.30029 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 30212
/proc/meminfo: memFree=31454340/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43304 CPUtime=6.29 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 25646 0 0 0 628 1 0 0 20 0 1 0 556825709 68239360 10826 33554432000 4194304 6211132 140722264699984 140722264697944 5039029 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10826 875 493 0 9965 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43304 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 30212
/proc/meminfo: memFree=31454496/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43304 CPUtime=12.69 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 32342 0 0 0 1267 2 0 0 20 0 1 0 556825709 68239360 10826 33554432000 4194304 6211132 140722264699984 140722264697944 5039199 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10826 875 493 0 9965 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43304 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 30214
/proc/meminfo: memFree=31453988/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43304 CPUtime=25.49 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 44557 0 0 0 2547 2 0 0 20 0 1 0 556825709 68239360 10826 33554432000 4194304 6211132 140722264699984 140722264697944 5039029 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10826 875 493 0 9965 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43304 KiB

[startup+51.1107 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 30214
/proc/meminfo: memFree=31454052/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43304 CPUtime=51.1 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 50471 0 0 0 5108 2 0 0 20 0 1 0 556825709 68239360 10826 33554432000 4194304 6211132 140722264699984 140722264697944 5038999 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10826 875 493 0 9965 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43304 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 30240
/proc/meminfo: memFree=31452824/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=102.3 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 55973 0 0 0 10227 3 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039014 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 30246
/proc/meminfo: memFree=31452524/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=162.3 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 56528 0 0 0 16227 3 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039038 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 30250
/proc/meminfo: memFree=31452748/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=222.3 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 57084 0 0 0 22227 3 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5409485 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 30254
/proc/meminfo: memFree=31452300/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=282.31 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 57089 0 0 0 28228 3 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5099205 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 282.31 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 30260
/proc/meminfo: memFree=31452200/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=342.31 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 57646 0 0 0 34228 3 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039038 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 342.31 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 31031
/proc/meminfo: memFree=31445624/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=402.32 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 57650 0 0 0 40229 3 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039132 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 402.32 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 31035
/proc/meminfo: memFree=31444888/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=462.32 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 58178 0 0 0 46229 3 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039178 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 462.32 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB


################
# More data... #
################

/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 1662.43 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+1722.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/199 31845
/proc/meminfo: memFree=31440536/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=1722.44 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 63566 0 0 0 172240 4 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039038 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 1722.44 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 31851
/proc/meminfo: memFree=31440476/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=1782.44 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 64047 0 0 0 178240 4 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039132 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 1782.44 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 31863
/proc/meminfo: memFree=31440492/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=1842.44 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 64092 0 0 0 184240 4 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039217 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 1842.44 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 31867
/proc/meminfo: memFree=31440492/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=1902.45 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 64537 0 0 0 190241 4 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039038 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 1902.45 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 31873
/proc/meminfo: memFree=31440248/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=1962.45 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 64538 0 0 0 196241 4 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039193 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 1962.45 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 31877
/proc/meminfo: memFree=31440616/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=2022.46 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 64982 0 0 0 202242 4 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039038 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 2022.46 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 31881
/proc/meminfo: memFree=31440112/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=2082.46 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 65093 0 0 0 208242 4 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039193 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 2082.46 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31887
/proc/meminfo: memFree=31440648/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=2142.47 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 65510 0 0 0 214243 4 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5397258 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 2142.47 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31891
/proc/meminfo: memFree=31440340/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=2202.47 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 65511 0 0 0 220243 4 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039199 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 2202.47 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31895
/proc/meminfo: memFree=31440436/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=2262.48 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 66033 0 0 0 226244 4 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039132 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 2262.48 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31901
/proc/meminfo: memFree=31440432/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=2322.48 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 66033 0 0 0 232244 4 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5078765 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 2322.48 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31905
/proc/meminfo: memFree=31440480/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=2382.49 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 66510 0 0 0 238245 4 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5039121 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 2382.49 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2399.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31905
/proc/meminfo: memFree=31440948/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=2400.09 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 66510 0 0 0 240005 4 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5394362 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 2400.09 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2399.9 s]
# the end of solver process 30202 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2400.06 s, system=0.047004 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2399.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 31905
/proc/meminfo: memFree=31440948/32770688 swapFree=67001380/67108860
[pid=30202] ppid=30199 vsize=66640 memory=43320 CPUtime=2400.09 cores=0-3
/proc/30202/stat : 30202 (cosoco) R 30199 30202 26332 0 -1 4202496 66510 0 0 0 240005 4 0 0 20 0 1 0 556825709 68239360 10830 33554432000 4194304 6211132 140722264699984 140722264697944 5394362 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 12857344 140722264708107 140722264708209 140722264708209 140722264711118 0
/proc/30202/statm: 16660 10830 875 493 0 9965 0
Current children cumulated CPU time: 2400.09 s
Current children cumulated vsize: 66640 KiB
Current children cumulated memory: 43320 KiB

Child status: 1
Real time (s): 2399.9
CPU time (s): 2400.1
CPU user time (s): 2400.06
CPU system time (s): 0.047004
CPU usage (%): 100.008
Max. virtual memory (cumulated for all children) (KiB): 66640
Max. memory (cumulated for all children) (KiB): 43320

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.06
system time used= 0.047004
maximum resident set size= 43384
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 66561
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 28
involuntary context switches= 648


# summary of solver processes directly reported to runsolver:
#   pid: 30202
#   total CPU time (s): 2400.1
#   total CPU user time (s): 2400.06
#   total CPU system time (s): 0.047004

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.4004 second user time and 17.932 second system time

The end

Launcher Data 

Begin job on node116 at 2019-09-30 03:59:59
IDJOB=4408681
IDBENCH=139774
IDSOLVER=2875
FILE ID=node116/4408681-1569808842
RUNJOBID= node116-1569787351-26363
PBS_JOBID= 21705835
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/CoveringArray/CoveringArray-elt-s1/CoveringArray-elt-3-11-2-11.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408681-1569808842/watcher-4408681-1569808842 -o /tmp/evaluation-result-4408681-1569808842/solver-4408681-1569808842 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node116-1569787351-26363 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4408681-1569808842.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= c0667791697b10c41f5c8efbba83a1bb
RANDOM SEED=2039568997

node116.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        31495028 kB
MemAvailable:   31854772 kB
Buffers:          195364 kB
Cached:           485168 kB
SwapCached:         3344 kB
Active:           376648 kB
Inactive:         310292 kB
Active(anon):      24404 kB
Inactive(anon):    63420 kB
Active(file):     352244 kB
Inactive(file):   246872 kB
Unevictable:      108916 kB
Mlocked:          108916 kB
SwapTotal:      67108860 kB
SwapFree:       67001380 kB
Dirty:              3576 kB
Writeback:             0 kB
AnonPages:        124052 kB
Mapped:            28092 kB
Shmem:             72416 kB
Slab:             183664 kB
SReclaimable:     152928 kB
SUnreclaim:        30736 kB
KernelStack:        3760 kB
PageTables:         5464 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     568872 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     77824 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116160 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 62024 MiB
End job on node116 at 2019-09-30 04:39:59