Trace number 4390034

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2400.03 2400.11

General information on the benchmark

NameLatinSquare/LatinSquare-xcsp2-qcp25/
qcp-25-264-09_X2.xml
MD5SUM9027aa50623a7bf75cd9351701a12dc2
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark14.0602
Satisfiable
(Un)Satisfiability was proved
Number of variables625
Number of constraints15000
Number of domains26
Minimum domain size1
Maximum domain size25
Distribution of domain sizes[{"size":1,"count":361},{"size":25,"count":264}]
Minimum variable degree48
Maximum variable degree48
Distribution of variable degrees[{"degree":48,"count":625}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":15000}]
Number of extensional constraints15000
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":15000}]
Optimization problemNO
Type of objective

Solver Data 

0.40/0.44	c root propagations     : 5433        
0.40/0.44	c restarts enabled, print stats at every restarts
0.40/0.44	c
0.40/0.44	c
0.40/0.44	c
0.40/0.44	c This is cosoco 2.00 --  
0.40/0.44	c
0.40/0.44	c command line: cosoco -lc -model -restarts -stick HOME/instance-4390034-1568353751.xml 
0.40/0.44	c ========================================[ Problem Statistics ]===========================================
0.40/0.44	c |                                                                                                       
0.40/0.44	c |  Parse time        :         0.41 s 
0.40/0.44	c |
0.40/0.44	c |               Variables: 625
0.40/0.44	c |            Domain Sizes: 1..25
0.40/0.44	c |
0.40/0.44	c |             Constraints: 15000
0.40/0.44	c |                   Arity: 2..2  -- Binary: 15000
0.40/0.44	c | 
0.40/0.44	c |                   Types: 
0.40/0.44	c |                          Extension: 15000  (nb tuples: 0..25) -- (shared: 9445)
0.40/0.44	c |                          
0.40/0.44	c =========================================================================================================
0.40/0.44	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.40/0.45	c 101            733            188586         13391          264            0              393   443   413
0.40/0.49	c 211            1603           474667         28252          264            0              420   455   432
0.51/0.52	c 332            2388           776607         42194          264            0              38   75   51   
0.51/0.56	c 465            3125           1160021        63408          264            0              40   75   60   
0.51/0.59	c 611            4040           1495694        79488          264            0              49   70   58   
0.60/0.63	c 771            4793           1812580        94891          264            0              36   69   55   
0.60/0.67	c 947            5739           2204257        113478         264            0              12   71   54   
0.69/0.70	c 1140           6567           2537142        130518         264            0              9   79   62    
0.69/0.74	c 1352           7711           2937051        149157         264            0              36   58   46   
0.69/0.79	c 1585           8985           3410973        172404         264            0              37   90   65   
0.79/0.88	c 1841           11363          4315321        217579         264            0              60   101   77  
0.89/0.96	c 2122           13358          5107435        257708         264            0              51   90   70   
1.00/1.06	c 2431           15415          6113252        310238         264            0              53   90   74   
1.10/1.13	c 2770           17220          6777329        341766         264            0              39   68   54   
1.19/1.22	c 3142           19448          7709738        392310         264            0              34   100   63  
1.29/1.39	c 3551           23511          9367309        481619         264            0              50   103   84  
1.49/1.53	c 4000           26853          10749867       550237         264            0              27   97   70   
1.59/1.61	c 4493           28899          11477013       588800         264            0              29   81   49   
1.69/1.71	c 5035           31800          12384625       631058         264            0              24   48   34   
1.79/1.80	c 5631           34710          13284185       675571         264            0              25   50   36   
2.00/2.01	c 6286           39771          15350406       782143         264            0              35   100   79  
2.19/2.21	c 7006           45033          17176921       869892         264            0              32   100   59  
2.29/2.37	c 7798           49338          18678088       942099         264            0              13   70   49   
2.49/2.52	c 8669           53544          20160125       1018413        264            0              41   74   55   
2.69/2.73	c 9627           59381          22217958       1120714        264            0              43   88   68   
2.89/2.97	c 10680          66093          24561086       1242686        264            0              40   82   60   
3.10/3.18	c 11838          70795          26576778       1355980        264            0              19   75   47   
3.39/3.40	c 13111          76951          28741765       1463050        264            0              13   75   45   
3.59/3.63	c 14511          82936          31026107       1573320        264            0              13   73   49   
3.89/3.93	c 16051          91292          33966081       1726421        264            0              47   91   67   
4.28/4.37	c 17745          101266         38412877       1985014        264            0              43   84   69   
4.78/4.81	c 19608          112389         42804513       2241209        264            0              43   99   80   
5.28/5.39	c 21657          126161         48548547       2561783        264            0              40   99   76   
5.88/5.90	c 23910          139509         53588513       2850728        264            0              16   107   81  
6.38/6.47	c 26388          154679         59182879       3149278        264            0              41   92   69   
7.09/7.19	c 29113          171483         66240525       3536894        264            0              31   92   71   
7.88/7.90	c 32110          192048         72710626       3853694        264            0              17   90   56   
8.78/8.80	c 35406          216694         81305746       4276476        264            0              50   99   76   
9.99/10.01	c 39031          246087         93270533       4918658        264            0              53   119   83  
10.78/10.86	c 43018          271726         101182925      5290048        264            0              27   85   59   
12.18/12.23	c 47403          308184         114474843      5979150        264            0              28   121   86  
13.88/13.90	c 52226          349883         130971271      6870505        264            0              63   122   97  
15.28/15.35	c 57531          390464         144773228      7558320        264            0              39   110   80  
16.99/17.08	c 63366          439788         161096764      8363587        264            0              43   103   77  
18.18/18.21	c 69784          470675         172085915      8904936        264            0              33   100   67  
20.38/20.44	c 76843          524260         193869723      10052622       264            0              42   108   76  
21.99/22.04	c 84607          568732         209165203      10820241       264            0              32   86   60   
24.99/25.06	c 93147          644016         238623940      12296199       264            0              56   122   91  
27.58/27.62	c 102541         716163         263148295      13504896       264            0              42   103   71  
30.58/30.69	c 112874         793210         293382229      15107112       264            0              62   120   86  
34.18/34.20	c 124240         884269         327281406      16844724       264            0              49   118   91  
36.68/36.70	c 136742         954777         351845321      18075115       264            0              18   98   65   
41.38/41.43	c 150494         1076972        397673139      20442150       264            0              48   117   83  
44.98/45.05	c 165621         1185653        431934471      22133400       264            0              34   104   67  
50.37/50.48	c 182260         1337464        487142520      24922814       264            0              28   125   88  
54.87/54.98	c 200562         1475712        540653711      27763524       264            0              44   124   87  
59.27/59.39	c 220694         1615297        593081868      30491660       264            0              33   103   74  
64.56/64.63	c 242839         1800323        665342222      34227176       264            0              58   122   91  
69.86/70.00	c 267198         2001627        738610168      37922693       264            0              53   130   86  
75.86/75.93	c 293992         2219024        820528060      42150610       264            0              58   125   93  
81.56/81.67	c 323465         2446443        897639710      46104419       264            0              51   123   88  
88.26/88.33	c 355885         2714159        988251853      50748180       264            0              32   130   94  
94.86/94.95	c 391547         2969528        1077856366     55506019       264            0              14   111   79  
102.07/102.12	c 430775         3259556        1174053711     60396349       264            0              39   121   82  
112.16/112.21	c 473925         3623755        1310417664     67616630       264            0              12   111   71  
121.46/121.56	c 521390         3976502        1437647236     74502409       264            0              46   117   81  
132.16/132.26	c 573601         4416851        1580320827     81559929       264            0              51   118   87  
143.66/143.71	c 631033         4851012        1735226598     89408649       264            0              41   107   76  
154.86/154.99	c 694208         5245517        1888687296     97553729       264            0              17   112   75  
168.75/168.89	c 763700         5777888        2075880474     107219157      264            0              41   110   75  
183.25/183.32	c 840141         6337996        2267879798     117048088      264            0              22   109   71  
195.85/195.91	c 924226         6869892        2432295894     124732534      264            0              15   96   62   
216.06/216.16	c 1016719        7611915        2708461722     140099025      264            0              17   111   84  
232.96/233.08	c 1118461        8261474        2933348606     151900942      264            0              12   101   70  
257.65/257.78	c 1230377        9132864        3271359574     169821733      264            0              41   121   79  
284.75/284.80	c 1353484        10110866       3641919287     189272616      264            0              42   138   84  
313.95/314.05	c 1488901        11169201       4046570311     210097714      264            0              52   126   95  
347.34/347.42	c 1637859        12336920       4505864355     234036885      264            0              51   128   91  
383.14/383.29	c 1801712        13534748       4997312503     260915906      264            0              46   117   81  
423.33/423.49	c 1981950        15019692       5546001345     289124146      264            0              40   116   81  
462.13/462.22	c 2180211        16578200       6060471384     314273939      264            0              30   115   76  
500.43/500.51	c 2398298        18054415       6575324428     341420900      264            0              36   110   74  
544.93/545.08	c 2638193        19834172       7170342347     370683396      264            0              23   129   77  
597.32/597.48	c 2902077        21872052       7866992615     406546437      264            0              29   119   70  
649.62/649.78	c 3192349        23922856       8572732429     442522555      264            0              25   119   77  
708.41/708.55	c 3511648        26223771       9351357349     482939015      264            0              18   111   69  
765.91/766.03	c 3862876        28568991       10105790392    519192304      264            0              25   110   65  
830.10/830.27	c 4249226        31050756       10963424066    563040871      264            0              25   118   69  
908.80/909.00	c 4674211        34087044       12006830537    615430240      264            0              28   120   67  
992.69/992.80	c 5141694        37256052       13150079831    673763587      264            0              29   120   80  
1111.28/1111.41	c 5655925        41601774       14782761988    757535794      264            0              46   137   94  
1242.37/1242.59	c 6221579        46231252       16594686854    851446816      264            0              46   134   92  
1370.16/1370.34	c 6843798        50965882       18352701100    939104186      264            0              41   135   88  
1511.15/1511.36	c 7528238        56262526       20283409546    1037459026     264            0              37   140   89  
1661.95/1662.15	c 8281122        62109418       22304959940    1140436775     264            0              9   125   81   
1826.46/1826.62	c 9109294        68245593       24555205528    1254983108     264            0              32   133   81  
2016.77/2016.92	c 10020283       75586782       27125491865    1390993480     264            0              31   134   81  
2235.09/2235.26	c 11022370       83724009       30133999860    1548794953     264            0              42   130   88  
2400.02/2400.11	
2400.02/2400.11	c *** INTERRUPTED ***
2400.02/2400.11	c restarts              : 98          
2400.02/2400.11	c conflicts             : 11906987     (4961 /sec)
2400.02/2400.11	c decisions             : 90186150     (37578 /sec)
2400.02/2400.11	c propagations          : 1660715392  (691967 /sec)
2400.02/2400.11	c root propagations     : 5433        
2400.02/2400.11	c filter calls          : 32364918373    (13485427 /sec)
2400.02/2400.11	c useless filter calls  : 30896475051    (95 %)
2400.02/2400.11	c Memory used           : 73.46 MB
2400.02/2400.11	c CPU time              : 2399.99 s
2400.02/2400.11	c real time             : 2400.11 s
2400.02/2400.11	
2400.02/2400.11	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15313 MiB free)
  memory of node 1: 16384 MiB (15611 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4390034-1568353751/watcher-4390034-1568353751 -o /tmp/evaluation-result-4390034-1568353751/solver-4390034-1568353751 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node133-1568334353-31997 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4390034-1568353751.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=3113, runsolver pid=3110

[startup+0.101013 s]*
/proc/loadavg: 2.05 2.04 2.05 3/203 3114
/proc/meminfo: memFree=31665636/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=29004 memory=5272 CPUtime=0.1 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 1482 0 0 0 10 0 0 0 20 0 1 0 411614781 29700096 1318 33554432000 4194304 6210612 140736881110208 140736881107480 140301924858353 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 7251 1318 805 493 0 556 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 29004 KiB
Current children cumulated memory: 5272 KiB

[startup+0.210006 s]*
/proc/loadavg: 2.05 2.04 2.05 3/203 3114
/proc/meminfo: memFree=31648792/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=46040 memory=22244 CPUtime=0.2 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 5779 0 0 0 20 0 0 0 20 0 1 0 411614781 47144960 5561 33554432000 4194304 6210612 140736881110208 140736881107480 140301918993672 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 11510 5561 805 493 0 4815 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 46040 KiB
Current children cumulated memory: 22244 KiB

[startup+0.309736 s]*
/proc/loadavg: 1.97 2.02 2.04 3/203 3114
/proc/meminfo: memFree=31635400/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=59636 memory=35708 CPUtime=0.31 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 9172 0 0 0 30 1 0 0 20 0 1 0 411614781 61067264 8927 33554432000 4194304 6210612 140736881110208 140736881105336 5810073 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 14909 8927 805 493 0 8214 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 59636 KiB
Current children cumulated memory: 35708 KiB

[startup+0.70028 s]
/proc/loadavg: 1.97 2.02 2.04 3/203 3114
/proc/meminfo: memFree=31619404/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51548 CPUtime=0.69 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 13124 0 0 0 67 2 0 0 20 0 1 0 411614781 77025280 12887 33554432000 4194304 6210612 140736881110208 140736881105336 5016909 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12887 851 493 0 12110 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51548 KiB

[startup+1.50027 s]
/proc/loadavg: 1.97 2.02 2.04 3/203 3114
/proc/meminfo: memFree=31618784/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51548 CPUtime=1.49 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 13124 0 0 0 147 2 0 0 20 0 1 0 411614781 77025280 12887 33554432000 4194304 6210612 140736881110208 140736881108168 5008730 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12887 851 493 0 12110 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51548 KiB

[startup+3.10974 s]
/proc/loadavg: 1.97 2.02 2.04 3/203 3114
/proc/meminfo: memFree=31618740/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51728 CPUtime=3.1 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 21371 0 0 0 308 2 0 0 20 0 1 0 411614781 77025280 12932 33554432000 4194304 6210612 140736881110208 140736881108168 5008626 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12932 851 493 0 12110 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51728 KiB

[startup+6.30024 s]
/proc/loadavg: 1.97 2.02 2.04 3/203 3114
/proc/meminfo: memFree=31618720/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51728 CPUtime=6.28 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 29608 0 0 0 626 2 0 0 20 0 1 0 411614781 77025280 12932 33554432000 4194304 6210612 140736881110208 140736881108168 5016875 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12932 851 493 0 12110 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51728 KiB

[startup+12.7002 s]
/proc/loadavg: 1.97 2.02 2.04 3/202 3114
/proc/meminfo: memFree=31618620/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51728 CPUtime=12.68 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 37862 0 0 0 1266 2 0 0 20 0 1 0 411614781 77025280 12932 33554432000 4194304 6210612 140736881110208 140736881108168 5008459 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12932 851 493 0 12110 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51728 KiB

[startup+25.5003 s]
/proc/loadavg: 1.98 2.02 2.04 3/202 3114
/proc/meminfo: memFree=31618776/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51728 CPUtime=25.48 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 54357 0 0 0 2545 3 0 0 20 0 1 0 411614781 77025280 12932 33554432000 4194304 6210612 140736881110208 140736881108168 5016906 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12932 851 493 0 12110 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51728 KiB

[startup+51.1096 s]
/proc/loadavg: 1.99 2.02 2.04 3/202 3117
/proc/meminfo: memFree=31618132/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=51.08 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 62110 0 0 0 5105 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5017005 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+102.3 s]
/proc/loadavg: 1.99 2.01 2.04 3/203 3129
/proc/meminfo: memFree=31617344/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=102.26 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 62377 0 0 0 10223 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5409293 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 102.26 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+162.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/204 3134
/proc/meminfo: memFree=31617584/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=162.26 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 62637 0 0 0 16223 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5409293 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+222.3 s]
/proc/loadavg: 2.12 2.05 2.05 3/204 3140
/proc/meminfo: memFree=31617648/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=222.25 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 62897 0 0 0 22222 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5409284 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 222.25 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+282.3 s]
/proc/loadavg: 2.04 2.04 2.05 3/204 3144
/proc/meminfo: memFree=31617772/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=282.25 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 63157 0 0 0 28222 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5016891 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 282.25 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+342.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/204 3148
/proc/meminfo: memFree=31617308/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=342.24 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 63417 0 0 0 34221 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5017005 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 342.24 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/203 3155
/proc/meminfo: memFree=31617012/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=402.24 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 63677 0 0 0 40221 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5409293 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 402.24 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/202 3159
/proc/meminfo: memFree=31617200/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=462.23 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 63937 0 0 0 46220 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5008463 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 462.23 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB


################
# More data... #
################

/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 1662.14 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+1722.3 s]
/proc/loadavg: 1.98 2.00 2.04 3/204 3301
/proc/meminfo: memFree=31615684/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=1722.15 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 68967 0 0 0 172212 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5017117 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 1722.15 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+1782.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/204 3305
/proc/meminfo: memFree=31615708/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=1782.15 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 69207 0 0 0 178212 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5008463 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 1782.15 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/204 3311
/proc/meminfo: memFree=31615868/32770624 swapFree=67003468/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=1842.16 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 69227 0 0 0 184213 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5185944 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 1842.16 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/204 3323
/proc/meminfo: memFree=31614956/32770624 swapFree=67003472/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=1902.16 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 69468 0 0 0 190213 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5008827 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 1902.16 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/203 3327
/proc/meminfo: memFree=31615400/32770624 swapFree=67003472/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=1962.17 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 69468 0 0 0 196214 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5017005 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 1962.17 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/203 3355
/proc/meminfo: memFree=31614768/32770624 swapFree=67003472/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=2022.18 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 69728 0 0 0 202215 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5008476 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 2022.18 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/203 3359
/proc/meminfo: memFree=31615664/32770624 swapFree=67003472/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=2082.18 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 69728 0 0 0 208215 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5409293 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 2082.18 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+2142.3 s]
/proc/loadavg: 2.01 2.00 2.04 3/204 3616
/proc/meminfo: memFree=31428496/32770624 swapFree=67003472/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=2142.19 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 69968 0 0 0 214216 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5017123 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 2142.19 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/204 3745
/proc/meminfo: memFree=31599668/32770624 swapFree=67003472/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=2202.19 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 69968 0 0 0 220216 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5397301 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 2202.19 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/204 3749
/proc/meminfo: memFree=31599456/32770624 swapFree=67003472/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=2262.2 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 70228 0 0 0 226217 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5397215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 2262.2 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+2322.3 s]
/proc/loadavg: 2.16 2.03 2.05 3/204 3753
/proc/meminfo: memFree=31600100/32770624 swapFree=67003472/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=2322.2 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 70228 0 0 0 232217 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5008463 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 2322.2 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

[startup+2382.3 s]
/proc/loadavg: 2.51 2.17 2.10 3/204 3760
/proc/meminfo: memFree=31599120/32770624 swapFree=67003472/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=2382.21 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 70465 0 0 0 238218 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5017018 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 2382.21 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.11 s]
/proc/loadavg: 2.40 2.16 2.10 3/203 3760
/proc/meminfo: memFree=31599636/32770624 swapFree=67003472/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=2400.02 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 70465 0 0 0 239999 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5008946 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 2400.02 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.11 s]
# the end of solver process 3113 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2399.99 s, system=0.040998 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.11 s]
/proc/loadavg: 2.40 2.16 2.10 3/203 3760
/proc/meminfo: memFree=31599636/32770624 swapFree=67003472/67108860
[pid=3113] ppid=3110 vsize=75220 memory=51736 CPUtime=2400.02 cores=0,2,4,6
/proc/3113/stat : 3113 (cosoco) R 3110 3113 31966 0 -1 4202496 70465 0 0 0 239999 3 0 0 20 0 1 0 411614781 77025280 12934 33554432000 4194304 6210612 140736881110208 140736881108168 5008946 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 40964096 140736881112075 140736881112177 140736881112177 140736881115086 0
/proc/3113/statm: 18805 12934 851 493 0 12110 0
Current children cumulated CPU time: 2400.02 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51736 KiB

Child status: 1
Real time (s): 2400.11
CPU time (s): 2400.03
CPU user time (s): 2399.99
CPU system time (s): 0.040998
CPU usage (%): 99.9968
Max. virtual memory (cumulated for all children) (KiB): 75220
Max. memory (cumulated for all children) (KiB): 51736

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.99
system time used= 0.040998
maximum resident set size= 51804
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 70517
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 33
involuntary context switches= 1544


# summary of solver processes directly reported to runsolver:
#   pid: 3113
#   total CPU time (s): 2400.03
#   total CPU user time (s): 2399.99
#   total CPU system time (s): 0.040998

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.20265 second user time and 16.8188 second system time

The end

Launcher Data 

Begin job on node133 at 2019-09-13 07:48:32
IDJOB=4390034
IDBENCH=139104
IDSOLVER=2830
FILE ID=node133/4390034-1568353751
RUNJOBID= node133-1568334353-31997
PBS_JOBID= 21701160
Free space on /tmp= 55112 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/LatinSquare/LatinSquare-xcsp2-qcp25/qcp-25-264-09_X2.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4390034-1568353751/watcher-4390034-1568353751 -o /tmp/evaluation-result-4390034-1568353751/solver-4390034-1568353751 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node133-1568334353-31997 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4390034-1568353751.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9027aa50623a7bf75cd9351701a12dc2
RANDOM SEED=958904956

node133.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.18
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31667128 kB
MemAvailable:   31894032 kB
Buffers:          143464 kB
Cached:           367664 kB
SwapCached:         3480 kB
Active:           274620 kB
Inactive:         249460 kB
Active(anon):      37304 kB
Inactive(anon):    15724 kB
Active(file):     237316 kB
Inactive(file):   233736 kB
Unevictable:      111240 kB
Mlocked:          111240 kB
SwapTotal:      67108860 kB
SwapFree:       67003468 kB
Dirty:              3060 kB
Writeback:             8 kB
AnonPages:        123072 kB
Mapped:            44876 kB
Shmem:             31328 kB
Slab:             171996 kB
SReclaimable:     143376 kB
SUnreclaim:        28620 kB
KernelStack:        3584 kB
PageTables:         5248 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     537192 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     75776 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      122240 kB
DirectMap2M:    33423360 kB

Free space on /tmp at the end= 55108 MiB
End job on node133 at 2019-09-13 08:28:32