Trace number 4408574

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2400.02 2400.01

General information on the benchmark

NameLatinSquare/LatinSquare-xcsp2-qcp25/
qcp-25-264-09_X2.xml
MD5SUM9027aa50623a7bf75cd9351701a12dc2
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark14.0602
Satisfiable
(Un)Satisfiability was proved
Number of variables625
Number of constraints15000
Number of domains26
Minimum domain size1
Maximum domain size25
Distribution of domain sizes[{"size":1,"count":361},{"size":25,"count":264}]
Minimum variable degree48
Maximum variable degree48
Distribution of variable degrees[{"degree":48,"count":625}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":15000}]
Number of extensional constraints15000
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":15000}]
Optimization problemNO
Type of objective

Solver Data

0.41/0.42	c root propagations     : 5433        
0.41/0.42	c restarts enabled, print stats at every restarts
0.41/0.42	c
0.41/0.42	c
0.41/0.42	c
0.41/0.42	c This is cosoco 2.00 --  
0.41/0.42	c
0.41/0.42	c command line: cosoco -lc -model -restarts -stick HOME/instance-4408574-1569808266.xml 
0.41/0.42	c ========================================[ Problem Statistics ]===========================================
0.41/0.42	c |                                                                                                       
0.41/0.42	c |  Parse time        :         0.40 s 
0.41/0.42	c |
0.41/0.42	c |               Variables: 625
0.41/0.42	c |            Domain Sizes: 1..25
0.41/0.42	c |
0.41/0.42	c |             Constraints: 15000
0.41/0.42	c |                   Arity: 2..2  -- Binary: 15000
0.41/0.42	c | 
0.41/0.42	c |                   Types: 
0.41/0.42	c |                          Extension: 15000  (nb tuples: 0..25) -- (shared: 9445)
0.41/0.42	c |                          
0.41/0.42	c =========================================================================================================
0.41/0.42	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.41/0.44	c 101            733            188586         13391          264            0              393   443   413
0.41/0.47	c 211            1603           474667         28252          264            0              420   455   432
0.41/0.50	c 332            2388           776607         42194          264            0              38   75   51   
0.51/0.54	c 465            3125           1160021        63408          264            0              40   75   60   
0.51/0.58	c 611            4040           1495694        79488          264            0              49   70   58   
0.60/0.61	c 771            4793           1812580        94891          264            0              36   69   55   
0.60/0.65	c 947            5739           2204257        113478         264            0              12   71   54   
0.60/0.68	c 1140           6567           2537142        130518         264            0              9   79   62    
0.69/0.72	c 1352           7711           2937051        149157         264            0              36   58   46   
0.69/0.77	c 1585           8985           3410973        172404         264            0              37   90   65   
0.79/0.86	c 1841           11363          4315321        217579         264            0              60   101   77  
0.89/0.94	c 2122           13358          5107435        257708         264            0              51   90   70   
1.00/1.03	c 2431           15415          6113252        310238         264            0              53   90   74   
1.00/1.10	c 2770           17220          6777329        341766         264            0              39   68   54   
1.19/1.20	c 3142           19448          7709738        392310         264            0              34   100   63  
1.29/1.36	c 3551           23511          9367309        481619         264            0              50   103   84  
1.49/1.50	c 4000           26853          10749867       550237         264            0              27   97   70   
1.49/1.57	c 4493           28899          11477013       588800         264            0              29   81   49   
1.59/1.67	c 5035           31800          12384625       631058         264            0              24   48   34   
1.69/1.76	c 5631           34710          13284185       675571         264            0              25   50   36   
1.89/1.97	c 6286           39771          15350406       782143         264            0              35   100   79  
2.10/2.17	c 7006           45033          17176921       869892         264            0              32   100   59  
2.29/2.33	c 7798           49338          18678088       942099         264            0              13   70   49   
2.39/2.48	c 8669           53544          20160125       1018413        264            0              41   74   55   
2.59/2.69	c 9627           59381          22217958       1120714        264            0              43   88   68   
2.89/2.93	c 10680          66093          24561086       1242686        264            0              40   82   60   
3.10/3.13	c 11838          70795          26576778       1355980        264            0              19   75   47   
3.29/3.35	c 13111          76951          28741765       1463050        264            0              13   75   45   
3.49/3.57	c 14511          82936          31026107       1573320        264            0              13   73   49   
3.79/3.87	c 16051          91292          33966081       1726421        264            0              47   91   67   
4.29/4.31	c 17745          101266         38412877       1985014        264            0              43   84   69   
4.69/4.74	c 19608          112389         42804513       2241209        264            0              43   99   80   
5.29/5.31	c 21657          126161         48548547       2561783        264            0              40   99   76   
5.79/5.81	c 23910          139509         53588513       2850728        264            0              16   107   81  
6.29/6.38	c 26388          154679         59182879       3149278        264            0              41   92   69   
7.00/7.09	c 29113          171483         66240525       3536894        264            0              31   92   71   
7.69/7.79	c 32110          192048         72710626       3853694        264            0              17   90   56   
8.59/8.68	c 35406          216694         81305746       4276476        264            0              50   99   76   
9.79/9.87	c 39031          246087         93270533       4918658        264            0              53   119   83  
10.69/10.71	c 43018          271726         101182925      5290048        264            0              27   85   59   
12.00/12.06	c 47403          308184         114474843      5979150        264            0              28   121   86  
13.69/13.71	c 52226          349883         130971271      6870505        264            0              63   122   97  
15.10/15.14	c 57531          390464         144773228      7558320        264            0              39   110   80  
16.79/16.84	c 63366          439788         161096764      8363587        264            0              43   103   77  
17.89/17.96	c 69784          470675         172085915      8904936        264            0              33   100   67  
20.10/20.15	c 76843          524260         193869723      10052622       264            0              42   108   76  
21.69/21.74	c 84607          568732         209165203      10820241       264            0              32   86   60   
24.69/24.71	c 93147          644016         238623940      12296199       264            0              56   122   91  
27.19/27.24	c 102541         716163         263148295      13504896       264            0              42   103   71  
30.19/30.27	c 112874         793210         293382229      15107112       264            0              62   120   86  
33.69/33.72	c 124240         884269         327281406      16844724       264            0              49   118   91  
36.10/36.19	c 136742         954777         351845321      18075115       264            0              18   98   65   
40.48/40.57	c 150494         1076972        397673139      20442150       264            0              48   117   83  
43.58/43.67	c 165621         1185653        431934471      22133400       264            0              34   104   67  
48.38/48.47	c 182260         1337464        487142520      24922814       264            0              28   125   88  
52.37/52.42	c 200562         1475712        540653711      27763524       264            0              44   124   87  
56.17/56.26	c 220694         1615297        593081868      30491660       264            0              33   103   74  
61.37/61.47	c 242839         1800323        665342222      34227176       264            0              58   122   91  
66.78/66.83	c 267198         2001627        738610168      37922693       264            0              53   130   86  
72.68/72.74	c 293992         2219024        820528060      42150610       264            0              58   125   93  
78.38/78.47	c 323465         2446443        897639710      46104419       264            0              51   123   88  
85.08/85.12	c 355885         2714159        988251853      50748180       264            0              32   130   94  
91.68/91.71	c 391547         2969528        1077856366     55506019       264            0              14   111   79  
98.78/98.87	c 430775         3259556        1174053711     60396349       264            0              39   121   82  
108.88/108.95	c 473925         3623755        1310417664     67616630       264            0              12   111   71  
118.18/118.27	c 521390         3976502        1437647236     74502409       264            0              46   117   81  
128.88/128.95	c 573601         4416851        1580320827     81559929       264            0              51   118   87  
140.28/140.38	c 631033         4851012        1735226598     89408649       264            0              41   107   76  
151.58/151.64	c 694208         5245517        1888687296     97553729       264            0              17   112   75  
165.48/165.50	c 763700         5777888        2075880474     107219157      264            0              41   110   75  
179.78/179.89	c 840141         6337996        2267879798     117048088      264            0              22   109   71  
192.38/192.44	c 924226         6869892        2432295894     124732534      264            0              15   96   62   
212.58/212.62	c 1016719        7611915        2708461722     140099025      264            0              17   111   84  
229.38/229.49	c 1118461        8261474        2933348606     151900942      264            0              12   101   70  
254.09/254.14	c 1230377        9132864        3271359574     169821733      264            0              41   121   79  
280.99/281.09	c 1353484        10110866       3641919287     189272616      264            0              42   138   84  
310.18/310.24	c 1488901        11169201       4046570311     210097714      264            0              52   126   95  
343.48/343.54	c 1637859        12336920       4505864355     234036885      264            0              51   128   91  
379.28/379.34	c 1801712        13534748       4997312503     260915906      264            0              46   117   81  
419.38/419.43	c 1981950        15019692       5546001345     289124146      264            0              40   116   81  
457.99/458.08	c 2180211        16578200       6060471384     314273939      264            0              30   115   76  
496.18/496.26	c 2398298        18054415       6575324428     341420900      264            0              36   110   74  
540.68/540.72	c 2638193        19834172       7170342347     370683396      264            0              23   129   77  
592.88/593.00	c 2902077        21872052       7866992615     406546437      264            0              29   119   70  
645.09/645.18	c 3192349        23922856       8572732429     442522555      264            0              25   119   77  
703.78/703.85	c 3511648        26223771       9351357349     482939015      264            0              18   111   69  
761.09/761.18	c 3862876        28568991       10105790392    519192304      264            0              25   110   65  
825.18/825.29	c 4249226        31050756       10963424066    563040871      264            0              25   118   69  
903.79/903.86	c 4674211        34087044       12006830537    615430240      264            0              28   120   67  
987.49/987.50	c 5141694        37256052       13150079831    673763587      264            0              29   120   80  
1105.89/1105.96	c 5655925        41601774       14782761988    757535794      264            0              46   137   94  
1236.89/1236.93	c 6221579        46231252       16594686854    851446816      264            0              46   134   92  
1364.49/1364.58	c 6843798        50965882       18352701100    939104186      264            0              41   135   88  
1505.19/1505.23	c 7528238        56262526       20283409546    1037459026     264            0              37   140   89  
1656.00/1656.01	c 8281122        62109418       22304959940    1140436775     264            0              9   125   81   
1821.10/1821.16	c 9109294        68245593       24555205528    1254983108     264            0              32   133   81  
2012.10/2012.12	c 10020283       75586782       27125491865    1390993480     264            0              31   134   81  
2231.00/2231.07	c 11022370       83724009       30133999860    1548794953     264            0              42   130   88  
2400.00/2400.00	
2400.00/2400.00	c *** INTERRUPTED ***
2400.00/2400.00	c restarts              : 98          
2400.00/2400.00	c conflicts             : 11926442     (4969 /sec)
2400.00/2400.00	c decisions             : 90326136     (37636 /sec)
2400.00/2400.00	c propagations          : 1663198298  (693005 /sec)
2400.00/2400.00	c root propagations     : 5433        
2400.00/2400.00	c filter calls          : 32414621151    (13506205 /sec)
2400.00/2400.00	c useless filter calls  : 30943994345    (95 %)
2400.00/2400.00	c Memory used           : 73.46 MB
2400.00/2400.00	c CPU time              : 2399.98 s
2400.00/2400.00	c real time             : 2400.01 s
2400.00/2400.00	
2400.00/2400.00	s UNKNOWN

Verifier Data


Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15117 MiB free)
  memory of node 1: 16384 MiB (15645 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408574-1569808266/watcher-4408574-1569808266 -o /tmp/evaluation-result-4408574-1569808266/solver-4408574-1569808266 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node126-1569787354-25326 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4408574-1569808266.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=29363, runsolver pid=29360

[startup+0.100152 s]*
/proc/loadavg: 2.01 2.07 2.07 3/200 29364
/proc/meminfo: memFree=31500032/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=29004 memory=5272 CPUtime=0.1 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 1489 0 0 0 10 0 0 0 20 0 1 0 557094333 29700096 1318 33554432000 4194304 6211132 140732873430912 140732873427448 140243662212069 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 7251 1318 808 493 0 556 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 29004 KiB
Current children cumulated memory: 5272 KiB

[startup+0.209599 s]*
/proc/loadavg: 2.01 2.07 2.07 3/200 29364
/proc/meminfo: memFree=31482628/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=46040 memory=22260 CPUtime=0.21 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 5786 0 0 0 21 0 0 0 20 0 1 0 557094333 47144960 5565 33554432000 4194304 6211132 140732873430912 140732873427448 140243665693067 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 11510 5565 808 493 0 4815 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 46040 KiB
Current children cumulated memory: 22260 KiB

[startup+0.309703 s]*
/proc/loadavg: 2.01 2.07 2.07 3/200 29364
/proc/meminfo: memFree=31468120/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=61616 memory=37836 CPUtime=0.3 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 9683 0 0 0 30 0 0 0 20 0 1 0 557094333 63094784 9459 33554432000 4194304 6211132 140732873430912 140732873427448 5817743 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 15404 9459 808 493 0 8709 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 61616 KiB
Current children cumulated memory: 37836 KiB

[startup+0.70035 s]
/proc/loadavg: 2.01 2.07 2.07 3/200 29364
/proc/meminfo: memFree=31453240/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51564 CPUtime=0.69 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 13127 0 0 0 68 1 0 0 20 0 1 0 557094333 77025280 12891 33554432000 4194304 6211132 140732873430912 140732873428184 5397407 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12891 854 493 0 12110 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51564 KiB

[startup+1.50033 s]
/proc/loadavg: 2.01 2.07 2.07 3/200 29364
/proc/meminfo: memFree=31453268/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51564 CPUtime=1.49 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 13127 0 0 0 148 1 0 0 20 0 1 0 557094333 77025280 12891 33554432000 4194304 6211132 140732873430912 140732873428872 5389460 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12891 854 493 0 12110 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51564 KiB

[startup+3.10956 s]
/proc/loadavg: 2.01 2.07 2.07 3/200 29364
/proc/meminfo: memFree=31453264/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51744 CPUtime=3.1 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 21373 0 0 0 309 1 0 0 20 0 1 0 557094333 77025280 12936 33554432000 4194304 6211132 140732873430912 140732873428872 5397407 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12936 854 493 0 12110 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51744 KiB

[startup+6.30028 s]
/proc/loadavg: 2.01 2.07 2.07 3/200 29364
/proc/meminfo: memFree=31452840/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51744 CPUtime=6.29 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 29610 0 0 0 628 1 0 0 20 0 1 0 557094333 77025280 12936 33554432000 4194304 6211132 140732873430912 140732873428872 5017277 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12936 854 493 0 12110 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51744 KiB

[startup+12.7003 s]
/proc/loadavg: 2.01 2.07 2.07 3/200 29366
/proc/meminfo: memFree=31452772/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51744 CPUtime=12.69 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 37864 0 0 0 1267 2 0 0 20 0 1 0 557094333 77025280 12936 33554432000 4194304 6211132 140732873430912 140732873428872 5017252 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12936 854 493 0 12110 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51744 KiB

[startup+25.5003 s]
/proc/loadavg: 2.01 2.07 2.07 3/200 29367
/proc/meminfo: memFree=31452756/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51744 CPUtime=25.49 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 54360 0 0 0 2546 3 0 0 20 0 1 0 557094333 77025280 12936 33554432000 4194304 6211132 140732873430912 140732873428872 5409485 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12936 854 493 0 12110 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51744 KiB

[startup+51.1095 s]
/proc/loadavg: 2.01 2.06 2.06 3/200 29367
/proc/meminfo: memFree=31452188/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=51.08 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 59066 0 0 0 5105 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5017451 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/200 29373
/proc/meminfo: memFree=31452852/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=102.28 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 59734 0 0 0 10225 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5389460 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 29377
/proc/meminfo: memFree=31452756/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=162.28 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 60402 0 0 0 16225 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5389851 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 29381
/proc/meminfo: memFree=31452992/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=222.28 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 61070 0 0 0 22225 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5389460 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 29388
/proc/meminfo: memFree=31452364/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=282.28 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 61739 0 0 0 28225 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5017373 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 29392
/proc/meminfo: memFree=31452384/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=342.28 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 62408 0 0 0 34225 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5397248 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 342.28 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 29396
/proc/meminfo: memFree=31452568/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=402.28 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 63076 0 0 0 40225 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5017564 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 402.28 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29403
/proc/meminfo: memFree=31452104/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=462.28 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 63744 0 0 0 46225 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5017462 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 462.28 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB


################
# More data... #
################

/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 1602.29 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+1662.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 29600
/proc/meminfo: memFree=31428792/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=1662.29 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 76786 0 0 0 166226 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5017277 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 1662.29 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29606
/proc/meminfo: memFree=31427668/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=1722.29 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 77418 0 0 0 172226 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5017564 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 1722.29 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29617
/proc/meminfo: memFree=31428340/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=1782.29 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 78058 0 0 0 178226 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5017243 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 1782.29 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 29621
/proc/meminfo: memFree=31428256/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=1842.29 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 78727 0 0 0 184226 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5409485 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 1842.29 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+1902.3 s]
/proc/loadavg: 2.34 2.09 2.07 3/199 29627
/proc/meminfo: memFree=31427504/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=1902.29 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 79357 0 0 0 190226 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5017186 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 1902.29 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+1962.3 s]
/proc/loadavg: 2.31 2.15 2.09 3/199 29631
/proc/meminfo: memFree=31428048/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=1962.29 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 79988 0 0 0 196226 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5017569 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 1962.29 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+2022.3 s]
/proc/loadavg: 2.17 2.14 2.09 3/199 29635
/proc/meminfo: memFree=31428404/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=2022.29 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 80663 0 0 0 202226 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5397407 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 2022.29 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+2082.3 s]
/proc/loadavg: 2.06 2.11 2.08 3/199 29642
/proc/meminfo: memFree=31428144/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=2082.29 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 81287 0 0 0 208226 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5397407 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 2082.29 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+2142.3 s]
/proc/loadavg: 2.02 2.09 2.08 3/199 29646
/proc/meminfo: memFree=31428316/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=2142.29 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 81914 0 0 0 214226 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5009314 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 2142.29 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/199 29650
/proc/meminfo: memFree=31427992/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=2202.29 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 82539 0 0 0 220226 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5017206 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 2202.29 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.06 2.07 3/199 29657
/proc/meminfo: memFree=31428288/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=2262.3 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 83207 0 0 0 226227 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5017267 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 2262.3 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/199 29661
/proc/meminfo: memFree=31427616/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=2322.29 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 83815 0 0 0 232226 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5017569 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 2322.29 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.04 2.06 3/199 29672
/proc/meminfo: memFree=31428140/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=2382.3 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 84434 0 0 0 238227 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5409485 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 2382.3 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400 s]*
/proc/loadavg: 2.00 2.04 2.05 3/199 29674
/proc/meminfo: memFree=31427732/32770624 swapFree=66997716/67108860
[pid=29363] ppid=29360 vsize=75220 memory=51752 CPUtime=2400 cores=1,3,5,7
/proc/29363/stat : 29363 (cosoco) R 29360 29363 25294 0 -1 4202496 85034 0 0 0 239997 3 0 0 20 0 1 0 557094333 77025280 12938 33554432000 4194304 6211132 140732873430912 140732873428872 5397407 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8312316 8317760 12984320 140732873434123 140732873434225 140732873434225 140732873437134 0
/proc/29363/statm: 18805 12938 854 493 0 12110 0
Current children cumulated CPU time: 2400 s
Current children cumulated vsize: 75220 KiB
Current children cumulated memory: 51752 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.01 s]
# the end of solver process 29363 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2399.98 s, system=0.04 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2400.01
CPU time (s): 2400.02
CPU user time (s): 2399.98
CPU system time (s): 0.04
CPU usage (%): 100
Max. virtual memory (cumulated for all children) (KiB): 75220
Max. memory (cumulated for all children) (KiB): 51752

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2399.98
system time used= 0.04
maximum resident set size= 51816
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 85087
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 31
involuntary context switches= 605


# summary of solver processes directly reported to runsolver:
#   pid: 29363
#   total CPU time (s): 2400.02
#   total CPU user time (s): 2399.98
#   total CPU system time (s): 0.04

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.77166 second user time and 16.3282 second system time

The end

Launcher Data

Begin job on node126 at 2019-09-30 03:50:28
IDJOB=4408574
IDBENCH=139104
IDSOLVER=2875
FILE ID=node126/4408574-1569808266
RUNJOBID= node126-1569787354-25326
PBS_JOBID= 21705827
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/LatinSquare/LatinSquare-xcsp2-qcp25/qcp-25-264-09_X2.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408574-1569808266/watcher-4408574-1569808266 -o /tmp/evaluation-result-4408574-1569808266/solver-4408574-1569808266 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node126-1569787354-25326 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4408574-1569808266.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9027aa50623a7bf75cd9351701a12dc2
RANDOM SEED=1938824325

node126.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31501756 kB
MemAvailable:   31858564 kB
Buffers:          208068 kB
Cached:           466880 kB
SwapCached:         7392 kB
Active:           345356 kB
Inactive:         340792 kB
Active(anon):      16388 kB
Inactive(anon):    70400 kB
Active(file):     328968 kB
Inactive(file):   270392 kB
Unevictable:      109388 kB
Mlocked:          109388 kB
SwapTotal:      67108860 kB
SwapFree:       66997716 kB
Dirty:              3164 kB
Writeback:             0 kB
AnonPages:        115016 kB
Mapped:            28996 kB
Shmem:             66840 kB
Slab:             176156 kB
SReclaimable:     146568 kB
SUnreclaim:        29588 kB
KernelStack:        3568 kB
PageTables:         5540 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     570480 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      130432 kB
DirectMap2M:    33415168 kB

Free space on /tmp at the end= 62024 MiB
End job on node126 at 2019-09-30 04:30:28