Trace number 4389412

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2520.02 2519.8

General information on the benchmark

NameCarSequencing/CarSequencing-m1-jcr/
CarSequencing-16-81.xml
MD5SUMe1683218a1e3c524b21c5eaa634d1705
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark27.9455
Satisfiable
(Un)Satisfiability was proved
Number of variables600
Number of constraints737
Number of domains2
Minimum domain size2
Maximum domain size26
Distribution of domain sizes[{"size":2,"count":500},{"size":26,"count":100}]
Minimum variable degree2
Maximum variable degree52
Distribution of variable degrees[{"degree":2,"count":100},{"degree":3,"count":5},{"degree":4,"count":5},{"degree":5,"count":6},{"degree":6,"count":10},{"degree":7,"count":10},{"degree":8,"count":18},{"degree":9,"count":18},{"degree":10,"count":18},{"degree":11,"count":18},{"degree":12,"count":18},{"degree":13,"count":18},{"degree":14,"count":18},{"degree":15,"count":18},{"degree":16,"count":18},{"degree":17,"count":18},{"degree":18,"count":18},{"degree":19,"count":18},{"degree":20,"count":18},{"degree":21,"count":18},{"degree":22,"count":20},{"degree":23,"count":20},{"degree":24,"count":20},{"degree":25,"count":20},{"degree":26,"count":10},"...",{"degree":28,"count":8}, {"degree":29,"count":8}, {"degree":30,"count":9}, {"degree":31,"count":9}, {"degree":32,"count":22}, {"degree":33,"count":5}, {"degree":34,"count":6}, {"degree":35,"count":6}, {"degree":36,"count":7}, {"degree":37,"count":2}, {"degree":38,"count":2}, {"degree":39,"count":2}, {"degree":40,"count":2}, {"degree":41,"count":2}, {"degree":42,"count":2}, {"degree":43,"count":2}, {"degree":44,"count":2}, {"degree":45,"count":2}, {"degree":46,"count":2}, {"degree":47,"count":2}, {"degree":48,"count":2}, {"degree":49,"count":2}, {"degree":50,"count":2}, {"degree":51,"count":3}, {"degree":52,"count":3}]
Minimum constraint arity2
Maximum constraint arity100
Distribution of constraint arities[{"arity":2,"count":99},{"arity":3,"count":196},{"arity":4,"count":1},{"arity":5,"count":194},{"arity":6,"count":101},{"arity":7,"count":1},{"arity":8,"count":1},{"arity":10,"count":4},{"arity":12,"count":1},{"arity":13,"count":1},{"arity":14,"count":1},{"arity":15,"count":2},{"arity":16,"count":2},{"arity":18,"count":1},{"arity":19,"count":2},{"arity":20,"count":3},{"arity":22,"count":3},{"arity":24,"count":1},{"arity":25,"count":4},{"arity":26,"count":1},{"arity":28,"count":3},{"arity":30,"count":3},{"arity":31,"count":2},{"arity":32,"count":1},{"arity":34,"count":3},"...",{"arity":67,"count":2}, {"arity":68,"count":1}, {"arity":70,"count":5}, {"arity":72,"count":1}, {"arity":73,"count":2}, {"arity":74,"count":1}, {"arity":75,"count":2}, {"arity":76,"count":3}, {"arity":78,"count":1}, {"arity":79,"count":2}, {"arity":80,"count":3}, {"arity":82,"count":3}, {"arity":84,"count":1}, {"arity":85,"count":4}, {"arity":86,"count":1}, {"arity":88,"count":3}, {"arity":90,"count":3}, {"arity":91,"count":2}, {"arity":92,"count":1}, {"arity":94,"count":3}, {"arity":95,"count":2}, {"arity":96,"count":1}, {"arity":97,"count":2}, {"arity":98,"count":1}, {"arity":100,"count":6}]
Number of extensional constraints100
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":100},{"type":"sum","count":636},{"type":"cardinality","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c Create Cardinality(vars,values,occurs) constraint using 100 Exactly/AtMost.. constraint 
0.00/0.00	c
0.00/0.07	c root propagations     : 0           
0.00/0.07	c restarts enabled, print stats at every restarts
0.00/0.07	c
0.00/0.07	c
0.00/0.07	c
0.00/0.07	c This is cosoco 2.00 --  
0.00/0.07	c
0.00/0.07	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389412-1568338642.xml 
0.00/0.07	c ========================================[ Problem Statistics ]===========================================
0.00/0.07	c |                                                                                                       
0.00/0.07	c |  Parse time        :         0.07 s 
0.00/0.07	c |
0.00/0.07	c |               Variables: 600
0.00/0.07	c |            Domain Sizes: 2..26
0.00/0.07	c |
0.00/0.07	c |             Constraints: 762
0.00/0.07	c |                   Arity: 2..100  -- Binary: 99  -- Ternary: 196
0.00/0.07	c | 
0.00/0.07	c |                   Types: 
0.00/0.07	c |                          Exactly K: 26
0.00/0.07	c |                          Extension: 100  (nb tuples: 26..26) -- (shared: 99)
0.00/0.07	c |                          Sum: 636
0.00/0.07	c |                          
0.00/0.07	c =========================================================================================================
0.00/0.07	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.10/0.21	c 101            783            59146          17151          0              0              324   354   337
0.31/0.36	c 211            1840           112191         30838          0              0              67   132   101 
0.41/0.49	c 332            2685           159292         40882          0              0              65   147   121 
0.69/0.70	c 465            3492           234124         51356          0              0              111   170   160
0.89/0.93	c 611            4514           314192         62575          0              0              135   181   163
1.10/1.11	c 771            5391           387861         76711          0              0              146   225   193
1.19/1.28	c 947            6215           478858         96782          0              0              139   208   199
1.49/1.50	c 1140           6807           560966         125969         0              0              137   183   171
1.69/1.72	c 1352           8366           650007         142467         0              0              143   178   162
1.89/1.99	c 1585           9490           790531         171457         0              0              25   216   203 
2.19/2.23	c 1841           10835          875594         189023         0              0              66   195   135 
2.79/2.82	c 2122           13204          1076112        245845         0              0              31   198   162 
3.19/3.30	c 2431           15499          1256848        279889         0              0              142   177   161
3.69/3.79	c 2770           16904          1434248        315419         0              0              132   170   165
4.29/4.32	c 3142           19358          1626222        378410         0              0              111   171   149
4.59/4.68	c 3551           21606          1765739        398710         0              0              9   153   140  
5.00/5.04	c 4000           23812          1935302        429827         0              0              75   230   186 
5.69/5.71	c 4493           26061          2184448        461683         0              0              103   169   161
6.29/6.38	c 5035           28972          2466710        511552         0              0              65   181   140 
6.89/6.90	c 5631           32859          2698302        536832         0              0              116   152   138
7.39/7.40	c 6286           35769          2893259        579225         0              0              17   153   110 
8.69/8.76	c 7006           40489          3357379        644971         0              0              87   150   121 
9.29/9.32	c 7798           43368          3640457        684904         0              0              119   168   161
11.39/11.46	c 8669           54150          4410589        821643         0              0              74   150   113 
11.89/11.98	c 9627           57029          4661443        851129         0              0              80   163   154 
12.69/12.71	c 10680          60882          5011669        903397         0              0              26   146   139 
13.39/13.42	c 11838          64378          5341022        950352         0              0              55   156   143 
14.59/14.68	c 13111          69431          5931411        1062559        0              0              24   152   140 
16.10/16.11	c 14511          75804          6428497        1119758        0              0              78   109   92  
17.10/17.17	c 16051          80973          6981091        1246052        0              0              79   148   132 
18.00/18.06	c 17745          86838          7468407        1301919        0              0              91   138   132 
19.00/19.06	c 19608          93242          7995824        1368666        0              0              74   106   100 
20.89/21.01	c 21657          98039          8732350        1695340        0              0              32   151   136 
24.39/24.41	c 23910          106644         10310071       1966138        0              0              44   120   105 
26.69/26.70	c 26388          114000         11642462       2260083        0              0              90   120   112 
30.49/30.56	c 29113          123676         13524117       2616413        0              0              108   129   119
32.49/32.59	c 32110          132237         14568323       2828745        0              0              110   189   168
35.00/35.09	c 35406          147119         16123382       3169434        0              0              108   161   146
38.19/38.25	c 39031          158736         17793191       3497485        0              0              92   140   116 
41.89/41.91	c 43018          175775         19923138       3901421        0              0              90   138   122 
47.19/47.25	c 47403          189921         22786043       4449158        0              0              100   136   127
50.10/50.11	c 52226          205367         24496699       4747007        0              0              94   141   126 
52.19/52.28	c 57531          217499         25832220       5110133        0              0              64   153   137 
57.00/57.03	c 63366          240039         28243900       5450587        0              0              63   136   122 
60.10/60.13	c 69784          252136         29617831       5926109        0              0              54   125   111 
65.79/65.86	c 76843          278052         31872432       6682685        0              0              42   84   75   
71.20/71.26	c 84607          297734         33909407       7069244        0              0              17   118   99  
82.50/82.56	c 93147          326875         40196034       8243769        0              0              93   165   154 
86.40/86.44	c 102541         343724         42153883       8628315        0              0              43   130   127 
92.30/92.36	c 112874         362813         44750235       9283000        0              0              96   189   179 
100.50/100.52	c 124240         392708         48775799       10136912       0              0              92   220   210 
108.70/108.79	c 136742         426590         52832966       11227352       0              0              66   195   180 
117.80/117.80	c 150494         464634         56359395       11966873       0              0              55   160   151 
138.50/138.51	c 165621         575268         63360827       12871228       0              0              91   145   122 
162.01/162.07	c 182260         678156         71557020       14261132       0              0              59   155   127 
179.60/179.67	c 200562         740579         80438012       15846676       0              0              94   153   128 
195.12/195.11	c 220694         809414         88883773       17315323       0              0              99   186   178 
207.02/207.07	c 242839         880017         94772976       18452488       0              0              71   170   143 
232.61/232.68	c 267198         991451         104374339      20946597       0              0              53   157   138 
269.31/269.39	c 293992         1114400        118707013      30105438       0              0              51   135   105 
320.32/320.31	c 323465         1282920        136633057      36156557       0              0              79   133   116 
359.72/359.71	c 355885         1437248        152920136      42773028       0              0              89   186   158 
395.72/395.79	c 391547         1702067        168420590      46291907       0              0              71   169   155 
420.92/420.92	c 430775         1798825        181149624      48804080       0              0              76   206   192 
457.63/457.61	c 473925         1939745        195639586      51767936       0              0              103   185   158
514.04/514.05	c 521390         2198520        220281709      57863031       0              0              8   199   156  
551.24/551.29	c 573601         2357188        240881459      62470433       0              0              68   178   158 
589.24/589.27	c 631033         2560326        262742812      66660216       0              0              16   185   173 
636.74/636.77	c 694208         2739446        287361601      72756458       0              0              96   208   199 
688.45/688.40	c 763700         2923050        312254007      80117811       0              0              79   207   199 
759.95/759.91	c 840141         3184634        352406112      86284738       0              0              100   186   174
800.96/800.99	c 924226         3384238        374677713      92588946       0              0              133   203   189
843.56/843.55	c 1016719        3598964        394908041      97310437       0              0              36   160   155 
913.27/913.25	c 1118461        3997566        436764705      106071772      0              0              58   146   134 
975.77/975.74	c 1230377        4354033        467259708      108903113      0              0              24   126   106 
1093.38/1093.34	c 1353484        4807779        524689471      118051575      0              0              88   144   132 
1168.99/1168.92	c 1488901        5095989        557066651      125695708      0              0              46   94   75   
1297.11/1297.02	c 1637859        5588425        622605746      141301205      0              0              16   155   145 
1454.22/1454.11	c 1801712        6088186        695237407      158535292      0              0              170   197   185
1537.83/1537.77	c 1981950        6492636        739249993      171448289      0              0              28   160   141 
1706.44/1706.39	c 2180211        7163925        818645641      185948617      0              0              26   164   141 
1913.66/1913.58	c 2398298        7741790        909096761      211987307      0              0              20   190   180 
2057.47/2057.34	c 2638193        8463186        981514384      230410993      0              0              120   174   163
2520.01/2519.80	
2520.01/2519.80	c *** INTERRUPTED ***
2520.01/2519.80	c restarts              : 83          
2520.01/2519.80	c conflicts             : 2893141      (1148 /sec)
2520.01/2519.80	c decisions             : 9303591      (3692 /sec)
2520.01/2519.80	c propagations          : 270006297   (107145 /sec)
2520.01/2519.80	c root propagations     : 0           
2520.01/2519.80	c filter calls          : 1155119824     (458380 /sec)
2520.01/2519.80	c useless filter calls  : 1080482068     (93 %)
2520.01/2519.80	c Memory used           : 30.49 MB
2520.01/2519.80	c CPU time              : 2520.01 s
2520.01/2519.80	c real time             : 2519.8 s
2520.01/2519.80	
2520.01/2519.80	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (13448 MiB free)
  memory of node 1: 16384 MiB (15689 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389412-1568338642/watcher-4389412-1568338642 -o /tmp/evaluation-result-4389412-1568338642/solver-4389412-1568338642 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node116-1568311136-6439 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389412-1568338642.xml 

running on 4 cores: 4-7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=11731, runsolver pid=11728
Current StackSize limit: 8192 KiB


[startup+0.100161 s]*
/proc/loadavg: 1.93 2.01 2.04 3/200 11732
/proc/meminfo: memFree=29833952/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=30824 memory=7536 CPUtime=0.1 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 2055 0 0 0 10 0 0 0 20 0 1 0 409805917 31563776 1884 33554432000 4194304 6210612 140722001010640 140722001007176 5155366 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7706 1884 889 493 0 1011 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 30824 KiB
Current children cumulated memory: 7536 KiB

[startup+0.210853 s]*
/proc/loadavg: 1.93 2.01 2.04 3/200 11732
/proc/meminfo: memFree=29833580/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=30956 memory=7536 CPUtime=0.21 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 2090 0 0 0 21 0 0 0 20 0 1 0 409805917 31698944 1884 33554432000 4194304 6210612 140722001010640 140722001007176 5249664 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7739 1884 889 493 0 1044 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 30956 KiB
Current children cumulated memory: 7536 KiB

[startup+0.310214 s]*
/proc/loadavg: 2.02 2.03 2.05 3/200 11732
/proc/meminfo: memFree=29833580/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31088 memory=7536 CPUtime=0.31 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 2093 0 0 0 31 0 0 0 20 0 1 0 409805917 31834112 1884 33554432000 4194304 6210612 140722001010640 140722001007176 5192928 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7772 1884 889 493 0 1077 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 31088 KiB
Current children cumulated memory: 7536 KiB

[startup+0.700286 s]
/proc/loadavg: 2.02 2.03 2.05 3/200 11732
/proc/meminfo: memFree=29833580/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31088 memory=7536 CPUtime=0.69 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 2107 0 0 0 69 0 0 0 20 0 1 0 409805917 31834112 1884 33554432000 4194304 6210612 140722001010640 140722001008600 5249691 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7772 1884 889 493 0 1077 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 31088 KiB
Current children cumulated memory: 7536 KiB

[startup+1.50028 s]
/proc/loadavg: 2.02 2.03 2.05 3/200 11732
/proc/meminfo: memFree=29833308/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7800 CPUtime=1.49 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 2140 0 0 0 149 0 0 0 20 0 1 0 409805917 31969280 1950 33554432000 4194304 6210612 140722001010640 140722001008600 5192894 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1950 891 493 0 1110 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7800 KiB

[startup+3.11032 s]
/proc/loadavg: 2.02 2.03 2.05 3/200 11796
/proc/meminfo: memFree=29832820/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7928 CPUtime=3.1 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 3131 0 0 0 310 0 0 0 20 0 1 0 409805917 31969280 1982 33554432000 4194304 6210612 140722001010640 140722001008600 5155888 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1982 891 493 0 1110 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7928 KiB

[startup+6.30029 s]
/proc/loadavg: 2.01 2.03 2.05 3/201 11798
/proc/meminfo: memFree=29831612/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7932 CPUtime=6.29 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 4127 0 0 0 629 0 0 0 20 0 1 0 409805917 31969280 1983 33554432000 4194304 6210612 140722001010640 140722001008600 5249691 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1983 891 493 0 1110 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7932 KiB

[startup+12.7003 s]
/proc/loadavg: 2.01 2.03 2.05 3/201 11799
/proc/meminfo: memFree=29831788/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7940 CPUtime=12.69 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 5121 0 0 0 1269 0 0 0 20 0 1 0 409805917 31969280 1985 33554432000 4194304 6210612 140722001010640 140722001008600 5156485 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1985 891 493 0 1110 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7940 KiB

[startup+25.5003 s]
/proc/loadavg: 2.01 2.03 2.05 3/200 11799
/proc/meminfo: memFree=29830812/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7940 CPUtime=25.49 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 7108 0 0 0 2549 0 0 0 20 0 1 0 409805917 31969280 1985 33554432000 4194304 6210612 140722001010640 140722001008600 5192938 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1985 891 493 0 1110 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7940 KiB

[startup+51.1104 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 11801
/proc/meminfo: memFree=29829596/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7944 CPUtime=51.1 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 7992 0 0 0 5110 0 0 0 20 0 1 0 409805917 31969280 1986 33554432000 4194304 6210612 140722001010640 140722001008600 5136215 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1986 891 493 0 1110 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7944 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 11805
/proc/meminfo: memFree=29831364/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7944 CPUtime=102.3 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 8504 0 0 0 10230 0 0 0 20 0 1 0 409805917 31969280 1986 33554432000 4194304 6210612 140722001010640 140722001008600 5192938 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1986 891 493 0 1110 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7944 KiB

[startup+162.3 s]
/proc/loadavg: 2.22 2.06 2.06 3/199 11809
/proc/meminfo: memFree=29831376/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7952 CPUtime=162.3 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 9016 0 0 0 16230 0 0 0 20 0 1 0 409805917 31969280 1988 33554432000 4194304 6210612 140722001010640 140722001008600 5249691 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1988 891 493 0 1110 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7952 KiB

[startup+222.3 s]
/proc/loadavg: 2.37 2.15 2.09 3/201 11822
/proc/meminfo: memFree=29830304/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7952 CPUtime=222.31 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 9530 0 0 0 22231 0 0 0 20 0 1 0 409805917 31969280 1988 33554432000 4194304 6210612 140722001010640 140722001008600 5156072 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1988 891 493 0 1110 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7952 KiB

[startup+282.3 s]
/proc/loadavg: 2.14 2.13 2.09 3/202 11828
/proc/meminfo: memFree=29830724/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7952 CPUtime=282.31 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 9530 0 0 0 28231 0 0 0 20 0 1 0 409805917 31969280 1988 33554432000 4194304 6210612 140722001010640 140722001008600 5156485 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1988 891 493 0 1110 0
Current children cumulated CPU time: 282.31 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7952 KiB

[startup+342.3 s]
/proc/loadavg: 2.05 2.10 2.08 3/201 11832
/proc/meminfo: memFree=29830272/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7952 CPUtime=342.32 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 10042 0 0 0 34232 0 0 0 20 0 1 0 409805917 31969280 1988 33554432000 4194304 6210612 140722001010640 140722001008600 5249712 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1988 891 493 0 1110 0
Current children cumulated CPU time: 342.32 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7952 KiB

[startup+402.3 s]
/proc/loadavg: 2.02 2.08 2.07 3/201 11836
/proc/meminfo: memFree=29830500/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7952 CPUtime=402.32 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 10044 0 0 0 40232 0 0 0 20 0 1 0 409805917 31969280 1988 33554432000 4194304 6210612 140722001010640 140722001008600 5249719 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1988 891 493 0 1110 0
Current children cumulated CPU time: 402.32 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7952 KiB

[startup+462.3 s]
/proc/loadavg: 2.01 2.07 2.07 3/202 11842
/proc/meminfo: memFree=29831448/32770688 swapFree=66960996/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7960 CPUtime=462.33 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 10558 0 0 0 46233 0 0 0 20 0 1 0 409805917 31969280 1990 33554432000 4194304 6210612 140722001010640 140722001008600 5156307 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1990 891 493 0 1110 0
Current children cumulated CPU time: 462.33 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7960 KiB


################
# More data... #
################

/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 1722.45 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 11985
/proc/meminfo: memFree=29829732/32770688 swapFree=66961000/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7964 CPUtime=1782.45 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 16128 0 0 0 178244 1 0 0 20 0 1 0 409805917 31969280 1991 33554432000 4194304 6210612 140722001010640 140722001008600 5157073 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 1782.45 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 11989
/proc/meminfo: memFree=29830072/32770688 swapFree=66961000/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7964 CPUtime=1842.46 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 16128 0 0 0 184245 1 0 0 20 0 1 0 409805917 31969280 1991 33554432000 4194304 6210612 140722001010640 140722001008600 5038670 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 1842.46 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 11995
/proc/meminfo: memFree=29830296/32770688 swapFree=66961000/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7964 CPUtime=1902.46 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 16538 0 0 0 190245 1 0 0 20 0 1 0 409805917 31969280 1991 33554432000 4194304 6210612 140722001010640 140722001008600 5156103 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 1902.46 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 11999
/proc/meminfo: memFree=29829720/32770688 swapFree=66961000/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7964 CPUtime=1962.47 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 16645 0 0 0 196246 1 0 0 20 0 1 0 409805917 31969280 1991 33554432000 4194304 6210612 140722001010640 140722001008600 5135947 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 1962.47 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12011
/proc/meminfo: memFree=29830272/32770688 swapFree=66961004/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7964 CPUtime=2022.47 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 17066 0 0 0 202246 1 0 0 20 0 1 0 409805917 31969280 1991 33554432000 4194304 6210612 140722001010640 140722001008600 5249724 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 2022.47 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 12017
/proc/meminfo: memFree=29830744/32770688 swapFree=66961004/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7964 CPUtime=2082.47 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 17160 0 0 0 208246 1 0 0 20 0 1 0 409805917 31969280 1991 33554432000 4194304 6210612 140722001010640 140722001008600 5192880 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 2082.47 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12021
/proc/meminfo: memFree=29829736/32770688 swapFree=66961004/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7964 CPUtime=2142.48 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 17572 0 0 0 214247 1 0 0 20 0 1 0 409805917 31969280 1991 33554432000 4194304 6210612 140722001010640 140722001008600 5135919 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 2142.48 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12047
/proc/meminfo: memFree=29828088/32770688 swapFree=66961004/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7964 CPUtime=2202.49 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 17574 0 0 0 220248 1 0 0 20 0 1 0 409805917 31969280 1991 33554432000 4194304 6210612 140722001010640 140722001008600 5249681 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 2202.49 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 12053
/proc/meminfo: memFree=29828168/32770688 swapFree=66961004/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7964 CPUtime=2262.49 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 17985 0 0 0 226248 1 0 0 20 0 1 0 409805917 31969280 1991 33554432000 4194304 6210612 140722001010640 140722001008600 5155300 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 2262.49 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12057
/proc/meminfo: memFree=29828156/32770688 swapFree=66961004/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7964 CPUtime=2322.5 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 17985 0 0 0 232249 1 0 0 20 0 1 0 409805917 31969280 1991 33554432000 4194304 6210612 140722001010640 140722001008600 5249890 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 2322.5 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12061
/proc/meminfo: memFree=29828360/32770688 swapFree=66961004/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7964 CPUtime=2382.5 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 18389 0 0 0 238249 1 0 0 20 0 1 0 409805917 31969280 1991 33554432000 4194304 6210612 140722001010640 140722001008600 5135924 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 2382.5 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 12067
/proc/meminfo: memFree=29828500/32770688 swapFree=66961004/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7964 CPUtime=2442.51 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 18395 0 0 0 244250 1 0 0 20 0 1 0 409805917 31969280 1991 33554432000 4194304 6210612 140722001010640 140722001008600 5135919 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 2442.51 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12071
/proc/meminfo: memFree=29828548/32770688 swapFree=66961004/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7964 CPUtime=2502.51 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 18804 0 0 0 250250 1 0 0 20 0 1 0 409805917 31969280 1991 33554432000 4194304 6210612 140722001010640 140722001008600 5155303 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 2502.51 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.8 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 12071
/proc/meminfo: memFree=29828548/32770688 swapFree=66961004/67108860
[pid=11731] ppid=11728 vsize=31220 memory=7964 CPUtime=2520.01 cores=4-7
/proc/11731/stat : 11731 (cosoco) R 11728 11731 6407 0 -1 4202496 18804 0 0 0 252000 1 0 0 20 0 1 0 409805917 31969280 1991 33554432000 4194304 6210612 140722001010640 140722001008600 5155888 0 0 4096 8405026 0 0 0 17 6 0 0 0 0 0 8308220 8313664 20398080 140722001015819 140722001015921 140722001015921 140722001018830 0
/proc/11731/statm: 7805 1991 891 493 0 1110 0
Current children cumulated CPU time: 2520.01 s
Current children cumulated vsize: 31220 KiB
Current children cumulated memory: 7964 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.8 s]
# the end of solver process 11731 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.01 s, system=0.016001 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2519.8
CPU time (s): 2520.02
CPU user time (s): 2520.01
CPU system time (s): 0.016001
CPU usage (%): 100.009
Max. virtual memory (cumulated for all children) (KiB): 31220
Max. memory (cumulated for all children) (KiB): 7964

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.01
system time used= 0.016001
maximum resident set size= 8032
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18857
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 7
involuntary context switches= 651


# summary of solver processes directly reported to runsolver:
#   pid: 11731
#   total CPU time (s): 2520.02
#   total CPU user time (s): 2520.01
#   total CPU system time (s): 0.016001

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 10.9871 second user time and 17.2105 second system time

The end

Launcher Data 

Begin job on node116 at 2019-09-13 03:36:41
IDJOB=4389412
IDBENCH=128090
IDSOLVER=2829
FILE ID=node116/4389412-1568338642
RUNJOBID= node116-1568311136-6439
PBS_JOBID= 21701125
Free space on /tmp= 56884 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/CarSequencing/CarSequencing-m1-jcr/CarSequencing-16-81.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389412-1568338642/watcher-4389412-1568338642 -o /tmp/evaluation-result-4389412-1568338642/solver-4389412-1568338642 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node116-1568311136-6439 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389412-1568338642.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e1683218a1e3c524b21c5eaa634d1705
RANDOM SEED=1003158947

node116.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        29837008 kB
MemAvailable:   31845696 kB
Buffers:          105104 kB
Cached:          2180524 kB
SwapCached:        46684 kB
Active:           827500 kB
Inactive:        1512052 kB
Active(anon):       5688 kB
Inactive(anon):    88756 kB
Active(file):     821812 kB
Inactive(file):  1423296 kB
Unevictable:      110248 kB
Mlocked:          110248 kB
SwapTotal:      67108860 kB
SwapFree:       66960996 kB
Dirty:              2944 kB
Writeback:             0 kB
AnonPages:        141016 kB
Mapped:            44564 kB
Shmem:             31900 kB
Slab:             187776 kB
SReclaimable:     158828 kB
SUnreclaim:        28948 kB
KernelStack:        3776 kB
PageTables:         5296 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     530300 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     92160 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116160 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 56880 MiB
End job on node116 at 2019-09-13 04:18:41