Trace number 4292813

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 1.12? (TO) 2520.1 2520.01

General information on the benchmark

NameColouredQueens/
ColouredQueens-16_c18.xml
MD5SUMca60191094dbbdd7cca22b5ebea1cb75
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables256
Number of constraints90
Number of domains1
Minimum domain size16
Maximum domain size16
Distribution of domain sizes[{"size":16,"count":256}]
Minimum variable degree3
Maximum variable degree4
Distribution of variable degrees[{"degree":3,"count":4},{"degree":4,"count":252}]
Minimum constraint arity2
Maximum constraint arity16
Distribution of constraint arities[{"arity":2,"count":4},{"arity":3,"count":4},{"arity":4,"count":4},{"arity":5,"count":4},{"arity":6,"count":4},{"arity":7,"count":4},{"arity":8,"count":4},{"arity":9,"count":4},{"arity":10,"count":4},{"arity":11,"count":4},{"arity":12,"count":4},{"arity":13,"count":4},{"arity":14,"count":4},{"arity":15,"count":4},{"arity":16,"count":34}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":90}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.01	c root propagations     : 0           
0.00/0.01	c restarts enabled, print stats at every restarts
0.00/0.01	c
0.00/0.01	c
0.00/0.01	c
0.00/0.01	c This is cosoco 1.12 --  
0.00/0.01	c
0.00/0.01	c command line: HOME/cosoco -lc -model -restarts HOME/instance-4292813-1532294888.xml 
0.00/0.01	c ========================================[ Problem Statistics ]===========================================
0.00/0.01	c |                                                                                                       
0.00/0.01	c |  Parse time        :         0.01 s 
0.00/0.01	c |
0.00/0.01	c |               Variables: 256
0.00/0.01	c |            Domain Sizes: 16..16
0.00/0.01	c |
0.00/0.01	c |             Constraints: 90
0.00/0.01	c |                   Arity: 2..16  -- Binary: 4  -- Ternary: 4
0.00/0.01	c | 
0.00/0.01	c |                   Types: 
0.00/0.01	c |                          (X != Y): 4
0.00/0.01	c |                          All Different: 86
0.00/0.01	c |                          
0.00/0.01	c =========================================================================================================
0.00/0.01	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.06	c 101            477            23412          33521          0              0              97   124   109 
0.10/0.11	c 211            984            47076          70590          0              0              103   132   120
0.10/0.20	c 332            1542           85912          123873         0              0              35   130   117 
0.21/0.27	c 465            2043           119007         181496         0              0              107   131   121
0.31/0.38	c 611            2671           164943         264538         0              0              62   141   127 
0.41/0.48	c 771            3403           209244         337170         0              0              111   134   123
0.51/0.58	c 947            4057           251165         400112         0              0              108   127   116
0.69/0.70	c 1140           4822           307659         485923         0              0              105   133   118
0.79/0.84	c 1352           5702           368460         578576         0              0              102   135   116
0.89/0.95	c 1585           6522           419571         661337         0              0              103   130   119
1.00/1.09	c 1841           7382           482110         759512         0              0              106   133   120
1.19/1.22	c 2122           8399           537906         849101         0              0              102   138   125
1.39/1.40	c 2431           9592           618444         977300         0              0              109   134   122
1.59/1.66	c 2770           11329          733065         1150672        0              0              109   145   127
1.79/1.88	c 3142           12917          830884         1311109        0              0              101   132   117
2.10/2.12	c 3551           14655          939945         1469952        0              0              98   136   119 
2.29/2.37	c 4000           16413          1049715        1626235        0              0              107   134   121
2.49/2.51	c 4493           17682          1113323        1782130        0              0              113   139   129
2.79/2.83	c 5035           19810          1255076        2008181        0              0              105   138   125
3.00/3.10	c 5631           21472          1372242        2209441        0              0              106   136   126
3.29/3.39	c 6286           23827          1503982        2417788        0              0              109   139   121
3.79/3.86	c 7006           26988          1706923        2737548        0              0              107   139   124
4.29/4.36	c 7798           29800          1927264        3107025        0              0              113   146   127
4.69/4.79	c 8669           32623          2114399        3419930        0              0              56   140   123 
5.29/5.34	c 9627           36123          2354574        3821137        0              0              102   137   121
5.69/5.78	c 10680          39049          2550346        4148126        0              0              102   134   122
6.29/6.36	c 11838          42690          2808903        4557128        0              0              96   134   119 
7.00/7.02	c 13111          47968          3104799        5011354        0              0              106   138   123
7.59/7.65	c 14511          52386          3382758        5486354        0              0              105   134   120
8.10/8.19	c 16051          56359          3616786        5934366        0              0              105   142   132
8.69/8.75	c 17745          60032          3865163        6432563        0              0              107   132   121
9.89/9.92	c 19608          65984          4375118        7259634        0              0              99   141   123 
10.59/10.62	c 21657          70427          4684642        7847300        0              0              50   148   132 
11.69/11.74	c 23910          77499          5182844        8763694        0              0              112   148   131
13.19/13.22	c 26388          85575          5831958        9851509        0              0              99   136   119 
14.79/14.83	c 29113          94390          6543235        11018753       0              0              108   138   121
15.79/15.85	c 32110          103506         7009883        11868549       0              0              65   143   128 
17.59/17.61	c 35406          114151         7769058        13249629       0              0              114   156   133
19.29/19.36	c 39031          127025         8544900        14442756       0              0              89   139   120 
20.89/20.95	c 43018          139737         9244957        15648190       0              0              81   142   126 
22.69/22.76	c 47403          151463         10057757       17139403       0              0              111   148   131
24.39/24.43	c 52226          163351         10792356       18491119       0              0              110   147   132
26.39/26.49	c 57531          176701         11704569       20124832       0              0              109   144   126
29.00/29.04	c 63366          193002         12844832       21902259       0              0              102   144   121
32.39/32.48	c 69784          214292         14347593       24436593       0              0              111   148   128
35.49/35.56	c 76843          234662         15689577       26970892       0              0              81   145   124 
39.19/39.26	c 84607          261126         17342423       29956491       0              0              111   152   132
42.89/42.94	c 93147          285023         19013732       32815800       0              0              92   150   129 
48.10/48.17	c 102541         315348         21358882       36351474       0              0              56   142   119 
53.29/53.34	c 112874         346800         23661780       40428327       0              0              101   143   124
57.69/57.70	c 124240         384064         25616762       43962046       0              0              106   159   131
61.89/62.00	c 136742         416979         27532440       47424429       0              0              36   151   131 
69.00/69.10	c 150494         458038         30685257       52520160       0              0              79   141   118 
76.10/76.19	c 165621         509947         33785078       57649175       0              0              104   150   127
82.79/82.85	c 182260         551941         36749919       62287051       0              0              87   144   125 
89.29/89.36	c 200562         601348         39575260       67958526       0              0              101   161   136
99.19/99.26	c 220694         661924         43872335       75733987       0              0              105   153   130
110.49/110.52	c 242839         725989         48837662       83927065       0              0              100   144   125
122.79/122.83	c 267198         799831         54311267       92153973       0              0              71   147   125 
134.69/134.71	c 293992         876017         59492309       101153858      0              0              101   158   132
146.10/146.14	c 323465         955938         64586520       109295593      0              0              107   148   130
159.10/159.16	c 355885         1038864        70377908       119598449      0              0              99   142   122 
174.20/174.26	c 391547         1145684        77019090       132023297      0              0              102   145   125
185.60/185.68	c 430775         1241669        82152761       141773532      0              0              88   146   124 
203.60/203.63	c 473925         1367955        90127064       155117655      0              0              101   153   127
220.11/220.13	c 521390         1480111        97470686       169259703      0              0              99   146   125 
240.01/240.02	c 573601         1619710        106243608      186705726      0              0              102   146   127
259.11/259.15	c 631033         1761867        114687896      203344761      0              0              104   144   127
282.90/282.94	c 694208         1923810        124969468      223770787      0              0              107   154   135
303.11/303.11	c 763700         2087020        133593294      244687497      0              0              116   159   140
342.20/342.25	c 840141         2319799        151002686      273649720      0              0              70   144   119 
377.90/377.96	c 924226         2538979        166668386      300695868      0              0              92   150   126 
414.51/414.55	c 1016719        2778336        182850832      328890064      0              0              102   149   125
455.71/455.74	c 1118461        3026567        200746188      362116064      0              0              111   151   131
514.31/514.39	c 1230377        3409936        226503597      406913292      0              0              79   153   124 
563.91/563.92	c 1353484        3731979        248222910      447234445      0              0              97   151   128 
600.31/600.38	c 1488901        4013423        264248296      477523199      0              0              100   161   135
655.31/655.31	c 1637859        4383211        287885027      524124193      0              0              106   157   135
744.72/744.76	c 1801712        4893091        327339334      591640379      0              0              100   152   126
812.03/812.09	c 1981950        5376051        356621976      649605295      0              0              98   157   126 
915.93/915.91	c 2180211        5972982        402410146      723435747      0              0              48   150   127 
1029.83/1029.83	c 2398298        6727062        452574398      813510030      0              0              98   152   123 
1104.43/1104.41	c 2638193        7332164        484996788      882721396      0              0              106   160   140
1253.64/1253.64	c 2902077        8201259        550703613      999356792      0              0              59   149   124 
1335.74/1335.74	c 3192349        8873512        587267357      1068743331     0              0              95   151   129 
1454.05/1454.09	c 3511648        9631923        638412582      1180653443     0              0              80   161   136 
1582.35/1582.35	c 3862876        10637657       694937882      1291296131     0              0              104   159   135
1781.56/1781.58	c 4249226        11694225       781590851      1426915428     0              0              100   153   127
2028.97/2028.93	c 4674211        13252003       890591551      1604473691     0              0              101   153   126
2225.27/2225.24	c 5141694        14570536       978784833      1745426378     0              0              95   151   125 
2441.38/2441.33	c 5655925        15951517       1074125405     1920031135     0              0              103   154   130
2520.09/2520.00	
2520.09/2520.00	c *** INTERRUPTED ***
2520.09/2520.00	c restarts              : 91          
2520.09/2520.00	c conflicts             : 5840247      (2317 /sec)
2520.09/2520.00	c decisions             : 16430043     (6520 /sec)
2520.09/2520.00	c propagations          : 1989529529  (789465 /sec)
2520.09/2520.00	c root propagations     : 0           
2520.09/2520.00	c filter calls          : 1108151684     (439725 /sec)
2520.09/2520.00	c useless filter calls  : 577924871      (52 %)
2520.09/2520.00	c Memory used           : 27.17 MB
2520.09/2520.00	c CPU time              : 2520.1 s
2520.09/2520.00	
2520.09/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (5848 MiB free)
  memory of node 1: 16384 MiB (10517 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4292813-1532294888/watcher-4292813-1532294888 -o /tmp/evaluation-result-4292813-1532294888/solver-4292813-1532294888 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532294888-5351 --watchdog 2580 HOME/cosoco -lc -model -restarts HOME/instance-4292813-1532294888.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=5375, runsolver pid=5372

[startup+0.100196 s]*
/proc/loadavg: 0.65 1.08 1.29 4/187 5382
/proc/meminfo: memFree=16757204/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27688 memory=4200 CPUtime=0.1 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 1220 0 0 0 10 0 0 0 20 0 1 0 47051984 28352512 1050 33554432000 4194304 6142532 140723177517984 140723177514472 5175264 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6922 1050 836 476 0 244 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 27688 KiB
Current children cumulated memory: 4200 KiB

[startup+0.209499 s]*
/proc/loadavg: 0.65 1.08 1.29 3/187 5382
/proc/meminfo: memFree=16757204/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27688 memory=4200 CPUtime=0.21 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 1223 0 0 0 21 0 0 0 20 0 1 0 47051984 28352512 1050 33554432000 4194304 6142532 140723177517984 140723177514472 5060775 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6922 1050 836 476 0 244 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 27688 KiB
Current children cumulated memory: 4200 KiB

[startup+0.308996 s]*
/proc/loadavg: 0.65 1.08 1.29 3/187 5382
/proc/meminfo: memFree=16757204/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27688 memory=4200 CPUtime=0.31 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 1223 0 0 0 31 0 0 0 20 0 1 0 47051984 28352512 1050 33554432000 4194304 6142532 140723177517984 140723177515384 5060741 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6922 1050 836 476 0 244 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 27688 KiB
Current children cumulated memory: 4200 KiB

[startup+0.700334 s]
/proc/loadavg: 0.65 1.08 1.29 3/187 5382
/proc/meminfo: memFree=16756832/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27688 memory=4200 CPUtime=0.69 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 1224 0 0 0 69 0 0 0 20 0 1 0 47051984 28352512 1050 33554432000 4194304 6142532 140723177517984 140723177515384 5058961 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6922 1050 836 476 0 244 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 27688 KiB
Current children cumulated memory: 4200 KiB

[startup+1.50034 s]
/proc/loadavg: 0.65 1.08 1.29 3/187 5382
/proc/meminfo: memFree=16756944/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27688 memory=4200 CPUtime=1.49 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 1225 0 0 0 149 0 0 0 20 0 1 0 47051984 28352512 1050 33554432000 4194304 6142532 140723177517984 140723177515384 5061721 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6922 1050 836 476 0 244 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 27688 KiB
Current children cumulated memory: 4200 KiB

[startup+3.10919 s]
/proc/loadavg: 0.65 1.08 1.29 3/187 5382
/proc/meminfo: memFree=16756524/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27688 memory=4280 CPUtime=3.1 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 1393 0 0 0 310 0 0 0 20 0 1 0 47051984 28352512 1070 33554432000 4194304 6142532 140723177517984 140723177515384 5058421 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6922 1070 837 476 0 244 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 27688 KiB
Current children cumulated memory: 4280 KiB

[startup+6.30033 s]
/proc/loadavg: 0.60 1.06 1.28 3/187 5382
/proc/meminfo: memFree=16757124/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27688 memory=4284 CPUtime=6.29 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 1563 0 0 0 629 0 0 0 20 0 1 0 47051984 28352512 1071 33554432000 4194304 6142532 140723177517984 140723177515384 5060879 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6922 1071 837 476 0 244 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 27688 KiB
Current children cumulated memory: 4284 KiB

[startup+12.7003 s]
/proc/loadavg: 0.71 1.07 1.29 3/187 5382
/proc/meminfo: memFree=16757448/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27688 memory=4284 CPUtime=12.69 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 1733 0 0 0 1269 0 0 0 20 0 1 0 47051984 28352512 1071 33554432000 4194304 6142532 140723177517984 140723177515384 5062250 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6922 1071 837 476 0 244 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 27688 KiB
Current children cumulated memory: 4284 KiB

[startup+25.5003 s]
/proc/loadavg: 1.00 1.12 1.30 3/187 5382
/proc/meminfo: memFree=16757872/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27688 memory=4292 CPUtime=25.49 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 2075 0 0 0 2549 0 0 0 20 0 1 0 47051984 28352512 1073 33554432000 4194304 6142532 140723177517984 140723177515384 5058760 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6922 1073 837 476 0 244 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 27688 KiB
Current children cumulated memory: 4292 KiB

[startup+51.109 s]
/proc/loadavg: 1.34 1.19 1.32 3/187 5382
/proc/meminfo: memFree=16758492/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27688 memory=4292 CPUtime=51.1 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 2246 0 0 0 5110 0 0 0 20 0 1 0 47051984 28352512 1073 33554432000 4194304 6142532 140723177517984 140723177515384 5053732 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6922 1073 837 476 0 244 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 27688 KiB
Current children cumulated memory: 4292 KiB

[startup+102.3 s]
/proc/loadavg: 1.78 1.33 1.36 3/187 5383
/proc/meminfo: memFree=16758400/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4308 CPUtime=102.29 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 2428 0 0 0 10229 0 0 0 20 0 1 0 47051984 28487680 1077 33554432000 4194304 6142532 140723177517984 140723177515384 5061881 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1077 837 476 0 277 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4308 KiB

[startup+162.3 s]
/proc/loadavg: 1.92 1.45 1.40 3/188 5392
/proc/meminfo: memFree=16758028/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4316 CPUtime=162.3 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 2606 0 0 0 16230 0 0 0 20 0 1 0 47051984 28487680 1079 33554432000 4194304 6142532 140723177517984 140723177515384 5060905 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1079 837 476 0 277 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4316 KiB

[startup+222.3 s]
/proc/loadavg: 1.97 1.55 1.44 3/188 5393
/proc/meminfo: memFree=16757784/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4320 CPUtime=222.3 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 2784 0 0 0 22230 0 0 0 20 0 1 0 47051984 28487680 1080 33554432000 4194304 6142532 140723177517984 140723177515384 5170084 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1080 837 476 0 277 0
Current children cumulated CPU time: 222.3 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4320 KiB

[startup+282.3 s]
/proc/loadavg: 1.99 1.63 1.47 3/188 5394
/proc/meminfo: memFree=16757912/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4320 CPUtime=282.3 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 2962 0 0 0 28230 0 0 0 20 0 1 0 47051984 28487680 1080 33554432000 4194304 6142532 140723177517984 140723177515384 5053569 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1080 837 476 0 277 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4320 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.70 1.51 3/188 5395
/proc/meminfo: memFree=16757684/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4320 CPUtime=342.3 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 2962 0 0 0 34230 0 0 0 20 0 1 0 47051984 28487680 1080 33554432000 4194304 6142532 140723177517984 140723177515384 5058007 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1080 837 476 0 277 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4320 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.75 1.53 3/188 5396
/proc/meminfo: memFree=16757440/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4320 CPUtime=402.31 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 3140 0 0 0 40231 0 0 0 20 0 1 0 47051984 28487680 1080 33554432000 4194304 6142532 140723177517984 140723177515384 5336709 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1080 837 476 0 277 0
Current children cumulated CPU time: 402.31 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4320 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.80 1.56 3/187 5397
/proc/meminfo: memFree=16757708/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4320 CPUtime=462.31 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 3318 0 0 0 46231 0 0 0 20 0 1 0 47051984 28487680 1080 33554432000 4194304 6142532 140723177517984 140723177515384 5058225 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1080 837 476 0 277 0
Current children cumulated CPU time: 462.31 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4320 KiB


################
# More data... #
################

/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 1722.36 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 1.99 1.89 3/187 5449
/proc/meminfo: memFree=16755748/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4332 CPUtime=1782.36 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 5980 0 0 0 178236 0 0 0 20 0 1 0 47051984 28487680 1083 33554432000 4194304 6142532 140723177517984 140723177515384 5060737 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 1782.36 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 1.99 1.89 3/187 5451
/proc/meminfo: memFree=16755680/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4332 CPUtime=1842.36 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 5980 0 0 0 184236 0 0 0 20 0 1 0 47051984 28487680 1083 33554432000 4194304 6142532 140723177517984 140723177515384 5061866 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 1842.36 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 1.99 1.90 3/187 5452
/proc/meminfo: memFree=16755808/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4332 CPUtime=1902.36 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 6145 0 0 0 190236 0 0 0 20 0 1 0 47051984 28487680 1083 33554432000 4194304 6142532 140723177517984 140723177515384 5058075 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 1902.36 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/188 5461
/proc/meminfo: memFree=16755868/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4332 CPUtime=1962.36 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 6310 0 0 0 196236 0 0 0 20 0 1 0 47051984 28487680 1083 33554432000 4194304 6142532 140723177517984 140723177515384 5061998 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 1962.36 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 1.99 1.91 3/188 5487
/proc/meminfo: memFree=16756008/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4332 CPUtime=2022.37 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 6475 0 0 0 202237 0 0 0 20 0 1 0 47051984 28487680 1083 33554432000 4194304 6142532 140723177517984 140723177515384 5054344 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 2022.37 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 1.99 1.92 3/188 5488
/proc/meminfo: memFree=16755932/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4332 CPUtime=2082.37 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 6491 0 0 0 208237 0 0 0 20 0 1 0 47051984 28487680 1083 33554432000 4194304 6142532 140723177517984 140723177515384 5061919 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 2082.37 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 1.99 1.92 3/188 5489
/proc/meminfo: memFree=16756184/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4332 CPUtime=2142.37 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 6655 0 0 0 214237 0 0 0 20 0 1 0 47051984 28487680 1083 33554432000 4194304 6142532 140723177517984 140723177515384 5175278 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 2142.37 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 1.99 1.93 3/188 5490
/proc/meminfo: memFree=16756140/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4332 CPUtime=2202.37 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 6819 0 0 0 220237 0 0 0 20 0 1 0 47051984 28487680 1083 33554432000 4194304 6142532 140723177517984 140723177515384 5336579 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 2202.37 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 1.99 1.94 3/187 5491
/proc/meminfo: memFree=16756316/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4332 CPUtime=2262.38 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 6836 0 0 0 226238 0 0 0 20 0 1 0 47051984 28487680 1083 33554432000 4194304 6142532 140723177517984 140723177515384 5058268 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 2262.38 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 1.99 1.94 3/187 5492
/proc/meminfo: memFree=16756172/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4332 CPUtime=2322.38 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 7001 0 0 0 232238 0 0 0 20 0 1 0 47051984 28487680 1083 33554432000 4194304 6142532 140723177517984 140723177515384 5061929 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 2322.38 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/187 5493
/proc/meminfo: memFree=16756168/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4332 CPUtime=2382.38 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 7166 0 0 0 238238 0 0 0 20 0 1 0 47051984 28487680 1083 33554432000 4194304 6142532 140723177517984 140723177515384 5062768 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 2382.38 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/187 5495
/proc/meminfo: memFree=16756144/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4332 CPUtime=2442.38 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 7182 0 0 0 244238 0 0 0 20 0 1 0 47051984 28487680 1083 33554432000 4194304 6142532 140723177517984 140723177515384 5336753 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 2442.38 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 1.99 1.95 3/187 5496
/proc/meminfo: memFree=16755884/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4332 CPUtime=2502.39 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 7346 0 0 0 250239 0 0 0 20 0 1 0 47051984 28487680 1083 33554432000 4194304 6142532 140723177517984 140723177515384 5330221 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 2502.39 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 1.99 1.95 3/187 5504
/proc/meminfo: memFree=16754392/32770624 swapFree=67108860/67108860
[pid=5375] ppid=5372 vsize=27820 memory=4332 CPUtime=2520.09 cores=0,2,4,6
/proc/5375/stat : 5375 (cosoco) R 5372 5375 5320 0 -1 4202496 7509 0 0 0 252009 0 0 0 20 0 1 0 47051984 28487680 1083 33554432000 4194304 6142532 140723177517984 140723177515384 5060144 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8243016 8247936 30593024 140723177522310 140723177522440 140723177522440 140723177525198 0
/proc/5375/statm: 6955 1083 837 476 0 277 0
Current children cumulated CPU time: 2520.09 s
Current children cumulated vsize: 27820 KiB
Current children cumulated memory: 4332 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 5375 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.1 s, system=0.003 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.1
CPU user time (s): 2520.1
CPU system time (s): 0.003
CPU usage (%): 100.004
Max. virtual memory (cumulated for all children) (KiB): 27820
Max. memory (cumulated for all children) (KiB): 4332

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.1
system time used= 0.003
maximum resident set size= 4396
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 7559
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 33
involuntary context switches= 640


# summary of solver processes directly reported to runsolver:
#   pid: 5375
#   total CPU time (s): 2520.1
#   total CPU user time (s): 2520.1
#   total CPU system time (s): 0.003

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.73633 second user time and 18.6162 second system time

The end

Launcher Data 

Begin job on node102 at 2018-07-22 23:28:08
IDJOB=4292813
IDBENCH=141020
IDSOLVER=2752
FILE ID=node102/4292813-1532294888
RUNJOBID= node102-1532294888-5351
PBS_JOBID= 21018982
Free space on /tmp= 53248 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP18/ColouredQueens/ColouredQueens-16_c18.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4292813-1532294888/watcher-4292813-1532294888 -o /tmp/evaluation-result-4292813-1532294888/solver-4292813-1532294888 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532294888-5351 --watchdog 2580  HOME/cosoco -lc -model -restarts HOME/instance-4292813-1532294888.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= ca60191094dbbdd7cca22b5ebea1cb75
RANDOM SEED=2081068831

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        16761808 kB
MemAvailable:   31936052 kB
Buffers:          244548 kB
Cached:         15018768 kB
SwapCached:            0 kB
Active:          1498612 kB
Inactive:       13820220 kB
Active(anon):      58924 kB
Inactive(anon):    16868 kB
Active(file):    1439688 kB
Inactive(file): 13803352 kB
Unevictable:        6604 kB
Mlocked:            6604 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              3216 kB
Writeback:             0 kB
AnonPages:         62296 kB
Mapped:            35856 kB
Shmem:             17036 kB
Slab:             387176 kB
SReclaimable:     359664 kB
SUnreclaim:        27512 kB
KernelStack:        3088 kB
PageTables:         5472 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     317504 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     10240 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 53240 MiB
End job on node102 at 2018-07-23 00:10:08