Trace number 4396858

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2520.03 2520.01

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h375-07.xml
MD5SUMb197b36061edf780c6549c887861e4b6
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark9.08383
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":375},{"degree":2,"count":525}]
Minimum constraint arity525
Maximum constraint arity900
Distribution of constraint arities[{"arity":525,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 4824        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4396858-1568593695.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 585
0.00/0.02	c |                   Arity: 1..30  -- Unary: 525
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 525
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.07	c 101            1009           13284          34297          884            0              543   659   630
0.10/0.11	c 211            1886           20277          58338          884            0              140   200   182
0.10/0.16	c 332            2943           29100          92913          884            0              126   676   618
0.10/0.19	c 465            4737           37805          113742         884            0              206   430   414
0.21/0.31	c 611            6032           58834          211725         884            0              256   599   561
0.31/0.40	c 771            7430           76345          282260         884            0              345   619   586
0.41/0.49	c 947            9048           92629          363262         884            0              382   610   584
0.51/0.57	c 1140           10338          107491         434043         884            0              425   576   562
0.60/0.66	c 1352           12017          124430         512301         884            0              414   475   453
0.69/0.71	c 1585           13375          134030         548040         884            0              414   478   457
0.69/0.77	c 1841           14389          143754         590742         884            0              385   447   437
0.79/0.85	c 2122           15560          159103         669409         884            0              387   413   402
0.89/0.92	c 2431           16835          171298         744417         884            0              365   419   391
1.19/1.25	c 2770           21887          233512         998257         884            0              272   590   506
1.29/1.33	c 3142           24601          249161         1064515        884            0              351   476   456
1.39/1.40	c 3551           26235          261600         1124899        884            0              379   468   447
1.49/1.56	c 4000           28745          290299         1242080        884            0              351   442   409
1.59/1.64	c 4493           30328          305499         1322898        884            0              328   364   356
1.79/1.82	c 5035           32634          337464         1472531        884            0              315   342   327
1.89/1.91	c 5631           34336          353952         1550812        884            0              274   305   295
2.10/2.15	c 6286           36929          396221         1746669        884            0              257   276   267
2.19/2.29	c 7006           40800          423514         1850542        884            0              211   247   237
2.49/2.58	c 7798           44825          474146         2106908        884            0              193   232   215
2.69/2.76	c 8669           47580          504643         2256216        884            0              191   217   207
2.89/2.99	c 9627           50352          545489         2452833        884            0              179   200   193
3.19/3.25	c 10680          54525          592895         2653203        884            0              179   213   198
3.59/3.69	c 11838          59847          669629         3045312        884            0              160   180   174
3.89/3.96	c 13111          64157          716872         3254608        884            0              149   176   167
4.39/4.46	c 14511          71070          803831         3664860        884            0              137   191   174
4.89/4.97	c 16051          77440          892679         4137055        884            0              146   185   162
5.39/5.49	c 17745          85460          985333         4526939        884            0              144   170   164
6.79/6.89	c 19608          106254         1243777        5690102        884            0              146   729   672
8.59/8.63	c 21657          126020         1559473        7301165        884            0              216   750   701
10.10/10.11	c 23910          142347         1828036        8506263        884            0              406   716   680
12.00/12.04	c 26388          165054         2181017        10082287       884            0              461   727   673
12.49/12.55	c 29113          175767         2272996        10523562       884            0              491   557   532
13.29/13.35	c 32110          188813         2419372        11153867       884            0              481   507   496
16.39/16.49	c 35406          213471         2973151        13991556       884            0              397   730   678
18.69/18.77	c 39031          242884         3389704        16010167       884            0              489   732   679
22.49/22.58	c 43018          274291         4067656        19510121       884            0              610   744   691
25.39/25.49	c 47403          303832         4592195        22270436       884            0              621   745   692
27.69/27.72	c 52226          330921         4996223        24348089       884            0              624   735   685
31.10/31.17	c 57531          363876         5609980        27512237       884            0              560   735   699
35.10/35.18	c 63366          399284         6324725        31167892       884            0              629   730   698
40.19/40.23	c 69784          439795         7221451        35675918       884            0              615   721   678
44.59/44.61	c 76843          483522         8011404        39228899       884            0              567   736   685
49.39/49.46	c 84607          526666         8880945        43559633       884            0              566   722   675
58.89/58.93	c 93147          590709         10553534       51891867       884            0              589   735   689
65.89/65.96	c 102541         643599         11804503       58308971       884            0              584   722   686
74.19/74.29	c 112874         706294         13282424       65988054       884            0              546   734   689
83.29/83.36	c 124240         777687         14905516       74193351       884            0              544   726   668
94.69/94.70	c 136742         870035         16934332       84865074       884            0              553   735   697
105.10/105.18	c 150494         969392         18843502       94157539       884            0              562   742   696
118.59/118.65	c 165621         1089456        21293604       106485131      884            0              548   742   697
130.29/130.35	c 182260         1189127        23385061       117741018      884            0              554   744   698
147.29/147.39	c 200562         1325191        26451985       134277949      884            0              562   749   692
162.19/162.25	c 220694         1470404        29161148       147030313      884            0              558   736   675
183.39/183.50	c 242839         1638003        32958988       166649505      884            0              552   739   693
205.39/205.45	c 267198         1799718        36853477       188166218      884            0              572   740   692
227.49/227.56	c 293992         1955052        40789283       209195385      884            0              585   710   669
257.59/257.63	c 323465         2166493        46184026       235829930      884            0              577   739   691
283.10/283.11	c 355885         2382840        50785846       258176666      884            0              616   725   675
312.59/312.64	c 391547         2602745        56063276       284915793      884            0              607   740   684
342.79/342.86	c 430775         2826476        61482971       312902671      884            0              608   723   680
370.10/370.12	c 473925         3068610        66413914       336732420      884            0              580   735   691
404.59/404.64	c 521390         3370358        72633526       366517885      884            0              583   727   679
440.89/440.95	c 573601         3747327        79245144       399034779      884            0              585   735   687
488.10/488.14	c 631033         4141725        87730034       444180590      884            0              602   747   700
530.60/530.69	c 694208         4491593        95316567       484900347      884            0              583   721   679
577.01/577.06	c 763700         4936440        103722369      527186040      884            0              567   739   690
637.20/637.25	c 840141         5446425        114579624      581172846      884            0              544   745   698
713.11/713.17	c 924226         6021630        128140513      649615665      884            0              576   758   699
789.20/789.26	c 1016719        6601446        141790534      718019970      884            0              565   714   670
864.90/864.93	c 1118461        7226196        155410629      783157897      884            0              553   734   674
941.50/941.60	c 1230377        7801945        169290759      851147029      884            0              556   735   672
1053.20/1053.23	c 1353484        8792696        189390875      956142772      884            0              552   748   685
1152.30/1152.33	c 1488901        9649083        207297306      1041507770     884            0              560   739   688
1239.20/1239.29	c 1637859        10478694       223013177      1117458195     884            0              564   729   667
1354.11/1354.17	c 1801712        11335969       243568396      1222759358     884            0              561   707   661
1459.01/1459.09	c 1981950        12230853       262406199      1317240611     884            0              550   723   678
1606.90/1606.93	c 2180211        13358995       288971684      1447019054     884            0              546   731   673
1746.51/1746.53	c 2398298        14615808       314246846      1574229679     884            0              565   738   682
1924.91/1924.93	c 2638193        16204468       346351038      1726993677     884            0              570   739   685
2135.31/2135.38	c 2902077        18255027       384458946      1912899607     884            0              557   756   689
2332.02/2332.01	c 3192349        19672741       419584834      2097748078     884            0              551   730   681
2520.02/2520.00	
2520.02/2520.00	c *** INTERRUPTED ***
2520.02/2520.00	c restarts              : 85          
2520.02/2520.00	c conflicts             : 3451241      (1370 /sec)
2520.02/2520.00	c decisions             : 21095054     (8371 /sec)
2520.02/2520.00	c propagations          : 2275990050  (903165 /sec)
2520.02/2520.00	c root propagations     : 4824        
2520.02/2520.00	c filter calls          : 453208829      (179844 /sec)
2520.02/2520.00	c useless filter calls  : 116903137      (25 %)
2520.02/2520.00	c Memory used           : 32.52 MB
2520.02/2520.00	c CPU time              : 2520.02 s
2520.02/2520.00	c real time             : 2520.01 s
2520.02/2520.00	
2520.02/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15453 MiB free)
  memory of node 1: 16384 MiB (15169 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4396858-1568593695/watcher-4396858-1568593695 -o /tmp/evaluation-result-4396858-1568593695/solver-4396858-1568593695 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node126-1568593658-23495 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4396858-1568593695.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=23513, runsolver pid=23510
Current StackSize limit: 8192 KiB


[startup+0.100153 s]*
/proc/loadavg: 1.75 1.92 2.01 3/199 23525
/proc/meminfo: memFree=31345644/32770624 swapFree=66986028/67108860
[pid=23513] ppid=23510 vsize=32240 memory=8668 CPUtime=0.1 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 2367 0 0 0 10 0 0 0 20 0 1 0 435637341 33013760 2167 33554432000 4194304 6211092 140734796909216 140734796905752 5081337 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8060 2167 864 493 0 1365 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32240 KiB
Current children cumulated memory: 8668 KiB

[startup+0.209614 s]*
/proc/loadavg: 1.75 1.92 2.01 3/199 23525
/proc/meminfo: memFree=31330268/32770624 swapFree=66986028/67108860
[pid=23513] ppid=23510 vsize=32768 memory=9196 CPUtime=0.21 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 2512 0 0 0 21 0 0 0 20 0 1 0 435637341 33554432 2299 33554432000 4194304 6211092 140734796909216 140734796905752 5409444 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8192 2299 866 493 0 1497 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9196 KiB

[startup+0.309109 s]*
/proc/loadavg: 1.75 1.92 2.01 3/199 23525
/proc/meminfo: memFree=31324400/32770624 swapFree=66986028/67108860
[pid=23513] ppid=23510 vsize=32900 memory=9196 CPUtime=0.31 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 2525 0 0 0 31 0 0 0 20 0 1 0 435637341 33689600 2299 33554432000 4194304 6211092 140734796909216 140734796906808 5081703 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8225 2299 866 493 0 1530 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32900 KiB
Current children cumulated memory: 9196 KiB

[startup+0.700278 s]
/proc/loadavg: 1.75 1.92 2.01 3/199 23525
/proc/meminfo: memFree=31301208/32770624 swapFree=66986028/67108860
[pid=23513] ppid=23510 vsize=33032 memory=9460 CPUtime=0.69 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 2552 0 0 0 69 0 0 0 20 0 1 0 435637341 33824768 2365 33554432000 4194304 6211092 140734796909216 140734796906808 139830409235429 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8258 2365 866 493 0 1563 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9460 KiB

[startup+1.50028 s]
/proc/loadavg: 1.75 1.92 2.01 3/199 23525
/proc/meminfo: memFree=31301208/32770624 swapFree=66986028/67108860
[pid=23513] ppid=23510 vsize=33032 memory=9460 CPUtime=1.49 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 2566 0 0 0 149 0 0 0 20 0 1 0 435637341 33824768 2365 33554432000 4194304 6211092 140734796909216 140734796906808 5082427 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8258 2365 866 493 0 1563 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9460 KiB

[startup+3.10897 s]
/proc/loadavg: 1.61 1.89 2.00 3/199 23525
/proc/meminfo: memFree=31300816/32770624 swapFree=66986028/67108860
[pid=23513] ppid=23510 vsize=33032 memory=9616 CPUtime=3.1 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 3645 0 0 0 310 0 0 0 20 0 1 0 435637341 33824768 2404 33554432000 4194304 6211092 140734796909216 140734796907176 5079246 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8258 2404 866 493 0 1563 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9616 KiB

[startup+6.30026 s]
/proc/loadavg: 1.61 1.89 2.00 3/199 23525
/proc/meminfo: memFree=31301064/32770624 swapFree=66986028/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9840 CPUtime=6.29 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 5170 0 0 0 629 0 0 0 20 0 1 0 435637341 34095104 2460 33554432000 4194304 6211092 140734796909216 140734796907176 5076376 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2460 866 493 0 1629 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9840 KiB

[startup+12.7003 s]
/proc/loadavg: 1.64 1.89 2.00 3/199 23525
/proc/meminfo: memFree=31301188/32770624 swapFree=66986028/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9896 CPUtime=12.69 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 6700 0 0 0 1269 0 0 0 20 0 1 0 435637341 34095104 2474 33554432000 4194304 6211092 140734796909216 140734796907176 5082800 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2474 866 493 0 1629 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9896 KiB

[startup+25.5003 s]
/proc/loadavg: 1.80 1.92 2.01 3/200 23530
/proc/meminfo: memFree=31300192/32770624 swapFree=66986032/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9916 CPUtime=25.49 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 9699 0 0 0 2549 0 0 0 20 0 1 0 435637341 34095104 2479 33554432000 4194304 6211092 140734796909216 140734796907176 5075544 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2479 866 493 0 1629 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9916 KiB

[startup+51.109 s]
/proc/loadavg: 1.87 1.92 2.01 3/200 23530
/proc/meminfo: memFree=31300188/32770624 swapFree=66986032/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9924 CPUtime=51.1 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 11223 0 0 0 5110 0 0 0 20 0 1 0 435637341 34095104 2481 33554432000 4194304 6211092 140734796909216 140734796907176 5081706 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2481 866 493 0 1629 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9924 KiB

[startup+102.3 s]
/proc/loadavg: 1.94 1.93 2.01 3/200 23534
/proc/meminfo: memFree=31299364/32770624 swapFree=66986032/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9932 CPUtime=102.29 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 12036 0 0 0 10229 0 0 0 20 0 1 0 435637341 34095104 2483 33554432000 4194304 6211092 140734796909216 140734796907176 5193696 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2483 866 493 0 1629 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9932 KiB

[startup+162.3 s]
/proc/loadavg: 1.98 1.95 2.01 3/201 23548
/proc/meminfo: memFree=31298452/32770624 swapFree=66986052/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=162.29 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 12541 0 0 0 16229 0 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5078748 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+222.3 s]
/proc/loadavg: 1.99 1.96 2.01 3/201 23552
/proc/meminfo: memFree=31300212/32770624 swapFree=66986052/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=222.29 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 13039 0 0 0 22229 0 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5075269 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.96 2.01 3/201 23556
/proc/meminfo: memFree=31299612/32770624 swapFree=66986052/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=282.29 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 13541 0 0 0 28229 0 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5082818 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.97 2.01 3/201 23562
/proc/meminfo: memFree=31298964/32770624 swapFree=66986052/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=342.29 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 14044 0 0 0 34229 0 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5079374 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.97 2.01 3/201 23566
/proc/meminfo: memFree=31299924/32770624 swapFree=66986052/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=402.29 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 14548 0 0 0 40229 0 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5081412 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.98 2.01 3/200 23570
/proc/meminfo: memFree=31300208/32770624 swapFree=66986052/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=462.29 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 15049 0 0 0 46229 0 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5081728 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB


################
# More data... #
################

/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 1722.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+1782.3 s]
/proc/loadavg: 2.47 2.20 2.09 3/200 23691
/proc/meminfo: memFree=31298488/32770624 swapFree=66986092/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=1782.31 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 23894 0 0 0 178230 1 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5081360 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 1782.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+1842.3 s]
/proc/loadavg: 2.27 2.20 2.10 3/200 23696
/proc/meminfo: memFree=31299024/32770624 swapFree=66986096/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=1842.31 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 24141 0 0 0 184230 1 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5074845 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 1842.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+1902.3 s]
/proc/loadavg: 2.10 2.16 2.09 3/200 23700
/proc/meminfo: memFree=31299776/32770624 swapFree=66986096/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=1902.31 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 24384 0 0 0 190230 1 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5076434 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 1902.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+1962.3 s]
/proc/loadavg: 2.04 2.13 2.08 3/199 23713
/proc/meminfo: memFree=31298556/32770624 swapFree=66986104/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=1962.31 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 24886 0 0 0 196230 1 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5081360 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 1962.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+2022.3 s]
/proc/loadavg: 2.01 2.11 2.08 3/200 23739
/proc/meminfo: memFree=31297204/32770624 swapFree=66986124/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=2022.31 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 25131 0 0 0 202230 1 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5409453 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 2022.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+2082.3 s]
/proc/loadavg: 2.01 2.09 2.07 3/200 23743
/proc/meminfo: memFree=31297344/32770624 swapFree=66986124/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=2082.31 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 25382 0 0 0 208230 1 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5082823 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 2082.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.07 2.07 3/200 23749
/proc/meminfo: memFree=31297928/32770624 swapFree=66986124/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=2142.31 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 25883 0 0 0 214230 1 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5082397 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 2142.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.06 2.06 3/200 23753
/proc/meminfo: memFree=31298356/32770624 swapFree=66986124/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=2202.31 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 26116 0 0 0 220230 1 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5079092 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 2202.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/200 23757
/proc/meminfo: memFree=31298048/32770624 swapFree=66986124/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=2262.31 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 26348 0 0 0 226230 1 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5082800 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 2262.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 23763
/proc/meminfo: memFree=31298308/32770624 swapFree=66986124/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=2322.31 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 26578 0 0 0 232230 1 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5081703 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 2322.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 23767
/proc/meminfo: memFree=31298800/32770624 swapFree=66986124/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=2382.31 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 27075 0 0 0 238230 1 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5193728 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 2382.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/200 23771
/proc/meminfo: memFree=31298812/32770624 swapFree=66986124/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=2442.31 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 27296 0 0 0 244230 1 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5081349 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 2442.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 23777
/proc/meminfo: memFree=31298304/32770624 swapFree=66986124/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=2502.31 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 27517 0 0 0 250230 1 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5075568 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 2502.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.02 2.05 3/200 23777
/proc/meminfo: memFree=31298536/32770624 swapFree=66986124/67108860
[pid=23513] ppid=23510 vsize=33296 memory=9936 CPUtime=2520.02 cores=1,3,5,7
/proc/23513/stat : 23513 (cosoco) R 23510 23513 23463 0 -1 4202496 27731 0 0 0 252001 1 0 0 20 0 1 0 435637341 34095104 2484 33554432000 4194304 6211092 140734796909216 140734796907176 5079328 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8312316 8317760 24739840 140734796915723 140734796915825 140734796915825 140734796918734 0
/proc/23513/statm: 8324 2484 866 493 0 1629 0
Current children cumulated CPU time: 2520.02 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9936 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 23513 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.02 s, system=0.017 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.03
CPU user time (s): 2520.02
CPU system time (s): 0.017
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 33296
Max. memory (cumulated for all children) (KiB): 9936

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.02
system time used= 0.017
maximum resident set size= 10000
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 27784
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 645


# summary of solver processes directly reported to runsolver:
#   pid: 23513
#   total CPU time (s): 2520.03
#   total CPU user time (s): 2520.02
#   total CPU system time (s): 0.017

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.91381 second user time and 16.9542 second system time

The end

Launcher Data 

Begin job on node126 at 2019-09-16 02:27:38
IDJOB=4396858
IDBENCH=138976
IDSOLVER=2848
FILE ID=node126/4396858-1568593695
RUNJOBID= node126-1568593658-23495
PBS_JOBID= 21703345
Free space on /tmp= 55708 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h375-07.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4396858-1568593695/watcher-4396858-1568593695 -o /tmp/evaluation-result-4396858-1568593695/solver-4396858-1568593695 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node126-1568593658-23495 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4396858-1568593695.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= b197b36061edf780c6549c887861e4b6
RANDOM SEED=981316346

node126.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31358148 kB
MemAvailable:   31899556 kB
Buffers:           14768 kB
Cached:           794020 kB
SwapCached:         3260 kB
Active:           492120 kB
Inactive:         322108 kB
Active(anon):      21896 kB
Inactive(anon):    15336 kB
Active(file):     470224 kB
Inactive(file):   306772 kB
Unevictable:      109048 kB
Mlocked:          109048 kB
SwapTotal:      67108860 kB
SwapFree:       66986028 kB
Dirty:              2728 kB
Writeback:             0 kB
AnonPages:        112928 kB
Mapped:            39072 kB
Shmem:             22440 kB
Slab:             189728 kB
SReclaimable:     160492 kB
SUnreclaim:        29236 kB
KernelStack:        3280 kB
PageTables:         6052 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     509796 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      130432 kB
DirectMap2M:    33415168 kB

Free space on /tmp at the end= 55700 MiB
End job on node126 at 2019-09-16 03:09:38