Trace number 4268055

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 1.12? (TO) 2520.01 2519.8

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-13.xml
MD5SUM2c503f7a351e8b8ef7001234fe31d43f
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark2.5475099
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data

0.00/0.02	c root propagations     : 4736        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 1.12 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts HOME/instance-4268055-1502582820.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 586
0.00/0.02	c |                   Arity: 1..30  -- Unary: 526
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 526
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.07	c 101            921            12850          41963          900            0              602   675   652
0.10/0.15	c 211            2153           27376          99402          900            0              584   689   664
0.10/0.21	c 332            3314           39397          142633         900            0              570   679   639
0.31/0.32	c 465            4707           59138          227103         900            0              586   705   677
0.31/0.40	c 611            6021           74950          287310         900            0              549   636   619
0.41/0.47	c 771            7514           87397          321230         900            0              560   638   618
0.51/0.52	c 947            8645           97740          369775         900            0              540   636   577
0.60/0.61	c 1140           10410          114685         429620         900            0              538   637   595
0.69/0.70	c 1352           11922          130166         497084         900            0              496   677   635
0.79/0.81	c 1585           13576          151103         591552         900            0              543   701   641
0.89/0.93	c 1841           15325          173689         695774         900            0              528   717   675
1.00/1.03	c 2122           17110          191493         765065         900            0              537   653   631
1.19/1.24	c 2431           19505          230764         934933         900            0              544   714   681
1.39/1.47	c 2770           22028          271575         1110307        900            0              566   712   663
1.49/1.58	c 3142           23797          293113         1194150        900            0              543   616   589
1.69/1.78	c 3551           26364          329620         1344598        900            0              544   688   652
2.00/2.03	c 4000           28938          375604         1555658        900            0              533   720   675
2.19/2.27	c 4493           31609          418032         1728855        900            0              560   704   663
2.39/2.49	c 5035           35276          459201         1900497        900            0              554   717   640
2.69/2.71	c 5631           38583          499781         2056311        900            0              540   691   632
3.00/3.06	c 6286           41650          561768         2340055        900            0              539   670   623
3.39/3.41	c 7006           45113          625076         2655922        900            0              563   706   669
3.69/3.71	c 7798           49544          680868         2925727        900            0              564   721   687
4.10/4.13	c 8669           53716          756538         3269157        900            0              567   697   665
4.49/4.58	c 9627           58495          838062         3715280        900            0              543   682   654
5.00/5.01	c 10680          63507          917804         4062208        900            0              543   689   656
5.89/5.91	c 11838          72064          1080189        4845866        900            0              559   731   688
6.49/6.55	c 13111          77963          1194870        5433114        900            0              562   692   660
7.29/7.32	c 14511          84717          1332569        6187978        900            0              546   741   699
7.89/7.96	c 16051          90888          1447512        6690905        900            0              557   699   658
8.89/9.00	c 17745          100250         1636573        7568055        900            0              583   740   702
9.79/9.87	c 19608          109054         1793461        8296493        900            0              568   701   659
10.69/10.78	c 21657          117908         1957483        9084936        900            0              600   704   674
11.69/11.74	c 23910          127392         2128874        9945327        900            0              643   720   689
13.00/13.09	c 26388          140063         2371506        11243681       900            0              562   708   681
14.39/14.45	c 29113          149658         2616464        12501731       900            0              554   709   685
15.89/15.91	c 32110          161763         2876223        13846450       900            0              559   703   663
17.79/17.87	c 35406          177647         3221740        15649540       900            0              565   729   672
19.59/19.60	c 39031          193028         3533149        17113703       900            0              609   708   678
21.69/21.76	c 43018          209533         3915637        19047255       900            0              563   698   671
24.19/24.28	c 47403          228395         4365314        21476750       900            0              559   722   694
26.10/26.18	c 52226          249335         4703642        23320095       900            0              576   718   677
28.59/28.69	c 57531          271229         5151165        25739653       900            0              581   723   678
32.19/32.25	c 63366          297289         5787242        29062933       900            0              613   718   684
35.19/35.20	c 69784          324256         6316903        31905276       900            0              577   731   692
38.39/38.44	c 76843          355204         6901070        34714574       900            0              568   706   662
42.59/42.63	c 84607          387677         7643373        38770797       900            0              543   703   671
48.19/48.26	c 93147          435458         8643139        43929299       900            0              559   733   683
52.39/52.41	c 102541         474584         9386901        47861150       900            0              559   731   700
57.69/57.76	c 112874         522108         10353434       52470210       900            0              555   714   678
64.49/64.50	c 124240         578533         11545376       59179589       900            0              548   725   684
70.39/70.47	c 136742         633895         12619653       64862278       900            0              557   729   674
78.69/78.74	c 150494         676429         14054540       71976214       900            0              559   693   664
84.29/84.38	c 165621         732074         15062180       77229009       900            0              550   703   670
92.89/92.95	c 182260         814397         16601736       84317540       900            0              575   745   673
104.50/104.53	c 200562         889493         18636033       94841510       900            0              553   685   646
114.30/114.37	c 220694         962281         20375935       104399060      900            0              577   713   682
125.70/125.72	c 242839         1056031        22397730       114362512      900            0              557   706   663
138.01/138.01	c 267198         1142294        24589505       125486080      900            0              558   698   648
152.90/152.98	c 293992         1265291        27276454       138970397      900            0              546   737   686
167.70/167.74	c 323465         1396460        29922912       152109379      900            0              551   735   688
183.01/183.09	c 355885         1577826        32701776       164934557      900            0              553   733   683
203.71/203.74	c 391547         1764698        36411601       181567987      900            0              563   720   677
221.91/221.94	c 430775         1934843        39662875       198698767      900            0              585   728   686
243.81/243.84	c 473925         2124795        43568221       218837385      900            0              585   717   672
266.02/266.09	c 521390         2313139        47557328       240126414      900            0              564   721   684
290.03/290.05	c 573601         2515236        51828314       263369663      900            0              568   735   697
319.13/319.11	c 631033         2771104        57014680       289252533      900            0              612   723   681
347.82/347.88	c 694208         3005265        62059659       315915600      900            0              589   716   674
386.73/386.73	c 763700         3301995        68957318       351336966      900            0              589   717   679
418.53/418.56	c 840141         3600382        74691787       380122532      900            0              585   715   675
456.23/456.28	c 924226         3948490        81388597       414290195      900            0              565   710   665
517.44/517.48	c 1016719        4367875        92206501       470350609      900            0              631   730   680
567.05/567.06	c 1118461        4767309        100920885      517198750      900            0              566   705   666
616.24/616.24	c 1230377        5189664        109695310      565584919      900            0              572   713   673
671.55/671.54	c 1353484        5731103        119623294      615400990      900            0              554   736   686
746.16/746.14	c 1488901        6356447        132992123      684182564      900            0              582   726   671
815.76/815.79	c 1637859        6972401        145385280      746693196      900            0              589   723   675
915.47/915.46	c 1801712        7740452        163178077      840681997      900            0              602   727   680
1023.67/1023.68	c 1981950        8565155        182610654      938089829      900            0              616   738   686
1103.58/1103.52	c 2180211        9517775        197112698      1012167141     900            0              602   738   693
1213.60/1213.53	c 2398298        10579203       216923412      1112525595     900            0              600   725   673
1319.61/1319.55	c 2638193        11618024       236065620      1214296166     900            0              563   753   701
1453.82/1453.72	c 2902077        12649174       260151550      1343812384     900            0              631   731   685
1616.43/1616.37	c 3192349        13877141       289354020      1504032544     900            0              628   747   699
1817.75/1817.69	c 3511648        15383306       325069358      1685036887     900            0              593   730   674
2006.47/2006.31	c 3862876        17014508       358758309      1859001426     900            0              598   729   674
2224.58/2224.47	c 4249226        18609224       397626404      2044178086     900            0              595   727   677
2459.00/2458.81	c 4674211        20440294       439326682      2260958576     900            0              563   747   682
2520.01/2519.80	
2520.01/2519.80	c *** INTERRUPTED ***
2520.01/2519.80	c restarts              : 89          
2520.01/2519.80	c conflicts             : 4781175      (1897 /sec)
2520.01/2519.80	c decisions             : 20908143     (8297 /sec)
2520.01/2519.80	c propagations          : 2314321075  (918389 /sec)
2520.01/2519.80	c root propagations     : 4736        
2520.01/2519.80	c filter calls          : 450155945      (178635 /sec)
2520.01/2519.80	c useless filter calls  : 115168585      (25 %)
2520.01/2519.80	c Memory used           : 32.17 MB
2520.01/2519.80	c CPU time              : 2519.98 s
2520.01/2519.80	
2520.01/2519.80	s UNKNOWN

Verifier Data


Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9829 MiB free)
  memory of node 1: 16384 MiB (14939 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4268055-1502582820/watcher-4268055-1502582820 -o /tmp/evaluation-result-4268055-1502582820/solver-4268055-1502582820 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node150-1502571587-3600 --watchdog 2580 cosoco -lc -model -restarts HOME/instance-4268055-1502582820.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=4666, runsolver pid=4663
Current StackSize limit: 8192 KiB


[startup+0.100156 s]*
/proc/loadavg: 1.94 2.00 2.04 3/187 4667
/proc/meminfo: memFree=25357880/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32540 memory=8776 CPUtime=0.1 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 2408 0 0 0 10 0 0 0 20 0 1 0 91363224 33320960 2194 33554432000 4194304 5972588 140729686056400 140729686053048 4975644 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8135 2194 774 435 0 1498 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32540 KiB
Current children cumulated memory: 8776 KiB

[startup+0.209612 s]*
/proc/loadavg: 1.94 2.00 2.04 3/187 4667
/proc/meminfo: memFree=25357880/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32672 memory=9040 CPUtime=0.21 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 2431 0 0 0 21 0 0 0 20 0 1 0 91363224 33456128 2260 33554432000 4194304 5972588 140729686056400 140729686053048 4975792 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8168 2260 774 435 0 1531 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32672 KiB
Current children cumulated memory: 9040 KiB

[startup+0.308881 s]*
/proc/loadavg: 1.94 2.00 2.04 3/187 4667
/proc/meminfo: memFree=25357208/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32672 memory=9040 CPUtime=0.31 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 2451 0 0 0 31 0 0 0 20 0 1 0 91363224 33456128 2260 33554432000 4194304 5972588 140729686056400 140729686053048 4971560 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8168 2260 774 435 0 1531 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32672 KiB
Current children cumulated memory: 9040 KiB

[startup+0.700268 s]
/proc/loadavg: 1.95 2.00 2.04 3/187 4667
/proc/meminfo: memFree=25357208/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32804 memory=9040 CPUtime=0.69 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 2473 0 0 0 69 0 0 0 20 0 1 0 91363224 33591296 2260 33554432000 4194304 5972588 140729686056400 140729686053336 4978790 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8201 2260 774 435 0 1564 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 32804 KiB
Current children cumulated memory: 9040 KiB

[startup+1.50027 s]
/proc/loadavg: 1.95 2.00 2.04 3/187 4667
/proc/meminfo: memFree=25357208/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32804 memory=9040 CPUtime=1.49 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 2487 0 0 0 149 0 0 0 20 0 1 0 91363224 33591296 2260 33554432000 4194304 5972588 140729686056400 140729686053704 4971949 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8201 2260 774 435 0 1564 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 32804 KiB
Current children cumulated memory: 9040 KiB

[startup+3.10893 s]
/proc/loadavg: 1.95 2.00 2.04 3/187 4667
/proc/meminfo: memFree=25356644/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9316 CPUtime=3.1 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 3950 0 0 0 310 0 0 0 20 0 1 0 91363224 33726464 2329 33554432000 4194304 5972588 140729686056400 140729686053336 4977745 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2329 774 435 0 1597 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9316 KiB

[startup+6.30024 s]
/proc/loadavg: 1.95 2.00 2.04 3/187 4667
/proc/meminfo: memFree=25356548/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9332 CPUtime=6.29 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 5414 0 0 0 629 0 0 0 20 0 1 0 91363224 33726464 2333 33554432000 4194304 5972588 140729686056400 140729686053704 4971949 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2333 774 435 0 1597 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9332 KiB

[startup+12.7003 s]
/proc/loadavg: 1.87 1.98 2.03 3/187 4667
/proc/meminfo: memFree=25354444/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9336 CPUtime=12.69 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 6876 0 0 0 1269 0 0 0 20 0 1 0 91363224 33726464 2334 33554432000 4194304 5972588 140729686056400 140729686053704 4978102 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2334 774 435 0 1597 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9336 KiB

[startup+25.5003 s]
/proc/loadavg: 1.97 2.00 2.04 3/187 4667
/proc/meminfo: memFree=25354056/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9356 CPUtime=25.49 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 9802 0 0 0 2549 0 0 0 20 0 1 0 91363224 33726464 2339 33554432000 4194304 5972588 140729686056400 140729686053704 4971589 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2339 774 435 0 1597 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9356 KiB

[startup+51.1089 s]
/proc/loadavg: 2.03 2.01 2.05 3/187 4667
/proc/meminfo: memFree=25347316/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9368 CPUtime=51.1 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 11281 0 0 0 5110 0 0 0 20 0 1 0 91363224 33726464 2342 33554432000 4194304 5972588 140729686056400 140729686053704 4978807 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2342 774 435 0 1597 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9368 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/187 4668
/proc/meminfo: memFree=25337080/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9372 CPUtime=102.3 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 12756 0 0 0 10230 0 0 0 20 0 1 0 91363224 33726464 2343 33554432000 4194304 5972588 140729686056400 140729686053704 4977756 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2343 774 435 0 1597 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9372 KiB

[startup+162.3 s]
/proc/loadavg: 2.01 2.01 2.05 3/187 4670
/proc/meminfo: memFree=25333900/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9376 CPUtime=162.3 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 14227 0 0 0 16230 0 0 0 20 0 1 0 91363224 33726464 2344 33554432000 4194304 5972588 140729686056400 140729686053704 4978058 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2344 774 435 0 1597 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9376 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4671
/proc/meminfo: memFree=25333404/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9388 CPUtime=222.31 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 15699 0 0 0 22230 1 0 0 20 0 1 0 91363224 33726464 2347 33554432000 4194304 5972588 140729686056400 140729686053704 4978775 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2347 774 435 0 1597 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9388 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4672
/proc/meminfo: memFree=25332576/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9388 CPUtime=282.32 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 15705 0 0 0 28231 1 0 0 20 0 1 0 91363224 33726464 2347 33554432000 4194304 5972588 140729686056400 140729686053704 5338173 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2347 774 435 0 1597 0
Current children cumulated CPU time: 282.32 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9388 KiB

[startup+342.3 s]
/proc/loadavg: 2.09 2.04 2.05 3/187 4674
/proc/meminfo: memFree=25332248/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9400 CPUtime=342.32 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 17179 0 0 0 34231 1 0 0 20 0 1 0 91363224 33726464 2350 33554432000 4194304 5972588 140729686056400 140729686053704 4971644 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2350 774 435 0 1597 0
Current children cumulated CPU time: 342.32 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9400 KiB

[startup+402.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/187 4675
/proc/meminfo: memFree=25331780/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9400 CPUtime=402.33 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 17181 0 0 0 40232 1 0 0 20 0 1 0 91363224 33726464 2350 33554432000 4194304 5972588 140729686056400 140729686053704 4970973 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2350 774 435 0 1597 0
Current children cumulated CPU time: 402.33 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9400 KiB

[startup+462.3 s]
/proc/loadavg: 2.01 2.03 2.05 3/188 4684
/proc/meminfo: memFree=25330272/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9404 CPUtime=462.33 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 18649 0 0 0 46232 1 0 0 20 0 1 0 91363224 33726464 2351 33554432000 4194304 5972588 140729686056400 140729686053704 4971099 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2351 774 435 0 1597 0
Current children cumulated CPU time: 462.33 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9404 KiB


################
# More data... #
################

/proc/4666/statm: 8234 2356 774 435 0 1597 0
Current children cumulated CPU time: 1722.44 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9424 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4747
/proc/meminfo: memFree=25315364/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9424 CPUtime=1782.45 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 28379 0 0 0 178243 2 0 0 20 0 1 0 91363224 33726464 2356 33554432000 4194304 5972588 140729686056400 140729686053704 4975784 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2356 774 435 0 1597 0
Current children cumulated CPU time: 1782.45 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9424 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4748
/proc/meminfo: memFree=25315488/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9424 CPUtime=1842.45 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 28599 0 0 0 184243 2 0 0 20 0 1 0 91363224 33726464 2356 33554432000 4194304 5972588 140729686056400 140729686053704 4975688 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2356 774 435 0 1597 0
Current children cumulated CPU time: 1842.45 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9424 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4749
/proc/meminfo: memFree=25315116/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9424 CPUtime=1902.46 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 28849 0 0 0 190244 2 0 0 20 0 1 0 91363224 33726464 2356 33554432000 4194304 5972588 140729686056400 140729686053704 4978757 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2356 774 435 0 1597 0
Current children cumulated CPU time: 1902.46 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9424 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4751
/proc/meminfo: memFree=25315240/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9424 CPUtime=1962.46 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 28849 0 0 0 196244 2 0 0 20 0 1 0 91363224 33726464 2356 33554432000 4194304 5972588 140729686056400 140729686053704 4978741 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2356 774 435 0 1597 0
Current children cumulated CPU time: 1962.46 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9424 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4752
/proc/meminfo: memFree=25315040/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9424 CPUtime=2022.47 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 29320 0 0 0 202245 2 0 0 20 0 1 0 91363224 33726464 2356 33554432000 4194304 5972588 140729686056400 140729686053704 4971621 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2356 774 435 0 1597 0
Current children cumulated CPU time: 2022.47 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9424 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4753
/proc/meminfo: memFree=25314924/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9424 CPUtime=2082.47 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 29320 0 0 0 208245 2 0 0 20 0 1 0 91363224 33726464 2356 33554432000 4194304 5972588 140729686056400 140729686053704 4975625 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2356 774 435 0 1597 0
Current children cumulated CPU time: 2082.47 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9424 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4755
/proc/meminfo: memFree=25315048/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9424 CPUtime=2142.48 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 29571 0 0 0 214246 2 0 0 20 0 1 0 91363224 33726464 2356 33554432000 4194304 5972588 140729686056400 140729686053704 4972046 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2356 774 435 0 1597 0
Current children cumulated CPU time: 2142.48 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9424 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 4756
/proc/meminfo: memFree=25313776/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9424 CPUtime=2202.48 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 29571 0 0 0 220246 2 0 0 20 0 1 0 91363224 33726464 2356 33554432000 4194304 5972588 140729686056400 140729686053704 4971586 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2356 774 435 0 1597 0
Current children cumulated CPU time: 2202.48 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9424 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4826
/proc/meminfo: memFree=27307632/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9424 CPUtime=2262.47 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 30043 0 0 0 226245 2 0 0 20 0 1 0 91363224 33726464 2356 33554432000 4194304 5972588 140729686056400 140729686053704 4971586 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2356 774 435 0 1597 0
Current children cumulated CPU time: 2262.47 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9424 KiB

[startup+2322.3 s]
/proc/loadavg: 1.93 2.00 2.04 3/188 4827
/proc/meminfo: memFree=27307280/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9424 CPUtime=2322.48 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 30294 0 0 0 232246 2 0 0 20 0 1 0 91363224 33726464 2356 33554432000 4194304 5972588 140729686056400 140729686053704 4978055 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2356 774 435 0 1597 0
Current children cumulated CPU time: 2322.48 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9424 KiB

[startup+2382.3 s]
/proc/loadavg: 1.97 2.00 2.04 3/188 4828
/proc/meminfo: memFree=27307572/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9424 CPUtime=2382.48 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 30294 0 0 0 238246 2 0 0 20 0 1 0 91363224 33726464 2356 33554432000 4194304 5972588 140729686056400 140729686053704 4978058 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2356 774 435 0 1597 0
Current children cumulated CPU time: 2382.48 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9424 KiB

[startup+2442.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/188 4829
/proc/meminfo: memFree=27307572/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9424 CPUtime=2442.5 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 30545 0 0 0 244247 3 0 0 20 0 1 0 91363224 33726464 2356 33554432000 4194304 5972588 140729686056400 140729686053704 4975104 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2356 774 435 0 1597 0
Current children cumulated CPU time: 2442.5 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9424 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 4830
/proc/meminfo: memFree=27307216/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9424 CPUtime=2502.5 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 30767 0 0 0 250247 3 0 0 20 0 1 0 91363224 33726464 2356 33554432000 4194304 5972588 140729686056400 140729686053704 4978730 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2356 774 435 0 1597 0
Current children cumulated CPU time: 2502.5 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9424 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.8 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 4830
/proc/meminfo: memFree=27307340/32770624 swapFree=67108860/67108860
[pid=4666] ppid=4663 vsize=32936 memory=9428 CPUtime=2520.01 cores=1,3,5,7
/proc/4666/stat : 4666 (cosoco) R 4663 4666 3568 0 -1 4202496 31014 0 0 0 251998 3 0 0 20 0 1 0 91363224 33726464 2357 33554432000 4194304 5972588 140729686056400 140729686053704 4978114 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8070896 8075904 18993152 140729686058175 140729686058270 140729686058270 140729686061006 0
/proc/4666/statm: 8234 2357 774 435 0 1597 0
Current children cumulated CPU time: 2520.01 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9428 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.8 s]
# the end of solver process 4666 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.98 s, system=0.031002 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2519.8
CPU time (s): 2520.01
CPU user time (s): 2519.98
CPU system time (s): 0.031002
CPU usage (%): 100.008
Max. virtual memory (cumulated for all children) (KiB): 32936
Max. memory (cumulated for all children) (KiB): 9428

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.98
system time used= 0.031002
maximum resident set size= 9504
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 31070
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 5143


# summary of solver processes directly reported to runsolver:
#   pid: 4666
#   total CPU time (s): 2520.01
#   total CPU user time (s): 2519.98
#   total CPU system time (s): 0.031002

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.15183 second user time and 16.4052 second system time

The end

Launcher Data

Begin job on node150 at 2017-08-13 01:52:42
IDJOB=4268055
IDBENCH=138954
IDSOLVER=2658
FILE ID=node150/4268055-1502582820
RUNJOBID= node150-1502571587-3600
PBS_JOBID= 20628290
Free space on /tmp= 61632 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-13.xml
COMMAND LINE= cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4268055-1502582820/watcher-4268055-1502582820 -o /tmp/evaluation-result-4268055-1502582820/solver-4268055-1502582820 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node150-1502571587-3600 --watchdog 2580  cosoco -lc -model -restarts HOME/instance-4268055-1502582820.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 2c503f7a351e8b8ef7001234fe31d43f
RANDOM SEED=1089327102

node150.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.89
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        25363688 kB
MemAvailable:   30028276 kB
Buffers:          214860 kB
Cached:          4738900 kB
SwapCached:            0 kB
Active:          2606756 kB
Inactive:        4359536 kB
Active(anon):    2015396 kB
Inactive(anon):    25068 kB
Active(file):     591360 kB
Inactive(file):  4334468 kB
Unevictable:        6228 kB
Mlocked:            6228 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2456 kB
Writeback:             0 kB
AnonPages:       2018824 kB
Mapped:            44736 kB
Shmem:             25224 kB
Slab:             135580 kB
SReclaimable:     109192 kB
SUnreclaim:        26388 kB
KernelStack:        3264 kB
PageTables:         8888 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:    2309884 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    256000 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 61632 MiB
End job on node150 at 2017-08-13 02:34:42