Trace number 4243117

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
R1: cosoco 1.1? (TO) 2400.1 2400.21

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-13.xml
MD5SUM2c503f7a351e8b8ef7001234fe31d43f
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark2.5475099
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.04	c root propagations     : 4736        
0.00/0.04	c restarts enabled, print stats at every restarts
0.00/0.04	c
0.00/0.04	c
0.00/0.04	c
0.00/0.04	c This is cosoco 1.0 --  
0.00/0.04	c
0.00/0.04	c ========================================[ Problem Statistics ]===========================================
0.00/0.04	c |                                                                                                       
0.00/0.04	c |  Parse time        :         0.01 s 
0.00/0.04	c |
0.00/0.04	c |               Variables: 900
0.00/0.04	c |            Domain Sizes: 30..30
0.00/0.04	c |
0.00/0.04	c |             Constraints: 586
0.00/0.04	c |                   Arity: 1..30  -- Unary: 526
0.00/0.04	c | 
0.00/0.04	c |                   Types: 
0.00/0.04	c |                          All Different: 60
0.00/0.04	c |                          Unary: 526
0.00/0.04	c |                          
0.00/0.04	c =========================================================================================================
0.00/0.04	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.09/0.12	c 101            921            12850          41963          900            0              602   675   652
0.19/0.21	c 211            2153           27376          99402          900            0              584   689   664
0.19/0.27	c 332            3314           39397          142633         900            0              570   679   639
0.29/0.38	c 465            4707           59138          227103         900            0              586   705   677
0.39/0.46	c 611            6021           74950          287310         900            0              549   636   619
0.49/0.53	c 771            7514           87397          321230         900            0              560   638   618
0.49/0.58	c 947            8645           97740          369775         900            0              540   636   577
0.59/0.67	c 1140           10410          114685         429620         900            0              538   637   595
0.69/0.75	c 1352           11922          130166         497084         900            0              496   677   635
0.79/0.87	c 1585           13576          151103         591552         900            0              543   701   641
0.89/0.99	c 1841           15325          173689         695774         900            0              528   717   675
0.99/1.08	c 2122           17110          191493         765065         900            0              537   653   631
1.29/1.30	c 2431           19505          230764         934933         900            0              544   714   681
1.49/1.52	c 2770           22028          271575         1110307        900            0              566   712   663
1.59/1.64	c 3142           23797          293113         1194150        900            0              543   616   589
1.79/1.84	c 3551           26364          329620         1344598        900            0              544   688   652
1.99/2.09	c 4000           28938          375604         1555658        900            0              533   720   675
2.30/2.32	c 4493           31609          418032         1728855        900            0              560   704   663
2.49/2.54	c 5035           35276          459201         1900497        900            0              554   717   640
2.69/2.76	c 5631           38583          499781         2056311        900            0              540   691   632
3.09/3.11	c 6286           41650          561768         2340055        900            0              539   670   623
3.40/3.46	c 7006           45113          625076         2655922        900            0              563   706   669
3.69/3.76	c 7798           49544          680868         2925727        900            0              564   721   687
4.09/4.17	c 8669           53716          756538         3269157        900            0              567   697   665
4.59/4.63	c 9627           58495          838062         3715280        900            0              543   682   654
4.99/5.06	c 10680          63507          917804         4062208        900            0              543   689   656
5.89/5.95	c 11838          72064          1080189        4845866        900            0              559   731   688
6.49/6.59	c 13111          77963          1194870        5433114        900            0              562   692   660
7.29/7.36	c 14511          84717          1332569        6187978        900            0              546   741   699
7.89/7.99	c 16051          90888          1447512        6690905        900            0              557   699   658
8.99/9.03	c 17745          100250         1636573        7568055        900            0              583   740   702
9.79/9.89	c 19608          109054         1793461        8296493        900            0              568   701   659
10.79/10.80	c 21657          117908         1957483        9084936        900            0              600   704   674
11.69/11.76	c 23910          127392         2128874        9945327        900            0              643   720   689
13.09/13.11	c 26388          140063         2371506        11243681       900            0              562   708   681
14.39/14.47	c 29113          149658         2616464        12501731       900            0              554   709   685
15.89/15.92	c 32110          161763         2876223        13846450       900            0              559   703   663
17.78/17.87	c 35406          177647         3221740        15649540       900            0              565   729   672
19.58/19.60	c 39031          193028         3533149        17113703       900            0              609   708   678
21.68/21.76	c 43018          209533         3915637        19047255       900            0              563   698   671
24.19/24.27	c 47403          228395         4365314        21476750       900            0              559   722   694
26.08/26.16	c 52226          249335         4703642        23320095       900            0              576   718   677
28.59/28.66	c 57531          271229         5151165        25739653       900            0              581   723   678
32.18/32.22	c 63366          297289         5787242        29062933       900            0              613   718   684
35.08/35.16	c 69784          324256         6316903        31905276       900            0              577   731   692
38.38/38.40	c 76843          355204         6901070        34714574       900            0              568   706   662
42.48/42.58	c 84607          387677         7643373        38770797       900            0              543   703   671
48.18/48.20	c 93147          435458         8643139        43929299       900            0              559   733   683
52.28/52.34	c 102541         474584         9386901        47861150       900            0              559   731   700
57.58/57.68	c 112874         522108         10353434       52470210       900            0              555   714   678
64.38/64.41	c 124240         578533         11545376       59179589       900            0              548   725   684
70.28/70.37	c 136742         633895         12619653       64862278       900            0              557   729   674
78.48/78.59	c 150494         676429         14054540       71976214       900            0              559   693   664
84.08/84.19	c 165621         732074         15062180       77229009       900            0              550   703   670
92.68/92.71	c 182260         814397         16601736       84317540       900            0              575   745   673
104.18/104.21	c 200562         889493         18636033       94841510       900            0              553   685   646
113.88/113.99	c 220694         962281         20375935       104399060      900            0              577   713   682
125.18/125.28	c 242839         1056031        22397730       114362512      900            0              557   706   663
137.38/137.49	c 267198         1142294        24589505       125486080      900            0              558   698   648
152.28/152.36	c 293992         1265291        27276454       138970397      900            0              546   737   686
166.97/167.03	c 323465         1396460        29922912       152109379      900            0              551   735   688
182.17/182.26	c 355885         1577826        32701776       164934557      900            0              553   733   683
202.67/202.73	c 391547         1764698        36411601       181567987      900            0              563   720   677
220.67/220.78	c 430775         1934843        39662875       198698767      900            0              585   728   686
242.47/242.55	c 473925         2124795        43568221       218837385      900            0              585   717   672
264.57/264.64	c 521390         2313139        47557328       240126414      900            0              564   721   684
288.37/288.45	c 573601         2515236        51828314       263369663      900            0              568   735   697
317.27/317.33	c 631033         2771104        57014680       289252533      900            0              612   723   681
345.87/345.90	c 694208         3005265        62059659       315915600      900            0              589   716   674
384.66/384.71	c 763700         3301995        68957318       351336966      900            0              589   717   679
416.26/416.34	c 840141         3600382        74691787       380122532      900            0              585   715   675
453.66/453.79	c 924226         3948490        81388597       414290195      900            0              565   710   665
514.56/514.60	c 1016719        4367875        92206501       470350609      900            0              631   730   680
563.76/563.87	c 1118461        4767309        100920885      517198750      900            0              566   705   666
612.67/612.71	c 1230377        5189664        109695310      565584919      900            0              572   713   673
667.56/667.63	c 1353484        5731103        119623294      615400990      900            0              554   736   686
741.66/741.70	c 1488901        6356447        132992123      684182564      900            0              582   726   671
810.76/810.86	c 1637859        6972401        145385280      746693196      900            0              589   723   675
909.65/909.79	c 1801712        7740452        163178077      840681997      900            0              602   727   680
1017.24/1017.30	c 1981950        8565155        182610654      938089829      900            0              616   738   686
1096.54/1096.64	c 2180211        9517775        197112698      1012167141     900            0              602   738   693
1205.93/1206.05	c 2398298        10579203       216923412      1112525595     900            0              600   725   673
1311.53/1311.63	c 2638193        11618024       236065620      1214296166     900            0              563   753   701
1445.12/1445.23	c 2902077        12649174       260151550      1343812384     900            0              631   731   685
1607.12/1607.21	c 3192349        13877141       289354020      1504032544     900            0              628   747   699
1807.51/1807.62	c 3511648        15383306       325069358      1685036887     900            0              593   730   674
1995.20/1995.31	c 3862876        17014508       358758309      1859001426     900            0              598   729   674
2212.29/2212.43	c 4249226        18609224       397626404      2044178086     900            0              595   727   677

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4243117-1500670813/watcher-4243117-1500670813 -o /tmp/evaluation-result-4243117-1500670813/solver-4243117-1500670813 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node124-1500648174-2482 --watchdog 2560 HOME/cosoco -lc -model -restarts HOME/instance-4243117-1500670813.xml 

pid=5258
running on 8 cores: 1,3,5,7,9,11,13,15

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 2.09 2.05 2.05 2/242 5261
/proc/meminfo: memFree=32026368/32770624 swapFree=5796/222760
[pid=5261] ppid=5258 vsize=27912 CPUtime=0 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 1183 0 0 0 0 0 0 0 20 0 1 0 2349021 28581888 999 33554432000 4194304 5970956 140731526132336 140731526128984 140008215903205 0 0 4096 0 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 6978 999 715 434 0 342 0

[startup+0.100149 s]
/proc/loadavg: 2.09 2.05 2.05 2/242 5261
/proc/meminfo: memFree=32026368/32770624 swapFree=5796/222760
[pid=5261] ppid=5258 vsize=32140 CPUtime=0.09 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 2314 0 0 0 9 0 0 0 20 0 1 0 2349021 32911360 2121 33554432000 4194304 5970956 140731526132336 140731526129032 4976802 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8035 2121 767 434 0 1399 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 32140

[startup+0.200315 s]
/proc/loadavg: 2.09 2.05 2.05 2/242 5261
/proc/meminfo: memFree=32026368/32770624 swapFree=5796/222760
[pid=5261] ppid=5258 vsize=32536 CPUtime=0.19 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 2409 0 0 0 19 0 0 0 20 0 1 0 2349021 33316864 2187 33554432000 4194304 5970956 140731526132336 140731526129032 4974299 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8134 2187 770 434 0 1498 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 32536

[startup+0.300235 s]
/proc/loadavg: 2.09 2.05 2.05 2/242 5261
/proc/meminfo: memFree=32026368/32770624 swapFree=5796/222760
[pid=5261] ppid=5258 vsize=32668 CPUtime=0.29 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 2436 0 0 0 29 0 0 0 20 0 1 0 2349021 33452032 2253 33554432000 4194304 5970956 140731526132336 140731526129672 4977781 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8167 2253 770 434 0 1531 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 32668

[startup+0.700208 s]
/proc/loadavg: 2.09 2.05 2.05 2/242 5261
/proc/meminfo: memFree=32026368/32770624 swapFree=5796/222760
[pid=5261] ppid=5258 vsize=32800 CPUtime=0.69 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 2467 0 0 0 69 0 0 0 20 0 1 0 2349021 33587200 2253 33554432000 4194304 5970956 140731526132336 140731526129672 4974143 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8200 2253 770 434 0 1564 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 32800

[startup+1.5002 s]
/proc/loadavg: 2.09 2.05 2.05 3/243 5262
/proc/meminfo: memFree=32019644/32770624 swapFree=5796/222760
[pid=5261] ppid=5258 vsize=32800 CPUtime=1.49 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 2482 0 0 0 149 0 0 0 20 0 1 0 2349021 33587200 2319 33554432000 4194304 5970956 140731526132336 140731526129672 4977734 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8200 2319 770 434 0 1564 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 32800

[startup+3.10021 s]
/proc/loadavg: 2.09 2.05 2.05 3/243 5262
/proc/meminfo: memFree=32019256/32770624 swapFree=5796/222760
[pid=5261] ppid=5258 vsize=32932 CPUtime=3.09 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 3947 0 0 0 309 0 0 0 20 0 1 0 2349021 33722368 2325 33554432000 4194304 5970956 140731526132336 140731526129672 4970607 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2325 770 434 0 1597 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 32932

[startup+6.3002 s]
/proc/loadavg: 2.08 2.05 2.05 3/243 5262
/proc/meminfo: memFree=32019256/32770624 swapFree=5796/222760
[pid=5261] ppid=5258 vsize=32932 CPUtime=6.29 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 5411 0 0 0 629 0 0 0 20 0 1 0 2349021 33722368 2330 33554432000 4194304 5970956 140731526132336 140731526129672 4977082 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2330 770 434 0 1597 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 32932

[startup+12.7002 s]
/proc/loadavg: 2.07 2.05 2.05 3/243 5262
/proc/meminfo: memFree=32019272/32770624 swapFree=5796/222832
[pid=5261] ppid=5258 vsize=32932 CPUtime=12.69 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 6881 0 0 0 1269 0 0 0 20 0 1 0 2349021 33722368 2331 33554432000 4194304 5970956 140731526132336 140731526129672 4977079 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2331 770 434 0 1597 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 32932

[startup+25.5003 s]
/proc/loadavg: 2.06 2.04 2.05 3/243 5262
/proc/meminfo: memFree=32019516/32770624 swapFree=5796/222832
[pid=5261] ppid=5258 vsize=32932 CPUtime=25.48 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 9815 0 0 0 2548 0 0 0 20 0 1 0 2349021 33722368 2336 33554432000 4194304 5970956 140731526132336 140731526129672 4977769 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2336 770 434 0 1597 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 32932

[startup+51.1003 s]
/proc/loadavg: 2.10 2.06 2.05 3/244 5285
/proc/meminfo: memFree=32018676/32770624 swapFree=5796/222868
[pid=5261] ppid=5258 vsize=32932 CPUtime=51.08 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 11293 0 0 0 5108 0 0 0 20 0 1 0 2349021 33722368 2339 33554432000 4194304 5970956 140731526132336 140731526129672 4974671 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2339 770 434 0 1597 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 32932

[startup+102.3 s]
/proc/loadavg: 2.04 2.05 2.05 3/244 5286
/proc/meminfo: memFree=32018972/32770624 swapFree=5796/222932
[pid=5261] ppid=5258 vsize=32932 CPUtime=102.29 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 12011 0 0 0 10229 0 0 0 20 0 1 0 2349021 33722368 2340 33554432000 4194304 5970956 140731526132336 140731526129672 4970285 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2340 770 434 0 1597 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 32932

[startup+162.3 s]
/proc/loadavg: 2.09 2.07 2.05 3/244 5287
/proc/meminfo: memFree=32019168/32770624 swapFree=5796/223000
[pid=5261] ppid=5258 vsize=32932 CPUtime=162.28 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 12474 0 0 0 16228 0 0 0 20 0 1 0 2349021 33722368 2341 33554432000 4194304 5970956 140731526132336 140731526129672 4978380 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2341 770 434 0 1597 0
Current children cumulated CPU time (s) 162.28
Current children cumulated vsize (KiB) 32932

[startup+222.307 s]
/proc/loadavg: 2.03 2.06 2.05 3/244 5288
/proc/meminfo: memFree=32019360/32770624 swapFree=5796/223060
[pid=5261] ppid=5258 vsize=32932 CPUtime=222.28 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 12940 0 0 0 22228 0 0 0 20 0 1 0 2349021 33722368 2344 33554432000 4194304 5970956 140731526132336 140731526129672 4977757 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2344 770 434 0 1597 0
Current children cumulated CPU time (s) 222.28
Current children cumulated vsize (KiB) 32932

[startup+282.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/244 5420
/proc/meminfo: memFree=29060216/32770624 swapFree=5796/223292
[pid=5261] ppid=5258 vsize=32932 CPUtime=282.27 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 13406 0 0 0 28227 0 0 0 20 0 1 0 2349021 33722368 2345 33554432000 4194304 5970956 140731526132336 140731526129672 4970645 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2345 770 434 0 1597 0
Current children cumulated CPU time (s) 282.27
Current children cumulated vsize (KiB) 32932

[startup+342.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/244 5421
/proc/meminfo: memFree=29057052/32770624 swapFree=5796/223376
[pid=5261] ppid=5258 vsize=32932 CPUtime=342.27 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 13872 0 0 0 34227 0 0 0 20 0 1 0 2349021 33722368 2347 33554432000 4194304 5970956 140731526132336 140731526129672 4974608 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2347 770 434 0 1597 0
Current children cumulated CPU time (s) 342.27
Current children cumulated vsize (KiB) 32932

[startup+402.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/243 5422
/proc/meminfo: memFree=29056668/32770624 swapFree=5796/223452
[pid=5261] ppid=5258 vsize=32932 CPUtime=402.26 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 14338 0 0 0 40226 0 0 0 20 0 1 0 2349021 33722368 2347 33554432000 4194304 5970956 140731526132336 140731526129672 4978135 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2347 770 434 0 1597 0
Current children cumulated CPU time (s) 402.26
Current children cumulated vsize (KiB) 32932

[startup+462.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/243 5423
/proc/meminfo: memFree=29056536/32770624 swapFree=5796/223500
[pid=5261] ppid=5258 vsize=32932 CPUtime=462.26 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 14806 0 0 0 46226 0 0 0 20 0 1 0 2349021 33722368 2348 33554432000 4194304 5970956 140731526132336 140731526129672 4971765 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2348 770 434 0 1597 0
Current children cumulated CPU time (s) 462.26
Current children cumulated vsize (KiB) 32932

[startup+522.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/242 5424
/proc/meminfo: memFree=29056968/32770624 swapFree=5796/223536
[pid=5261] ppid=5258 vsize=32932 CPUtime=522.26 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 15273 0 0 0 52226 0 0 0 20 0 1 0 2349021 33722368 2348 33554432000 4194304 5970956 140731526132336 140731526129672 4976709 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2348 770 434 0 1597 0
Current children cumulated CPU time (s) 522.26
Current children cumulated vsize (KiB) 32932

[startup+582.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 5426
/proc/meminfo: memFree=29055332/32770624 swapFree=5796/223588
[pid=5261] ppid=5258 vsize=32932 CPUtime=582.26 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 15740 0 0 0 58225 1 0 0 20 0 1 0 2349021 33722368 2348 33554432000 4194304 5970956 140731526132336 140731526129672 4974124 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2348 770 434 0 1597 0
Current children cumulated CPU time (s) 582.26
Current children cumulated vsize (KiB) 32932


################
# More data... #
################

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 5455
/proc/meminfo: memFree=29053388/32770624 swapFree=5796/224244
[pid=5261] ppid=5258 vsize=32932 CPUtime=1482.22 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 21621 0 0 0 148221 1 0 0 20 0 1 0 2349021 33722368 2352 33554432000 4194304 5970956 140731526132336 140731526129672 4970584 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2352 770 434 0 1597 0
Current children cumulated CPU time (s) 1482.22
Current children cumulated vsize (KiB) 32932

[startup+1542.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 5457
/proc/meminfo: memFree=29053764/32770624 swapFree=5796/224288
[pid=5261] ppid=5258 vsize=32932 CPUtime=1542.23 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 21851 0 0 0 154222 1 0 0 20 0 1 0 2349021 33722368 2352 33554432000 4194304 5970956 140731526132336 140731526129672 4976725 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2352 770 434 0 1597 0
Current children cumulated CPU time (s) 1542.23
Current children cumulated vsize (KiB) 32932

[startup+1602.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 5458
/proc/meminfo: memFree=29053108/32770624 swapFree=5796/224316
[pid=5261] ppid=5258 vsize=32932 CPUtime=1602.22 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 22094 0 0 0 160221 1 0 0 20 0 1 0 2349021 33722368 2352 33554432000 4194304 5970956 140731526132336 140731526129672 4976747 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2352 770 434 0 1597 0
Current children cumulated CPU time (s) 1602.22
Current children cumulated vsize (KiB) 32932

[startup+1662.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 5459
/proc/meminfo: memFree=29053912/32770624 swapFree=5796/224352
[pid=5261] ppid=5258 vsize=32932 CPUtime=1662.21 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 22581 0 0 0 166220 1 0 0 20 0 1 0 2349021 33722368 2352 33554432000 4194304 5970956 140731526132336 140731526129672 5323110 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2352 770 434 0 1597 0
Current children cumulated CPU time (s) 1662.21
Current children cumulated vsize (KiB) 32932

[startup+1722.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 5461
/proc/meminfo: memFree=29053564/32770624 swapFree=5796/224392
[pid=5261] ppid=5258 vsize=32932 CPUtime=1722.21 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 22835 0 0 0 172220 1 0 0 20 0 1 0 2349021 33722368 2352 33554432000 4194304 5970956 140731526132336 140731526129672 4978135 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2352 770 434 0 1597 0
Current children cumulated CPU time (s) 1722.21
Current children cumulated vsize (KiB) 32932

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 5462
/proc/meminfo: memFree=29053004/32770624 swapFree=5796/224436
[pid=5261] ppid=5258 vsize=32932 CPUtime=1782.21 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 23087 0 0 0 178220 1 0 0 20 0 1 0 2349021 33722368 2352 33554432000 4194304 5970956 140731526132336 140731526129672 4974147 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2352 770 434 0 1597 0
Current children cumulated CPU time (s) 1782.21
Current children cumulated vsize (KiB) 32932

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/245 5472
/proc/meminfo: memFree=29053832/32770624 swapFree=5796/224472
[pid=5261] ppid=5258 vsize=32932 CPUtime=1842.21 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 23558 0 0 0 184220 1 0 0 20 0 1 0 2349021 33722368 2352 33554432000 4194304 5970956 140731526132336 140731526129672 4977079 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2352 770 434 0 1597 0
Current children cumulated CPU time (s) 1842.21
Current children cumulated vsize (KiB) 32932

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/245 5473
/proc/meminfo: memFree=29053692/32770624 swapFree=5796/224524
[pid=5261] ppid=5258 vsize=32932 CPUtime=1902.2 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 23806 0 0 0 190219 1 0 0 20 0 1 0 2349021 33722368 2352 33554432000 4194304 5970956 140731526132336 140731526129672 4978093 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2352 770 434 0 1597 0
Current children cumulated CPU time (s) 1902.2
Current children cumulated vsize (KiB) 32932

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/245 5474
/proc/meminfo: memFree=29054436/32770624 swapFree=5796/224556
[pid=5261] ppid=5258 vsize=32932 CPUtime=1962.2 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 24054 0 0 0 196219 1 0 0 20 0 1 0 2349021 33722368 2352 33554432000 4194304 5970956 140731526132336 140731526129672 4974138 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2352 770 434 0 1597 0
Current children cumulated CPU time (s) 1962.2
Current children cumulated vsize (KiB) 32932

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/245 5475
/proc/meminfo: memFree=29054540/32770624 swapFree=5796/224596
[pid=5261] ppid=5258 vsize=32932 CPUtime=2022.2 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 24525 0 0 0 202219 1 0 0 20 0 1 0 2349021 33722368 2352 33554432000 4194304 5970956 140731526132336 140731526129672 4977138 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2352 770 434 0 1597 0
Current children cumulated CPU time (s) 2022.2
Current children cumulated vsize (KiB) 32932

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/245 5476
/proc/meminfo: memFree=29054132/32770624 swapFree=5796/224640
[pid=5261] ppid=5258 vsize=32932 CPUtime=2082.2 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 24773 0 0 0 208219 1 0 0 20 0 1 0 2349021 33722368 2352 33554432000 4194304 5970956 140731526132336 140731526129672 4978182 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2352 770 434 0 1597 0
Current children cumulated CPU time (s) 2082.2
Current children cumulated vsize (KiB) 32932

[startup+2142.3 s]
/proc/loadavg: 2.04 2.03 2.05 3/243 5477
/proc/meminfo: memFree=29052188/32770624 swapFree=5796/224640
[pid=5261] ppid=5258 vsize=32932 CPUtime=2142.19 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 25023 0 0 0 214218 1 0 0 20 0 1 0 2349021 33722368 2352 33554432000 4194304 5970956 140731526132336 140731526129672 4977752 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2352 770 434 0 1597 0
Current children cumulated CPU time (s) 2142.19
Current children cumulated vsize (KiB) 32932

[startup+2202.31 s]
/proc/loadavg: 2.02 2.02 2.05 3/243 5478
/proc/meminfo: memFree=29053924/32770624 swapFree=5796/224708
[pid=5261] ppid=5258 vsize=32932 CPUtime=2202.2 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 25271 0 0 0 220219 1 0 0 20 0 1 0 2349021 33722368 2352 33554432000 4194304 5970956 140731526132336 140731526129672 4977803 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2352 770 434 0 1597 0
Current children cumulated CPU time (s) 2202.2
Current children cumulated vsize (KiB) 32932

[startup+2262.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/243 5479
/proc/meminfo: memFree=29054628/32770624 swapFree=5796/224748
[pid=5261] ppid=5258 vsize=32932 CPUtime=2262.19 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 25748 0 0 0 226218 1 0 0 20 0 1 0 2349021 33722368 2353 33554432000 4194304 5970956 140731526132336 140731526129672 4974816 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2353 770 434 0 1597 0
Current children cumulated CPU time (s) 2262.19
Current children cumulated vsize (KiB) 32932

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 5480
/proc/meminfo: memFree=29054908/32770624 swapFree=5796/224780
[pid=5261] ppid=5258 vsize=32932 CPUtime=2322.18 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 26005 0 0 0 232217 1 0 0 20 0 1 0 2349021 33722368 2353 33554432000 4194304 5970956 140731526132336 140731526129672 4978138 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2353 770 434 0 1597 0
Current children cumulated CPU time (s) 2322.18
Current children cumulated vsize (KiB) 32932

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 5481
/proc/meminfo: memFree=29055256/32770624 swapFree=5796/224824
[pid=5261] ppid=5258 vsize=32932 CPUtime=2382.18 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 26248 0 0 0 238217 1 0 0 20 0 1 0 2349021 33722368 2353 33554432000 4194304 5970956 140731526132336 140731526129672 4978138 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2353 770 434 0 1597 0
Current children cumulated CPU time (s) 2382.18
Current children cumulated vsize (KiB) 32932



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.2 s]
/proc/loadavg: 2.00 2.01 2.05 3/245 5490
/proc/meminfo: memFree=29054604/32770624 swapFree=5796/224844
[pid=5261] ppid=5258 vsize=32932 CPUtime=2400.09 cores=1,3,5,7,9,11,13,15
/proc/5261/stat : 5261 (cosoco) R 5258 5261 2448 0 -1 4202496 26508 0 0 0 240008 1 0 0 20 0 1 0 2349021 33722368 2353 33554432000 4194304 5970956 140731526132336 140731526129672 4978203 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 39075840 140731526141121 140731526141251 140731526141251 140731526143950 0
/proc/5261/statm: 8233 2353 770 434 0 1597 0
Current children cumulated CPU time (s) 2400.09
Current children cumulated vsize (KiB) 32932

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 5261 sig 9
??? kill -5261 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2400.21
CPU time (s): 2400.1
CPU user time (s): 2400.08
CPU system time (s): 0.012999
CPU usage (%): 99.9953
Max. virtual memory (cumulated for all children) (KiB): 32932

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.08
system time used= 0.012999
maximum resident set size= 9456
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 26538
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 14
involuntary context switches= 120641

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.11329 second user time and 9.73186 second system time

The end

Launcher Data 

Begin job on node124 at 2017-07-21 23:00:13
IDJOB=4243117
IDBENCH=138954
IDSOLVER=2620
FILE ID=node124/4243117-1500670813
RUNJOBID= node124-1500648174-2482
PBS_JOBID= 20623296
Free space on /tmp= 62008 MiB

SOLVER NAME= cosoco 1.1
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-13.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4243117-1500670813/watcher-4243117-1500670813 -o /tmp/evaluation-result-4243117-1500670813/solver-4243117-1500670813 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node124-1500648174-2482 --watchdog 2560  HOME/cosoco -lc -model -restarts HOME/instance-4243117-1500670813.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 8

MD5SUM BENCH= 2c503f7a351e8b8ef7001234fe31d43f
RANDOM SEED=1295301475

node124.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2133.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 5
initial apicid	: 5
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 21
initial apicid	: 21
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 7
initial apicid	: 7
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.16
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 23
initial apicid	: 23
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        32027184 kB
MemAvailable:   32026460 kB
Buffers:           38360 kB
Cached:           272616 kB
SwapCached:            0 kB
Active:           143868 kB
Inactive:         231468 kB
Active(anon):      66712 kB
Inactive(anon):     8708 kB
Active(file):      77156 kB
Inactive(file):   222760 kB
Unevictable:        5796 kB
Mlocked:            5796 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2452 kB
Writeback:             0 kB
AnonPages:        161792 kB
Mapped:            30480 kB
Shmem:              8844 kB
Slab:              62400 kB
SReclaimable:      30392 kB
SUnreclaim:        32008 kB
KernelStack:        4256 kB
PageTables:         5020 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     335128 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    104448 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 62004 MiB
End job on node124 at 2017-07-21 23:40:13