Trace number 4268059

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 1.12? (TO) 2520.05 2519.7

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h375-17.xml
MD5SUM946d300933e85b0b5e5d11b6e9e445b0
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark5.0790401
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":375},{"degree":2,"count":525}]
Minimum constraint arity525
Maximum constraint arity900
Distribution of constraint arities[{"arity":525,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 4831        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 1.12 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts HOME/instance-4268059-1502582825.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 585
0.00/0.02	c |                   Arity: 1..30  -- Unary: 525
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 525
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.08	c 101            1049           14366          45541          898            0              590   660   641
0.10/0.15	c 211            2151           28245          106041         898            0              415   688   657
0.21/0.23	c 332            3483           41846          165452         898            0              498   689   643
0.21/0.29	c 465            4823           55017          214352         898            0              546   675   609
0.31/0.40	c 611            6502           75259          307812         898            0              577   716   669
0.41/0.46	c 771            7857           86412          345167         898            0              595   677   656
0.51/0.55	c 947            9249           103198         418305         898            0              557   670   622
0.60/0.69	c 1140           10851          127658         538015         898            0              560   714   673
0.79/0.80	c 1352           12778          148533         631344         898            0              534   720   682
0.89/0.91	c 1585           14503          168890         720441         898            0              573   701   668
1.00/1.06	c 1841           16657          197474         840094         898            0              579   721   662
1.19/1.20	c 2122           18682          222018         944433         898            0              559   709   651
1.29/1.32	c 2431           20590          244784         1032245        898            0              550   608   594
1.49/1.53	c 2770           22896          281919         1223934        898            0              565   728   684
1.69/1.73	c 3142           25827          319307         1422063        898            0              575   730   705
2.00/2.02	c 3551           28380          370355         1694378        898            0              618   716   686
2.10/2.19	c 4000           31226          402453         1845681        898            0              585   710   674
2.49/2.51	c 4493           34833          460801         2144464        898            0              652   722   695
2.69/2.74	c 5035           38536          503072         2329745        898            0              608   707   675
3.00/3.07	c 5631           42540          563980         2628440        898            0              594   763   714
3.39/3.41	c 6286           47101          626834         2923410        898            0              601   724   683
3.69/3.79	c 7006           51070          694075         3235530        898            0              575   714   675
4.10/4.11	c 7798           54435          752518         3514686        898            0              552   683   619
4.49/4.54	c 8669           59634          831596         3886261        898            0              552   748   695
5.00/5.05	c 9627           64260          922497         4319384        898            0              572   736   682
5.49/5.50	c 10680          69630          1005101        4701496        898            0              548   657   621
5.89/5.95	c 11838          75065          1087335        5109211        898            0              571   733   696
6.49/6.54	c 13111          83095          1194819        5575362        898            0              579   717   672
7.19/7.25	c 14511          90414          1324347        6252593        898            0              595   734   701
7.89/7.95	c 16051          98301          1450905        7022929        898            0              578   744   709
8.69/8.75	c 17745          106929         1595670        7759400        898            0              606   730   685
9.69/9.77	c 19608          119100         1780210        8678601        898            0              561   727   690
10.79/10.85	c 21657          129533         1976073        9666359        898            0              565   729   696
12.29/12.37	c 23910          143282         2247150        11279788       898            0              573   749   705
13.39/13.41	c 26388          153486         2431540        12281258       898            0              564   680   657
14.29/14.39	c 29113          164416         2612658        13167720       898            0              596   730   699
16.19/16.21	c 32110          178343         2935689        14835095       898            0              584   713   685
17.59/17.66	c 35406          193202         3196728        16148242       898            0              587   723   684
19.39/19.40	c 39031          213535         3516778        17552915       898            0              629   734   693
21.10/21.18	c 43018          230393         3836169        19264885       898            0              568   722   674
23.49/23.51	c 47403          253893         4251323        21358675       898            0              584   731   664
25.89/25.97	c 52226          274820         4690257        23638318       898            0              546   721   686
28.59/28.68	c 57531          298502         5178963        26425311       898            0              549   754   717
30.89/30.94	c 63366          320544         5588207        28422859       898            0              603   706   671
34.49/34.55	c 69784          350321         6238624        31678912       898            0              565   736   688
37.49/37.52	c 76843          375608         6774145        34495478       898            0              557   722   683
40.89/40.98	c 84607          407664         7397424        37640467       898            0              555   711   674
45.10/45.17	c 93147          448746         8151544        41154998       898            0              555   722   653
50.19/50.29	c 102541         495420         9082926        45935473       898            0              561   752   692
55.29/55.30	c 112874         542020         9981302        50906378       898            0              561   745   708
61.70/61.73	c 124240         590836         11138556       56980793       898            0              561   731   695
67.80/67.82	c 136742         658876         12256676       62510359       898            0              564   722   686
74.40/74.48	c 150494         716382         13457450       68643636       898            0              575   732   699
83.30/83.37	c 165621         786382         15047536       76629376       898            0              595   746   688
91.40/91.46	c 182260         859649         16504313       84493780       898            0              591   729   680
101.80/101.83	c 200562         962305         18383143       94087763       898            0              616   756   700
113.50/113.53	c 220694         1059569        20496247       104621658      898            0              585   736   695
124.11/124.17	c 242839         1153252        22424892       115364147      898            0              588   754   703
134.40/134.42	c 267198         1272793        24313392       125556580      898            0              571   742   699
147.41/147.40	c 293992         1391188        26672263       136935494      898            0              583   715   667
163.41/163.45	c 323465         1540075        29574700       151836613      898            0              587   726   682
177.61/177.65	c 355885         1690120        32158116       164576820      898            0              611   718   677
196.31/196.32	c 391547         1871912        35557885       181243385      898            0              564   733   688
217.62/217.63	c 430775         2047849        39408272       201919525      898            0              572   732   690
241.52/241.52	c 473925         2248501        43700287       222707172      898            0              569   726   674
267.13/267.17	c 521390         2485033        48319959       245863166      898            0              571   735   671
289.83/289.84	c 573601         2729053        52408661       266131664      898            0              555   722   675
324.33/324.36	c 631033         3062316        58671362       299625592      898            0              554   764   703
359.63/359.62	c 694208         3371659        65020225       333488335      898            0              602   745   690
396.74/396.75	c 763700         3702792        71748080       367018946      898            0              558   735   682
440.15/440.16	c 840141         4140566        79679991       403292912      898            0              558   745   679
483.55/483.52	c 924226         4541832        87527100       443461084      898            0              556   745   703
535.76/535.75	c 1016719        5091384        96991442       488821747      898            0              556   756   694
574.47/574.42	c 1118461        5460563        104023968      526675297      898            0              578   743   694
633.58/633.55	c 1230377        5939414        114677873      583230869      898            0              571   729   688
690.69/690.65	c 1353484        6505384        125034870      637049036      898            0              588   750   697
757.80/757.78	c 1488901        7010095        137023694      704185950      898            0              585   718   670
835.51/835.46	c 1637859        7695375        151052840      779519465      898            0              586   752   698
902.62/902.58	c 1801712        8365237        163257656      837972447      898            0              585   747   692
997.73/997.60	c 1981950        9018411        180139833      930196951      898            0              579   737   688
1092.55/1092.48	c 2180211        9764883        197158069      1021268513     898            0              552   722   680
1202.86/1202.72	c 2398298        10735039       217109545      1130083512     898            0              581   739   692
1316.18/1316.05	c 2638193        11807730       237496651      1244339047     898            0              561   742   681
1454.70/1454.52	c 2902077        12915442       262271691      1376738809     898            0              558   731   685
1603.12/1602.98	c 3192349        14419782       289171359      1511862394     898            0              566   734   682
1772.84/1772.61	c 3511648        15976261       319839083      1670489620     898            0              602   736   683
1924.37/1924.15	c 3862876        17577034       347602447      1812538678     898            0              556   761   708
2113.09/2112.86	c 4249226        19262272       381500699      1990914969     898            0              623   722   674
2323.12/2322.84	c 4674211        21564032       419762627      2180009799     898            0              596   746   686
2520.05/2519.70	
2520.05/2519.70	c *** INTERRUPTED ***
2520.05/2519.70	c restarts              : 89          
2520.05/2519.70	c conflicts             : 5043122      (2001 /sec)
2520.05/2519.70	c decisions             : 23245475     (9224 /sec)
2520.05/2519.70	c propagations          : 2377022004  (943247 /sec)
2520.05/2519.70	c root propagations     : 4831        
2520.05/2519.70	c filter calls          : 455176902      (180623 /sec)
2520.05/2519.70	c useless filter calls  : 120296697      (26 %)
2520.05/2519.70	c Memory used           : 32.17 MB
2520.05/2519.70	c CPU time              : 2520.04 s
2520.05/2519.70	
2520.05/2519.70	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13574 MiB free)
  memory of node 1: 16384 MiB (14677 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4268059-1502582825/watcher-4268059-1502582825 -o /tmp/evaluation-result-4268059-1502582825/solver-4268059-1502582825 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1502576806-1301 --watchdog 2580 cosoco -lc -model -restarts HOME/instance-4268059-1502582825.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=2149, runsolver pid=2146

[startup+0.100145 s]*
/proc/loadavg: 2.06 2.03 2.05 3/188 2150
/proc/meminfo: memFree=28925060/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32540 memory=8780 CPUtime=0.1 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 2406 0 0 0 10 0 0 0 20 0 1 0 91363450 33320960 2195 33554432000 4194304 5972588 140726851102080 140726851098728 4975117 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8135 2195 774 435 0 1498 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32540 KiB
Current children cumulated memory: 8780 KiB

[startup+0.209651 s]*
/proc/loadavg: 2.06 2.03 2.05 3/188 2150
/proc/meminfo: memFree=28924808/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32672 memory=9044 CPUtime=0.21 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 2443 0 0 0 21 0 0 0 20 0 1 0 91363450 33456128 2261 33554432000 4194304 5972588 140726851102080 140726851099016 4978058 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8168 2261 774 435 0 1531 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32672 KiB
Current children cumulated memory: 9044 KiB

[startup+0.309029 s]*
/proc/loadavg: 2.06 2.03 2.05 3/188 2150
/proc/meminfo: memFree=28924560/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32672 memory=9044 CPUtime=0.31 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 2460 0 0 0 31 0 0 0 20 0 1 0 91363450 33456128 2261 33554432000 4194304 5972588 140726851102080 140726851099016 4978706 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8168 2261 774 435 0 1531 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32672 KiB
Current children cumulated memory: 9044 KiB

[startup+0.700271 s]
/proc/loadavg: 2.06 2.03 2.05 4/188 2150
/proc/meminfo: memFree=28924560/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32804 memory=9044 CPUtime=0.69 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 2475 0 0 0 69 0 0 0 20 0 1 0 91363450 33591296 2261 33554432000 4194304 5972588 140726851102080 140726851099016 4975119 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8201 2261 774 435 0 1564 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 32804 KiB
Current children cumulated memory: 9044 KiB

[startup+1.50027 s]
/proc/loadavg: 2.06 2.03 2.05 3/188 2150
/proc/meminfo: memFree=28924560/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32804 memory=9044 CPUtime=1.49 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 2485 0 0 0 149 0 0 0 20 0 1 0 91363450 33591296 2261 33554432000 4194304 5972588 140726851102080 140726851099016 4978381 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8201 2261 774 435 0 1564 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 32804 KiB
Current children cumulated memory: 9044 KiB

[startup+3.10903 s]
/proc/loadavg: 2.06 2.03 2.05 3/188 2150
/proc/meminfo: memFree=28924808/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32804 memory=9308 CPUtime=3.1 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 3949 0 0 0 310 0 0 0 20 0 1 0 91363450 33591296 2327 33554432000 4194304 5972588 140726851102080 140726851099384 4975792 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8201 2327 774 435 0 1564 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 32804 KiB
Current children cumulated memory: 9308 KiB

[startup+6.30026 s]
/proc/loadavg: 2.06 2.03 2.05 3/188 2150
/proc/meminfo: memFree=28924940/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9332 CPUtime=6.29 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 5423 0 0 0 629 0 0 0 20 0 1 0 91363450 33726464 2333 33554432000 4194304 5972588 140726851102080 140726851099384 4975647 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2333 774 435 0 1597 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9332 KiB

[startup+12.7003 s]
/proc/loadavg: 2.05 2.03 2.05 3/188 2150
/proc/meminfo: memFree=28925212/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9348 CPUtime=12.69 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 6893 0 0 0 1269 0 0 0 20 0 1 0 91363450 33726464 2337 33554432000 4194304 5972588 140726851102080 140726851099384 4975444 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2337 774 435 0 1597 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9348 KiB

[startup+25.5003 s]
/proc/loadavg: 2.04 2.03 2.05 3/188 2150
/proc/meminfo: memFree=28925540/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9372 CPUtime=25.49 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 9831 0 0 0 2549 0 0 0 20 0 1 0 91363450 33726464 2343 33554432000 4194304 5972588 140726851102080 140726851099384 4975680 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2343 774 435 0 1597 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9372 KiB

[startup+51.109 s]
/proc/loadavg: 2.03 2.02 2.05 3/188 2150
/proc/meminfo: memFree=28924548/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9380 CPUtime=51.1 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 11312 0 0 0 5110 0 0 0 20 0 1 0 91363450 33726464 2345 33554432000 4194304 5972588 140726851102080 140726851099384 4977727 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2345 774 435 0 1597 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9380 KiB

[startup+102.3 s]
/proc/loadavg: 2.06 2.04 2.05 3/188 2151
/proc/meminfo: memFree=28924532/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9388 CPUtime=102.3 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 11798 0 0 0 10230 0 0 0 20 0 1 0 91363450 33726464 2347 33554432000 4194304 5972588 140726851102080 140726851099384 4977701 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2347 774 435 0 1597 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9388 KiB

[startup+162.3 s]
/proc/loadavg: 2.05 2.04 2.05 3/187 2153
/proc/meminfo: memFree=28924492/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9392 CPUtime=162.31 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 12285 0 0 0 16231 0 0 0 20 0 1 0 91363450 33726464 2348 33554432000 4194304 5972588 140726851102080 140726851099384 4972617 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2348 774 435 0 1597 0
Current children cumulated CPU time: 162.31 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9392 KiB

[startup+222.3 s]
/proc/loadavg: 2.19 2.08 2.06 3/187 2154
/proc/meminfo: memFree=28924596/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9392 CPUtime=222.32 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 12772 0 0 0 22232 0 0 0 20 0 1 0 91363450 33726464 2348 33554432000 4194304 5972588 140726851102080 140726851099384 4971454 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2348 774 435 0 1597 0
Current children cumulated CPU time: 222.32 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9392 KiB

[startup+282.3 s]
/proc/loadavg: 2.10 2.08 2.06 3/187 2155
/proc/meminfo: memFree=28924960/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9392 CPUtime=282.32 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 12774 0 0 0 28232 0 0 0 20 0 1 0 91363450 33726464 2348 33554432000 4194304 5972588 140726851102080 140726851099384 4975654 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2348 774 435 0 1597 0
Current children cumulated CPU time: 282.32 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9392 KiB

[startup+342.3 s]
/proc/loadavg: 2.10 2.08 2.06 3/187 2157
/proc/meminfo: memFree=28924584/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9396 CPUtime=342.33 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 13257 0 0 0 34233 0 0 0 20 0 1 0 91363450 33726464 2349 33554432000 4194304 5972588 140726851102080 140726851099384 4970781 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2349 774 435 0 1597 0
Current children cumulated CPU time: 342.33 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9396 KiB

[startup+402.3 s]
/proc/loadavg: 2.04 2.07 2.05 3/187 2158
/proc/meminfo: memFree=28924336/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9396 CPUtime=402.34 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 13262 0 0 0 40234 0 0 0 20 0 1 0 91363450 33726464 2349 33554432000 4194304 5972588 140726851102080 140726851099384 4978775 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2349 774 435 0 1597 0
Current children cumulated CPU time: 402.34 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9396 KiB

[startup+462.3 s]
/proc/loadavg: 2.01 2.05 2.05 3/187 2166
/proc/meminfo: memFree=28923996/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9400 CPUtime=462.35 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 13747 0 0 0 46235 0 0 0 20 0 1 0 91363450 33726464 2350 33554432000 4194304 5972588 140726851102080 140726851099384 4972712 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2350 774 435 0 1597 0
Current children cumulated CPU time: 462.35 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9400 KiB


################
# More data... #
################

/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 1782.54 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB

[startup+1842.3 s]
/proc/loadavg: 2.03 2.08 2.07 3/188 2234
/proc/meminfo: memFree=28923152/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9416 CPUtime=1842.55 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 18879 0 0 0 184254 1 0 0 20 0 1 0 91363450 33726464 2354 33554432000 4194304 5972588 140726851102080 140726851099384 4975792 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 1842.55 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.06 2.06 3/188 2235
/proc/meminfo: memFree=28923048/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9416 CPUtime=1902.56 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 19097 0 0 0 190255 1 0 0 20 0 1 0 91363450 33726464 2354 33554432000 4194304 5972588 140726851102080 140726851099384 4972757 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 1902.56 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/188 2237
/proc/meminfo: memFree=28923128/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9416 CPUtime=1962.57 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 19370 0 0 0 196256 1 0 0 20 0 1 0 91363450 33726464 2354 33554432000 4194304 5972588 140726851102080 140726851099384 4978745 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 1962.57 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 2238
/proc/meminfo: memFree=28923508/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9416 CPUtime=2022.58 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 19615 0 0 0 202257 1 0 0 20 0 1 0 91363450 33726464 2354 33554432000 4194304 5972588 140726851102080 140726851099384 4978713 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 2022.58 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB

[startup+2082.3 s]
/proc/loadavg: 2.05 2.05 2.05 3/187 2239
/proc/meminfo: memFree=28923244/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9416 CPUtime=2082.59 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 19619 0 0 0 208258 1 0 0 20 0 1 0 91363450 33726464 2354 33554432000 4194304 5972588 140726851102080 140726851099384 4975305 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 2082.59 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB

[startup+2142.3 s]
/proc/loadavg: 2.02 2.04 2.05 3/187 2241
/proc/meminfo: memFree=28922848/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9416 CPUtime=2142.59 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 20108 0 0 0 214258 1 0 0 20 0 1 0 91363450 33726464 2354 33554432000 4194304 5972588 140726851102080 140726851099384 5328685 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 2142.59 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/187 2242
/proc/meminfo: memFree=28922352/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9416 CPUtime=2202.6 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 20108 0 0 0 220259 1 0 0 20 0 1 0 91363450 33726464 2354 33554432000 4194304 5972588 140726851102080 140726851099384 4978710 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 2202.6 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 2251
/proc/meminfo: memFree=28921556/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9416 CPUtime=2262.61 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 20357 0 0 0 226260 1 0 0 20 0 1 0 91363450 33726464 2354 33554432000 4194304 5972588 140726851102080 140726851099384 4971586 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 2262.61 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 2252
/proc/meminfo: memFree=28921900/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9416 CPUtime=2322.62 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 20358 0 0 0 232261 1 0 0 20 0 1 0 91363450 33726464 2354 33554432000 4194304 5972588 140726851102080 140726851099384 4972741 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 2322.62 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/189 2254
/proc/meminfo: memFree=28922020/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9416 CPUtime=2382.63 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 20837 0 0 0 238262 1 0 0 20 0 1 0 91363450 33726464 2354 33554432000 4194304 5972588 140726851102080 140726851099384 4972783 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 2382.63 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 2255
/proc/meminfo: memFree=28921848/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9416 CPUtime=2442.64 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 20837 0 0 0 244263 1 0 0 20 0 1 0 91363450 33726464 2354 33554432000 4194304 5972588 140726851102080 140726851099384 5094148 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 2442.64 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 2256
/proc/meminfo: memFree=28921724/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9416 CPUtime=2502.64 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 21085 0 0 0 250263 1 0 0 20 0 1 0 91363450 33726464 2354 33554432000 4194304 5972588 140726851102080 140726851099384 5099616 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 2502.64 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.7 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 2318
/proc/meminfo: memFree=20606920/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9416 CPUtime=2520.05 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 21085 0 0 0 252004 1 0 0 20 0 1 0 91363450 33726464 2354 33554432000 4194304 5972588 140726851102080 140726851099384 4975104 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 2520.05 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.7 s]
# the end of solver process 2149 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.04 s, system=0.013001 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.7 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 2318
/proc/meminfo: memFree=20606920/32770624 swapFree=67108860/67108860
[pid=2149] ppid=2146 vsize=32936 memory=9416 CPUtime=2520.05 cores=0,2,4,6
/proc/2149/stat : 2149 (cosoco) R 2146 2149 1270 0 -1 4202496 21085 0 0 0 252004 1 0 0 20 0 1 0 91363450 33726464 2354 33554432000 4194304 5972588 140726851102080 140726851099384 4975104 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8070896 8075904 33439744 140726851110079 140726851110174 140726851110174 140726851112910 0
/proc/2149/statm: 8234 2354 774 435 0 1597 0
Current children cumulated CPU time: 2520.05 s
Current children cumulated vsize: 32936 KiB
Current children cumulated memory: 9416 KiB

Child status: 1
Real time (s): 2519.7
CPU time (s): 2520.05
CPU user time (s): 2520.04
CPU system time (s): 0.013001
CPU usage (%): 100.014
Max. virtual memory (cumulated for all children) (KiB): 32936
Max. memory (cumulated for all children) (KiB): 9416

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.04
system time used= 0.013001
maximum resident set size= 9492
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 21138
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 825


# summary of solver processes directly reported to runsolver:
#   pid: 2149
#   total CPU time (s): 2520.05
#   total CPU user time (s): 2520.04
#   total CPU system time (s): 0.013001

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.30782 second user time and 15.6269 second system time

The end

Launcher Data 

Begin job on node151 at 2017-08-13 01:52:47
IDJOB=4268059
IDBENCH=138962
IDSOLVER=2658
FILE ID=node151/4268059-1502582825
RUNJOBID= node151-1502576806-1301
PBS_JOBID= 20628292
Free space on /tmp= 61752 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h375-17.xml
COMMAND LINE= cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4268059-1502582825/watcher-4268059-1502582825 -o /tmp/evaluation-result-4268059-1502582825/solver-4268059-1502582825 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1502576806-1301 --watchdog 2580  cosoco -lc -model -restarts HOME/instance-4268059-1502582825.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 946d300933e85b0b5e5d11b6e9e445b0
RANDOM SEED=1071859743

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28931164 kB
MemAvailable:   31988864 kB
Buffers:          212476 kB
Cached:          3138196 kB
SwapCached:            0 kB
Active:           842416 kB
Inactive:        2567472 kB
Active(anon):      62192 kB
Inactive(anon):    25044 kB
Active(file):     780224 kB
Inactive(file):  2542428 kB
Unevictable:        7024 kB
Mlocked:            7024 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2136 kB
Writeback:             4 kB
AnonPages:        139476 kB
Mapped:            44632 kB
Shmem:             25224 kB
Slab:             128588 kB
SReclaimable:     101764 kB
SUnreclaim:        26824 kB
KernelStack:        3584 kB
PageTables:         5116 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     358020 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     83968 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      114048 kB
DirectMap2M:    33431552 kB

Free space on /tmp at the end= 61748 MiB
End job on node151 at 2017-08-13 02:34:47