Trace number 4268056

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 1.12? (TO) 2520.01 2519.8

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-15.xml
MD5SUMfdd30079817c8a7e676a6353b2e6ebba
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark7.1181402
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 4928        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 1.12 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts HOME/instance-4268056-1502584299.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 586
0.00/0.02	c |                   Arity: 1..30  -- Unary: 526
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 526
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.09	c 101            1132           16913          50412          890            0              623   660   633
0.10/0.15	c 211            2752           28623          91567          890            0              321   412   382
0.21/0.27	c 332            5787           53801          175501         890            0              315   666   606
0.31/0.34	c 465            7076           66320          226641         890            0              547   670   635
0.31/0.40	c 611            8460           77514          274159         890            0              510   560   547
0.41/0.48	c 771            9871           92302          338562         890            0              429   654   618
0.51/0.57	c 947            11421          108929         405749         890            0              472   699   657
0.60/0.67	c 1140           12764          126800         481937         890            0              493   702   660
0.69/0.79	c 1352           14469          149589         574857         890            0              499   700   659
0.79/0.87	c 1585           15908          165659         644183         890            0              516   668   617
0.89/0.94	c 1841           17428          177756         699209         890            0              517   619   584
1.00/1.07	c 2122           19226          201936         800467         890            0              521   668   632
1.19/1.26	c 2431           21422          235798         959971         890            0              502   708   672
1.39/1.49	c 2770           24148          278403         1135002        890            0              522   731   677
1.69/1.75	c 3142           26901          326675         1377425        890            0              526   730   692
2.00/2.06	c 3551           29081          380442         1649377        890            0              538   704   684
2.39/2.45	c 4000           31993          451139         2000086        890            0              539   717   686
2.79/2.80	c 4493           35692          515405         2320303        890            0              529   727   694
3.10/3.11	c 5035           38516          570809         2589929        890            0              539   713   680
3.49/3.51	c 5631           42630          642832         2911129        890            0              544   710   676
3.89/3.91	c 6286           47037          715107         3267707        890            0              549   708   662
4.39/4.44	c 7006           51189          808954         3763218        890            0              561   732   694
5.00/5.04	c 7798           55676          917033         4327501        890            0              584   718   684
5.39/5.48	c 8669           60148          996364         4725436        890            0              588   691   669
5.89/5.95	c 9627           66144          1080057        5075771        890            0              567   705   626
6.49/6.57	c 10680          73767          1193311        5604228        890            0              559   730   686
7.10/7.15	c 11838          80549          1298514        6137776        890            0              566   716   684
7.79/7.82	c 13111          86841          1420110        6723514        890            0              584   714   689
8.59/8.66	c 14511          94719          1572517        7470770        890            0              612   723   690
9.29/9.38	c 16051          103825         1705565        8156609        890            0              669   734   699
10.39/10.40	c 17745          112595         1890831        9081209        890            0              646   711   685
11.19/11.27	c 19608          122893         2051095        9819595        890            0              595   691   661
12.49/12.54	c 21657          133233         2280286        11022413       890            0              586   707   678
14.00/14.10	c 23910          143169         2557096        12560492       890            0              645   708   677
15.39/15.47	c 26388          158125         2808450        13734095       890            0              584   715   676
16.79/16.82	c 29113          171752         3055767        15060842       890            0              540   754   718
18.39/18.46	c 32110          187148         3352850        16561710       890            0              589   718   686
20.39/20.44	c 35406          204227         3711869        18504626       890            0              564   739   700
22.29/22.33	c 39031          222822         4055209        20265312       890            0              562   738   694
24.00/24.04	c 43018          238572         4363927        22094245       890            0              619   699   674
26.19/26.29	c 47403          257080         4764505        24290506       890            0              553   718   684
29.19/29.20	c 52226          284894         5292859        27118751       890            0              592   759   713
32.19/32.25	c 57531          309945         5844123        29915740       890            0              573   723   681
35.00/35.08	c 63366          341978         6360445        32527862       890            0              559   732   673
38.39/38.48	c 69784          372044         6982121        35627949       890            0              613   738   692
42.10/42.11	c 76843          412572         7642784        38838835       890            0              622   730   676
47.19/47.25	c 84607          453917         8570677        43953012       890            0              586   742   702
51.39/51.47	c 93147          501804         9344965        47714772       890            0              542   745   695
56.10/56.11	c 102541         551116         10186103       52119261       890            0              578   747   700
62.29/62.32	c 112874         606731         11313521       57785504       890            0              640   726   681
68.29/68.36	c 124240         663581         12408631       63662305       890            0              642   750   700
75.00/75.07	c 136742         726490         13629819       70118748       890            0              591   731   692
82.49/82.50	c 150494         797237         14977106       77260243       890            0              637   734   690
89.60/89.65	c 165621         868756         16292802       84243443       890            0              581   740   706
98.80/98.82	c 182260         946457         17952220       92780803       890            0              585   720   685
108.50/108.59	c 200562         1058955        19749041       101617090      890            0              614   747   703
121.11/121.14	c 220694         1165851        22012281       113828766      890            0              582   761   714
133.90/133.97	c 242839         1293674        24350773       125984809      890            0              567   754   699
148.80/148.81	c 267198         1425669        27081037       139433284      890            0              603   743   700
165.30/165.37	c 293992         1561090        30055111       156431275      890            0              590   757   705
183.30/183.33	c 323465         1688888        33288990       172698007      890            0              629   722   681
199.50/199.57	c 355885         1843100        36222647       188024625      890            0              612   723   672
218.71/218.73	c 391547         2002973        39665828       207650504      890            0              643   732   688
241.91/241.98	c 430775         2183858        43852569       229661973      890            0              588   742   695
260.91/260.93	c 473925         2356958        47305382       248953089      890            0              570   740   699
288.51/288.55	c 521390         2558479        52289603       275502745      890            0              642   741   695
320.21/320.25	c 573601         2805178        58007502       305113392      890            0              600   744   692
352.32/352.32	c 631033         3099684        63882374       335641369      890            0              541   753   710
382.13/382.13	c 694208         3438133        69351167       363478119      890            0              595   746   700
421.32/421.34	c 763700         3833461        76538272       398740973      890            0              583   757   689
455.93/455.95	c 840141         4171833        82761807       435054012      890            0              598   729   683
513.33/513.31	c 924226         4592941        93000192       489745965      890            0              593   749   685
567.63/567.69	c 1016719        5071446        102828137      538704860      890            0              603   753   689
621.24/621.23	c 1118461        5652976        112550366      589738248      890            0              561   760   703
675.24/675.22	c 1230377        6189304        122300441      643807029      890            0              591   751   700
751.16/751.11	c 1353484        6838111        136120223      717839787      890            0              636   755   695
822.46/822.47	c 1488901        7561114        149053691      781731325      890            0              606   749   693
909.07/909.03	c 1637859        8293966        164684988      868165456      890            0              591   746   692
994.77/994.79	c 1801712        9126126        180319571      945951894      890            0              580   751   698
1093.78/1093.74	c 1981950        10078738       198398413      1037891686     890            0              583   750   684
1184.29/1184.27	c 2180211        11068536       214852364      1122532748     890            0              559   748   678
1282.39/1282.32	c 2398298        12139140       232875721      1211937830     890            0              592   765   710
1422.11/1422.05	c 2638193        13280682       258040619      1346099627     890            0              585   756   704
1578.52/1578.44	c 2902077        14861499       286810510      1492280655     890            0              639   762   712
1699.13/1699.02	c 3192349        16082532       308858541      1613384706     890            0              561   752   696
1855.45/1855.33	c 3511648        17627949       337293023      1759610570     890            0              583   759   695
2038.76/2038.64	c 3862876        19246407       370464455      1940767511     890            0              590   749   697
2229.58/2229.44	c 4249226        21134531       405044345      2129935082     890            0              568   771   703
2450.60/2450.43	c 4674211        22959814       444931410      2364702101     890            0              576   771   704
2520.00/2519.80	
2520.00/2519.80	c *** INTERRUPTED ***
2520.00/2519.80	c restarts              : 89          
2520.00/2519.80	c conflicts             : 4791465      (1901 /sec)
2520.00/2519.80	c decisions             : 23492842     (9323 /sec)
2520.00/2519.80	c propagations          : 2431653716  (964942 /sec)
2520.00/2519.80	c root propagations     : 4928        
2520.00/2519.80	c filter calls          : 457501681      (181548 /sec)
2520.00/2519.80	c useless filter calls  : 121938095      (26 %)
2520.00/2519.80	c Memory used           : 32.32 MB
2520.00/2519.80	c CPU time              : 2520 s
2520.00/2519.80	
2520.00/2519.80	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13799 MiB free)
  memory of node 1: 16384 MiB (14093 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4268056-1502584299/watcher-4268056-1502584299 -o /tmp/evaluation-result-4268056-1502584299/solver-4268056-1502584299 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node148-1502574286-2987 --watchdog 2580 cosoco -lc -model -restarts HOME/instance-4268056-1502584299.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=3906, runsolver pid=3903

[startup+0.100156 s]*
/proc/loadavg: 2.00 2.00 2.04 3/187 3907
/proc/meminfo: memFree=28557152/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=32140 memory=8512 CPUtime=0.1 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 2303 0 0 0 10 0 0 0 20 0 1 0 91510973 32911360 2128 33554432000 4194304 5972588 140727412140720 140727412137368 4971573 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8035 2128 772 435 0 1398 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32140 KiB
Current children cumulated memory: 8512 KiB

[startup+0.209578 s]*
/proc/loadavg: 2.00 2.00 2.04 3/187 3907
/proc/meminfo: memFree=28556780/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=32668 memory=9040 CPUtime=0.21 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 2429 0 0 0 21 0 0 0 20 0 1 0 91510973 33452032 2260 33554432000 4194304 5972588 140727412140720 140727412137368 4972741 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8167 2260 774 435 0 1530 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32668 KiB
Current children cumulated memory: 9040 KiB

[startup+0.308824 s]*
/proc/loadavg: 2.00 2.00 2.04 3/187 3907
/proc/meminfo: memFree=28556408/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=32800 memory=9040 CPUtime=0.31 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 2465 0 0 0 31 0 0 0 20 0 1 0 91510973 33587200 2260 33554432000 4194304 5972588 140727412140720 140727412137368 4972365 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8200 2260 774 435 0 1563 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32800 KiB
Current children cumulated memory: 9040 KiB

[startup+0.70027 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 3907
/proc/meminfo: memFree=28556036/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=32956 memory=9304 CPUtime=0.69 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 2495 0 0 0 69 0 0 0 20 0 1 0 91510973 33746944 2326 33554432000 4194304 5972588 140727412140720 140727412137368 4978804 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8239 2326 774 435 0 1602 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 32956 KiB
Current children cumulated memory: 9304 KiB

[startup+1.50027 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 3907
/proc/meminfo: memFree=28556036/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=32956 memory=9304 CPUtime=1.49 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 2499 0 0 0 149 0 0 0 20 0 1 0 91510973 33746944 2326 33554432000 4194304 5972588 140727412140720 140727412137368 5323925 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8239 2326 774 435 0 1602 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 32956 KiB
Current children cumulated memory: 9304 KiB

[startup+3.10894 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 3907
/proc/meminfo: memFree=28555640/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=32956 memory=9352 CPUtime=3.1 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 3967 0 0 0 310 0 0 0 20 0 1 0 91510973 33746944 2338 33554432000 4194304 5972588 140727412140720 140727412138024 4979114 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8239 2338 774 435 0 1602 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 32956 KiB
Current children cumulated memory: 9352 KiB

[startup+6.30026 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 3907
/proc/meminfo: memFree=28555972/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=32956 memory=9384 CPUtime=6.29 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 5455 0 0 0 629 0 0 0 20 0 1 0 91510973 33746944 2346 33554432000 4194304 5972588 140727412140720 140727412138024 4972926 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8239 2346 774 435 0 1602 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 32956 KiB
Current children cumulated memory: 9384 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 3907
/proc/meminfo: memFree=28555720/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=32956 memory=9400 CPUtime=12.69 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 5933 0 0 0 1269 0 0 0 20 0 1 0 91510973 33746944 2350 33554432000 4194304 5972588 140727412140720 140727412138024 5328561 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8239 2350 774 435 0 1602 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 32956 KiB
Current children cumulated memory: 9400 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 3907
/proc/meminfo: memFree=28555844/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=32956 memory=9440 CPUtime=25.49 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 6891 0 0 0 2549 0 0 0 20 0 1 0 91510973 33746944 2360 33554432000 4194304 5972588 140727412140720 140727412138024 4977727 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8239 2360 774 435 0 1602 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 32956 KiB
Current children cumulated memory: 9440 KiB

[startup+51.1089 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 3907
/proc/meminfo: memFree=28556148/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=32956 memory=9444 CPUtime=51.1 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 7375 0 0 0 5110 0 0 0 20 0 1 0 91510973 33746944 2361 33554432000 4194304 5972588 140727412140720 140727412138024 4971920 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8239 2361 774 435 0 1602 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 32956 KiB
Current children cumulated memory: 9444 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 3908
/proc/meminfo: memFree=28556016/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=32956 memory=9448 CPUtime=102.3 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 7863 0 0 0 10230 0 0 0 20 0 1 0 91510973 33746944 2362 33554432000 4194304 5972588 140727412140720 140727412138024 5094096 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8239 2362 774 435 0 1602 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 32956 KiB
Current children cumulated memory: 9448 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 3917
/proc/meminfo: memFree=28555388/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=32956 memory=9460 CPUtime=162.3 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 8351 0 0 0 16230 0 0 0 20 0 1 0 91510973 33746944 2365 33554432000 4194304 5972588 140727412140720 140727412138024 4977672 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8239 2365 774 435 0 1602 0
Current children cumulated CPU time: 162.3 s
Current children cumulated vsize: 32956 KiB
Current children cumulated memory: 9460 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 3918
/proc/meminfo: memFree=28555720/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9468 CPUtime=222.31 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 8839 0 0 0 22231 0 0 0 20 0 1 0 91510973 33882112 2367 33554432000 4194304 5972588 140727412140720 140727412138024 4975104 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2367 774 435 0 1635 0
Current children cumulated CPU time: 222.31 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9468 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 3919
/proc/meminfo: memFree=28555928/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9468 CPUtime=282.31 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 8841 0 0 0 28231 0 0 0 20 0 1 0 91510973 33882112 2367 33554432000 4194304 5972588 140727412140720 140727412138024 4975616 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2367 774 435 0 1635 0
Current children cumulated CPU time: 282.31 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9468 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 3920
/proc/meminfo: memFree=28555432/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9468 CPUtime=342.32 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 9326 0 0 0 34232 0 0 0 20 0 1 0 91510973 33882112 2367 33554432000 4194304 5972588 140727412140720 140727412138024 4970752 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2367 774 435 0 1635 0
Current children cumulated CPU time: 342.32 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9468 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 3921
/proc/meminfo: memFree=28555672/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9468 CPUtime=402.32 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 9329 0 0 0 40232 0 0 0 20 0 1 0 91510973 33882112 2367 33554432000 4194304 5972588 140727412140720 140727412138024 4979111 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2367 774 435 0 1635 0
Current children cumulated CPU time: 402.32 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9468 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 3923
/proc/meminfo: memFree=28555128/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9472 CPUtime=462.33 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 9813 0 0 0 46233 0 0 0 20 0 1 0 91510973 33882112 2368 33554432000 4194304 5972588 140727412140720 140727412138024 4979546 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2368 774 435 0 1635 0
Current children cumulated CPU time: 462.33 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9472 KiB


################
# More data... #
################

/proc/3906/statm: 8272 2371 774 435 0 1635 0
Current children cumulated CPU time: 1722.44 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9484 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 3962
/proc/meminfo: memFree=28554440/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9484 CPUtime=1782.44 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 14885 0 0 0 178243 1 0 0 20 0 1 0 91510973 33882112 2371 33554432000 4194304 5972588 140727412140720 140727412138024 4977719 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2371 774 435 0 1635 0
Current children cumulated CPU time: 1782.44 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9484 KiB

[startup+1842.3 s]
/proc/loadavg: 1.96 1.99 2.03 3/187 4023
/proc/meminfo: memFree=17234788/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9484 CPUtime=1842.45 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 14889 0 0 0 184244 1 0 0 20 0 1 0 91510973 33882112 2371 33554432000 4194304 5972588 140727412140720 140727412138024 4978839 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2371 774 435 0 1635 0
Current children cumulated CPU time: 1842.45 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9484 KiB

[startup+1902.3 s]
/proc/loadavg: 1.99 1.99 2.03 3/187 4024
/proc/meminfo: memFree=17232628/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9488 CPUtime=1902.45 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 15362 0 0 0 190244 1 0 0 20 0 1 0 91510973 33882112 2372 33554432000 4194304 5972588 140727412140720 140727412138024 4978790 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2372 774 435 0 1635 0
Current children cumulated CPU time: 1902.45 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9488 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 4033
/proc/meminfo: memFree=17230348/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9488 CPUtime=1962.46 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 15364 0 0 0 196245 1 0 0 20 0 1 0 91510973 33882112 2372 33554432000 4194304 5972588 140727412140720 140727412138024 4977707 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2372 774 435 0 1635 0
Current children cumulated CPU time: 1962.46 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9488 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 4034
/proc/meminfo: memFree=17230384/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9488 CPUtime=2022.46 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 15578 0 0 0 202245 1 0 0 20 0 1 0 91510973 33882112 2372 33554432000 4194304 5972588 140727412140720 140727412138024 4975303 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2372 774 435 0 1635 0
Current children cumulated CPU time: 2022.46 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9488 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 4035
/proc/meminfo: memFree=17230044/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9488 CPUtime=2082.47 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 15848 0 0 0 208246 1 0 0 20 0 1 0 91510973 33882112 2372 33554432000 4194304 5972588 140727412140720 140727412138024 4977727 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2372 774 435 0 1635 0
Current children cumulated CPU time: 2082.47 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9488 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 4036
/proc/meminfo: memFree=17229364/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9488 CPUtime=2142.47 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 16083 0 0 0 214246 1 0 0 20 0 1 0 91510973 33882112 2372 33554432000 4194304 5972588 140727412140720 140727412138024 4977734 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2372 774 435 0 1635 0
Current children cumulated CPU time: 2142.47 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9488 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/188 4037
/proc/meminfo: memFree=17228552/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9488 CPUtime=2202.48 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 16088 0 0 0 220247 1 0 0 20 0 1 0 91510973 33882112 2372 33554432000 4194304 5972588 140727412140720 140727412138024 4978055 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2372 774 435 0 1635 0
Current children cumulated CPU time: 2202.48 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9488 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 4039
/proc/meminfo: memFree=17227612/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9488 CPUtime=2262.48 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 16572 0 0 0 226247 1 0 0 20 0 1 0 91510973 33882112 2372 33554432000 4194304 5972588 140727412140720 140727412138024 4978730 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2372 774 435 0 1635 0
Current children cumulated CPU time: 2262.48 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9488 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 4040
/proc/meminfo: memFree=17227992/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9488 CPUtime=2322.49 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 16572 0 0 0 232248 1 0 0 20 0 1 0 91510973 33882112 2372 33554432000 4194304 5972588 140727412140720 140727412138024 4975114 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2372 774 435 0 1635 0
Current children cumulated CPU time: 2322.49 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9488 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 4041
/proc/meminfo: memFree=17227076/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9488 CPUtime=2382.49 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 16803 0 0 0 238248 1 0 0 20 0 1 0 91510973 33882112 2372 33554432000 4194304 5972588 140727412140720 140727412138024 5334121 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2372 774 435 0 1635 0
Current children cumulated CPU time: 2382.49 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9488 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 4043
/proc/meminfo: memFree=17226288/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9488 CPUtime=2442.5 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 16803 0 0 0 244249 1 0 0 20 0 1 0 91510973 33882112 2372 33554432000 4194304 5972588 140727412140720 140727412138024 4975784 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2372 774 435 0 1635 0
Current children cumulated CPU time: 2442.5 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9488 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 4044
/proc/meminfo: memFree=17227140/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9488 CPUtime=2502.5 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 17291 0 0 0 250249 1 0 0 20 0 1 0 91510973 33882112 2372 33554432000 4194304 5972588 140727412140720 140727412138024 4971573 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2372 774 435 0 1635 0
Current children cumulated CPU time: 2502.5 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9488 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.8 s]
/proc/loadavg: 2.00 1.99 2.03 3/187 4045
/proc/meminfo: memFree=17226860/32770624 swapFree=67108860/67108860
[pid=3906] ppid=3903 vsize=33088 memory=9488 CPUtime=2520 cores=1,3,5,7
/proc/3906/stat : 3906 (cosoco) R 3903 3906 2954 0 -1 4202496 17291 0 0 0 251999 1 0 0 20 0 1 0 91510973 33882112 2372 33554432000 4194304 5972588 140727412140720 140727412138024 4975605 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 41521152 140727412147391 140727412147486 140727412147486 140727412150222 0
/proc/3906/statm: 8272 2372 774 435 0 1635 0
Current children cumulated CPU time: 2520 s
Current children cumulated vsize: 33088 KiB
Current children cumulated memory: 9488 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.8 s]
# the end of solver process 3906 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520 s, system=0.012001 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2519.8
CPU time (s): 2520.01
CPU user time (s): 2520
CPU system time (s): 0.012001
CPU usage (%): 100.008
Max. virtual memory (cumulated for all children) (KiB): 33088
Max. memory (cumulated for all children) (KiB): 9488

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520
system time used= 0.012001
maximum resident set size= 9564
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17344
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 12
involuntary context switches= 657


# summary of solver processes directly reported to runsolver:
#   pid: 3906
#   total CPU time (s): 2520.01
#   total CPU user time (s): 2520
#   total CPU system time (s): 0.012001

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.9178 second user time and 15.7016 second system time

The end

Launcher Data 

Begin job on node148 at 2017-08-13 02:17:21
IDJOB=4268056
IDBENCH=138969
IDSOLVER=2658
FILE ID=node148/4268056-1502584299
RUNJOBID= node148-1502574286-2987
PBS_JOBID= 20628291
Free space on /tmp= 61616 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-15.xml
COMMAND LINE= cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4268056-1502584299/watcher-4268056-1502584299 -o /tmp/evaluation-result-4268056-1502584299/solver-4268056-1502584299 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node148-1502574286-2987 --watchdog 2580  cosoco -lc -model -restarts HOME/instance-4268056-1502584299.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= fdd30079817c8a7e676a6353b2e6ebba
RANDOM SEED=273651651

node148.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.19
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.19
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.19
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.19
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28562360 kB
MemAvailable:   31987332 kB
Buffers:          213800 kB
Cached:          3501852 kB
SwapCached:            0 kB
Active:           754276 kB
Inactive:        3020248 kB
Active(anon):      62088 kB
Inactive(anon):    25092 kB
Active(file):     692188 kB
Inactive(file):  2995156 kB
Unevictable:        6208 kB
Mlocked:            6208 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2336 kB
Writeback:             0 kB
AnonPages:         65448 kB
Mapped:            44216 kB
Shmem:             25224 kB
Slab:             133000 kB
SReclaimable:     106928 kB
SUnreclaim:        26072 kB
KernelStack:        3360 kB
PageTables:         5168 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     357568 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     10240 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      126336 kB
DirectMap2M:    33419264 kB

Free space on /tmp at the end= 61612 MiB
End job on node148 at 2017-08-13 02:59:21