Trace number 4268057

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 1.12? (TO) 2520.04 2519.7

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h375-04.xml
MD5SUM64333456646456b433c0ccf5da59df06
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark20.1682
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":375},{"degree":2,"count":525}]
Minimum constraint arity525
Maximum constraint arity900
Distribution of constraint arities[{"arity":525,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 4839        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 1.12 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts HOME/instance-4268057-1502582812.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 585
0.00/0.02	c |                   Arity: 1..30  -- Unary: 525
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 525
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.08	c 101            974            15363          48649          895            0              605   693   620
0.10/0.15	c 211            2116           27934          101241         895            0              180   691   636
0.21/0.23	c 332            3436           42949          170592         895            0              451   705   661
0.30/0.33	c 465            4975           60606          238746         895            0              615   676   638
0.30/0.38	c 611            6162           71590          284132         895            0              553   680   621
0.40/0.47	c 771            7667           87316          343797         895            0              566   694   667
0.50/0.58	c 947            9289           108157         430834         895            0              597   694   669
0.69/0.74	c 1140           11299          136744         555313         895            0              595   696   665
0.79/0.85	c 1352           13070          157499         644408         895            0              574   676   640
1.00/1.01	c 1585           15273          187395         786886         895            0              560   725   686
1.10/1.12	c 1841           17006          207059         878411         895            0              554   708   667
1.19/1.27	c 2122           18962          234528         1003965        895            0              577   692   668
1.39/1.46	c 2431           20941          269304         1162110        895            0              545   687   660
1.63/1.68	c 2770           23371          309144         1353062        895            0              589   713   680
1.89/1.90	c 3142           25753          348581         1552146        895            0              592   703   678
2.10/2.11	c 3551           28753          386734         1741264        895            0              612   724   691
2.19/2.27	c 4000           31006          416529         1905937        895            0              615   720   697
2.49/2.59	c 4493           33761          473981         2187791        895            0              603   713   686
2.79/2.88	c 5035           36678          525700         2440759        895            0              639   728   690
3.19/3.24	c 5631           40501          590886         2780349        895            0              556   722   685
3.59/3.61	c 6286           44046          657629         3106696        895            0              560   718   682
4.00/4.03	c 7006           49291          733796         3457973        895            0              558   739   688
4.39/4.48	c 7798           53881          814992         3857014        895            0              564   737   693
5.00/5.05	c 8669           59486          918603         4377985        895            0              616   734   693
5.49/5.50	c 9627           63760          998063         4792813        895            0              584   712   686
5.89/5.94	c 10680          68785          1077933        5181008        895            0              562   698   665
6.49/6.54	c 11838          74732          1185728        5743503        895            0              614   705   677
7.29/7.37	c 13111          83143          1333406        6421797        895            0              595   731   680
8.19/8.25	c 14511          90593          1492020        7171001        895            0              543   735   696
9.00/9.05	c 16051          98455          1635509        7848528        895            0              546   731   690
9.79/9.83	c 17745          105813         1776727        8529842        895            0              545   705   675
10.69/10.73	c 19608          113599         1939234        9331020        895            0              549   713   683
11.59/11.69	c 21657          123242         2112650        10255114       895            0              549   723   682
12.69/12.74	c 23910          132622         2303766        11218167       895            0              567   708   676
14.29/14.37	c 26388          147138         2598649        12577294       895            0              555   707   673
15.89/15.96	c 29113          161490         2886916        13955350       895            0              572   739   702
17.39/17.45	c 32110          175862         3158083        15285597       895            0              572   707   681
19.69/19.76	c 35406          194113         3575290        17297126       895            0              570   728   689
21.69/21.72	c 39031          213208         3927926        19070247       895            0              571   694   661
23.29/23.36	c 43018          230213         4226394        20556867       895            0              551   742   701
25.39/25.47	c 47403          253080         4608955        22539267       895            0              556   737   706
27.79/27.81	c 52226          275461         5028093        24673547       895            0              567   704   661
30.79/30.86	c 57531          304201         5584252        27177772       895            0              544   721   681
33.69/33.73	c 63366          328928         6104303        29828402       895            0              559   731   695
36.89/36.92	c 69784          356256         6674305        32688480       895            0              549   705   668
40.29/40.37	c 76843          389868         7297931        35734251       895            0              577   714   673
43.89/43.95	c 84607          423380         7948953        38978931       895            0              615   719   679
48.10/48.12	c 93147          464097         8702614        43177734       895            0              608   738   709
52.69/52.76	c 102541         514656         9547105        47487158       895            0              579   737   688
58.19/58.23	c 112874         562485         10535684       52550084       895            0              588   724   683
64.49/64.51	c 124240         623445         11676355       58213405       895            0              547   750   703
71.20/71.21	c 136742         686365         12893255       64039851       895            0              545   729   689
77.90/77.98	c 150494         759168         14124794       69711330       895            0              546   736   679
84.70/84.73	c 165621         815972         15347227       76112638       895            0              545   742   692
92.11/92.16	c 182260         903156         16709587       82609333       895            0              544   736   683
101.01/101.06	c 200562         977763         18303922       90830761       895            0              562   717   669
111.01/111.07	c 220694         1065541        20118504       99377407       895            0              561   710   668
124.30/124.37	c 242839         1177667        22523566       112058559      895            0              563   738   684
144.11/144.16	c 267198         1314950        26064301       129847796      895            0              562   731   676
157.81/157.85	c 293992         1445349        28548994       142867098      895            0              546   730   688
171.02/171.05	c 323465         1569061        30918160       154781192      895            0              546   738   687
187.41/187.45	c 355885         1702946        33851199       169897479      895            0              561   713   665
202.91/202.98	c 391547         1852815        36646359       184497342      895            0              545   716   665
221.02/221.02	c 430775         2035873        39925927       200404085      895            0              545   736   686
244.82/244.85	c 473925         2225461        44198748       221958113      895            0              546   738   681
267.32/267.38	c 521390         2423758        48270150       242876714      895            0              545   741   702
299.13/299.18	c 573601         2617887        53944979       270219109      895            0              543   740   696
325.93/325.98	c 631033         2861485        58805418       293863185      895            0              545   723   678
357.73/357.70	c 694208         3161919        64529755       320396718      895            0              546   720   668
396.44/396.43	c 763700         3470792        71456349       357097839      895            0              549   742   690
445.85/445.89	c 840141         3839757        80315530       402911309      895            0              546   738   686
493.16/493.17	c 924226         4229101        88826163       445508475      895            0              546   726   682
546.07/546.04	c 1016719        4637415        98403544       494799705      895            0              548   771   713
602.18/602.11	c 1118461        5047815        108455590      546997709      895            0              552   714   670
669.18/669.19	c 1230377        5587587        120442829      608673116      895            0              544   735   683
731.68/731.65	c 1353484        6205068        131780296      665228895      895            0              552   731   684
813.00/812.92	c 1488901        6859323        146430960      740550044      895            0              554   765   693
901.41/901.36	c 1637859        7650104        162337094      824043959      895            0              557   749   699
976.82/976.74	c 1801712        8422662        175996015      888595042      895            0              549   734   679
1068.63/1068.58	c 1981950        9402692        192630550      967826114      895            0              540   735   683
1154.54/1154.48	c 2180211        10288875       208264541      1044863444     895            0              539   724   662
1274.16/1274.05	c 2398298        11261826       229856793      1153460876     895            0              538   746   686
1388.97/1388.88	c 2638193        12495453       250770592      1248525345     895            0              542   734   662
1527.09/1526.93	c 2902077        13775833       275498744      1376856777     895            0              538   738   673
1671.71/1671.59	c 3192349        15149435       301671888      1509029737     895            0              539   748   681
1819.13/1818.95	c 3511648        16739434       328469883      1647772069     895            0              542   740   681
2016.26/2016.03	c 3862876        18980872       364542452      1818786696     895            0              543   764   692
2196.89/2196.69	c 4249226        21221977       397575080      1977903409     895            0              539   752   687
2401.11/2400.87	c 4674211        23574249       434731150      2153700904     895            0              540   737   672
2520.03/2519.70	
2520.03/2519.70	c *** INTERRUPTED ***
2520.03/2519.70	c restarts              : 89          
2520.03/2519.70	c conflicts             : 4888943      (1940 /sec)
2520.03/2519.70	c decisions             : 24691659     (9798 /sec)
2520.03/2519.70	c propagations          : 2261634661  (897465 /sec)
2520.03/2519.70	c root propagations     : 4839        
2520.03/2519.70	c filter calls          : 456265233      (181056 /sec)
2520.03/2519.70	c useless filter calls  : 123957171      (27 %)
2520.03/2519.70	c Memory used           : 32.18 MB
2520.03/2519.70	c CPU time              : 2520.03 s
2520.03/2519.70	
2520.03/2519.70	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13555 MiB free)
  memory of node 1: 16384 MiB (14684 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4268057-1502582812/watcher-4268057-1502582812 -o /tmp/evaluation-result-4268057-1502582812/solver-4268057-1502582812 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1502576806-1302 --watchdog 2580 cosoco -lc -model -restarts HOME/instance-4268057-1502582812.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=2088, runsolver pid=2084

[startup+0.100151 s]*
/proc/loadavg: 2.08 2.03 2.05 3/188 2089
/proc/meminfo: memFree=28911984/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32416 memory=8780 CPUtime=0.1 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 2393 0 0 0 10 0 0 0 20 0 1 0 91362101 33193984 2195 33554432000 4194304 5972588 140724264679280 140724264676504 4979162 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8104 2195 774 435 0 1467 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32416 KiB
Current children cumulated memory: 8780 KiB

[startup+0.209605 s]*
/proc/loadavg: 2.08 2.03 2.05 3/188 2089
/proc/meminfo: memFree=28910992/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32680 memory=9044 CPUtime=0.21 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 2442 0 0 0 21 0 0 0 20 0 1 0 91362101 33464320 2261 33554432000 4194304 5972588 140724264679280 140724264676504 5099648 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8170 2261 774 435 0 1533 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32680 KiB
Current children cumulated memory: 9044 KiB

[startup+0.309061 s]*
/proc/loadavg: 2.08 2.03 2.05 3/188 2089
/proc/meminfo: memFree=28910620/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32680 memory=9044 CPUtime=0.3 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 2447 0 0 0 30 0 0 0 20 0 1 0 91362101 33464320 2261 33554432000 4194304 5972588 140724264679280 140724264676504 4972728 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8170 2261 774 435 0 1533 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 32680 KiB
Current children cumulated memory: 9044 KiB

[startup+0.700269 s]
/proc/loadavg: 2.08 2.03 2.05 3/188 2089
/proc/meminfo: memFree=28909140/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32812 memory=9044 CPUtime=0.69 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 2466 0 0 0 69 0 0 0 20 0 1 0 91362101 33599488 2261 33554432000 4194304 5972588 140724264679280 140724264676216 4972046 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8203 2261 774 435 0 1566 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 32812 KiB
Current children cumulated memory: 9044 KiB

[startup+1.50025 s]
/proc/loadavg: 2.08 2.03 2.05 3/188 2089
/proc/meminfo: memFree=28906452/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32812 memory=9044 CPUtime=1.49 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 2474 0 0 0 149 0 0 0 20 0 1 0 91362101 33599488 2261 33554432000 4194304 5972588 140724264679280 140724264676216 4975444 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8203 2261 774 435 0 1566 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 32812 KiB
Current children cumulated memory: 9044 KiB

[startup+3.10904 s]
/proc/loadavg: 2.08 2.03 2.05 3/188 2089
/proc/meminfo: memFree=28895244/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32812 memory=9256 CPUtime=3.1 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 3926 0 0 0 310 0 0 0 20 0 1 0 91362101 33599488 2314 33554432000 4194304 5972588 140724264679280 140724264676584 4978062 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8203 2314 774 435 0 1566 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 32812 KiB
Current children cumulated memory: 9256 KiB

[startup+6.30027 s]
/proc/loadavg: 2.08 2.03 2.05 3/188 2089
/proc/meminfo: memFree=28844032/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32812 memory=9280 CPUtime=6.29 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 5389 0 0 0 629 0 0 0 20 0 1 0 91362101 33599488 2320 33554432000 4194304 5972588 140724264679280 140724264676584 4972741 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8203 2320 774 435 0 1566 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 32812 KiB
Current children cumulated memory: 9280 KiB

[startup+12.7002 s]
/proc/loadavg: 2.06 2.03 2.05 3/192 2109
/proc/meminfo: memFree=28923556/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32812 memory=9300 CPUtime=12.69 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 6855 0 0 0 1269 0 0 0 20 0 1 0 91362101 33599488 2325 33554432000 4194304 5972588 140724264679280 140724264676584 4972057 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8203 2325 774 435 0 1566 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 32812 KiB
Current children cumulated memory: 9300 KiB

[startup+25.5001 s]
/proc/loadavg: 2.05 2.03 2.05 3/188 2150
/proc/meminfo: memFree=28925212/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9348 CPUtime=25.49 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 7773 0 0 0 2549 0 0 0 20 0 1 0 91362101 33734656 2337 33554432000 4194304 5972588 140724264679280 140724264676584 5323316 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2337 774 435 0 1599 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9348 KiB

[startup+51.109 s]
/proc/loadavg: 2.04 2.03 2.05 3/188 2150
/proc/meminfo: memFree=28925416/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9372 CPUtime=51.1 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 8243 0 0 0 5110 0 0 0 20 0 1 0 91362101 33734656 2343 33554432000 4194304 5972588 140724264679280 140724264676584 5099648 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2343 774 435 0 1599 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9372 KiB

[startup+102.3 s]
/proc/loadavg: 2.07 2.04 2.05 3/188 2151
/proc/meminfo: memFree=28924416/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9376 CPUtime=102.3 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 8711 0 0 0 10230 0 0 0 20 0 1 0 91362101 33734656 2344 33554432000 4194304 5972588 140724264679280 140724264676584 4979170 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2344 774 435 0 1599 0
Current children cumulated CPU time: 102.3 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9376 KiB

[startup+162.3 s]
/proc/loadavg: 2.06 2.04 2.05 3/187 2153
/proc/meminfo: memFree=28924492/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9380 CPUtime=162.31 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 9177 0 0 0 16231 0 0 0 20 0 1 0 91362101 33734656 2345 33554432000 4194304 5972588 140724264679280 140724264676584 4975275 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2345 774 435 0 1599 0
Current children cumulated CPU time: 162.31 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9380 KiB

[startup+222.3 s]
/proc/loadavg: 2.14 2.07 2.05 3/187 2154
/proc/meminfo: memFree=28924424/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9384 CPUtime=222.32 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 9648 0 0 0 22232 0 0 0 20 0 1 0 91362101 33734656 2346 33554432000 4194304 5972588 140724264679280 140724264676584 4975644 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2346 774 435 0 1599 0
Current children cumulated CPU time: 222.32 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9384 KiB

[startup+282.3 s]
/proc/loadavg: 2.12 2.08 2.06 3/187 2155
/proc/meminfo: memFree=28924960/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9384 CPUtime=282.32 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 9649 0 0 0 28232 0 0 0 20 0 1 0 91362101 33734656 2346 33554432000 4194304 5972588 140724264679280 140724264676584 4975213 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2346 774 435 0 1599 0
Current children cumulated CPU time: 282.32 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9384 KiB

[startup+342.3 s]
/proc/loadavg: 2.11 2.08 2.06 3/187 2157
/proc/meminfo: memFree=28924460/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9392 CPUtime=342.33 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 10117 0 0 0 34233 0 0 0 20 0 1 0 91362101 33734656 2348 33554432000 4194304 5972588 140724264679280 140724264676584 4970752 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2348 774 435 0 1599 0
Current children cumulated CPU time: 342.33 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9392 KiB

[startup+402.3 s]
/proc/loadavg: 2.04 2.07 2.05 3/187 2158
/proc/meminfo: memFree=28924212/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9392 CPUtime=402.34 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 10119 0 0 0 40234 0 0 0 20 0 1 0 91362101 33734656 2348 33554432000 4194304 5972588 140724264679280 140724264676584 4975391 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2348 774 435 0 1599 0
Current children cumulated CPU time: 402.34 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9392 KiB

[startup+462.3 s]
/proc/loadavg: 2.02 2.06 2.05 3/187 2166
/proc/meminfo: memFree=28923996/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9392 CPUtime=462.35 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 10588 0 0 0 46235 0 0 0 20 0 1 0 91362101 33734656 2348 33554432000 4194304 5972588 140724264679280 140724264676584 4978055 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2348 774 435 0 1599 0
Current children cumulated CPU time: 462.35 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9392 KiB


################
# More data... #
################

/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 1782.52 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB

[startup+1842.3 s]
/proc/loadavg: 2.03 2.08 2.07 3/188 2234
/proc/meminfo: memFree=28923028/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9400 CPUtime=1842.53 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 15762 0 0 0 184253 0 0 0 20 0 1 0 91362101 33734656 2350 33554432000 4194304 5972588 140724264679280 140724264676584 4975647 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 1842.53 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB

[startup+1902.3 s]
/proc/loadavg: 2.01 2.07 2.06 3/188 2235
/proc/meminfo: memFree=28923040/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9400 CPUtime=1902.54 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 16011 0 0 0 190254 0 0 0 20 0 1 0 91362101 33734656 2350 33554432000 4194304 5972588 140724264679280 140724264676584 4978058 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 1902.54 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.05 2.06 3/188 2237
/proc/meminfo: memFree=28923004/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9400 CPUtime=1962.55 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 16012 0 0 0 196255 0 0 0 20 0 1 0 91362101 33734656 2350 33554432000 4194304 5972588 140724264679280 140724264676584 4972754 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 1962.55 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/187 2238
/proc/meminfo: memFree=28923260/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9400 CPUtime=2022.56 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 16482 0 0 0 202256 0 0 0 20 0 1 0 91362101 33734656 2350 33554432000 4194304 5972588 140724264679280 140724264676584 4975104 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 2022.56 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB

[startup+2082.3 s]
/proc/loadavg: 2.07 2.05 2.05 3/187 2239
/proc/meminfo: memFree=28923244/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9400 CPUtime=2082.56 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 16482 0 0 0 208256 0 0 0 20 0 1 0 91362101 33734656 2350 33554432000 4194304 5972588 140724264679280 140724264676584 4972280 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 2082.56 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB

[startup+2142.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/187 2241
/proc/meminfo: memFree=28922732/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9400 CPUtime=2142.58 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 16722 0 0 0 214257 1 0 0 20 0 1 0 91362101 33734656 2350 33554432000 4194304 5972588 140724264679280 140724264676584 4971544 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 2142.58 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.04 2.05 3/187 2242
/proc/meminfo: memFree=28922228/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9400 CPUtime=2202.59 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 16951 0 0 0 220258 1 0 0 20 0 1 0 91362101 33734656 2350 33554432000 4194304 5972588 140724264679280 140724264676584 4972728 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 2202.59 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/188 2251
/proc/meminfo: memFree=28921556/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9400 CPUtime=2262.6 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 17188 0 0 0 226259 1 0 0 20 0 1 0 91362101 33734656 2350 33554432000 4194304 5972588 140724264679280 140724264676584 4972754 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 2262.6 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/188 2252
/proc/meminfo: memFree=28921900/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9400 CPUtime=2322.6 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 17188 0 0 0 232259 1 0 0 20 0 1 0 91362101 33734656 2350 33554432000 4194304 5972588 140724264679280 140724264676584 4972203 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 2322.6 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/189 2254
/proc/meminfo: memFree=28922020/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9400 CPUtime=2382.61 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 17419 0 0 0 238260 1 0 0 20 0 1 0 91362101 33734656 2350 33554432000 4194304 5972588 140724264679280 140724264676584 4975792 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 2382.61 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 2255
/proc/meminfo: memFree=28921848/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9400 CPUtime=2442.62 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 17659 0 0 0 244261 1 0 0 20 0 1 0 91362101 33734656 2350 33554432000 4194304 5972588 140724264679280 140724264676584 4971573 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 2442.62 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 2256
/proc/meminfo: memFree=28921724/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9400 CPUtime=2502.63 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 17895 0 0 0 250262 1 0 0 20 0 1 0 91362101 33734656 2350 33554432000 4194304 5972588 140724264679280 140724264676584 4975584 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 2502.63 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.7 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 2256
/proc/meminfo: memFree=28921724/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9400 CPUtime=2520.03 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 17895 0 0 0 252002 1 0 0 20 0 1 0 91362101 33734656 2350 33554432000 4194304 5972588 140724264679280 140724264676584 4977685 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 2520.03 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.7 s]
# the end of solver process 2088 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.03 s, system=0.011001 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.7 s]
/proc/loadavg: 2.00 2.01 2.05 3/189 2256
/proc/meminfo: memFree=28921724/32770624 swapFree=67108860/67108860
[pid=2088] ppid=2084 vsize=32944 memory=9400 CPUtime=2520.03 cores=1,3,5,7
/proc/2088/stat : 2088 (cosoco) R 2084 2088 1270 0 -1 4202496 17895 0 0 0 252002 1 0 0 20 0 1 0 91362101 33734656 2350 33554432000 4194304 5972588 140724264679280 140724264676584 4977685 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8070896 8075904 18288640 140724264682687 140724264682782 140724264682782 140724264685518 0
/proc/2088/statm: 8236 2350 774 435 0 1599 0
Current children cumulated CPU time: 2520.03 s
Current children cumulated vsize: 32944 KiB
Current children cumulated memory: 9400 KiB

Child status: 1
Real time (s): 2519.7
CPU time (s): 2520.04
CPU user time (s): 2520.03
CPU system time (s): 0.011001
CPU usage (%): 100.013
Max. virtual memory (cumulated for all children) (KiB): 32944
Max. memory (cumulated for all children) (KiB): 9400

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.03
system time used= 0.011001
maximum resident set size= 9476
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 17948
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 688


# summary of solver processes directly reported to runsolver:
#   pid: 2088
#   total CPU time (s): 2520.04
#   total CPU user time (s): 2520.03
#   total CPU system time (s): 0.011001

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.76257 second user time and 15.8211 second system time

The end

Launcher Data 

Begin job on node151 at 2017-08-13 01:52:33
IDJOB=4268057
IDBENCH=138951
IDSOLVER=2658
FILE ID=node151/4268057-1502582812
RUNJOBID= node151-1502576806-1302
PBS_JOBID= 20628292
Free space on /tmp= 61752 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h375-04.xml
COMMAND LINE= cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4268057-1502582812/watcher-4268057-1502582812 -o /tmp/evaluation-result-4268057-1502582812/solver-4268057-1502582812 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node151-1502576806-1302 --watchdog 2580  cosoco -lc -model -restarts HOME/instance-4268057-1502582812.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 64333456646456b433c0ccf5da59df06
RANDOM SEED=1071859743

node151.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.95
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28918496 kB
MemAvailable:   31976840 kB
Buffers:          212416 kB
Cached:          3138552 kB
SwapCached:            0 kB
Active:           853420 kB
Inactive:        2567928 kB
Active(anon):      72992 kB
Inactive(anon):    25044 kB
Active(file):     780428 kB
Inactive(file):  2542884 kB
Unevictable:        7024 kB
Mlocked:            7024 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              5068 kB
Writeback:             0 kB
AnonPages:         65144 kB
Mapped:            44596 kB
Shmem:             25224 kB
Slab:             128460 kB
SReclaimable:     101736 kB
SUnreclaim:        26724 kB
KernelStack:        3344 kB
PageTables:         5244 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     369140 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:      6144 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      114048 kB
DirectMap2M:    33431552 kB

Free space on /tmp at the end= 61752 MiB
End job on node151 at 2017-08-13 02:34:33