Trace number 4243113

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
R1: cosoco 1.1? (TO) 2400.01 2400.21

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h375-04.xml
MD5SUM64333456646456b433c0ccf5da59df06
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark20.1682
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":375},{"degree":2,"count":525}]
Minimum constraint arity525
Maximum constraint arity900
Distribution of constraint arities[{"arity":525,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.04	c root propagations     : 4839        
0.00/0.04	c restarts enabled, print stats at every restarts
0.00/0.04	c
0.00/0.04	c
0.00/0.04	c
0.00/0.04	c This is cosoco 1.0 --  
0.00/0.04	c
0.00/0.04	c ========================================[ Problem Statistics ]===========================================
0.00/0.04	c |                                                                                                       
0.00/0.04	c |  Parse time        :         0.01 s 
0.00/0.04	c |
0.00/0.04	c |               Variables: 900
0.00/0.04	c |            Domain Sizes: 30..30
0.00/0.04	c |
0.00/0.04	c |             Constraints: 585
0.00/0.04	c |                   Arity: 1..30  -- Unary: 525
0.00/0.04	c | 
0.00/0.04	c |                   Types: 
0.00/0.04	c |                          All Different: 60
0.00/0.04	c |                          Unary: 525
0.00/0.04	c |                          
0.00/0.04	c =========================================================================================================
0.00/0.04	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.09/0.12	c 101            974            15363          48649          895            0              605   693   620
0.09/0.19	c 211            2116           27934          101241         895            0              180   691   636
0.19/0.27	c 332            3436           42949          170592         895            0              451   705   661
0.29/0.36	c 465            4975           60606          238746         895            0              615   676   638
0.39/0.42	c 611            6162           71590          284132         895            0              553   680   621
0.49/0.51	c 771            7667           87316          343797         895            0              566   694   667
0.59/0.62	c 947            9289           108157         430834         895            0              597   694   669
0.69/0.77	c 1140           11299          136744         555313         895            0              595   696   665
0.79/0.89	c 1352           13070          157499         644408         895            0              574   676   640
0.99/1.05	c 1585           15273          187395         786886         895            0              560   725   686
1.10/1.15	c 1841           17006          207059         878411         895            0              554   708   667
1.29/1.30	c 2122           18962          234528         1003965        895            0              577   692   668
1.49/1.50	c 2431           20941          269304         1162110        895            0              545   687   660
1.69/1.72	c 2770           23371          309144         1353062        895            0              589   713   680
1.89/1.93	c 3142           25753          348581         1552146        895            0              592   703   678
2.09/2.14	c 3551           28753          386734         1741264        895            0              612   724   691
2.30/2.31	c 4000           31006          416529         1905937        895            0              615   720   697
2.59/2.62	c 4493           33761          473981         2187791        895            0              603   713   686
2.89/2.91	c 5035           36678          525700         2440759        895            0              639   728   690
3.19/3.27	c 5631           40501          590886         2780349        895            0              556   722   685
3.59/3.64	c 6286           44046          657629         3106696        895            0              560   718   682
3.99/4.06	c 7006           49291          733796         3457973        895            0              558   739   688
4.50/4.50	c 7798           53881          814992         3857014        895            0              564   737   693
4.99/5.08	c 8669           59486          918603         4377985        895            0              616   734   693
5.50/5.52	c 9627           63760          998063         4792813        895            0              584   712   686
5.89/5.96	c 10680          68785          1077933        5181008        895            0              562   698   665
6.49/6.56	c 11838          74732          1185728        5743503        895            0              614   705   677
7.29/7.38	c 13111          83143          1333406        6421797        895            0              595   731   680
8.19/8.27	c 14511          90593          1492020        7171001        895            0              543   735   696
8.99/9.06	c 16051          98455          1635509        7848528        895            0              546   731   690
9.79/9.84	c 17745          105813         1776727        8529842        895            0              545   705   675
10.69/10.75	c 19608          113599         1939234        9331020        895            0              549   713   683
11.69/11.71	c 21657          123242         2112650        10255114       895            0              549   723   682
12.69/12.77	c 23910          132622         2303766        11218167       895            0              567   708   676
14.30/14.40	c 26388          147138         2598649        12577294       895            0              555   707   673
15.89/15.99	c 29113          161490         2886916        13955350       895            0              572   739   702
17.49/17.50	c 32110          175862         3158083        15285597       895            0              572   707   681
19.80/19.81	c 35406          194113         3575290        17297126       895            0              570   728   689
21.69/21.78	c 39031          213208         3927926        19070247       895            0              571   694   661
23.39/23.43	c 43018          230213         4226394        20556867       895            0              551   742   701
25.49/25.55	c 47403          253080         4608955        22539267       895            0              556   737   706
27.79/27.89	c 52226          275461         5028093        24673547       895            0              567   704   661
30.89/30.95	c 57531          304201         5584252        27177772       895            0              544   721   681
33.79/33.83	c 63366          328928         6104303        29828402       895            0              559   731   695
36.99/37.03	c 69784          356256         6674305        32688480       895            0              549   705   668
40.38/40.49	c 76843          389868         7297931        35734251       895            0              577   714   673
43.99/44.08	c 84607          423380         7948953        38978931       895            0              615   719   679
48.18/48.27	c 93147          464097         8702614        43177734       895            0              608   738   709
52.89/52.93	c 102541         514656         9547105        47487158       895            0              579   737   688
58.39/58.41	c 112874         562485         10535684       52550084       895            0              588   724   683
64.68/64.72	c 124240         623445         11676355       58213405       895            0              547   750   703
71.38/71.46	c 136742         686365         12893255       64039851       895            0              545   729   689
78.19/78.25	c 150494         759168         14124794       69711330       895            0              546   736   679
84.98/85.02	c 165621         815972         15347227       76112638       895            0              545   742   692
92.39/92.48	c 182260         903156         16709587       82609333       895            0              544   736   683
101.38/101.42	c 200562         977763         18303922       90830761       895            0              562   717   669
111.38/111.47	c 220694         1065541        20118504       99377407       895            0              561   710   668
124.78/124.84	c 242839         1177667        22523566       112058559      895            0              563   738   684
144.68/144.71	c 267198         1314950        26064301       129847796      895            0              562   731   676
158.38/158.47	c 293992         1445349        28548994       142867098      895            0              546   730   688
171.68/171.71	c 323465         1569061        30918160       154781192      895            0              546   738   687
188.08/188.17	c 355885         1702946        33851199       169897479      895            0              561   713   665
203.67/203.74	c 391547         1852815        36646359       184497342      895            0              545   716   665
221.67/221.77	c 430775         2035873        39925927       200404085      895            0              545   736   686
245.47/245.58	c 473925         2225461        44198748       221958113      895            0              546   738   681
268.06/268.11	c 521390         2423758        48270150       242876714      895            0              545   741   702
299.76/299.89	c 573601         2617887        53944979       270219109      895            0              543   740   696
326.56/326.70	c 631033         2861485        58805418       293863185      895            0              545   723   678
358.26/358.36	c 694208         3161919        64529755       320396718      895            0              546   720   668
397.06/397.11	c 763700         3470792        71456349       357097839      895            0              549   742   690
446.45/446.56	c 840141         3839757        80315530       402911309      895            0              546   738   686
493.75/493.83	c 924226         4229101        88826163       445508475      895            0              546   726   682
546.65/546.80	c 1016719        4637415        98403544       494799705      895            0              548   771   713
602.74/602.89	c 1118461        5047815        108455590      546997709      895            0              552   714   670
669.94/670.07	c 1230377        5587587        120442829      608673116      895            0              544   735   683
732.43/732.56	c 1353484        6205068        131780296      665228895      895            0              552   731   684
813.72/813.89	c 1488901        6859323        146430960      740550044      895            0              554   765   693
902.31/902.45	c 1637859        7650104        162337094      824043959      895            0              557   749   699
977.61/977.78	c 1801712        8422662        175996015      888595042      895            0              549   734   679
1069.30/1069.46	c 1981950        9402692        192630550      967826114      895            0              540   735   683
1155.09/1155.28	c 2180211        10288875       208264541      1044863444     895            0              539   724   662
1274.79/1274.99	c 2398298        11261826       229856793      1153460876     895            0              538   746   686
1389.47/1389.68	c 2638193        12495453       250770592      1248525345     895            0              542   734   662
1527.66/1527.82	c 2902077        13775833       275498744      1376856777     895            0              538   738   673
1672.25/1672.45	c 3192349        15149435       301671888      1509029737     895            0              539   748   681
1819.64/1819.81	c 3511648        16739434       328469883      1647772069     895            0              542   740   681
2016.62/2016.84	c 3862876        18980872       364542452      1818786696     895            0              543   764   692
2197.51/2197.71	c 4249226        21221977       397575080      1977903409     895            0              539   752   687

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4243113-1500670780/watcher-4243113-1500670780 -o /tmp/evaluation-result-4243113-1500670780/solver-4243113-1500670780 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node102-1500668255-12114 --watchdog 2560 HOME/cosoco -lc -model -restarts HOME/instance-4243113-1500670780.xml 

pid=13706
running on 8 cores: 1,3,5,7,9,11,13,15

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 1.97 2.00 1.95 4/242 13709
/proc/meminfo: memFree=31453088/32770624 swapFree=5912/223044
[pid=13709] ppid=13706 vsize=28044 CPUtime=0 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 1240 0 0 0 0 0 0 0 20 0 1 0 2348090 28717056 1064 33554432000 4194304 5970956 140721175362592 140721175359240 5451784 0 0 4096 0 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 7011 1064 715 434 0 375 0

[startup+0.100144 s]
/proc/loadavg: 1.97 2.00 1.95 4/242 13709
/proc/meminfo: memFree=31453088/32770624 swapFree=5912/223044
[pid=13709] ppid=13706 vsize=31752 CPUtime=0.09 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 2206 0 0 0 9 0 0 0 20 0 1 0 2348090 32514048 1988 33554432000 4194304 5970956 140721175362592 140721175359288 4970607 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 7938 1988 767 434 0 1302 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 31752

[startup+0.2003 s]
/proc/loadavg: 1.97 2.00 1.95 4/242 13709
/proc/meminfo: memFree=31453088/32770624 swapFree=5912/223044
[pid=13709] ppid=13706 vsize=32544 CPUtime=0.19 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 2395 0 0 0 19 0 0 0 20 0 1 0 2348090 33325056 2186 33554432000 4194304 5970956 140721175362592 140721175359928 5327850 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8136 2186 770 434 0 1500 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 32544

[startup+0.300239 s]
/proc/loadavg: 1.97 2.00 1.95 4/242 13709
/proc/meminfo: memFree=31453088/32770624 swapFree=5912/223044
[pid=13709] ppid=13706 vsize=32676 CPUtime=0.29 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 2438 0 0 0 29 0 0 0 20 0 1 0 2348090 33460224 2252 33554432000 4194304 5970956 140721175362592 140721175359928 4971564 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8169 2252 770 434 0 1533 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 32676

[startup+0.700205 s]
/proc/loadavg: 1.97 2.00 1.95 4/242 13709
/proc/meminfo: memFree=31453088/32770624 swapFree=5912/223044
[pid=13709] ppid=13706 vsize=32808 CPUtime=0.69 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 2458 0 0 0 69 0 0 0 20 0 1 0 2348090 33595392 2252 33554432000 4194304 5970956 140721175362592 140721175359560 4976677 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8202 2252 770 434 0 1566 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 32808

[startup+1.5002 s]
/proc/loadavg: 1.97 2.00 1.95 3/243 13710
/proc/meminfo: memFree=31447516/32770624 swapFree=5912/223044
[pid=13709] ppid=13706 vsize=32808 CPUtime=1.49 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 2466 0 0 0 149 0 0 0 20 0 1 0 2348090 33595392 2252 33554432000 4194304 5970956 140721175362592 140721175359928 4971310 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8202 2252 770 434 0 1566 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 32808

[startup+3.1002 s]
/proc/loadavg: 1.97 2.00 1.95 3/243 13710
/proc/meminfo: memFree=31446516/32770624 swapFree=5912/223044
[pid=13709] ppid=13706 vsize=32808 CPUtime=3.09 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 3922 0 0 0 309 0 0 0 20 0 1 0 2348090 33595392 2309 33554432000 4194304 5970956 140721175362592 140721175359928 4974280 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8202 2309 770 434 0 1566 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 32808

[startup+6.30021 s]
/proc/loadavg: 2.05 2.01 1.96 3/243 13710
/proc/meminfo: memFree=31446516/32770624 swapFree=5912/223044
[pid=13709] ppid=13706 vsize=32808 CPUtime=6.29 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 5381 0 0 0 629 0 0 0 20 0 1 0 2348090 33595392 2315 33554432000 4194304 5970956 140721175362592 140721175359928 4974138 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8202 2315 770 434 0 1566 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 32808

[startup+12.7002 s]
/proc/loadavg: 2.05 2.01 1.96 3/243 13710
/proc/meminfo: memFree=31445640/32770624 swapFree=5912/223044
[pid=13709] ppid=13706 vsize=32808 CPUtime=12.69 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 6846 0 0 0 1269 0 0 0 20 0 1 0 2348090 33595392 2320 33554432000 4194304 5970956 140721175362592 140721175359928 4971775 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8202 2320 770 434 0 1566 0
Current children cumulated CPU time (s) 12.69
Current children cumulated vsize (KiB) 32808

[startup+25.5003 s]
/proc/loadavg: 2.04 2.01 1.96 3/244 13718
/proc/meminfo: memFree=31445024/32770624 swapFree=5912/223116
[pid=13709] ppid=13706 vsize=32940 CPUtime=25.49 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 9783 0 0 0 2549 0 0 0 20 0 1 0 2348090 33730560 2333 33554432000 4194304 5970956 140721175362592 140721175359928 4978176 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2333 770 434 0 1599 0
Current children cumulated CPU time (s) 25.49
Current children cumulated vsize (KiB) 32940

[startup+51.1003 s]
/proc/loadavg: 2.03 2.01 1.96 3/244 13718
/proc/meminfo: memFree=31445096/32770624 swapFree=5912/223140
[pid=13709] ppid=13706 vsize=32940 CPUtime=51.08 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 11265 0 0 0 5108 0 0 0 20 0 1 0 2348090 33730560 2339 33554432000 4194304 5970956 140721175362592 140721175359928 4974138 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2339 770 434 0 1599 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 32940

[startup+102.3 s]
/proc/loadavg: 2.16 2.06 1.98 3/245 13742
/proc/meminfo: memFree=31445068/32770624 swapFree=5912/223228
[pid=13709] ppid=13706 vsize=32940 CPUtime=102.29 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 12745 0 0 0 10229 0 0 0 20 0 1 0 2348090 33730560 2340 33554432000 4194304 5970956 140721175362592 140721175359928 4974124 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2340 770 434 0 1599 0
Current children cumulated CPU time (s) 102.29
Current children cumulated vsize (KiB) 32940

[startup+162.3 s]
/proc/loadavg: 2.06 2.05 1.98 3/245 13743
/proc/meminfo: memFree=31445728/32770624 swapFree=5912/223300
[pid=13709] ppid=13706 vsize=32940 CPUtime=162.27 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 14223 0 0 0 16227 0 0 0 20 0 1 0 2348090 33730560 2341 33554432000 4194304 5970956 140721175362592 140721175359928 4970136 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2341 770 434 0 1599 0
Current children cumulated CPU time (s) 162.27
Current children cumulated vsize (KiB) 32940

[startup+222.308 s]
/proc/loadavg: 2.11 2.07 1.99 3/245 13744
/proc/meminfo: memFree=31445268/32770624 swapFree=5912/223348
[pid=13709] ppid=13706 vsize=32940 CPUtime=222.27 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 15706 0 0 0 22227 0 0 0 20 0 1 0 2348090 33730560 2342 33554432000 4194304 5970956 140721175362592 140721175359928 4971752 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2342 770 434 0 1599 0
Current children cumulated CPU time (s) 222.27
Current children cumulated vsize (KiB) 32940

[startup+282.3 s]
/proc/loadavg: 2.11 2.07 1.99 3/245 13745
/proc/meminfo: memFree=31445636/32770624 swapFree=5912/223392
[pid=13709] ppid=13706 vsize=32940 CPUtime=282.26 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 16171 0 0 0 28226 0 0 0 20 0 1 0 2348090 33730560 2343 33554432000 4194304 5970956 140721175362592 140721175359928 4974720 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2343 770 434 0 1599 0
Current children cumulated CPU time (s) 282.26
Current children cumulated vsize (KiB) 32940

[startup+342.3 s]
/proc/loadavg: 2.04 2.06 1.99 3/244 13746
/proc/meminfo: memFree=31445456/32770624 swapFree=5912/223432
[pid=13709] ppid=13706 vsize=32940 CPUtime=342.26 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 16636 0 0 0 34226 0 0 0 20 0 1 0 2348090 33730560 2344 33554432000 4194304 5970956 140721175362592 140721175359928 4977769 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2344 770 434 0 1599 0
Current children cumulated CPU time (s) 342.26
Current children cumulated vsize (KiB) 32940

[startup+402.3 s]
/proc/loadavg: 2.02 2.05 1.99 3/243 13747
/proc/meminfo: memFree=31445696/32770624 swapFree=5912/223468
[pid=13709] ppid=13706 vsize=32940 CPUtime=402.25 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 17102 0 0 0 40225 0 0 0 20 0 1 0 2348090 33730560 2344 33554432000 4194304 5970956 140721175362592 140721175359928 4970610 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2344 770 434 0 1599 0
Current children cumulated CPU time (s) 402.25
Current children cumulated vsize (KiB) 32940

[startup+462.3 s]
/proc/loadavg: 2.01 2.04 1.99 3/243 13748
/proc/meminfo: memFree=31445820/32770624 swapFree=5912/223500
[pid=13709] ppid=13706 vsize=32940 CPUtime=462.25 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 17567 0 0 0 46225 0 0 0 20 0 1 0 2348090 33730560 2344 33554432000 4194304 5970956 140721175362592 140721175359928 4974128 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2344 770 434 0 1599 0
Current children cumulated CPU time (s) 462.25
Current children cumulated vsize (KiB) 32940

[startup+522.3 s]
/proc/loadavg: 2.18 2.08 2.01 3/242 14225
/proc/meminfo: memFree=31645360/32770624 swapFree=5912/224244
[pid=13709] ppid=13706 vsize=32940 CPUtime=522.24 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 18032 0 0 0 52224 0 0 0 20 0 1 0 2348090 33730560 2344 33554432000 4194304 5970956 140721175362592 140721175359928 4970613 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2344 770 434 0 1599 0
Current children cumulated CPU time (s) 522.24
Current children cumulated vsize (KiB) 32940

[startup+582.3 s]
/proc/loadavg: 2.06 2.07 2.01 3/243 14227
/proc/meminfo: memFree=30614572/32770624 swapFree=5912/224288
[pid=13709] ppid=13706 vsize=32940 CPUtime=582.24 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 18499 0 0 0 58224 0 0 0 20 0 1 0 2348090 33730560 2344 33554432000 4194304 5970956 140721175362592 140721175359928 4976788 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2344 770 434 0 1599 0
Current children cumulated CPU time (s) 582.24
Current children cumulated vsize (KiB) 32940


################
# More data... #
################

[startup+1482.3 s]
/proc/loadavg: 2.00 2.01 2.01 3/243 14256
/proc/meminfo: memFree=30613760/32770624 swapFree=5912/224912
[pid=13709] ppid=13706 vsize=32940 CPUtime=1482.16 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 24451 0 0 0 148216 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4974138 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 1482.16
Current children cumulated vsize (KiB) 32940

[startup+1542.31 s]
/proc/loadavg: 2.00 2.01 2.01 3/243 14258
/proc/meminfo: memFree=30613648/32770624 swapFree=5912/224956
[pid=13709] ppid=13706 vsize=32940 CPUtime=1542.17 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 24919 0 0 0 154217 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4971736 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 1542.17
Current children cumulated vsize (KiB) 32940

[startup+1602.3 s]
/proc/loadavg: 2.05 2.03 2.02 3/243 14259
/proc/meminfo: memFree=30613944/32770624 swapFree=5912/224992
[pid=13709] ppid=13706 vsize=32940 CPUtime=1602.15 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 25175 0 0 0 160215 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4976696 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 1602.15
Current children cumulated vsize (KiB) 32940

[startup+1662.3 s]
/proc/loadavg: 2.02 2.02 2.02 3/243 14260
/proc/meminfo: memFree=30614508/32770624 swapFree=5912/225024
[pid=13709] ppid=13706 vsize=32940 CPUtime=1662.15 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 25425 0 0 0 166215 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4977332 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 1662.15
Current children cumulated vsize (KiB) 32940

[startup+1722.3 s]
/proc/loadavg: 2.01 2.02 2.02 3/243 14262
/proc/meminfo: memFree=30614916/32770624 swapFree=5912/225096
[pid=13709] ppid=13706 vsize=32940 CPUtime=1722.14 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 25897 0 0 0 172214 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4977828 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 1722.14
Current children cumulated vsize (KiB) 32940

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/243 14263
/proc/meminfo: memFree=30615192/32770624 swapFree=5912/225104
[pid=13709] ppid=13706 vsize=32940 CPUtime=1782.14 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 26152 0 0 0 178214 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4970584 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 1782.14
Current children cumulated vsize (KiB) 32940

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.02 3/243 14271
/proc/meminfo: memFree=30614476/32770624 swapFree=5912/225152
[pid=13709] ppid=13706 vsize=32940 CPUtime=1842.14 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 26619 0 0 0 184214 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 5322628 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 1842.14
Current children cumulated vsize (KiB) 32940

[startup+1902.3 s]
/proc/loadavg: 2.05 2.03 2.02 3/243 14272
/proc/meminfo: memFree=30615044/32770624 swapFree=5912/225152
[pid=13709] ppid=13706 vsize=32940 CPUtime=1902.13 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 26883 0 0 0 190213 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4969989 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 1902.13
Current children cumulated vsize (KiB) 32940

[startup+1962.3 s]
/proc/loadavg: 2.02 2.02 2.02 3/243 14273
/proc/meminfo: memFree=30615608/32770624 swapFree=5912/225232
[pid=13709] ppid=13706 vsize=32940 CPUtime=1962.13 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 27142 0 0 0 196213 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4971333 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 1962.13
Current children cumulated vsize (KiB) 32940

[startup+2022.3 s]
/proc/loadavg: 2.01 2.02 2.02 3/243 14274
/proc/meminfo: memFree=30615392/32770624 swapFree=5912/225292
[pid=13709] ppid=13706 vsize=32940 CPUtime=2022.12 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 27609 0 0 0 202212 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4978135 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 2022.12
Current children cumulated vsize (KiB) 32940

[startup+2082.3 s]
/proc/loadavg: 2.04 2.03 2.03 3/243 14275
/proc/meminfo: memFree=30615372/32770624 swapFree=5912/225312
[pid=13709] ppid=13706 vsize=32940 CPUtime=2082.12 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 27867 0 0 0 208212 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4970123 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 2082.12
Current children cumulated vsize (KiB) 32940

[startup+2142.3 s]
/proc/loadavg: 2.06 2.04 2.04 3/243 14276
/proc/meminfo: memFree=30615444/32770624 swapFree=5912/225312
[pid=13709] ppid=13706 vsize=32940 CPUtime=2142.11 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 28125 0 0 0 214211 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4971119 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 2142.11
Current children cumulated vsize (KiB) 32940

[startup+2202.31 s]
/proc/loadavg: 2.02 2.03 2.04 3/243 14277
/proc/meminfo: memFree=30615440/32770624 swapFree=5912/225388
[pid=13709] ppid=13706 vsize=32940 CPUtime=2202.11 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 28592 0 0 0 220211 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4978111 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 2202.11
Current children cumulated vsize (KiB) 32940

[startup+2262.3 s]
/proc/loadavg: 2.01 2.03 2.04 3/243 14278
/proc/meminfo: memFree=30615928/32770624 swapFree=5912/225388
[pid=13709] ppid=13706 vsize=32940 CPUtime=2262.1 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 28844 0 0 0 226210 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4970544 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 2262.1
Current children cumulated vsize (KiB) 32940

[startup+2322.3 s]
/proc/loadavg: 2.00 2.02 2.04 3/243 14279
/proc/meminfo: memFree=30615388/32770624 swapFree=5912/225484
[pid=13709] ppid=13706 vsize=32940 CPUtime=2322.1 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 29094 0 0 0 232210 0 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4971317 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 2322.1
Current children cumulated vsize (KiB) 32940

[startup+2382.3 s]
/proc/loadavg: 2.05 2.03 2.04 3/243 14280
/proc/meminfo: memFree=30613592/32770624 swapFree=5912/225484
[pid=13709] ppid=13706 vsize=32940 CPUtime=2382.1 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 29342 0 0 0 238209 1 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4970000 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 2382.1
Current children cumulated vsize (KiB) 32940



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.2 s]
/proc/loadavg: 2.04 2.03 2.04 3/243 14280
/proc/meminfo: memFree=30613592/32770624 swapFree=5912/225484
[pid=13709] ppid=13706 vsize=32940 CPUtime=2400.01 cores=1,3,5,7,9,11,13,15
/proc/13709/stat : 13709 (cosoco) R 13706 13709 9838 0 -1 4202496 29588 0 0 0 240000 1 0 0 20 0 1 0 2348090 33730560 2346 33554432000 4194304 5970956 140721175362592 140721175359928 4969776 0 0 4096 8405026 0 0 0 17 9 0 0 0 0 0 8070896 8075904 38965248 140721175364801 140721175364931 140721175364931 140721175367630 0
/proc/13709/statm: 8235 2346 770 434 0 1599 0
Current children cumulated CPU time (s) 2400.01
Current children cumulated vsize (KiB) 32940

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 13709 sig 9
??? kill -13709 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2400.21
CPU time (s): 2400.01
CPU user time (s): 2400
CPU system time (s): 0.011999
CPU usage (%): 99.9919
Max. virtual memory (cumulated for all children) (KiB): 32940

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400
system time used= 0.011999
maximum resident set size= 9428
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 29616
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 8
involuntary context switches= 120636

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.74224 second user time and 10.2845 second system time

The end

Launcher Data 

Begin job on node102 at 2017-07-21 22:59:40
IDJOB=4243113
IDBENCH=138951
IDSOLVER=2620
FILE ID=node102/4243113-1500670780
RUNJOBID= node102-1500668255-12114
PBS_JOBID= 20623312
Free space on /tmp= 61884 MiB

SOLVER NAME= cosoco 1.1
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h375-04.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4243113-1500670780/watcher-4243113-1500670780 -o /tmp/evaluation-result-4243113-1500670780/solver-4243113-1500670780 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node102-1500668255-12114 --watchdog 2560  HOME/cosoco -lc -model -restarts HOME/instance-4243113-1500670780.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 8

MD5SUM BENCH= 64333456646456b433c0ccf5da59df06
RANDOM SEED=249940460

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1867.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1867.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2133.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1867.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 5
initial apicid	: 5
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1867.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 21
initial apicid	: 21
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 7
initial apicid	: 7
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.40
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 23
initial apicid	: 23
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31453212 kB
MemAvailable:   31487512 kB
Buffers:           40968 kB
Cached:           301796 kB
SwapCached:            0 kB
Active:           702984 kB
Inactive:         231632 kB
Active(anon):     594968 kB
Inactive(anon):     8588 kB
Active(file):     108016 kB
Inactive(file):   223044 kB
Unevictable:        5912 kB
Mlocked:            5912 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2428 kB
Writeback:             0 kB
AnonPages:        548676 kB
Mapped:            30472 kB
Shmem:              8852 kB
Slab:              71200 kB
SReclaimable:      38148 kB
SUnreclaim:        33052 kB
KernelStack:        4288 kB
PageTables:         6716 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     865240 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    143360 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      136576 kB
DirectMap2M:    33409024 kB

Free space on /tmp at the end= 61884 MiB
End job on node102 at 2017-07-21 23:39:41