Trace number 4243145

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
R1: cosoco 1.1? (TO) 2400.02 2400.31

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gs/
qwh-o035-h405.xml
MD5SUM3223705abdf773009dcd28d689e47bd8
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark12.0507
Satisfiable
(Un)Satisfiability was proved
Number of variables1225
Number of constraints2
Number of domains1
Minimum domain size35
Maximum domain size35
Distribution of domain sizes[{"size":35,"count":1225}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":405},{"degree":2,"count":820}]
Minimum constraint arity820
Maximum constraint arity1225
Distribution of constraint arities[{"arity":820,"count":1},{"arity":1225,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.07	c root propagations     : 9644        
0.00/0.07	c restarts enabled, print stats at every restarts
0.00/0.07	c
0.00/0.07	c
0.00/0.07	c
0.00/0.07	c This is cosoco 1.0 --  
0.00/0.07	c
0.00/0.07	c ========================================[ Problem Statistics ]===========================================
0.00/0.07	c |                                                                                                       
0.00/0.07	c |  Parse time        :         0.02 s 
0.00/0.07	c |
0.00/0.07	c |               Variables: 1225
0.00/0.07	c |            Domain Sizes: 35..35
0.00/0.07	c |
0.00/0.07	c |             Constraints: 890
0.00/0.07	c |                   Arity: 1..35  -- Unary: 820
0.00/0.07	c | 
0.00/0.07	c |                   Types: 
0.00/0.07	c |                          All Different: 70
0.00/0.07	c |                          Unary: 820
0.00/0.07	c |                          
0.00/0.07	c =========================================================================================================
0.00/0.07	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.19/0.20	c 101            1472           23326          94326          1221           0              926   982   954
0.29/0.30	c 211            3916           40430          154029         1221           0              514   897   762
0.39/0.43	c 332            5975           62853          263451         1221           0              603   892   840
0.49/0.53	c 465            7485           78852          340701         1221           0              770   896   857
0.59/0.61	c 611            9214           93705          404542         1221           0              777   854   811
0.69/0.78	c 771            11080          120730         540330         1221           0              758   937   896
0.79/0.86	c 947            12799          134560         600671         1221           0              817   958   916
0.99/1.01	c 1140           15242          159513         725439         1221           0              757   987   953
1.10/1.16	c 1352           17484          183827         832375         1221           0              822   943   910
1.29/1.35	c 1585           19513          215562         986976         1221           0              816   959   925
1.49/1.59	c 1841           22151          253509         1191121        1221           0              827   1007   955
1.69/1.79	c 2122           24237          286585         1382879        1221           0              869   962   928
1.99/2.00	c 2431           26485          319165         1564950        1221           0              806   985   944
2.30/2.32	c 2770           29794          370137         1837814        1221           0              814   963   927
2.59/2.62	c 3142           32209          419758         2086321        1221           0              820   960   936
2.89/2.99	c 3551           35300          478625         2413924        1221           0              823   957   924
3.30/3.36	c 4000           38467          538184         2727228        1221           0              824   971   931
3.79/3.88	c 4493           42918          621298         3153236        1221           0              828   967   931
4.09/4.12	c 5035           45744          660808         3348405        1221           0              827   1000   969
4.50/4.52	c 5631           49272          723700         3703622        1221           0              801   982   954
4.99/5.02	c 6286           54410          805083         4140473        1221           0              810   1002   962
5.60/5.67	c 7006           58331          903415         4797004        1221           0              836   989   958
6.19/6.23	c 7798           63407          993394         5277817        1221           0              883   992   955
6.59/6.65	c 8669           68852          1062529        5649461        1221           0              875   1007   947
7.28/7.31	c 9627           75157          1169979        6213364        1221           0              883   1011   959
7.88/7.98	c 10680          81549          1276857        6821797        1221           0              895   1002   961
8.89/8.97	c 11838          88536          1435659        7720445        1221           0              875   1018   980
9.68/9.70	c 13111          95816          1553563        8366167        1221           0              868   997   942
10.58/10.68	c 14511          103502         1711019        9250487        1221           0              868   1042   999
11.68/11.71	c 16051          112370         1874576        10116345       1221           0              866   992   952
12.58/12.67	c 17745          122732         2030894        10891484       1221           0              838   1024   961
14.18/14.26	c 19608          136712         2285294        12346049       1221           0              860   1013   969
15.98/16.06	c 21657          149148         2570748        13988021       1221           0              852   1011   949
17.48/17.53	c 23910          165440         2809935        15133666       1221           0              835   1019   950
19.38/19.42	c 26388          183461         3117281        16783328       1221           0              1   1029   988 
22.28/22.34	c 29113          201339         3577737        19395514       1221           0              857   1014   971
24.48/24.56	c 32110          220681         3933271        21410041       1221           0              859   1018   976
27.08/27.10	c 35406          245660         4346316        23417736       1221           0              866   1012   960
29.88/29.99	c 39031          265502         4802612        26094709       1221           0              875   1032   977
32.68/32.78	c 43018          284868         5246445        28887531       1221           0              939   1042   1008
36.48/36.52	c 47403          315557         5848786        32308022       1221           0              887   1039   975
40.08/40.15	c 52226          341794         6430991        35414063       1221           0              885   1002   950
43.38/43.45	c 57531          366541         6953898        38395061       1221           0              884   1028   978
47.68/47.70	c 63366          407371         7636330        41928099       1221           0              911   1026   969
52.38/52.47	c 69784          438052         8388453        46264444       1221           0              897   999   952
57.29/57.33	c 76843          473439         9167812        50702581       1221           0              894   999   947
63.08/63.12	c 84607          522690         10090964       55999273       1221           0              878   1012   952
68.18/68.26	c 93147          563263         10906370       60999686       1221           0              928   1033   985
75.38/75.49	c 102541         608486         12048104       67450536       1221           0              901   1009   964
81.97/82.04	c 112874         656555         13079001       73696227       1221           0              861   1007   959
90.67/90.78	c 124240         727378         14487859       81237708       1221           0              846   1013   964
99.77/99.89	c 136742         795397         15931063       89837966       1221           0              856   1032   978
108.17/108.26	c 150494         873191         17277838       97003958       1221           0              845   1015   952
118.97/119.07	c 165621         979108         19027935       106145647      1221           0              862   1003   943
131.27/131.31	c 182260         1072271        20997747       117035444      1221           0              812   1022   974
148.97/149.08	c 200562         1206153        23814975       132753909      1221           0              859   1039   964
163.56/163.68	c 220694         1326605        26163042       145724679      1221           0              869   1027   961
185.26/185.38	c 242839         1487273        29631329       165385840      1221           0              877   1014   946
200.96/201.06	c 267198         1617334        32143913       179672263      1221           0              858   1039   946
220.86/220.95	c 293992         1802042        35326413       196670783      1221           0              842   1004   932
237.76/237.80	c 323465         1978730        38053157       212314427      1221           0              823   1041   986
258.75/258.88	c 355885         2156191        41441612       231144007      1221           0              833   1048   979
282.95/283.09	c 391547         2334743        45299485       253088152      1221           0              840   1002   941
307.75/307.85	c 430775         2517667        49255806       275108371      1221           0              816   1031   976
339.54/339.60	c 473925         2765269        54344604       302285236      1221           0              854   1006   928
375.15/375.23	c 521390         3092845        60054120       333097428      1221           0              839   1027   935
413.93/414.04	c 573601         3437540        66350358       367363061      1221           0              839   1058   963
447.03/447.19	c 631033         3773639        71708491       395253899      1221           0              833   984   911
490.82/490.92	c 694208         4114023        78678058       433418242      1221           0              809   1009   942
533.82/533.96	c 763700         4475763        85554896       472506505      1221           0              809   1031   974
585.81/585.99	c 840141         4917525        93861026       518575625      1221           0              818   1024   943
646.01/646.15	c 924226         5352621        103401679      574751161      1221           0              830   1026   972
709.00/709.15	c 1016719        5833102        113432936      630750518      1221           0              837   1027   962
777.30/777.40	c 1118461        6308877        124316608      692961656      1221           0              849   1018   963
862.09/862.21	c 1230377        6946952        137864058      768325885      1221           0              848   1019   956
961.68/961.82	c 1353484        7713395        153829719      854288971      1221           0              841   1014   952
1073.36/1073.57	c 1488901        8513714        171551195      951982755      1221           0              857   1020   968
1162.95/1163.10	c 1637859        9113052        185795889      1033673544     1221           0              834   1025   973
1279.04/1279.25	c 1801712        10480812       204817628      1131053789     1221           0              840   1020   943
1411.82/1412.06	c 1981950        11625427       226051948      1245241732     1221           0              859   1014   948
1577.00/1577.27	c 2180211        12937123       252439280      1400459461     1221           0              845   1058   978
1724.08/1724.31	c 2398298        14089279       275942609      1538220963     1221           0              838   1043   981
1896.46/1896.75	c 2638193        15332577       303380103      1698226013     1221           0              855   1051   975
2095.44/2095.70	c 2902077        16773297       335100629      1878444922     1221           0              855   1023   960
2360.81/2361.11	c 3192349        18431918       377215113      2115988929     1221           0              859   1027   968

Verifier Data 

One s line expected

Watcher Data 

runsolver Copyright (C) 2010-2013 Olivier ROUSSEL

This is runsolver version 3.3.7 (svn: 2553)

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4243145-1500670987/watcher-4243145-1500670987 -o /tmp/evaluation-result-4243145-1500670987/solver-4243145-1500670987 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node126-1500648174-2492 --watchdog 2560 HOME/cosoco -lc -model -restarts HOME/instance-4243145-1500670987.xml 

pid=6202
running on 8 cores: 1,3,5,7,9,11,13,15

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Current StackSize limit: 8192 KiB


[startup+0 s]
/proc/loadavg: 1.99 2.05 2.05 3/242 6205
/proc/meminfo: memFree=32022236/32770624 swapFree=5840/224724
[pid=6205] ppid=6202 vsize=27912 CPUtime=0.01 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 1199 0 0 0 1 0 0 0 20 0 1 0 2366496 28581888 999 33554432000 4194304 5970956 140721159426688 140721159426192 140501965892581 0 0 4096 0 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 6978 999 703 434 0 342 0

[startup+0.100128 s]
/proc/loadavg: 1.99 2.05 2.05 3/242 6205
/proc/meminfo: memFree=32022236/32770624 swapFree=5840/224724
[pid=6205] ppid=6202 vsize=36116 CPUtime=0.09 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 3288 0 0 0 9 0 0 0 20 0 1 0 2366496 36982784 3111 33554432000 4194304 5970956 140721159426688 140721159423656 140501965892581 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9029 3111 767 434 0 2393 0
Current children cumulated CPU time (s) 0.09
Current children cumulated vsize (KiB) 36116

[startup+0.200335 s]
/proc/loadavg: 1.99 2.05 2.05 3/242 6205
/proc/meminfo: memFree=32022236/32770624 swapFree=5840/224724
[pid=6205] ppid=6202 vsize=36644 CPUtime=0.19 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 3441 0 0 0 19 0 0 0 20 0 1 0 2366496 37523456 3243 33554432000 4194304 5970956 140721159426688 140721159423384 4976769 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9161 3243 767 434 0 2525 0
Current children cumulated CPU time (s) 0.19
Current children cumulated vsize (KiB) 36644

[startup+0.300215 s]
/proc/loadavg: 1.99 2.05 2.05 3/242 6205
/proc/meminfo: memFree=32022236/32770624 swapFree=5840/224724
[pid=6205] ppid=6202 vsize=37700 CPUtime=0.29 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 3695 0 0 0 29 0 0 0 20 0 1 0 2366496 38604800 3507 33554432000 4194304 5970956 140721159426688 140721159423656 4974128 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9425 3507 770 434 0 2789 0
Current children cumulated CPU time (s) 0.29
Current children cumulated vsize (KiB) 37700

[startup+0.700181 s]
/proc/loadavg: 1.99 2.05 2.05 3/242 6205
/proc/meminfo: memFree=32022236/32770624 swapFree=5840/224724
[pid=6205] ppid=6202 vsize=37968 CPUtime=0.69 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 3772 0 0 0 69 0 0 0 20 0 1 0 2366496 38879232 3573 33554432000 4194304 5970956 140721159426688 140721159424024 4971778 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9492 3573 770 434 0 2856 0
Current children cumulated CPU time (s) 0.69
Current children cumulated vsize (KiB) 37968

[startup+1.50018 s]
/proc/loadavg: 1.99 2.05 2.05 3/243 6206
/proc/meminfo: memFree=32009952/32770624 swapFree=5840/224724
[pid=6205] ppid=6202 vsize=38232 CPUtime=1.49 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 3827 0 0 0 149 0 0 0 20 0 1 0 2366496 39149568 3639 33554432000 4194304 5970956 140721159426688 140721159423656 4974104 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9558 3639 770 434 0 2922 0
Current children cumulated CPU time (s) 1.49
Current children cumulated vsize (KiB) 38232

[startup+3.10018 s]
/proc/loadavg: 1.99 2.05 2.05 3/243 6206
/proc/meminfo: memFree=32009192/32770624 swapFree=5840/224724
[pid=6205] ppid=6202 vsize=38232 CPUtime=3.09 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 6437 0 0 0 309 0 0 0 20 0 1 0 2366496 39149568 3670 33554432000 4194304 5970956 140721159426688 140721159424024 5108512 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9558 3670 770 434 0 2922 0
Current children cumulated CPU time (s) 3.09
Current children cumulated vsize (KiB) 38232

[startup+6.30018 s]
/proc/loadavg: 1.91 2.04 2.04 3/243 6206
/proc/meminfo: memFree=32009224/32770624 swapFree=5840/224724
[pid=6205] ppid=6202 vsize=38232 CPUtime=6.29 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 9056 0 0 0 629 0 0 0 20 0 1 0 2366496 39149568 3675 33554432000 4194304 5970956 140721159426688 140721159424024 4976656 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9558 3675 770 434 0 2922 0
Current children cumulated CPU time (s) 6.29
Current children cumulated vsize (KiB) 38232

[startup+12.7002 s]
/proc/loadavg: 1.92 2.04 2.04 3/243 6206
/proc/meminfo: memFree=32008804/32770624 swapFree=5840/224724
[pid=6205] ppid=6202 vsize=38232 CPUtime=12.68 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 9799 0 0 0 1268 0 0 0 20 0 1 0 2366496 39149568 3680 33554432000 4194304 5970956 140721159426688 140721159424024 4974124 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9558 3680 770 434 0 2922 0
Current children cumulated CPU time (s) 12.68
Current children cumulated vsize (KiB) 38232

[startup+25.5002 s]
/proc/loadavg: 1.94 2.03 2.04 3/243 6206
/proc/meminfo: memFree=32008804/32770624 swapFree=5840/224724
[pid=6205] ppid=6202 vsize=38368 CPUtime=25.48 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 11232 0 0 0 2548 0 0 0 20 0 1 0 2366496 39288832 3689 33554432000 4194304 5970956 140721159426688 140721159424024 4977138 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3689 770 434 0 2956 0
Current children cumulated CPU time (s) 25.48
Current children cumulated vsize (KiB) 38368

[startup+51.1002 s]
/proc/loadavg: 1.96 2.03 2.04 3/243 6206
/proc/meminfo: memFree=32009684/32770624 swapFree=5840/224452
[pid=6205] ppid=6202 vsize=38368 CPUtime=51.08 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 11986 0 0 0 5108 0 0 0 20 0 1 0 2366496 39288832 3690 33554432000 4194304 5970956 140721159426688 140721159424024 4976751 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3690 770 434 0 2956 0
Current children cumulated CPU time (s) 51.08
Current children cumulated vsize (KiB) 38368

[startup+102.3 s]
/proc/loadavg: 1.98 2.03 2.04 3/243 6207
/proc/meminfo: memFree=32009508/32770624 swapFree=5840/224544
[pid=6205] ppid=6202 vsize=38368 CPUtime=102.28 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 12718 0 0 0 10228 0 0 0 20 0 1 0 2366496 39288832 3691 33554432000 4194304 5970956 140721159426688 140721159424024 4976681 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3691 770 434 0 2956 0
Current children cumulated CPU time (s) 102.28
Current children cumulated vsize (KiB) 38368

[startup+162.3 s]
/proc/loadavg: 1.99 2.02 2.04 3/243 6208
/proc/meminfo: memFree=32009360/32770624 swapFree=5840/224608
[pid=6205] ppid=6202 vsize=38368 CPUtime=162.26 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 13437 0 0 0 16226 0 0 0 20 0 1 0 2366496 39288832 3691 33554432000 4194304 5970956 140721159426688 140721159424024 4974321 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3691 770 434 0 2956 0
Current children cumulated CPU time (s) 162.26
Current children cumulated vsize (KiB) 38368

[startup+222.308 s]
/proc/loadavg: 2.04 2.03 2.05 3/243 6209
/proc/meminfo: memFree=32009848/32770624 swapFree=5840/224668
[pid=6205] ppid=6202 vsize=38368 CPUtime=222.26 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 14153 0 0 0 22226 0 0 0 20 0 1 0 2366496 39288832 3691 33554432000 4194304 5970956 140721159426688 140721159424024 4969776 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3691 770 434 0 2956 0
Current children cumulated CPU time (s) 222.26
Current children cumulated vsize (KiB) 38368

[startup+282.3 s]
/proc/loadavg: 2.02 2.03 2.05 3/243 6210
/proc/meminfo: memFree=32009800/32770624 swapFree=5840/224668
[pid=6205] ppid=6202 vsize=38368 CPUtime=282.25 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 14864 0 0 0 28225 0 0 0 20 0 1 0 2366496 39288832 3692 33554432000 4194304 5970956 140721159426688 140721159424024 5338397 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3692 770 434 0 2956 0
Current children cumulated CPU time (s) 282.25
Current children cumulated vsize (KiB) 38368

[startup+342.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/242 6211
/proc/meminfo: memFree=32009072/32770624 swapFree=5840/224764
[pid=6205] ppid=6202 vsize=38368 CPUtime=342.24 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 15579 0 0 0 34224 0 0 0 20 0 1 0 2366496 39288832 3694 33554432000 4194304 5970956 140721159426688 140721159424024 4974124 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3694 770 434 0 2956 0
Current children cumulated CPU time (s) 342.24
Current children cumulated vsize (KiB) 38368

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 6213
/proc/meminfo: memFree=32007756/32770624 swapFree=5840/224812
[pid=6205] ppid=6202 vsize=38368 CPUtime=402.23 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 16287 0 0 0 40223 0 0 0 20 0 1 0 2366496 39288832 3695 33554432000 4194304 5970956 140721159426688 140721159424024 4976696 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3695 770 434 0 2956 0
Current children cumulated CPU time (s) 402.23
Current children cumulated vsize (KiB) 38368

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 6221
/proc/meminfo: memFree=32008248/32770624 swapFree=5840/224868
[pid=6205] ppid=6202 vsize=38368 CPUtime=462.23 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 16986 0 0 0 46223 0 0 0 20 0 1 0 2366496 39288832 3695 33554432000 4194304 5970956 140721159426688 140721159424024 4974668 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3695 770 434 0 2956 0
Current children cumulated CPU time (s) 462.23
Current children cumulated vsize (KiB) 38368

[startup+522.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 6222
/proc/meminfo: memFree=32008268/32770624 swapFree=5840/224912
[pid=6205] ppid=6202 vsize=38368 CPUtime=522.22 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 17689 0 0 0 52222 0 0 0 20 0 1 0 2366496 39288832 3697 33554432000 4194304 5970956 140721159426688 140721159424024 4976612 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3697 770 434 0 2956 0
Current children cumulated CPU time (s) 522.22
Current children cumulated vsize (KiB) 38368

[startup+582.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 6223
/proc/meminfo: memFree=32009264/32770624 swapFree=5840/224960
[pid=6205] ppid=6202 vsize=38368 CPUtime=582.21 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 18065 0 0 0 58221 0 0 0 20 0 1 0 2366496 39288832 3697 33554432000 4194304 5970956 140721159426688 140721159424024 4970548 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3697 770 434 0 2956 0
Current children cumulated CPU time (s) 582.21
Current children cumulated vsize (KiB) 38368


################
# More data... #
################


[startup+1542.31 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 6249
/proc/meminfo: memFree=32004272/32770624 swapFree=5840/225664
[pid=6205] ppid=6202 vsize=38368 CPUtime=1542.11 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 27511 0 0 0 154210 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 4978203 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 1542.11
Current children cumulated vsize (KiB) 38368

[startup+1602.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 6250
/proc/meminfo: memFree=32004508/32770624 swapFree=5840/225700
[pid=6205] ppid=6202 vsize=38368 CPUtime=1602.1 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 28226 0 0 0 160209 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 4969795 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 1602.1
Current children cumulated vsize (KiB) 38368

[startup+1662.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/243 6258
/proc/meminfo: memFree=32004508/32770624 swapFree=5840/225744
[pid=6205] ppid=6202 vsize=38368 CPUtime=1662.09 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 28603 0 0 0 166208 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 4977712 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 1662.09
Current children cumulated vsize (KiB) 38368

[startup+1722.3 s]
/proc/loadavg: 2.03 2.02 2.05 3/243 6259
/proc/meminfo: memFree=32004356/32770624 swapFree=5840/225744
[pid=6205] ppid=6202 vsize=38368 CPUtime=1722.09 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 28981 0 0 0 172208 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 5327999 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 1722.09
Current children cumulated vsize (KiB) 38368

[startup+1782.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/243 6260
/proc/meminfo: memFree=32004848/32770624 swapFree=5840/225820
[pid=6205] ppid=6202 vsize=38368 CPUtime=1782.08 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 29719 0 0 0 178207 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 5098896 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 1782.08
Current children cumulated vsize (KiB) 38368

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 6261
/proc/meminfo: memFree=32004604/32770624 swapFree=5840/225860
[pid=6205] ppid=6202 vsize=38368 CPUtime=1842.07 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 30099 0 0 0 184206 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 4974128 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 1842.07
Current children cumulated vsize (KiB) 38368

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 6262
/proc/meminfo: memFree=32004092/32770624 swapFree=5840/225896
[pid=6205] ppid=6202 vsize=38368 CPUtime=1902.06 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 30812 0 0 0 190205 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 4977803 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 1902.06
Current children cumulated vsize (KiB) 38368

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/243 6263
/proc/meminfo: memFree=32005072/32770624 swapFree=5840/225936
[pid=6205] ppid=6202 vsize=38368 CPUtime=1962.06 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 31195 0 0 0 196205 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 4976596 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 1962.06
Current children cumulated vsize (KiB) 38368

[startup+2022.3 s]
/proc/loadavg: 1.85 1.98 2.03 2/236 6315
/proc/meminfo: memFree=32019036/32770624 swapFree=5840/225988
[pid=6205] ppid=6202 vsize=38368 CPUtime=2022.05 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 31580 0 0 0 202204 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 4974124 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 2022.05
Current children cumulated vsize (KiB) 38368

[startup+2082.3 s]
/proc/loadavg: 1.31 1.80 1.97 2/236 6316
/proc/meminfo: memFree=32019964/32770624 swapFree=5840/226012
[pid=6205] ppid=6202 vsize=38368 CPUtime=2082.05 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 31969 0 0 0 208204 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 5327116 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 2082.05
Current children cumulated vsize (KiB) 38368

[startup+2142.3 s]
/proc/loadavg: 1.11 1.66 1.91 2/236 6317
/proc/meminfo: memFree=32020744/32770624 swapFree=5840/226044
[pid=6205] ppid=6202 vsize=38368 CPUtime=2142.03 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 32691 0 0 0 214202 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 4977787 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 2142.03
Current children cumulated vsize (KiB) 38368

[startup+2202.31 s]
/proc/loadavg: 1.10 1.55 1.86 2/236 6318
/proc/meminfo: memFree=32020640/32770624 swapFree=5840/226044
[pid=6205] ppid=6202 vsize=38368 CPUtime=2202.03 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 33085 0 0 0 220202 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 4974704 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 2202.03
Current children cumulated vsize (KiB) 38368

[startup+2262.3 s]
/proc/loadavg: 1.04 1.45 1.80 2/237 6327
/proc/meminfo: memFree=32021324/32770624 swapFree=5840/226112
[pid=6205] ppid=6202 vsize=38368 CPUtime=2262.02 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 33480 0 0 0 226201 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 4974403 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 2262.02
Current children cumulated vsize (KiB) 38368

[startup+2322.3 s]
/proc/loadavg: 1.01 1.37 1.75 2/237 6328
/proc/meminfo: memFree=32022440/32770624 swapFree=5840/226132
[pid=6205] ppid=6202 vsize=38368 CPUtime=2322.01 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 33858 0 0 0 232200 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 5337501 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 2322.01
Current children cumulated vsize (KiB) 38368

[startup+2382.3 s]
/proc/loadavg: 1.00 1.30 1.71 2/237 6329
/proc/meminfo: memFree=32022228/32770624 swapFree=5840/226164
[pid=6205] ppid=6202 vsize=38368 CPUtime=2382 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 34581 0 0 0 238199 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 4978176 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 2382
Current children cumulated vsize (KiB) 38368



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.31 s]
/proc/loadavg: 1.00 1.29 1.70 2/237 6329
/proc/meminfo: memFree=32022228/32770624 swapFree=5840/226164
[pid=6205] ppid=6202 vsize=38368 CPUtime=2400.01 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 34939 0 0 0 240000 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 4974668 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 2400.01
Current children cumulated vsize (KiB) 38368

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

Solver just ended.
??? exit watcher main loop
??? sigkill at end of watcher main loop
??? kill 6205 sig 9
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.31 s]
/proc/loadavg: 1.00 1.29 1.70 2/237 6329
/proc/meminfo: memFree=32022228/32770624 swapFree=5840/226164
[pid=6205] ppid=6202 vsize=38368 CPUtime=2400.01 cores=1,3,5,7,9,11,13,15
/proc/6205/stat : 6205 (cosoco) R 6202 6205 2458 0 -1 4202496 34939 0 0 0 240000 1 0 0 20 0 1 0 2366496 39288832 3701 33554432000 4194304 5970956 140721159426688 140721159424024 4974668 0 0 4096 8405026 0 0 0 17 13 0 0 0 0 0 8070896 8075904 25518080 140721159435457 140721159435587 140721159435587 140721159438286 0
/proc/6205/statm: 9592 3701 770 434 0 2956 0
Current children cumulated CPU time (s) 2400.01
Current children cumulated vsize (KiB) 38368

Child status: 1
Real time (s): 2400.31
CPU time (s): 2400.02
CPU user time (s): 2400
CPU system time (s): 0.012998
CPU usage (%): 99.9878
Max. virtual memory (cumulated for all children) (KiB): 38368

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400
system time used= 0.012998
maximum resident set size= 14848
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 34967
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 9
involuntary context switches= 120635

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 6.98382 second user time and 10.6176 second system time

The end

Launcher Data 

Begin job on node126 at 2017-07-21 23:03:07
IDJOB=4243145
IDBENCH=139130
IDSOLVER=2620
FILE ID=node126/4243145-1500670987
RUNJOBID= node126-1500648174-2492
PBS_JOBID= 20623294
Free space on /tmp= 61980 MiB

SOLVER NAME= cosoco 1.1
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gs/qwh-o035-h405.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4243145-1500670987/watcher-4243145-1500670987 -o /tmp/evaluation-result-4243145-1500670987/solver-4243145-1500670987 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node126-1500648174-2492 --watchdog 2560  HOME/cosoco -lc -model -restarts HOME/instance-4243145-1500670987.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 8

MD5SUM BENCH= 3223705abdf773009dcd28d689e47bd8
RANDOM SEED=1324153873

node126.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 8
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 1
initial apicid	: 1
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 9
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1867.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 0
cpu cores	: 4
apicid		: 17
initial apicid	: 17
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 10
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 3
initial apicid	: 3
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 11
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 1
cpu cores	: 4
apicid		: 19
initial apicid	: 19
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 12
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 5
initial apicid	: 5
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 13
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1867.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 2
cpu cores	: 4
apicid		: 21
initial apicid	: 21
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 14
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 0
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 7
initial apicid	: 7
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.50
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 15
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 1600.000
cache size	: 8192 KB
physical id	: 1
siblings	: 8
core id		: 3
cpu cores	: 4
apicid		: 23
initial apicid	: 23
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        32022284 kB
MemAvailable:   32022996 kB
Buffers:           38644 kB
Cached:           274160 kB
SwapCached:            0 kB
Active:           145640 kB
Inactive:         233380 kB
Active(anon):      69092 kB
Inactive(anon):     8656 kB
Active(file):      76548 kB
Inactive(file):   224724 kB
Unevictable:        5840 kB
Mlocked:            5840 kB
SwapTotal:      67108860 kB
SwapFree:       67108860 kB
Dirty:              2508 kB
Writeback:             0 kB
AnonPages:         82184 kB
Mapped:            31316 kB
Shmem:              8840 kB
Slab:              62128 kB
SReclaimable:      30548 kB
SUnreclaim:        31580 kB
KernelStack:        4576 kB
PageTables:         5528 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     338876 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     26624 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      134528 kB
DirectMap2M:    33411072 kB

Free space on /tmp at the end= 61980 MiB
End job on node126 at 2017-07-21 23:43:08