Trace number 4299959

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 1.12? (TO) 2519.83 2520.01

General information on the benchmark

NameMagicSquare/
MagicSquare-10-sum_c18.xml
MD5SUM9b613e70bdeb54a559e13aaa64a0062e
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark29.5201
Satisfiable
(Un)Satisfiability was proved
Number of variables100
Number of constraints23
Number of domains1
Minimum domain size100
Maximum domain size100
Distribution of domain sizes[{"size":100,"count":100}]
Minimum variable degree3
Maximum variable degree4
Distribution of variable degrees[{"degree":3,"count":80},{"degree":4,"count":20}]
Minimum constraint arity10
Maximum constraint arity100
Distribution of constraint arities[{"arity":10,"count":22},{"arity":100,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"sum","count":22}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c root propagations     : 0           
0.00/0.00	c restarts enabled, print stats at every restarts
0.00/0.00	c
0.00/0.00	c
0.00/0.00	c
0.00/0.00	c This is cosoco 1.12 --  
0.00/0.00	c
0.00/0.00	c command line: HOME/cosoco -lc -model -restarts HOME/instance-4299959-1532825889.xml 
0.00/0.00	c ========================================[ Problem Statistics ]===========================================
0.00/0.00	c |                                                                                                       
0.00/0.00	c |  Parse time        :         0.00 s 
0.00/0.00	c |
0.00/0.00	c |               Variables: 100
0.00/0.00	c |            Domain Sizes: 100..100
0.00/0.00	c |
0.00/0.00	c |             Constraints: 23
0.00/0.00	c |                   Arity: 10..100
0.00/0.00	c | 
0.00/0.00	c |                   Types: 
0.00/0.00	c |                          All Different: 1
0.00/0.00	c |                          Sum: 22
0.00/0.00	c |                          
0.00/0.00	c =========================================================================================================
0.00/0.00	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.02	c 101            152            1804           13547          0              0              7   18   9     
0.00/0.03	c 211            323            3810           30324          0              0              7   26   10    
0.00/0.04	c 332            503            5883           46326          0              0              7   19   10    
0.00/0.06	c 465            710            8373           66199          0              0              7   34   14    
0.00/0.08	c 611            925            10907          85139          0              0              7   19   11    
0.00/0.10	c 771            1167           13816          105392         0              0              7   28   15    
0.10/0.12	c 947            1424           16944          127945         0              0              7   19   13    
0.10/0.15	c 1140           1718           20485          153271         0              0              7   34   17    
0.10/0.17	c 1352           2033           24327          181902         0              0              7   29   15    
0.10/0.20	c 1585           2373           28171          211359         0              0              7   28   16    
0.20/0.22	c 1841           2747           32307          242554         0              0              7   36   21    
0.20/0.25	c 2122           3143           36824          281416         0              0              7   26   17    
0.20/0.29	c 2431           3581           41756          328402         0              0              8   17   13    
0.30/0.33	c 2770           4058           47282          379387         0              0              9   17   14    
0.30/0.37	c 3142           4581           53125          433848         0              0              6   17   14    
0.40/0.42	c 3551           5161           59698          496407         0              0              8   17   14    
0.40/0.47	c 4000           5794           66851          561837         0              0              6   17   14    
0.50/0.53	c 4493           6501           74924          636575         0              0              8   17   14    
0.50/0.59	c 5035           7265           83479          715839         0              0              6   17   14    
0.60/0.66	c 5631           8134           93414          806469         0              0              8   23   15    
0.69/0.75	c 6286           9110           105195         932174         0              0              7   26   17    
0.79/0.84	c 7006           10169          117296         1066712        0              0              7   26   18    
0.89/0.93	c 7798           11320          130201         1213903        0              0              7   26   18    
1.00/1.03	c 8669           12581          144318         1335919        0              0              8   26   17    
1.10/1.14	c 9627           13963          159482         1467078        0              0              8   26   18    
1.19/1.25	c 10680          15443          175249         1650960        0              0              7   26   20    
1.29/1.38	c 11838          17101          193778         1809073        0              0              8   35   20    
1.49/1.51	c 13111          18928          215441         1980764        0              0              8   35   21    
1.59/1.66	c 14511          20918          238383         2170564        0              0              9   35   21    
1.79/1.82	c 16051          23023          260407         2416124        0              0              7   27   22    
1.89/1.98	c 17745          25393          287274         2618462        0              0              7   42   29    
2.10/2.16	c 19608          27994          317676         2845983        0              0              10   42   29   
2.29/2.35	c 21657          30812          345274         3123726        0              0              8   27   25    
2.49/2.57	c 23910          33986          381558         3422578        0              0              8   42   28    
2.79/2.83	c 26388          37476          424483         3750781        0              0              9   42   26    
3.10/3.11	c 29113          41389          472294         4077326        0              0              9   48   30    
3.39/3.43	c 32110          45582          525372         4462423        0              0              10   42   29   
3.69/3.73	c 35406          50117          579933         4886108        0              0              9   42   34    
4.10/4.15	c 39031          55544          650468         5390504        0              0              10   76   38   
4.49/4.51	c 43018          60928          720365         6012763        0              0              12   54   45   
5.00/5.04	c 47403          66949          808405         6851691        0              0              15   43   38   
5.49/5.54	c 52226          73999          894979         7577083        0              0              11   46   36   
6.19/6.24	c 57531          81484          989303         8793869        0              0              15   42   38   
6.69/6.77	c 63366          88999          1083411        9896468        0              0              7   28   26    
7.39/7.41	c 69784          97925          1194615        10968992       0              0              9   63   45    
7.89/7.96	c 76843          107457         1296283        11907007       0              0              10   53   44   
8.69/8.74	c 84607          118504         1424646        12905967       0              0              10   44   40   
9.29/9.36	c 93147          129639         1543920        13910864       0              0              12   52   47   
10.09/10.19	c 102541         141946         1679428        15273967       0              0              12   45   41   
11.09/11.19	c 112874         156018         1828719        17483929       0              0              9   48   44    
11.99/12.04	c 124240         170155         1976152        18953950       0              0              16   42   39   
13.09/13.11	c 136742         185851         2163243        20684119       0              0              13   41   38   
14.89/14.94	c 150494         205339         2439118        23619346       0              0              13   42   39   
16.49/16.53	c 165621         226994         2750595        26094422       0              0              12   41   38   
17.79/17.84	c 182260         249140         3015874        27757352       0              0              10   60   51   
19.49/19.55	c 200562         273158         3276983        31187602       0              0              15   49   46   
20.88/20.96	c 220694         298294         3518105        33277332       0              0              12   42   39   
22.28/22.34	c 242839         325680         3795121        35772306       0              0              10   52   49   
24.09/24.14	c 267198         355962         4136827        38998973       0              0              14   42   40   
27.38/27.43	c 293992         395807         4818700        42872615       0              0              11   41   39   
30.28/30.38	c 323465         435238         5378312        47002374       0              0              9   41   39    
32.48/32.54	c 355885         475863         5747191        50155945       0              0              8   46   44    
36.78/36.86	c 391547         530901         6477478        57902632       0              0              15   29   28   
40.58/40.68	c 430775         585877         7196386        67355901       0              0              12   54   51   
44.58/44.66	c 473925         642466         7794143        78403129       0              0              12   52   48   
48.18/48.26	c 521390         704988         8422844        85869059       0              0              7   53   49    
52.78/52.82	c 573601         773342         9147742        92887652       0              0              10   41   40   
59.38/59.48	c 631033         840295         10580228       109137870      0              0              8   54   51    
65.68/65.75	c 694208         918740         11847107       120445253      0              0              9   50   46    
74.18/74.29	c 763700         1006051        13328669       134034435      0              0              11   44   42   
80.18/80.27	c 840141         1098696        14477196       145116408      0              0              7   54   52    
87.48/87.58	c 924226         1203201        15811365       159460757      0              0              8   47   44    
93.78/93.84	c 1016719        1321225        16901793       169440171      0              0              9   47   45    
100.28/100.31	c 1118461        1444286        17999804       184386812      0              0              11   46   44   
109.37/109.46	c 1230377        1587858        19743672       200449419      0              0              12   46   44   
118.08/118.16	c 1353484        1739862        21406919       216585122      0              0              11   53   51   
141.47/141.57	c 1488901        1936458        25632888       265775559      0              0              8   58   54    
162.98/163.05	c 1637859        2106818        29366468       347309412      0              0              13   54   50   
179.98/180.09	c 1801712        2306650        32394073       388631727      0              0              14   53   50   
191.57/191.67	c 1981950        2519951        34529374       409468369      0              0              10   53   51   
211.97/212.05	c 2180211        2769315        38067609       445080195      0              0              16   42   40   
229.97/230.09	c 2398298        3055380        41762602       481478927      0              0              11   51   49   
253.16/253.25	c 2638193        3391180        46180289       520228130      0              0              12   42   40   
281.85/282.00	c 2902077        3686753        51160374       619447923      0              0              8   54   52    
308.75/308.82	c 3192349        4062911        55903861       668414328      0              0              16   43   42   
337.25/337.33	c 3511648        4458785        61172313       728260989      0              0              14   47   45   
372.05/372.16	c 3862876        4929475        66048564       798271469      0              0              9   43   41    
415.14/415.25	c 4249226        5458311        74059232       873594702      0              0              13   48   46   
444.63/444.77	c 4674211        5963022        80123716       925818445      0              0              10   54   52   
476.23/476.34	c 5141694        6526936        85631514       994672813      0              0              11   47   45   
549.42/549.52	c 5655925        7237788        100036302      1111609374     0              0              12   55   53   
583.22/583.39	c 6221579        7917767        106435493      1191464513     0              0              12   54   52   
623.21/623.39	c 6843798        8651428        114559180      1301593089     0              0              11   54   52   
678.02/678.14	c 7528238        9534709        124180967      1417996489     0              0              12   42   40   
738.50/738.68	c 8281122        10473669       134309914      1586038748     0              0              8   43   40    
793.09/793.23	c 9109294        11478382       142628506      1704327980     0              0              9   43   42    
926.98/927.17	c 10020283       12520249       169469301      2182985442     0              0              15   53   51   
1003.97/1004.16	c 11022370       13788514       183105909      2352953370     0              0              15   42   41   
1076.76/1076.93	c 12124665       15064994       196381077      2511598690     0              0              8   54   53    
1158.86/1159.03	c 13337189       16554625       211319271      2694329065     0              0              13   55   53   
1300.84/1301.04	c 14670965       18431928       234025533      2929914495     0              0              13   45   43   
1447.23/1447.42	c 16138118       20214988       264057496      3270714499     0              0              10   55   51   
1603.93/1604.19	c 17751986       22530733       293763226      3511065717     0              0              16   46   43   
1993.93/1994.13	c 19527240       25555233       373913017      4073433452     0              0              10   56   51   
2182.32/2182.53	c 21480019       27810826       409174307      4562609171     0              0              13   61   59   
2467.31/2467.55	c 23628075       30252118       473374659      5212846167     0              0              12   57   53   
2519.82/2520.00	
2519.82/2520.00	c *** INTERRUPTED ***
2519.82/2520.00	c restarts              : 106         
2519.82/2520.00	c conflicts             : 24031453     (9537 /sec)
2519.82/2520.00	c decisions             : 30717846     (12190 /sec)
2519.82/2520.00	c propagations          : 5380255311  (2135169 /sec)
2519.82/2520.00	c root propagations     : 0           
2519.82/2520.00	c filter calls          : 484444495      (192253 /sec)
2519.82/2520.00	c useless filter calls  : 321213460      (66 %)
2519.82/2520.00	c Memory used           : 26.66 MB
2519.82/2520.00	c CPU time              : 2519.83 s
2519.82/2520.00	
2519.82/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9077 MiB free)
  memory of node 1: 16384 MiB (12638 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299959-1532825889/watcher-4299959-1532825889 -o /tmp/evaluation-result-4299959-1532825889/solver-4299959-1532825889 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532809523-24536 --watchdog 2580 HOME/cosoco -lc -model -restarts HOME/instance-4299959-1532825889.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=26496, runsolver pid=26493
Current StackSize limit: 8192 KiB


[startup+0.100874 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 26497
/proc/meminfo: memFree=22236788/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=3932 CPUtime=0.1 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1157 0 0 0 10 0 0 0 20 0 1 0 100152119 27947008 983 33554432000 4194304 6142532 140723710500672 140723710498072 5175278 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 983 858 476 0 145 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 3932 KiB

[startup+0.209219 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 26497
/proc/meminfo: memFree=22236416/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=3932 CPUtime=0.2 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1157 0 0 0 20 0 0 0 20 0 1 0 100152119 27947008 983 33554432000 4194304 6142532 140723710500672 140723710498072 5058000 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 983 858 476 0 145 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 3932 KiB

[startup+0.308677 s]*
/proc/loadavg: 2.00 2.01 2.05 3/187 26497
/proc/meminfo: memFree=22236416/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=3932 CPUtime=0.3 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1158 0 0 0 30 0 0 0 20 0 1 0 100152119 27947008 983 33554432000 4194304 6142532 140723710500672 140723710498072 5058163 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 983 858 476 0 145 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 3932 KiB

[startup+0.700274 s]
/proc/loadavg: 2.00 2.01 2.05 4/187 26497
/proc/meminfo: memFree=22236340/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=3932 CPUtime=0.69 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1158 0 0 0 69 0 0 0 20 0 1 0 100152119 27947008 983 33554432000 4194304 6142532 140723710500672 140723710498072 5175264 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 983 858 476 0 145 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 3932 KiB

[startup+1.50027 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 26497
/proc/meminfo: memFree=22236456/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=3932 CPUtime=1.49 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1158 0 0 0 149 0 0 0 20 0 1 0 100152119 27947008 983 33554432000 4194304 6142532 140723710500672 140723710498072 5062306 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 983 858 476 0 145 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 3932 KiB

[startup+3.10882 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 26497
/proc/meminfo: memFree=22236184/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4004 CPUtime=3.1 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1228 0 0 0 310 0 0 0 20 0 1 0 100152119 27947008 1001 33554432000 4194304 6142532 140723710500672 140723710498072 5175056 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1001 872 476 0 145 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4004 KiB

[startup+6.30027 s]
/proc/loadavg: 1.92 2.00 2.04 3/187 26497
/proc/meminfo: memFree=22236056/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4004 CPUtime=6.29 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1305 0 0 0 629 0 0 0 20 0 1 0 100152119 27947008 1001 33554432000 4194304 6142532 140723710500672 140723710498072 5131353 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1001 872 476 0 145 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4004 KiB

[startup+12.7003 s]
/proc/loadavg: 1.93 2.00 2.04 3/187 26497
/proc/meminfo: memFree=22236304/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=12.69 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1379 0 0 0 1269 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5057941 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+25.5003 s]
/proc/loadavg: 1.95 2.00 2.04 3/187 26497
/proc/meminfo: memFree=22236428/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=25.48 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1525 0 0 0 2548 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5058024 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+51.1088 s]
/proc/loadavg: 1.96 2.00 2.04 3/187 26497
/proc/meminfo: memFree=22236924/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=51.09 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1600 0 0 0 5109 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5335916 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+102.3 s]
/proc/loadavg: 1.98 2.00 2.04 3/187 26498
/proc/meminfo: memFree=22236996/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=102.28 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1676 0 0 0 10228 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5055149 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 26506
/proc/meminfo: memFree=22237196/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=162.27 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1751 0 0 0 16227 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5175264 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 26529
/proc/meminfo: memFree=22235372/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=222.26 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1825 0 0 0 22226 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5061915 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 222.26 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 26530
/proc/meminfo: memFree=22235860/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=282.25 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1900 0 0 0 28225 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5058027 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 282.25 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 26531
/proc/meminfo: memFree=22236248/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=342.25 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 1974 0 0 0 34225 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5058334 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 342.25 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 26532
/proc/meminfo: memFree=22236324/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=402.24 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 2048 0 0 0 40224 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5175068 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 402.24 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 26533
/proc/meminfo: memFree=22236312/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=462.23 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 2123 0 0 0 46223 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5060713 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 462.23 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB


################
# More data... #
################

/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 1722.12 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26730
/proc/meminfo: memFree=22235312/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=1782.12 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 3585 0 0 0 178212 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5055567 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 1782.12 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26732
/proc/meminfo: memFree=22235808/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=1842.12 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 3642 0 0 0 184212 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5336528 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 1842.12 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/187 26733
/proc/meminfo: memFree=22235888/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=1902.12 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 3699 0 0 0 190212 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5131791 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 1902.12 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26742
/proc/meminfo: memFree=22235784/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=1962.12 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 3756 0 0 0 196212 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5058552 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 1962.12 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26743
/proc/meminfo: memFree=22235948/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=2022.12 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 3831 0 0 0 202212 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5058042 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 2022.12 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26744
/proc/meminfo: memFree=22235948/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=2082.12 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 3888 0 0 0 208212 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5330311 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 2082.12 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 26745
/proc/meminfo: memFree=22235700/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=2142.12 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 3945 0 0 0 214212 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5054411 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 2142.12 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+2202.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/188 26746
/proc/meminfo: memFree=22235972/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=2202.12 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 4020 0 0 0 220212 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5055244 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 2202.12 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+2262.3 s]
/proc/loadavg: 2.10 2.04 2.05 3/187 26747
/proc/meminfo: memFree=22235616/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=2262.12 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 4077 0 0 0 226212 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5175278 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 2262.12 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+2322.3 s]
/proc/loadavg: 2.11 2.05 2.05 3/187 26748
/proc/meminfo: memFree=22235484/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=2322.12 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 4134 0 0 0 232212 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5131364 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 2322.12 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+2382.3 s]
/proc/loadavg: 2.04 2.04 2.05 3/187 26749
/proc/meminfo: memFree=22235244/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=2382.11 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 4191 0 0 0 238211 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5131312 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 2382.11 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+2442.3 s]
/proc/loadavg: 2.09 2.05 2.05 3/187 26750
/proc/meminfo: memFree=22235120/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=2442.11 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 4248 0 0 0 244211 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5061866 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 2442.11 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

[startup+2502.3 s]
/proc/loadavg: 2.03 2.04 2.05 3/187 26751
/proc/meminfo: memFree=22235492/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=2502.11 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 4322 0 0 0 250211 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5170084 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 2502.11 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.02 2.04 2.05 3/187 26759
/proc/meminfo: memFree=22234384/32770624 swapFree=67108796/67108860
[pid=26496] ppid=26493 vsize=27292 memory=4032 CPUtime=2519.82 cores=1,3,5,7
/proc/26496/stat : 26496 (cosoco) R 26493 26496 24504 0 -1 4202496 4379 0 0 0 251982 0 0 0 20 0 1 0 100152119 27947008 1008 33554432000 4194304 6142532 140723710500672 140723710498072 5131753 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 21368832 140723710502022 140723710502152 140723710502152 140723710504910 0
/proc/26496/statm: 6823 1008 872 476 0 145 0
Current children cumulated CPU time: 2519.82 s
Current children cumulated vsize: 27292 KiB
Current children cumulated memory: 4032 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 26496 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.83 s, system=0.002021 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2519.83
CPU user time (s): 2519.83
CPU system time (s): 0.002021
CPU usage (%): 99.9928
Max. virtual memory (cumulated for all children) (KiB): 27292
Max. memory (cumulated for all children) (KiB): 4032

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.83
system time used= 0.002021
maximum resident set size= 4096
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 4430
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 1359


# summary of solver processes directly reported to runsolver:
#   pid: 26496
#   total CPU time (s): 2519.83
#   total CPU user time (s): 2519.83
#   total CPU system time (s): 0.002021

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.55618 second user time and 15.8001 second system time

The end

Launcher Data 

Begin job on node138 at 2018-07-29 02:58:10
IDJOB=4299959
IDBENCH=141513
IDSOLVER=2761
FILE ID=node138/4299959-1532825889
RUNJOBID= node138-1532809523-24536
PBS_JOBID= 21022478
Free space on /tmp= 53796 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP18/MagicSquare/MagicSquare-10-sum_c18.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299959-1532825889/watcher-4299959-1532825889 -o /tmp/evaluation-result-4299959-1532825889/solver-4299959-1532825889 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node138-1532809523-24536 --watchdog 2580  HOME/cosoco -lc -model -restarts HOME/instance-4299959-1532825889.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 9b613e70bdeb54a559e13aaa64a0062e
RANDOM SEED=127116461

node138.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.71
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        22237340 kB
MemAvailable:   31922176 kB
Buffers:          214968 kB
Cached:          9673700 kB
SwapCached:           44 kB
Active:          2564144 kB
Inactive:        7385416 kB
Active(anon):       5272 kB
Inactive(anon):    83480 kB
Active(file):    2558872 kB
Inactive(file):  7301936 kB
Unevictable:        7280 kB
Mlocked:            7280 kB
SwapTotal:      67108860 kB
SwapFree:       67108796 kB
Dirty:              2424 kB
Writeback:             0 kB
AnonPages:         78220 kB
Mapped:            39952 kB
Shmem:             25164 kB
Slab:             280968 kB
SReclaimable:     252488 kB
SUnreclaim:        28480 kB
KernelStack:        3568 kB
PageTables:         5168 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     352820 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     22528 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      112000 kB
DirectMap2M:    33433600 kB

Free space on /tmp at the end= 53792 MiB
End job on node138 at 2018-07-29 03:40:10