Trace number 4389530

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2519.92 2520

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-01.xml
MD5SUMbc231a1d8845efcd5c5ebc235ca42ef6
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark8.4717
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 3950        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389530-1568358421.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 586
0.00/0.02	c |                   Arity: 1..30  -- Unary: 526
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 526
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.08	c 101            990            13275          43884          876            0              595   621   598
0.09/0.11	c 211            1984           20489          75503          876            0              256   349   325
0.20/0.23	c 332            4564           42479          157636         876            0              280   657   554
0.20/0.29	c 465            5939           55746          205520         876            0              566   645   628
0.30/0.39	c 611            7361           73655          291389         876            0              536   704   676
0.50/0.55	c 771            8916           102357         417056         876            0              608   724   679
0.60/0.68	c 947            10727          126158         519616         876            0              671   716   691
0.79/0.83	c 1140           12522          154341         659936         876            0              625   738   701
0.89/0.99	c 1352           14489          183489         795201         876            0              612   728   688
1.10/1.18	c 1585           17009          217956         948117         876            0              574   702   664
1.29/1.35	c 1841           19239          248119         1081545        876            0              548   683   646
1.49/1.53	c 2122           21675          281370         1242541        876            0              570   672   643
1.69/1.76	c 2431           23947          322591         1441633        876            0              557   695   665
1.89/1.97	c 2770           26143          361050         1616711        876            0              573   711   666
1.99/2.04	c 3142           27465          374830         1663279        876            0              555   591   574
2.29/2.31	c 3551           30586          422779         1901100        876            0              533   725   695
2.59/2.60	c 4000           33581          474545         2158510        876            0              541   735   684
2.89/2.94	c 4493           36752          535945         2471731        876            0              542   716   682
3.19/3.26	c 5035           39948          593894         2734150        876            0              541   699   658
3.79/3.81	c 5631           43725          692025         3184585        876            0              545   715   685
4.19/4.21	c 6286           48525          765457         3523270        876            0              547   728   682
4.69/4.70	c 7006           54370          854931         3967698        876            0              550   725   696
5.49/5.57	c 7798           60836          1008152        4765417        876            0              550   733   689
6.39/6.42	c 8669           66761          1158849        5563461        876            0              549   734   700
6.99/7.05	c 9627           73210          1270978        6191399        876            0              555   716   692
7.89/7.91	c 10680          82394          1426038        6907432        876            0              559   717   678
8.69/8.72	c 11838          89555          1570453        7607632        876            0              626   701   666
9.39/9.40	c 13111          96505          1692795        8196382        876            0              587   700   668
10.29/10.36	c 14511          103558         1865518        9008596        876            0              580   691   658
11.29/11.31	c 16051          110961         2035411        9856430        876            0              539   750   708
12.29/12.38	c 17745          120065         2224301        10875032       876            0              541   700   666
13.78/13.80	c 19608          132723         2477722        12208107       876            0              547   723   688
15.58/15.66	c 21657          149275         2810321        13878044       876            0              548   716   681
17.09/17.19	c 23910          164132         3084508        15419111       876            0              565   758   708
18.68/18.70	c 26388          176646         3352966        16852130       876            0              571   712   678
20.38/20.43	c 29113          189550         3656724        18440004       876            0              554   691   660
22.68/22.77	c 32110          208554         4071909        20425251       876            0              553   697   654
24.78/24.81	c 35406          228555         4437706        22243942       876            0              556   709   663
26.99/27.08	c 39031          246981         4847696        24304448       876            0              553   718   685
29.88/29.98	c 43018          268088         5359648        27044256       876            0              540   723   690
33.78/33.83	c 47403          298456         6038803        30877749       876            0              542   737   702
37.18/37.28	c 52226          325627         6653458        34091093       876            0              595   726   676
39.78/39.82	c 57531          347672         7105802        36567285       876            0              599   728   696
44.99/45.04	c 63366          380974         8033452        41788718       876            0              542   740   705
49.99/50.08	c 69784          418707         8933460        46634059       876            0              616   739   695
55.09/55.13	c 76843          461750         9838701        51488996       876            0              566   749   713
61.28/61.30	c 84607          509062         10920688       57866157       876            0              558   741   704
67.78/67.87	c 93147          565666         12099291       63915623       876            0              573   725   694
75.48/75.58	c 102541         624202         13470871       70966655       876            0              584   752   709
82.78/82.87	c 112874         673013         14764292       77916945       876            0              574   732   697
90.68/90.71	c 124240         731092         16162520       85695092       876            0              596   746   703
103.18/103.24	c 136742         810995         18376789       97345917       876            0              573   728   688
111.68/111.74	c 150494         884222         19892560       105375023      876            0              590   722   675
122.88/122.92	c 165621         957254         21875977       116329489      876            0              563   725   674
134.09/134.15	c 182260         1040180        23848277       127703529      876            0              612   729   696
146.58/146.68	c 200562         1155324        26104011       140159870      876            0              608   765   717
163.28/163.35	c 220694         1274504        29037497       156855084      876            0              609   745   698
177.28/177.39	c 242839         1388613        31523098       171372705      876            0              561   750   706
195.78/195.87	c 267198         1522776        34799663       189012069      876            0              569   742   699
214.88/214.93	c 293992         1680175        38204759       207331563      876            0              575   757   712
235.78/235.88	c 323465         1827181        41892589       227383237      876            0              572   732   690
258.78/258.86	c 355885         1992044        45916263       252017598      876            0              559   728   689
281.47/281.56	c 391547         2200963        50006471       273975785      876            0              570   746   695
307.98/308.03	c 430775         2418951        54739115       299609141      876            0              565   756   697
339.47/339.52	c 473925         2662789        60345204       329561287      876            0              603   740   695
383.08/383.13	c 521390         2943629        68030294       369494643      876            0              602   727   681
411.47/411.53	c 573601         3159209        73045058       396716191      876            0              566   730   685
449.47/449.58	c 631033         3435469        79753376       436662417      876            0              638   751   710
488.17/488.24	c 694208         3796102        86617791       474799766      876            0              556   750   697
530.66/530.72	c 763700         4161307        94224778       515733355      876            0              564   750   691
579.46/579.51	c 840141         4598082        102976605      563489434      876            0              583   744   705
638.16/638.27	c 924226         5002088        113394881      618617483      876            0              561   735   689
698.46/698.56	c 1016719        5504971        124017649      674212504      876            0              560   718   669
765.86/765.96	c 1118461        6040942        135925052      745735880      876            0              580   746   706
863.25/863.34	c 1230377        6672935        153058093      836365980      876            0              575   725   680
952.65/952.79	c 1353484        7307271        168953466      921947052      876            0              627   739   688
1050.24/1050.36	c 1488901        7995669        186210219      1022618746     876            0              618   753   710
1139.54/1139.63	c 1637859        8641015        202024286      1109271017     876            0              576   728   687
1249.34/1249.44	c 1801712        9491441        221548060      1220810124     876            0              549   747   697
1366.83/1366.96	c 1981950        10256544       242297622      1342457584     876            0              549   745   693
1530.83/1530.98	c 2180211        11615033       271479937      1506722013     876            0              636   734   684
1720.63/1720.79	c 2398298        12805903       304812368      1693996373     876            0              572   742   692
1922.73/1922.82	c 2638193        14349150       340722763      1880802849     876            0              573   746   692
2091.62/2091.76	c 2902077        15927748       370772725      2049392985     876            0              575   759   703
2314.51/2314.65	c 3192349        17415731       409925314      2280709633     876            0              568   769   719
2519.91/2520.00	
2519.91/2520.00	c *** INTERRUPTED ***
2519.91/2520.00	c restarts              : 85          
2519.91/2520.00	c conflicts             : 3452812      (1370 /sec)
2519.91/2520.00	c decisions             : 18959124     (7524 /sec)
2519.91/2520.00	c propagations          : 2475602663  (982420 /sec)
2519.91/2520.00	c root propagations     : 3950        
2519.91/2520.00	c filter calls          : 446479562      (177181 /sec)
2519.91/2520.00	c useless filter calls  : 111900793      (25 %)
2519.91/2520.00	c Memory used           : 32.39 MB
2519.91/2520.00	c CPU time              : 2519.9 s
2519.91/2520.00	c real time             : 2520 s
2519.91/2520.00	
2519.91/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13923 MiB free)
  memory of node 1: 16384 MiB (15786 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389530-1568358421/watcher-4389530-1568358421 -o /tmp/evaluation-result-4389530-1568358421/solver-4389530-1568358421 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node117-1568358258-32622 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389530-1568358421.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB
solver pid=319, runsolver pid=316


[startup+0.100109 s]*
/proc/loadavg: 2.03 2.04 2.05 3/200 320
/proc/meminfo: memFree=30417988/32770624 swapFree=66942516/67108860
[pid=319] ppid=316 vsize=32108 memory=8668 CPUtime=0.09 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 2331 0 0 0 9 0 0 0 20 0 1 0 411784068 32878592 2167 33554432000 4194304 6210612 140733363986144 140733363982680 5076037 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8027 2167 862 493 0 1332 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 32108 KiB
Current children cumulated memory: 8668 KiB

[startup+0.20969 s]*
/proc/loadavg: 2.03 2.04 2.05 3/200 320
/proc/meminfo: memFree=30416652/32770624 swapFree=66942516/67108860
[pid=319] ppid=316 vsize=32768 memory=9196 CPUtime=0.2 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 2512 0 0 0 20 0 0 0 20 0 1 0 411784068 33554432 2299 33554432000 4194304 6210612 140733363986144 140733363983736 5078864 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8192 2299 862 493 0 1497 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9196 KiB

[startup+0.30893 s]*
/proc/loadavg: 2.03 2.04 2.05 3/200 320
/proc/meminfo: memFree=30415908/32770624 swapFree=66942516/67108860
[pid=319] ppid=316 vsize=32900 memory=9460 CPUtime=0.3 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 2536 0 0 0 30 0 0 0 20 0 1 0 411784068 33689600 2365 33554432000 4194304 6210612 140733363986144 140733363983736 139892473727973 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8225 2365 862 493 0 1530 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 32900 KiB
Current children cumulated memory: 9460 KiB

[startup+0.700228 s]
/proc/loadavg: 2.03 2.04 2.05 3/200 320
/proc/meminfo: memFree=30414680/32770624 swapFree=66942516/67108860
[pid=319] ppid=316 vsize=33032 memory=9460 CPUtime=0.69 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 2570 0 0 0 69 0 0 0 20 0 1 0 411784068 33824768 2365 33554432000 4194304 6210612 140733363986144 140733363983736 5076066 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8258 2365 862 493 0 1563 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9460 KiB

[startup+1.50022 s]
/proc/loadavg: 2.03 2.04 2.05 3/200 320
/proc/meminfo: memFree=30414184/32770624 swapFree=66942516/67108860
[pid=319] ppid=316 vsize=33032 memory=9460 CPUtime=1.49 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 2574 0 0 0 149 0 0 0 20 0 1 0 411784068 33824768 2365 33554432000 4194304 6210612 140733363986144 140733363984104 5079064 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8258 2365 862 493 0 1563 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9460 KiB

[startup+3.10941 s]
/proc/loadavg: 1.87 2.01 2.04 3/200 320
/proc/meminfo: memFree=30408932/32770624 swapFree=66942516/67108860
[pid=319] ppid=316 vsize=33032 memory=9648 CPUtime=3.09 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 4032 0 0 0 309 0 0 0 20 0 1 0 411784068 33824768 2412 33554432000 4194304 6210612 140733363986144 140733363984104 5192880 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8258 2412 862 493 0 1563 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9648 KiB

[startup+6.30026 s]
/proc/loadavg: 1.87 2.01 2.04 3/200 320
/proc/meminfo: memFree=30401620/32770624 swapFree=66942516/67108860
[pid=319] ppid=316 vsize=33164 memory=9652 CPUtime=6.29 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 4479 0 0 0 629 0 0 0 20 0 1 0 411784068 33959936 2413 33554432000 4194304 6210612 140733363986144 140733363984104 5079072 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2413 862 493 0 1596 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9652 KiB

[startup+12.7003 s]
/proc/loadavg: 1.88 2.01 2.04 3/200 320
/proc/meminfo: memFree=30386244/32770624 swapFree=66942516/67108860
[pid=319] ppid=316 vsize=33164 memory=9680 CPUtime=12.69 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 4938 0 0 0 1269 0 0 0 20 0 1 0 411784068 33959936 2420 33554432000 4194304 6210612 140733363986144 140733363984104 5078380 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2420 862 493 0 1596 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9680 KiB

[startup+25.5003 s]
/proc/loadavg: 1.91 2.01 2.04 3/200 323
/proc/meminfo: memFree=30351352/32770624 swapFree=66942516/67108860
[pid=319] ppid=316 vsize=33164 memory=9724 CPUtime=25.48 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 5854 0 0 0 2548 0 0 0 20 0 1 0 411784068 33959936 2431 33554432000 4194304 6210612 140733363986144 140733363984104 5076008 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2431 862 493 0 1596 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9724 KiB

[startup+51.1091 s]
/proc/loadavg: 1.94 2.01 2.04 3/200 323
/proc/meminfo: memFree=30282036/32770624 swapFree=66942516/67108860
[pid=319] ppid=316 vsize=33164 memory=9724 CPUtime=51.09 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 6318 0 0 0 5109 0 0 0 20 0 1 0 411784068 33959936 2431 33554432000 4194304 6210612 140733363986144 140733363984104 5074800 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2431 862 493 0 1596 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9724 KiB

[startup+102.3 s]
/proc/loadavg: 1.97 2.01 2.04 3/200 327
/proc/meminfo: memFree=30149388/32770624 swapFree=66942516/67108860
[pid=319] ppid=316 vsize=33164 memory=9736 CPUtime=102.28 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 6778 0 0 0 10228 0 0 0 20 0 1 0 411784068 33959936 2434 33554432000 4194304 6210612 140733363986144 140733363984104 5192880 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2434 862 493 0 1596 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9736 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 2.01 2.04 3/201 333
/proc/meminfo: memFree=29995572/32770624 swapFree=66942516/67108860
[pid=319] ppid=316 vsize=33164 memory=9744 CPUtime=162.28 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 7245 0 0 0 16228 0 0 0 20 0 1 0 411784068 33959936 2436 33554432000 4194304 6210612 140733363986144 140733363984104 5078507 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2436 862 493 0 1596 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9744 KiB

[startup+222.3 s]
/proc/loadavg: 2.08 2.03 2.04 3/199 337
/proc/meminfo: memFree=29824760/32770624 swapFree=66942516/67108860
[pid=319] ppid=316 vsize=33164 memory=9748 CPUtime=222.28 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 7711 0 0 0 22228 0 0 0 20 0 1 0 411784068 33959936 2437 33554432000 4194304 6210612 140733363986144 140733363984104 5081328 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2437 862 493 0 1596 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9748 KiB

[startup+282.3 s]
/proc/loadavg: 2.03 2.02 2.04 3/199 411
/proc/meminfo: memFree=30516496/32770624 swapFree=66942532/67108860
[pid=319] ppid=316 vsize=33164 memory=9764 CPUtime=282.27 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 8184 0 0 0 28227 0 0 0 20 0 1 0 411784068 33959936 2441 33554432000 4194304 6210612 140733363986144 140733363984104 5076021 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2441 862 493 0 1596 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9764 KiB

[startup+342.3 s]
/proc/loadavg: 1.95 2.00 2.04 3/200 418
/proc/meminfo: memFree=29890460/32770624 swapFree=66942532/67108860
[pid=319] ppid=316 vsize=33164 memory=9772 CPUtime=342.27 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 8655 0 0 0 34227 0 0 0 20 0 1 0 411784068 33959936 2443 33554432000 4194304 6210612 140733363986144 140733363984104 5074898 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2443 862 493 0 1596 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9772 KiB

[startup+402.3 s]
/proc/loadavg: 1.92 1.98 2.03 3/199 422
/proc/meminfo: memFree=29261632/32770624 swapFree=66942532/67108860
[pid=319] ppid=316 vsize=33164 memory=9772 CPUtime=402.27 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 9127 0 0 0 40227 0 0 0 20 0 1 0 411784068 33959936 2443 33554432000 4194304 6210612 140733363986144 140733363984104 5078380 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2443 862 493 0 1596 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9772 KiB

[startup+462.3 s]
/proc/loadavg: 1.97 1.99 2.03 3/199 426
/proc/meminfo: memFree=28639084/32770624 swapFree=66942532/67108860
[pid=319] ppid=316 vsize=33164 memory=9776 CPUtime=462.27 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 9598 0 0 0 46227 0 0 0 20 0 1 0 411784068 33959936 2444 33554432000 4194304 6210612 140733363986144 140733363984104 5081968 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2444 862 493 0 1596 0
Current children cumulated CPU time: 462.27 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9776 KiB


################
# More data... #
################

/proc/319/statm: 8291 2447 862 493 0 1596 0
Current children cumulated CPU time: 1782.23 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9788 KiB

[startup+1842.3 s]
/proc/loadavg: 2.31 2.22 2.14 3/199 653
/proc/meminfo: memFree=30102492/32770624 swapFree=66943632/67108860
[pid=319] ppid=316 vsize=33164 memory=9788 CPUtime=1842.23 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 18536 0 0 0 184222 1 0 0 20 0 1 0 411784068 33959936 2447 33554432000 4194304 6210612 140733363986144 140733363984104 5078507 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2447 862 493 0 1596 0
Current children cumulated CPU time: 1842.23 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9788 KiB

[startup+1902.3 s]
/proc/loadavg: 2.11 2.18 2.13 4/199 657
/proc/meminfo: memFree=30072884/32770624 swapFree=66943632/67108860
[pid=319] ppid=316 vsize=33164 memory=9788 CPUtime=1902.23 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 18818 0 0 0 190222 1 0 0 20 0 1 0 411784068 33959936 2447 33554432000 4194304 6210612 140733363986144 140733363984104 5081875 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2447 862 493 0 1596 0
Current children cumulated CPU time: 1902.23 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9788 KiB

[startup+1962.3 s]
/proc/loadavg: 2.57 2.28 2.17 3/200 663
/proc/meminfo: memFree=30040020/32770624 swapFree=66943632/67108860
[pid=319] ppid=316 vsize=33164 memory=9788 CPUtime=1962.23 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 19291 0 0 0 196222 1 0 0 20 0 1 0 411784068 33959936 2447 33554432000 4194304 6210612 140733363986144 140733363984104 5078384 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2447 862 493 0 1596 0
Current children cumulated CPU time: 1962.23 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9788 KiB

[startup+2022.3 s]
/proc/loadavg: 2.21 2.23 2.16 3/199 667
/proc/meminfo: memFree=30027164/32770624 swapFree=66943632/67108860
[pid=319] ppid=316 vsize=33164 memory=9788 CPUtime=2022.22 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 19573 0 0 0 202221 1 0 0 20 0 1 0 411784068 33959936 2447 33554432000 4194304 6210612 140733363986144 140733363984104 5081332 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2447 862 493 0 1596 0
Current children cumulated CPU time: 2022.22 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9788 KiB

[startup+2082.3 s]
/proc/loadavg: 2.08 2.19 2.15 3/200 679
/proc/meminfo: memFree=30014068/32770624 swapFree=66943664/67108860
[pid=319] ppid=316 vsize=33164 memory=9788 CPUtime=2082.22 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 19855 0 0 0 208221 1 0 0 20 0 1 0 411784068 33959936 2447 33554432000 4194304 6210612 140733363986144 140733363984104 5078384 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2447 862 493 0 1596 0
Current children cumulated CPU time: 2082.22 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9788 KiB

[startup+2142.3 s]
/proc/loadavg: 2.03 2.16 2.14 3/201 685
/proc/meminfo: memFree=30013508/32770624 swapFree=66943664/67108860
[pid=319] ppid=316 vsize=33164 memory=9792 CPUtime=2142.22 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 20322 0 0 0 214221 1 0 0 20 0 1 0 411784068 33959936 2448 33554432000 4194304 6210612 140733363986144 140733363984104 5192912 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2448 862 493 0 1596 0
Current children cumulated CPU time: 2142.22 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9792 KiB

[startup+2202.3 s]
/proc/loadavg: 2.01 2.13 2.13 3/200 689
/proc/meminfo: memFree=30007984/32770624 swapFree=66943664/67108860
[pid=319] ppid=316 vsize=33164 memory=9792 CPUtime=2202.22 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 20596 0 0 0 220221 1 0 0 20 0 1 0 411784068 33959936 2448 33554432000 4194304 6210612 140733363986144 140733363984104 5079064 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2448 862 493 0 1596 0
Current children cumulated CPU time: 2202.22 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9792 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.10 2.12 3/200 693
/proc/meminfo: memFree=30009356/32770624 swapFree=66943664/67108860
[pid=319] ppid=316 vsize=33164 memory=9792 CPUtime=2262.22 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 20869 0 0 0 226221 1 0 0 20 0 1 0 411784068 33959936 2448 33554432000 4194304 6210612 140733363986144 140733363984104 5074895 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2448 862 493 0 1596 0
Current children cumulated CPU time: 2262.22 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9792 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.09 2.12 3/201 699
/proc/meminfo: memFree=30009700/32770624 swapFree=66943664/67108860
[pid=319] ppid=316 vsize=33164 memory=9792 CPUtime=2322.21 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 21342 0 0 0 232220 1 0 0 20 0 1 0 411784068 33959936 2448 33554432000 4194304 6210612 140733363986144 140733363984104 5076069 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2448 862 493 0 1596 0
Current children cumulated CPU time: 2322.21 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9792 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.07 2.11 3/199 703
/proc/meminfo: memFree=30008904/32770624 swapFree=66943664/67108860
[pid=319] ppid=316 vsize=33164 memory=9792 CPUtime=2382.21 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 21614 0 0 0 238220 1 0 0 20 0 1 0 411784068 33959936 2448 33554432000 4194304 6210612 140733363986144 140733363984104 5082025 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2448 862 493 0 1596 0
Current children cumulated CPU time: 2382.21 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9792 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.06 2.11 3/199 707
/proc/meminfo: memFree=30009028/32770624 swapFree=66943664/67108860
[pid=319] ppid=316 vsize=33164 memory=9792 CPUtime=2442.21 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 21886 0 0 0 244220 1 0 0 20 0 1 0 411784068 33959936 2448 33554432000 4194304 6210612 140733363986144 140733363984104 5078779 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2448 862 493 0 1596 0
Current children cumulated CPU time: 2442.21 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9792 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.05 2.10 3/200 713
/proc/meminfo: memFree=30009400/32770624 swapFree=66943664/67108860
[pid=319] ppid=316 vsize=33164 memory=9792 CPUtime=2502.21 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 22158 0 0 0 250220 1 0 0 20 0 1 0 411784068 33959936 2448 33554432000 4194304 6210612 140733363986144 140733363984104 5076037 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2448 862 493 0 1596 0
Current children cumulated CPU time: 2502.21 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9792 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]
/proc/loadavg: 2.00 2.04 2.10 3/199 713
/proc/meminfo: memFree=30009044/32770624 swapFree=66943664/67108860
[pid=319] ppid=316 vsize=33164 memory=9792 CPUtime=2519.91 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 22429 0 0 0 251990 1 0 0 20 0 1 0 411784068 33959936 2448 33554432000 4194304 6210612 140733363986144 140733363984104 5081865 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2448 862 493 0 1596 0
Current children cumulated CPU time: 2519.91 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9792 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520 s]
# the end of solver process 319 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.9 s, system=0.012999 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2520 s]
/proc/loadavg: 2.00 2.04 2.10 3/199 713
/proc/meminfo: memFree=30009044/32770624 swapFree=66943664/67108860
[pid=319] ppid=316 vsize=33164 memory=9792 CPUtime=2519.91 cores=1,3,5,7
/proc/319/stat : 319 (cosoco) R 316 319 31452 0 -1 4202496 22429 0 0 0 251990 1 0 0 20 0 1 0 411784068 33959936 2448 33554432000 4194304 6210612 140733363986144 140733363984104 5081865 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8308220 8313664 40144896 140733363987467 140733363987569 140733363987569 140733363990478 0
/proc/319/statm: 8291 2448 862 493 0 1596 0
Current children cumulated CPU time: 2519.91 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9792 KiB

Child status: 1
Real time (s): 2520
CPU time (s): 2519.92
CPU user time (s): 2519.9
CPU system time (s): 0.012999
CPU usage (%): 99.9967
Max. virtual memory (cumulated for all children) (KiB): 33164
Max. memory (cumulated for all children) (KiB): 9792

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.9
system time used= 0.012999
maximum resident set size= 9860
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 22485
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 676


# summary of solver processes directly reported to runsolver:
#   pid: 319
#   total CPU time (s): 2519.92
#   total CPU user time (s): 2519.9
#   total CPU system time (s): 0.012999

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.56035 second user time and 16.1995 second system time

The end

Launcher Data 

Begin job on node117 at 2019-09-13 09:06:19
IDJOB=4389530
IDBENCH=138961
IDSOLVER=2829
FILE ID=node117/4389530-1568358421
RUNJOBID= node117-1568358258-32622
PBS_JOBID= 21701179
Free space on /tmp= 58916 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-01.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389530-1568358421/watcher-4389530-1568358421 -o /tmp/evaluation-result-4389530-1568358421/solver-4389530-1568358421 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node117-1568358258-32622 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389530-1568358421.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= bc231a1d8845efcd5c5ebc235ca42ef6
RANDOM SEED=1803049784

node117.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.75
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        30422548 kB
MemAvailable:   31552108 kB
Buffers:           90500 kB
Cached:          1293632 kB
SwapCached:        43248 kB
Active:          1055792 kB
Inactive:         696012 kB
Active(anon):     340232 kB
Inactive(anon):    47812 kB
Active(file):     715560 kB
Inactive(file):   648200 kB
Unevictable:      110288 kB
Mlocked:          110288 kB
SwapTotal:      67108860 kB
SwapFree:       66942516 kB
Dirty:              2832 kB
Writeback:             0 kB
AnonPages:        384664 kB
Mapped:            30564 kB
Shmem:             11712 kB
Slab:             191388 kB
SReclaimable:     163272 kB
SUnreclaim:        28116 kB
KernelStack:        3776 kB
PageTables:         6136 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     851844 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     30720 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      118144 kB
DirectMap2M:    33427456 kB

Free space on /tmp at the end= 58832 MiB
End job on node117 at 2019-09-13 09:48:19