Trace number 4389573

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2520.03 2520.01

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h374-08.xml
MD5SUMa38db4eec3f77542c2f3ff7a616038a8
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark9.15382
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":374},{"degree":2,"count":526}]
Minimum constraint arity526
Maximum constraint arity900
Distribution of constraint arities[{"arity":526,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 4686        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389573-1568358434.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 586
0.00/0.02	c |                   Arity: 1..30  -- Unary: 526
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 526
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.08	c 101            1093           13179          45982          894            0              582   684   642
0.10/0.12	c 211            2209           21862          73523          894            0              280   506   465
0.20/0.23	c 332            3925           42218          158680         894            0              310   703   625
0.20/0.28	c 465            5037           50503          186124         894            0              522   666   637
0.30/0.36	c 611            6331           66496          253747         894            0              522   695   661
0.40/0.42	c 771            7517           77822          296290         894            0              562   621   577
0.50/0.53	c 947            9306           97385          370959         894            0              506   678   649
0.50/0.57	c 1140           10550          105568         396370         894            0              516   576   555
0.60/0.69	c 1352           12581          128214         489334         894            0              516   688   648
0.79/0.85	c 1585           14716          156171         614146         894            0              543   706   659
0.99/1.06	c 1841           17218          194760         783460         894            0              580   707   684
1.29/1.35	c 2122           20331          247599         1034962        894            0              642   752   715
1.59/1.64	c 2431           23324          298698         1299131        894            0              576   746   709
1.69/1.79	c 2770           25398          326845         1440641        894            0              544   709   676
2.10/2.14	c 3142           28427          389079         1741414        894            0              587   720   690
2.49/2.56	c 3551           32016          462560         2119324        894            0              644   732   699
2.99/3.06	c 4000           36457          552587         2562692        894            0              570   717   686
3.39/3.48	c 4493           39740          628175         2929314        894            0              601   715   674
3.89/3.97	c 5035           43424          713948         3388845        894            0              588   698   672
4.39/4.48	c 5631           47805          804171         3883509        894            0              570   721   691
5.09/5.11	c 6286           52882          914900         4422622        894            0              590   711   683
5.49/5.57	c 7006           57331          997513         4837039        894            0              611   710   685
6.28/6.36	c 7798           63117          1137548        5548190        894            0              604   717   690
6.99/7.01	c 8669           68076          1253230        6109807        894            0              640   709   675
7.78/7.80	c 9627           74425          1393676        6865590        894            0              631   723   700
8.88/8.91	c 10680          84034          1591802        7896626        894            0              593   743   694
9.58/9.66	c 11838          90620          1725594        8632495        894            0              585   743   697
10.68/10.77	c 13111          99367          1921184        9674150        894            0              566   736   693
11.48/11.58	c 14511          106451         2065414        10372524       894            0              561   724   677
12.68/12.76	c 16051          117297         2276027        11380671       894            0              563   710   676
14.18/14.26	c 17745          129285         2543245        12597062       894            0              562   709   663
15.38/15.44	c 19608          139272         2752956        13683694       894            0              571   700   665
16.58/16.63	c 21657          150719         2966387        14718880       894            0              572   718   679
18.18/18.29	c 23910          163318         3260931        16122336       894            0              553   710   676
20.18/20.25	c 26388          178554         3609261        17904852       894            0              554   725   684
22.68/22.73	c 29113          200914         4051777        20080261       894            0              565   726   678
24.78/24.80	c 32110          222530         4421327        21991471       894            0              551   728   693
26.58/26.69	c 35406          240589         4758849        23612235       894            0              552   707   658
30.09/30.14	c 39031          267783         5368391        26779771       894            0              543   732   687
31.58/31.61	c 43018          284031         5633109        28118275       894            0              547   719   666
35.18/35.24	c 47403          312524         6276704        31390952       894            0              539   726   695
37.78/37.85	c 52226          332779         6742031        33725318       894            0              542   707   681
41.88/41.95	c 57531          365655         7481687        37328983       894            0              549   746   697
46.38/46.40	c 63366          395361         8261631        41222321       894            0              557   707   670
52.68/52.72	c 69784          438717         9375925        46994191       894            0              576   730   689
60.28/60.34	c 76843          492616         10718315       54186006       894            0              616   743   700
66.88/66.90	c 84607          539562         11883628       60091614       894            0              559   740   687
74.38/74.47	c 93147          607140         13247922       67202530       894            0              580   751   715
81.99/82.05	c 102541         675233         14604652       74402834       894            0              592   745   706
90.38/90.47	c 112874         736598         16086664       81805777       894            0              614   710   670
102.48/102.59	c 124240         814294         18220341       92850582       894            0              602   736   692
112.99/113.07	c 136742         901967         20086955       101915225      894            0              606   742   692
122.68/122.78	c 150494         980651         21799836       111032583      894            0              612   731   686
134.99/135.05	c 165621         1074856        23973181       122105217      894            0              625   735   687
153.28/153.37	c 182260         1220816        27244000       139087546      894            0              613   759   697
170.78/170.82	c 200562         1354632        30344866       155726009      894            0              632   754   704
190.68/190.78	c 220694         1486604        33877357       173662186      894            0              582   731   693
213.99/214.08	c 242839         1672946        38015143       194706694      894            0              640   736   689
239.58/239.65	c 267198         1843422        42515795       218129558      894            0              642   735   692
263.88/263.99	c 293992         2009026        46765832       240721885      894            0              644   745   692
289.68/289.75	c 323465         2210167        51322635       262961959      894            0              622   735   687
312.39/312.48	c 355885         2398919        55349503       284488759      894            0              573   745   700
336.89/336.91	c 391547         2606422        59702011       306401289      894            0              591   735   690
366.99/367.10	c 430775         2863963        65039171       335721613      894            0              613   735   690
400.59/400.68	c 473925         3135394        70996386       365041203      894            0              640   751   699
434.99/435.02	c 521390         3413700        77117504       397177528      894            0              581   737   693
473.69/473.74	c 573601         3709413        84005626       431073944      894            0              650   747   698
519.79/519.88	c 631033         4086463        92155871       474408759      894            0              642   740   690
568.69/568.72	c 694208         4479298        100807282      521956334      894            0              584   751   691
644.29/644.33	c 763700         4953998        114094316      592149836      894            0              622   742   686
711.19/711.23	c 840141         5457953        125922565      653287654      894            0              594   743   695
780.69/780.77	c 924226         5912485        138193367      714223958      894            0              637   752   683
841.39/841.49	c 1016719        6364658        148861929      772175319      894            0              611   723   681
919.49/919.54	c 1118461        6959384        162606608      844979640      894            0              626   740   682
1008.19/1008.26	c 1230377        7635687        178177998      926718954      894            0              587   753   689
1112.00/1112.01	c 1353484        8401368        196482658      1017956693     894            0              627   742   684
1213.00/1213.06	c 1488901        9206619        214362789      1108108898     894            0              563   739   687
1295.10/1295.15	c 1637859        9915562        228907286      1187204812     894            0              558   746   696
1425.10/1425.11	c 1801712        11028792       251995542      1307307049     894            0              574   750   692
1575.30/1575.37	c 1981950        12275670       278694134      1447862538     894            0              550   745   695
1735.70/1735.78	c 2180211        13475042       307128856      1608528943     894            0              557   753   702
1926.40/1926.42	c 2398298        14937815       340727938      1790374016     894            0              564   752   697
2110.70/2110.74	c 2638193        16275468       373280813      1966164653     894            0              616   738   684
2316.90/2316.99	c 2902077        17854637       409954314      2156328423     894            0              600   730   683
2520.01/2520.00	
2520.01/2520.00	c *** INTERRUPTED ***
2520.01/2520.00	c restarts              : 84          
2520.01/2520.00	c conflicts             : 3157933      (1253 /sec)
2520.01/2520.00	c decisions             : 19334856     (7673 /sec)
2520.01/2520.00	c propagations          : 2352082804  (933359 /sec)
2520.01/2520.00	c root propagations     : 4686        
2520.01/2520.00	c filter calls          : 445761722      (176888 /sec)
2520.01/2520.00	c useless filter calls  : 110501337      (24 %)
2520.01/2520.00	c Memory used           : 32.52 MB
2520.01/2520.00	c CPU time              : 2520.02 s
2520.01/2520.00	c real time             : 2520 s
2520.01/2520.00	
2520.01/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13750 MiB free)
  memory of node 1: 16384 MiB (14183 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389573-1568358434/watcher-4389573-1568358434 -o /tmp/evaluation-result-4389573-1568358434/solver-4389573-1568358434 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node126-1568358397-4231 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389573-1568358434.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=4250, runsolver pid=4247

[startup+0.100661 s]*
/proc/loadavg: 3.53 3.33 2.68 3/199 4261
/proc/meminfo: memFree=28595024/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=32504 memory=8936 CPUtime=0.1 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 2420 0 0 0 10 0 0 0 20 0 1 0 412111255 33284096 2234 33554432000 4194304 6210612 140737245660000 140737245657592 5397289 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8126 2234 859 493 0 1431 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32504 KiB
Current children cumulated memory: 8936 KiB

[startup+0.209618 s]*
/proc/loadavg: 3.53 3.33 2.68 3/199 4261
/proc/meminfo: memFree=28593532/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=32900 memory=9464 CPUtime=0.2 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 2535 0 0 0 20 0 0 0 20 0 1 0 412111255 33689600 2366 33554432000 4194304 6210612 140737245660000 140737245657288 5079072 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8225 2366 862 493 0 1530 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 32900 KiB
Current children cumulated memory: 9464 KiB

[startup+0.309047 s]*
/proc/loadavg: 3.53 3.33 2.68 3/199 4261
/proc/meminfo: memFree=28593424/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33032 memory=9464 CPUtime=0.3 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 2549 0 0 0 30 0 0 0 20 0 1 0 412111255 33824768 2366 33554432000 4194304 6210612 140737245660000 140737245657288 5082025 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8258 2366 862 493 0 1563 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+0.700276 s]
/proc/loadavg: 3.53 3.33 2.68 3/199 4261
/proc/meminfo: memFree=28593424/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33032 memory=9464 CPUtime=0.69 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 2562 0 0 0 69 0 0 0 20 0 1 0 412111255 33824768 2366 33554432000 4194304 6210612 140737245660000 140737245657288 5396166 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8258 2366 862 493 0 1563 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+1.50028 s]
/proc/loadavg: 3.53 3.33 2.68 3/200 4263
/proc/meminfo: memFree=28592164/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33032 memory=9464 CPUtime=1.49 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 2572 0 0 0 149 0 0 0 20 0 1 0 412111255 33824768 2366 33554432000 4194304 6210612 140737245660000 140737245657960 5080981 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8258 2366 862 493 0 1563 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+3.10926 s]
/proc/loadavg: 3.41 3.31 2.67 3/200 4263
/proc/meminfo: memFree=28591548/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33032 memory=9640 CPUtime=3.09 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 4026 0 0 0 309 0 0 0 20 0 1 0 412111255 33824768 2410 33554432000 4194304 6210612 140737245660000 140737245657960 5192894 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8258 2410 862 493 0 1563 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9640 KiB

[startup+6.30027 s]
/proc/loadavg: 3.41 3.31 2.67 3/200 4263
/proc/meminfo: memFree=28591208/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33164 memory=9664 CPUtime=6.28 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 5493 0 0 0 628 0 0 0 20 0 1 0 412111255 33959936 2416 33554432000 4194304 6210612 140737245660000 140737245657592 5082438 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8291 2416 862 493 0 1596 0
Current children cumulated CPU time: 6.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9664 KiB

[startup+12.7003 s]
/proc/loadavg: 3.19 3.26 2.67 3/199 4263
/proc/meminfo: memFree=28591060/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33164 memory=9680 CPUtime=12.68 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 5942 0 0 0 1268 0 0 0 20 0 1 0 412111255 33959936 2420 33554432000 4194304 6210612 140737245660000 140737245657960 5082636 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8291 2420 862 493 0 1596 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9680 KiB

[startup+25.5003 s]
/proc/loadavg: 3.01 3.22 2.66 3/199 4263
/proc/meminfo: memFree=28591420/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33164 memory=9704 CPUtime=25.48 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 6843 0 0 0 2548 0 0 0 20 0 1 0 412111255 33959936 2426 33554432000 4194304 6210612 140737245660000 140737245657960 5080965 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8291 2426 862 493 0 1596 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9704 KiB

[startup+51.1093 s]
/proc/loadavg: 2.67 3.12 2.64 3/199 4265
/proc/meminfo: memFree=28591368/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33164 memory=9712 CPUtime=51.09 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 7301 0 0 0 5109 0 0 0 20 0 1 0 412111255 33959936 2428 33554432000 4194304 6210612 140737245660000 140737245657960 5076037 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8291 2428 862 493 0 1596 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9712 KiB

[startup+102.3 s]
/proc/loadavg: 2.27 2.94 2.61 3/199 4269
/proc/meminfo: memFree=28590740/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33164 memory=9744 CPUtime=102.28 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 7769 0 0 0 10228 0 0 0 20 0 1 0 412111255 33959936 2436 33554432000 4194304 6210612 140737245660000 140737245657960 5082059 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8291 2436 862 493 0 1596 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9744 KiB

[startup+162.3 s]
/proc/loadavg: 2.13 2.78 2.57 3/199 4273
/proc/meminfo: memFree=28591028/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33164 memory=9756 CPUtime=162.28 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 8234 0 0 0 16228 0 0 0 20 0 1 0 412111255 33959936 2439 33554432000 4194304 6210612 140737245660000 140737245657960 5078896 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8291 2439 862 493 0 1596 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9756 KiB

[startup+222.3 s]
/proc/loadavg: 2.05 2.64 2.54 3/200 4285
/proc/meminfo: memFree=28589816/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33164 memory=9764 CPUtime=222.28 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 8701 0 0 0 22228 0 0 0 20 0 1 0 412111255 33959936 2441 33554432000 4194304 6210612 140737245660000 140737245657960 5076021 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8291 2441 862 493 0 1596 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9764 KiB

[startup+282.3 s]
/proc/loadavg: 2.02 2.52 2.50 3/200 4291
/proc/meminfo: memFree=28590056/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33164 memory=9772 CPUtime=282.28 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 9168 0 0 0 28228 0 0 0 20 0 1 0 412111255 33959936 2443 33554432000 4194304 6210612 140737245660000 140737245657960 5082455 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8291 2443 862 493 0 1596 0
Current children cumulated CPU time: 282.28 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9772 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.43 2.47 3/200 4295
/proc/meminfo: memFree=28591044/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33164 memory=9780 CPUtime=342.29 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 9639 0 0 0 34229 0 0 0 20 0 1 0 412111255 33959936 2445 33554432000 4194304 6210612 140737245660000 140737245657960 5074225 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8291 2445 862 493 0 1596 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9780 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.35 2.44 3/200 4299
/proc/meminfo: memFree=28591416/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33164 memory=9780 CPUtime=402.29 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 10108 0 0 0 40229 0 0 0 20 0 1 0 412111255 33959936 2445 33554432000 4194304 6210612 140737245660000 140737245657960 5078394 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8291 2445 862 493 0 1596 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9780 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.29 2.41 3/200 4305
/proc/meminfo: memFree=28590668/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33164 memory=9780 CPUtime=462.29 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 10577 0 0 0 46229 0 0 0 20 0 1 0 412111255 33959936 2445 33554432000 4194304 6210612 140737245660000 140737245657960 5075426 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8291 2445 862 493 0 1596 0
Current children cumulated CPU time: 462.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9780 KiB


################
# More data... #
################

/proc/4250/statm: 8291 2451 862 493 0 1596 0
Current children cumulated CPU time: 1722.3 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9804 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.12 3/200 4427
/proc/meminfo: memFree=28589508/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33164 memory=9804 CPUtime=1782.3 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 19288 0 0 0 178230 0 0 0 20 0 1 0 412111255 33959936 2451 33554432000 4194304 6210612 140737245660000 140737245657960 5074840 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8291 2451 862 493 0 1596 0
Current children cumulated CPU time: 1782.3 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9804 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.11 3/201 4432
/proc/meminfo: memFree=28589428/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33164 memory=9804 CPUtime=1842.3 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 19551 0 0 0 184230 0 0 0 20 0 1 0 412111255 33959936 2451 33554432000 4194304 6210612 140737245660000 140737245657960 5079006 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8291 2451 862 493 0 1596 0
Current children cumulated CPU time: 1842.3 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9804 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.10 3/201 4438
/proc/meminfo: memFree=28588996/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33164 memory=9804 CPUtime=1902.3 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 19818 0 0 0 190230 0 0 0 20 0 1 0 412111255 33959936 2451 33554432000 4194304 6210612 140737245660000 140737245657960 5078380 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8291 2451 862 493 0 1596 0
Current children cumulated CPU time: 1902.3 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9804 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.10 3/200 4442
/proc/meminfo: memFree=28589340/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33296 memory=9804 CPUtime=1962.3 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 20293 0 0 0 196230 0 0 0 20 0 1 0 412111255 34095104 2451 33554432000 4194304 6210612 140737245660000 140737245657592 5074898 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8324 2451 862 493 0 1629 0
Current children cumulated CPU time: 1962.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9804 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.09 3/200 4453
/proc/meminfo: memFree=28588904/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33296 memory=9808 CPUtime=2022.3 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 20558 0 0 0 202230 0 0 0 20 0 1 0 412111255 34095104 2452 33554432000 4194304 6210612 140737245660000 140737245657592 5081382 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8324 2452 862 493 0 1629 0
Current children cumulated CPU time: 2022.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9808 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.09 3/200 4459
/proc/meminfo: memFree=28588552/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33296 memory=9808 CPUtime=2082.3 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 20823 0 0 0 208230 0 0 0 20 0 1 0 412111255 34095104 2452 33554432000 4194304 6210612 140737245660000 140737245657592 5075781 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8324 2452 862 493 0 1629 0
Current children cumulated CPU time: 2082.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9808 KiB

[startup+2142.3 s]
/proc/loadavg: 2.05 2.03 2.09 3/200 4463
/proc/meminfo: memFree=28588952/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33296 memory=9808 CPUtime=2142.3 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 21298 0 0 0 214230 0 0 0 20 0 1 0 412111255 34095104 2452 33554432000 4194304 6210612 140737245660000 140737245657960 5078960 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8324 2452 862 493 0 1629 0
Current children cumulated CPU time: 2142.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9808 KiB

[startup+2202.3 s]
/proc/loadavg: 2.02 2.02 2.08 3/200 4467
/proc/meminfo: memFree=28589152/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33296 memory=9808 CPUtime=2202.3 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 21560 0 0 0 220230 0 0 0 20 0 1 0 412111255 34095104 2452 33554432000 4194304 6210612 140737245660000 140737245657960 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8324 2452 862 493 0 1629 0
Current children cumulated CPU time: 2202.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9808 KiB

[startup+2262.3 s]
/proc/loadavg: 2.01 2.02 2.07 3/200 4473
/proc/meminfo: memFree=28588404/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33296 memory=9808 CPUtime=2262.3 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 21822 0 0 0 226230 0 0 0 20 0 1 0 412111255 34095104 2452 33554432000 4194304 6210612 140737245660000 140737245657960 5074840 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8324 2452 862 493 0 1629 0
Current children cumulated CPU time: 2262.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9808 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.07 3/200 4477
/proc/meminfo: memFree=28589504/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33296 memory=9808 CPUtime=2322.3 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 22299 0 0 0 232230 0 0 0 20 0 1 0 412111255 34095104 2452 33554432000 4194304 6210612 140737245660000 140737245657960 5076037 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8324 2452 862 493 0 1629 0
Current children cumulated CPU time: 2322.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9808 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.06 3/200 4481
/proc/meminfo: memFree=28589196/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33296 memory=9812 CPUtime=2382.3 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 22562 0 0 0 238230 0 0 0 20 0 1 0 412111255 34095104 2453 33554432000 4194304 6210612 140737245660000 140737245657960 5082029 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 2382.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.06 3/199 4487
/proc/meminfo: memFree=28588928/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33296 memory=9812 CPUtime=2442.3 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 22825 0 0 0 244230 0 0 0 20 0 1 0 412111255 34095104 2453 33554432000 4194304 6210612 140737245660000 140737245657960 5081335 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 2442.3 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+2502.3 s]
/proc/loadavg: 2.34 2.09 2.08 3/199 4491
/proc/meminfo: memFree=28589484/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33296 memory=9812 CPUtime=2502.31 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 23086 0 0 0 250231 0 0 0 20 0 1 0 412111255 34095104 2453 33554432000 4194304 6210612 140737245660000 140737245657960 5078394 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 2502.31 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.53 2.15 2.10 3/199 4491
/proc/meminfo: memFree=28589080/32770624 swapFree=67004752/67108860
[pid=4250] ppid=4247 vsize=33296 memory=9812 CPUtime=2520.01 cores=1,3,5,7
/proc/4250/stat : 4250 (cosoco) R 4247 4250 2914 0 -1 4202496 23347 0 0 0 252001 0 0 0 20 0 1 0 412111255 34095104 2453 33554432000 4194304 6210612 140737245660000 140737245657960 5192880 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 21221376 140737245664267 140737245664369 140737245664369 140737245667278 0
/proc/4250/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 2520.01 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 4250 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.02 s, system=0.009 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.03
CPU user time (s): 2520.02
CPU system time (s): 0.009
CPU usage (%): 100.001
Max. virtual memory (cumulated for all children) (KiB): 33296
Max. memory (cumulated for all children) (KiB): 9812

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.02
system time used= 0.009
maximum resident set size= 9880
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 23403
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 692


# summary of solver processes directly reported to runsolver:
#   pid: 4250
#   total CPU time (s): 2520.03
#   total CPU user time (s): 2520.02
#   total CPU system time (s): 0.009

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.70842 second user time and 16.2298 second system time

The end

Launcher Data 

Begin job on node126 at 2019-09-13 09:06:37
IDJOB=4389573
IDBENCH=138965
IDSOLVER=2829
FILE ID=node126/4389573-1568358434
RUNJOBID= node126-1568358397-4231
PBS_JOBID= 21701174
Free space on /tmp= 55388 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h374-08.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389573-1568358434/watcher-4389573-1568358434 -o /tmp/evaluation-result-4389573-1568358434/solver-4389573-1568358434 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node126-1568358397-4231 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389573-1568358434.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= a38db4eec3f77542c2f3ff7a616038a8
RANDOM SEED=1460799438

node126.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.45
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.56
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        28607920 kB
MemAvailable:   31860368 kB
Buffers:          143388 kB
Cached:          3350140 kB
SwapCached:         2860 kB
Active:          1841232 kB
Inactive:        1657304 kB
Active(anon):       3584 kB
Inactive(anon):    43276 kB
Active(file):    1837648 kB
Inactive(file):  1614028 kB
Unevictable:      109112 kB
Mlocked:          109112 kB
SwapTotal:      67108860 kB
SwapFree:       67004752 kB
Dirty:              2744 kB
Writeback:             0 kB
AnonPages:        112308 kB
Mapped:            43528 kB
Shmem:             32816 kB
Slab:             258820 kB
SReclaimable:     229232 kB
SUnreclaim:        29588 kB
KernelStack:        3664 kB
PageTables:         5324 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     502384 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      130432 kB
DirectMap2M:    33415168 kB

Free space on /tmp at the end= 55380 MiB
End job on node126 at 2019-09-13 09:48:37