Trace number 4389536

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2520.06 2520.01

General information on the benchmark

NameLatinSquare/LatinSquare-m1-gp/
qwh-o30-h375-01.xml
MD5SUMdebd4f53dd650fe0aa41c33fe17bde33
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark11.8697
Satisfiable
(Un)Satisfiability was proved
Number of variables900
Number of constraints2
Number of domains1
Minimum domain size30
Maximum domain size30
Distribution of domain sizes[{"size":30,"count":900}]
Minimum variable degree1
Maximum variable degree2
Distribution of variable degrees[{"degree":1,"count":375},{"degree":2,"count":525}]
Minimum constraint arity525
Maximum constraint arity900
Distribution of constraint arities[{"arity":525,"count":1},{"arity":900,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"instantiation","count":1}]
Optimization problemNO
Type of objective

Solver Data

0.00/0.02	c root propagations     : 4542        
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389536-1568358484.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 900
0.00/0.02	c |            Domain Sizes: 30..30
0.00/0.02	c |
0.00/0.02	c |             Constraints: 585
0.00/0.02	c |                   Arity: 1..30  -- Unary: 525
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 60
0.00/0.02	c |                          Unary: 525
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.06	c 101            947            10926          30122          892            0              556   657   638
0.10/0.14	c 211            2145           25140          86452          892            0              192   699   646
0.20/0.24	c 332            3585           43726          168328         892            0              596   704   667
0.20/0.30	c 465            4957           55773          202721         892            0              521   646   611
0.40/0.43	c 611            6097           77905          300325         892            0              578   675   657
0.50/0.57	c 771            7701           103586         412294         892            0              567   703   669
0.60/0.64	c 947            9005           117800         468451         892            0              603   674   641
0.79/0.86	c 1140           10849          154797         659561         892            0              581   686   663
0.89/1.00	c 1352           12543          181119         777010         892            0              579   703   668
1.10/1.15	c 1585           14498          207679         896549         892            0              607   707   667
1.29/1.34	c 1841           16650          241501         1055144        892            0              566   705   670
1.39/1.48	c 2122           18545          266652         1167999        892            0              561   720   657
1.49/1.54	c 2431           20346          278787         1200595        892            0              561   599   581
1.59/1.61	c 2770           22216          293515         1256477        892            0              550   638   619
1.59/1.69	c 3142           23739          307487         1307934        892            0              535   579   563
1.69/1.77	c 3551           25460          322833         1357364        892            0              530   552   536
1.79/1.87	c 4000           27288          342846         1429838        892            0              513   537   528
1.89/1.98	c 4493           31295          365195         1491929        892            0              395   510   469
1.99/2.05	c 5035           33207          379688         1538342        892            0              447   478   455
2.39/2.48	c 5631           37743          455667         1902088        892            0              366   706   588
2.99/3.01	c 6286           42751          550218         2358072        892            0              454   706   669
3.49/3.56	c 7006           47847          648827         2848278        892            0              503   720   676
4.10/4.15	c 7798           52771          753100         3348696        892            0              519   702   676
4.79/4.84	c 8669           58109          875415         3926963        892            0              525   700   672
5.49/5.55	c 9627           65194          1001966        4590175        892            0              531   728   689
6.49/6.56	c 10680          71198          1178763        5487985        892            0              532   714   677
7.29/7.34	c 11838          78040          1317822        6242984        892            0              534   719   693
8.19/8.23	c 13111          86188          1477033        7103696        892            0              535   755   711
9.19/9.29	c 14511          96386          1665935        7999458        892            0              534   716   675
10.19/10.25	c 16051          106088         1835767        8916443        892            0              536   714   675
11.10/11.12	c 17745          113594         1991561        9666715        892            0              534   693   663
12.49/12.57	c 19608          123389         2246286        10992989       892            0              534   717   678
14.49/14.59	c 21657          142327         2606676        12714867       892            0              533   726   686
16.19/16.24	c 23910          159739         2901354        14068285       892            0              537   703   666
19.19/19.24	c 26388          186670         3431043        16834740       892            0              536   742   702
21.69/21.79	c 29113          203458         3876910        19287133       892            0              549   744   707
23.79/23.89	c 32110          216450         4245452        21441336       892            0              550   717   694
26.00/26.09	c 35406          233715         4637389        23530467       892            0              562   753   704
28.10/28.15	c 39031          259449         5008850        25239522       892            0              540   740   676
30.59/30.65	c 43018          280743         5444970        27665350       892            0              592   738   699
33.79/33.88	c 47403          306331         6019227        30687453       892            0              596   722   689
37.89/37.98	c 52226          334458         6738717        34627554       892            0              622   729   684
41.59/41.63	c 57531          363775         7389524        38039763       892            0              612   741   704
46.10/46.13	c 63366          404221         8189278        42472656       892            0              656   764   717
51.49/51.59	c 69784          442901         9145089        47729379       892            0              642   729   685
56.39/56.47	c 76843          479561         9999845        52382748       892            0              612   731   680
62.49/62.58	c 84607          533037         11094480       58067040       892            0              623   743   694
69.49/69.54	c 93147          588790         12321299       64921042       892            0              631   765   721
76.10/76.16	c 102541         643258         13497791       71402359       892            0              646   743   699
83.89/83.91	c 112874         709875         14875756       79249216       892            0              574   744   702
92.39/92.42	c 124240         776241         16379852       87963806       892            0              570   732   698
100.00/100.01	c 136742         852742         17739650       95186755       892            0              639   756   692
108.49/108.56	c 150494         932129         19274085       103434653      892            0              597   734   689
120.10/120.15	c 165621         1025543        21334932       114611555      892            0              554   752   705
133.49/133.51	c 182260         1162471        23720401       126778164      892            0              599   757   703
150.00/150.08	c 200562         1285079        26641398       142905195      892            0              545   752   694
164.79/164.85	c 220694         1416455        29288320       157204404      892            0              564   730   685
179.19/179.23	c 242839         1536496        31836884       171943129      892            0              540   722   672
198.29/198.38	c 267198         1695002        35254538       189597819      892            0              542   737   689
220.00/220.06	c 293992         1858740        39100878       209942386      892            0              546   753   701
240.29/240.31	c 323465         2028391        42745997       230797199      892            0              537   771   723
262.69/262.73	c 355885         2228752        46761669       253652402      892            0              537   766   711
284.10/284.20	c 391547         2400698        50550267       276115504      892            0              539   734   696
316.89/316.94	c 430775         2641191        56365841       305873829      892            0              541   736   684
351.19/351.28	c 473925         2903373        62448439       340288799      892            0              539   764   717
383.39/383.45	c 521390         3187912        68198414       372979638      892            0              539   750   709
420.20/420.20	c 573601         3511932        74799240       409333786      892            0              538   738   695
464.40/464.44	c 631033         3803275        82615972       455966197      892            0              540   731   690
501.90/501.93	c 694208         4079129        89206762       495232954      892            0              541   732   686
557.80/557.83	c 763700         4488191        99150618       546069115      892            0              540   718   676
623.01/623.08	c 840141         4934055        110652525      606699959      892            0              549   729   684
681.11/681.12	c 924226         5388219        120928101      664125076      892            0              552   743   685
738.50/738.56	c 1016719        5936184        131141574      720169459      892            0              553   735   681
796.80/796.81	c 1118461        6486625        141547906      780209555      892            0              548   757   705
879.30/879.36	c 1230377        7106985        156119202      859646790      892            0              544   743   691
959.11/959.15	c 1353484        7747891        170249932      934388885      892            0              540   748   685
1055.21/1055.22	c 1488901        8601494        187471051      1021859142     892            0              540   745   696
1144.61/1144.64	c 1637859        9397727        203475599      1108946175     892            0              536   749   697
1255.92/1255.91	c 1801712        10459693       223374581      1210710988     892            0              537   757   690
1344.62/1344.63	c 1981950        11308673       239338541      1295374904     892            0              531   767   711
1485.23/1485.25	c 2180211        12494634       264432427      1415304763     892            0              529   733   684
1647.43/1647.46	c 2398298        13875810       293182519      1560630222     892            0              529   749   691
1781.63/1781.68	c 2638193        15045761       317255002      1678552061     892            0              529   740   678
2013.53/2013.52	c 2902077        16772679       358531268      1894622570     892            0              529   748   688
2167.34/2167.35	c 3192349        18396764       386264559      2030738500     892            0              529   753   686
2468.15/2468.17	c 3511648        20591037       439312601      2304133149     892            0              529   745   695
2520.05/2520.00	
2520.05/2520.00	c *** INTERRUPTED ***
2520.05/2520.00	c restarts              : 86          
2520.05/2520.00	c conflicts             : 3583399      (1422 /sec)
2520.05/2520.00	c decisions             : 21002740     (8334 /sec)
2520.05/2520.00	c propagations          : 2349124237  (932178 /sec)
2520.05/2520.00	c root propagations     : 4542        
2520.05/2520.00	c filter calls          : 448538843      (177989 /sec)
2520.05/2520.00	c useless filter calls  : 117172905      (26 %)
2520.05/2520.00	c Memory used           : 32.52 MB
2520.05/2520.00	c CPU time              : 2520.04 s
2520.05/2520.00	c real time             : 2520.01 s
2520.05/2520.00	
2520.05/2520.00	s UNKNOWN

Verifier Data


Watcher Data

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (13994 MiB free)
  memory of node 1: 16384 MiB (13326 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389536-1568358484/watcher-4389536-1568358484 -o /tmp/evaluation-result-4389536-1568358484/solver-4389536-1568358484 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node127-1568329019-3495 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389536-1568358484.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=10403, runsolver pid=10400

[startup+0.100195 s]*
/proc/loadavg: 2.00 1.99 2.03 3/199 10404
/proc/meminfo: memFree=27972192/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=32768 memory=9200 CPUtime=0.1 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 2506 0 0 0 10 0 0 0 20 0 1 0 412117277 33554432 2300 33554432000 4194304 6210612 140734770332000 140734770328536 5080969 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8192 2300 862 493 0 1497 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32768 KiB
Current children cumulated memory: 9200 KiB

[startup+0.209958 s]*
/proc/loadavg: 2.00 1.99 2.03 3/199 10404
/proc/meminfo: memFree=27971540/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=32900 memory=9464 CPUtime=0.2 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 2532 0 0 0 20 0 0 0 20 0 1 0 412117277 33689600 2366 33554432000 4194304 6210612 140734770332000 140734770328536 5082037 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8225 2366 862 493 0 1530 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 32900 KiB
Current children cumulated memory: 9464 KiB

[startup+0.309242 s]*
/proc/loadavg: 2.00 1.99 2.03 3/199 10404
/proc/meminfo: memFree=27971540/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=32900 memory=9464 CPUtime=0.3 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 2538 0 0 0 30 0 0 0 20 0 1 0 412117277 33689600 2366 33554432000 4194304 6210612 140734770332000 140734770328536 139954757737445 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8225 2366 862 493 0 1530 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 32900 KiB
Current children cumulated memory: 9464 KiB

[startup+0.700344 s]
/proc/loadavg: 2.00 1.99 2.03 3/200 10406
/proc/meminfo: memFree=27970016/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33032 memory=9464 CPUtime=0.69 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 2556 0 0 0 69 0 0 0 20 0 1 0 412117277 33824768 2366 33554432000 4194304 6210612 140734770332000 140734770328536 5082391 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8258 2366 862 493 0 1563 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+1.50034 s]
/proc/loadavg: 2.00 1.99 2.03 5/200 10406
/proc/meminfo: memFree=27970264/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33032 memory=9464 CPUtime=1.49 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 2566 0 0 0 149 0 0 0 20 0 1 0 412117277 33824768 2366 33554432000 4194304 6210612 140734770332000 140734770328536 5075025 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8258 2366 862 493 0 1563 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 33032 KiB
Current children cumulated memory: 9464 KiB

[startup+3.10948 s]
/proc/loadavg: 2.00 1.99 2.03 4/200 10406
/proc/meminfo: memFree=27970156/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33164 memory=9664 CPUtime=3.1 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 4040 0 0 0 310 0 0 0 20 0 1 0 412117277 33959936 2416 33554432000 4194304 6210612 140734770332000 140734770328536 5082394 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8291 2416 862 493 0 1596 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9664 KiB

[startup+6.30033 s]
/proc/loadavg: 2.00 1.99 2.03 4/199 10406
/proc/meminfo: memFree=27969732/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33164 memory=9708 CPUtime=6.29 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 5514 0 0 0 629 0 0 0 20 0 1 0 412117277 33959936 2427 33554432000 4194304 6210612 140734770332000 140734770329960 5076075 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8291 2427 862 493 0 1596 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9708 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 1.99 2.03 4/199 10406
/proc/meminfo: memFree=27970104/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33164 memory=9732 CPUtime=12.69 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 7003 0 0 0 1268 1 0 0 20 0 1 0 412117277 33959936 2433 33554432000 4194304 6210612 140734770332000 140734770329960 5081030 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8291 2433 862 493 0 1596 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9732 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 1.99 2.03 4/199 10406
/proc/meminfo: memFree=27969924/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33164 memory=9780 CPUtime=25.49 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 9979 0 0 0 2548 1 0 0 20 0 1 0 412117277 33959936 2445 33554432000 4194304 6210612 140734770332000 140734770329960 5075367 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8291 2445 862 493 0 1596 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9780 KiB

[startup+51.1094 s]
/proc/loadavg: 2.00 1.99 2.03 4/199 10408
/proc/meminfo: memFree=27969168/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33164 memory=9780 CPUtime=51.1 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 11464 0 0 0 5109 1 0 0 20 0 1 0 412117277 33959936 2445 33554432000 4194304 6210612 140734770332000 140734770329960 5409293 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8291 2445 862 493 0 1596 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9780 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 1.99 2.03 4/199 10412
/proc/meminfo: memFree=27969104/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33164 memory=9784 CPUtime=102.29 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 12960 0 0 0 10228 1 0 0 20 0 1 0 412117277 33959936 2446 33554432000 4194304 6210612 140734770332000 140734770329960 5078896 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8291 2446 862 493 0 1596 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 1.99 2.03 4/201 10425
/proc/meminfo: memFree=27967752/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33164 memory=9784 CPUtime=162.29 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 14448 0 0 0 16228 1 0 0 20 0 1 0 412117277 33959936 2446 33554432000 4194304 6210612 140734770332000 140734770329960 5082063 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8291 2446 862 493 0 1596 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 1.99 2.03 4/201 10429
/proc/meminfo: memFree=27965396/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33164 memory=9784 CPUtime=222.29 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 15933 0 0 0 22228 1 0 0 20 0 1 0 412117277 33959936 2446 33554432000 4194304 6210612 140734770332000 140734770329960 5192880 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8291 2446 862 493 0 1596 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9784 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 1.99 2.03 4/201 10435
/proc/meminfo: memFree=27964816/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33164 memory=9788 CPUtime=282.29 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 17416 0 0 0 28228 1 0 0 20 0 1 0 412117277 33959936 2447 33554432000 4194304 6210612 140734770332000 140734770329960 5074183 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8291 2447 862 493 0 1596 0
Current children cumulated CPU time: 282.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9788 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 1.99 2.03 4/201 10439
/proc/meminfo: memFree=27964960/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33164 memory=9788 CPUtime=342.29 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 17891 0 0 0 34228 1 0 0 20 0 1 0 412117277 33959936 2447 33554432000 4194304 6210612 140734770332000 140734770329960 5082438 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8291 2447 862 493 0 1596 0
Current children cumulated CPU time: 342.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9788 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 1.99 2.03 4/201 10443
/proc/meminfo: memFree=27964700/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33164 memory=9788 CPUtime=402.29 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 18367 0 0 0 40228 1 0 0 20 0 1 0 412117277 33959936 2447 33554432000 4194304 6210612 140734770332000 140734770329960 5078408 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8291 2447 862 493 0 1596 0
Current children cumulated CPU time: 402.29 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9788 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 1.99 2.03 4/199 10449
/proc/meminfo: memFree=27961536/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33164 memory=9788 CPUtime=462.3 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 18842 0 0 0 46229 1 0 0 20 0 1 0 412117277 33959936 2447 33554432000 4194304 6210612 140734770332000 140734770329960 5079064 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8291 2447 862 493 0 1596 0
Current children cumulated CPU time: 462.3 s
Current children cumulated vsize: 33164 KiB
Current children cumulated memory: 9788 KiB


################
# More data... #
################

/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 1722.33 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 1.99 2.03 4/199 10568
/proc/meminfo: memFree=27954544/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33296 memory=9812 CPUtime=1782.33 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 27891 0 0 0 178231 2 0 0 20 0 1 0 412117277 34095104 2453 33554432000 4194304 6210612 140734770332000 140734770329960 5081335 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 1782.33 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 1.99 2.03 4/199 10572
/proc/meminfo: memFree=27955020/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33296 memory=9812 CPUtime=1842.33 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 28154 0 0 0 184231 2 0 0 20 0 1 0 412117277 34095104 2453 33554432000 4194304 6210612 140734770332000 140734770329960 5078555 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 1842.33 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 1.99 2.03 4/199 10578
/proc/meminfo: memFree=27955372/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33296 memory=9812 CPUtime=1902.33 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 28418 0 0 0 190231 2 0 0 20 0 1 0 412117277 34095104 2453 33554432000 4194304 6210612 140734770332000 140734770329960 5078496 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 1902.33 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 1.99 2.03 4/199 10589
/proc/meminfo: memFree=27953944/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33296 memory=9812 CPUtime=1962.33 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 28682 0 0 0 196231 2 0 0 20 0 1 0 412117277 34095104 2453 33554432000 4194304 6210612 140734770332000 140734770329960 5078384 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 1962.33 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 1.99 2.03 4/199 10593
/proc/meminfo: memFree=27954872/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33296 memory=9812 CPUtime=2022.33 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 29162 0 0 0 202231 2 0 0 20 0 1 0 412117277 34095104 2453 33554432000 4194304 6210612 140734770332000 140734770329960 5082025 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 2022.33 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+2082.3 s]
/proc/loadavg: 1.87 1.95 2.02 3/199 10659
/proc/meminfo: memFree=28377640/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33296 memory=9812 CPUtime=2082.34 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 29431 0 0 0 208232 2 0 0 20 0 1 0 412117277 34095104 2453 33554432000 4194304 6210612 140734770332000 140734770329960 5074673 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 2082.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+2142.3 s]
/proc/loadavg: 1.95 1.96 2.02 3/199 10663
/proc/meminfo: memFree=28377716/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33296 memory=9812 CPUtime=2142.34 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 29700 0 0 0 214232 2 0 0 20 0 1 0 412117277 34095104 2453 33554432000 4194304 6210612 140734770332000 140734770329960 5081990 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 2142.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+2202.3 s]
/proc/loadavg: 1.98 1.97 2.02 3/199 10667
/proc/meminfo: memFree=28377240/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33296 memory=9812 CPUtime=2202.34 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 30180 0 0 0 220232 2 0 0 20 0 1 0 412117277 34095104 2453 33554432000 4194304 6210612 140734770332000 140734770329960 5076034 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 2202.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+2262.3 s]
/proc/loadavg: 1.99 1.97 2.02 3/199 10673
/proc/meminfo: memFree=28376880/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33296 memory=9812 CPUtime=2262.34 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 30447 0 0 0 226232 2 0 0 20 0 1 0 412117277 34095104 2453 33554432000 4194304 6210612 140734770332000 140734770329960 5078678 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 2262.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 1.98 2.02 3/199 10677
/proc/meminfo: memFree=28377752/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33296 memory=9812 CPUtime=2322.34 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 30713 0 0 0 232232 2 0 0 20 0 1 0 412117277 34095104 2453 33554432000 4194304 6210612 140734770332000 140734770329960 5082081 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 2322.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 1.98 2.02 3/199 10681
/proc/meminfo: memFree=28377580/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33296 memory=9812 CPUtime=2382.34 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 30979 0 0 0 238232 2 0 0 20 0 1 0 412117277 34095104 2453 33554432000 4194304 6210612 140734770332000 140734770329960 5078384 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 2382.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 1.99 2.02 3/199 10687
/proc/meminfo: memFree=28377216/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33296 memory=9812 CPUtime=2442.34 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 31245 0 0 0 244232 2 0 0 20 0 1 0 412117277 34095104 2453 33554432000 4194304 6210612 140734770332000 140734770329960 5078536 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 2442.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 1.99 2.02 3/199 10691
/proc/meminfo: memFree=28377144/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33296 memory=9812 CPUtime=2502.34 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 31726 0 0 0 250232 2 0 0 20 0 1 0 412117277 34095104 2453 33554432000 4194304 6210612 140734770332000 140734770329960 5078384 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 2502.34 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 1.99 2.02 3/199 10691
/proc/meminfo: memFree=28376612/32770624 swapFree=66998520/67108860
[pid=10403] ppid=10400 vsize=33296 memory=9812 CPUtime=2520.05 cores=0,2,4,6
/proc/10403/stat : 10403 (cosoco) R 10400 10403 3464 0 -1 4202496 31989 0 0 0 252003 2 0 0 20 0 1 0 412117277 34095104 2453 33554432000 4194304 6210612 140734770332000 140734770329960 5076063 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 36847616 140734770336779 140734770336881 140734770336881 140734770339790 0
/proc/10403/statm: 8324 2453 862 493 0 1629 0
Current children cumulated CPU time: 2520.05 s
Current children cumulated vsize: 33296 KiB
Current children cumulated memory: 9812 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 10403 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.04 s, system=0.024 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2520.06
CPU user time (s): 2520.04
CPU system time (s): 0.024
CPU usage (%): 100.002
Max. virtual memory (cumulated for all children) (KiB): 33296
Max. memory (cumulated for all children) (KiB): 9812

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.04
system time used= 0.024
maximum resident set size= 9880
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 32043
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 665


# summary of solver processes directly reported to runsolver:
#   pid: 10403
#   total CPU time (s): 2520.06
#   total CPU user time (s): 2520.04
#   total CPU system time (s): 0.024

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.96643 second user time and 17.2248 second system time

The end

Launcher Data

Begin job on node127 at 2019-09-13 09:07:24
IDJOB=4389536
IDBENCH=138967
IDSOLVER=2829
FILE ID=node127/4389536-1568358484
RUNJOBID= node127-1568329019-3495
PBS_JOBID= 21701156
Free space on /tmp= 58820 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/LatinSquare/LatinSquare-m1-gp/qwh-o30-h375-01.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389536-1568358484/watcher-4389536-1568358484 -o /tmp/evaluation-result-4389536-1568358484/solver-4389536-1568358484 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node127-1568329019-3495 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389536-1568358484.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= debd4f53dd650fe0aa41c33fe17bde33
RANDOM SEED=529947596

node127.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        27977384 kB
MemAvailable:   31444976 kB
Buffers:          149216 kB
Cached:          3571972 kB
SwapCached:         6780 kB
Active:          2418476 kB
Inactive:        1732640 kB
Active(anon):     422716 kB
Inactive(anon):    48636 kB
Active(file):    1995760 kB
Inactive(file):  1684004 kB
Unevictable:      109044 kB
Mlocked:          109044 kB
SwapTotal:      67108860 kB
SwapFree:       66998520 kB
Dirty:              2724 kB
Writeback:             4 kB
AnonPages:        533828 kB
Mapped:            45704 kB
Shmem:             32692 kB
Slab:             237300 kB
SReclaimable:     207328 kB
SUnreclaim:        29972 kB
KernelStack:        3472 kB
PageTables:         6240 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     946340 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:    481280 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      138624 kB
DirectMap2M:    33406976 kB

Free space on /tmp at the end= 58816 MiB
End job on node127 at 2019-09-13 09:49:24