Trace number 4390007

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2400.07 2400.3

General information on the benchmark

NameColouredQueens/ColouredQueens-m1-s1/
ColouredQueens-08.xml
MD5SUM097ee2ac2bfb45f3aedded97da1eabe0
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark8.52622
Satisfiable
(Un)Satisfiability was proved
Number of variables64
Number of constraints42
Number of domains1
Minimum domain size8
Maximum domain size8
Distribution of domain sizes[{"size":8,"count":64}]
Minimum variable degree3
Maximum variable degree4
Distribution of variable degrees[{"degree":3,"count":4},{"degree":4,"count":60}]
Minimum constraint arity2
Maximum constraint arity8
Distribution of constraint arities[{"arity":2,"count":4},{"arity":3,"count":4},{"arity":4,"count":4},{"arity":5,"count":4},{"arity":6,"count":4},{"arity":7,"count":4},{"arity":8,"count":18}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":42}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.00	c root propagations     : 0           
0.00/0.00	c restarts enabled, print stats at every restarts
0.00/0.00	c
0.00/0.00	c
0.00/0.00	c
0.00/0.00	c This is cosoco 2.00 --  
0.00/0.00	c
0.00/0.00	c command line: cosoco -lc -model -restarts -stick HOME/instance-4390007-1568322803.xml 
0.00/0.00	c ========================================[ Problem Statistics ]===========================================
0.00/0.00	c |                                                                                                       
0.00/0.00	c |  Parse time        :         0.00 s 
0.00/0.00	c |
0.00/0.00	c |               Variables: 64
0.00/0.00	c |            Domain Sizes: 8..8
0.00/0.00	c |
0.00/0.00	c |             Constraints: 42
0.00/0.00	c |                   Arity: 2..8  -- Binary: 4  -- Ternary: 4
0.00/0.00	c | 
0.00/0.00	c |                   Types: 
0.00/0.00	c |                          (X != Y): 4
0.00/0.00	c |                          All Different: 38
0.00/0.00	c |                          
0.00/0.00	c =========================================================================================================
0.00/0.00	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.02	c 101            336            13037          19171          0              0              18   28   23   
0.00/0.03	c 211            746            27872          38661          0              0              17   30   22   
0.00/0.05	c 332            1163           42544          58765          0              0              16   30   22   
0.00/0.07	c 465            1624           61934          83052          0              0              14   29   21   
0.00/0.09	c 611            2154           84214          111508         0              0              2   31   22    
0.10/0.12	c 771            2796           106607         140950         0              0              6   31   22    
0.10/0.14	c 947            3310           127312         170174         0              0              10   30   23   
0.10/0.17	c 1140           4078           156012         208551         0              0              3   32   22    
0.10/0.20	c 1352           4929           185777         249198         0              0              16   30   22   
0.21/0.23	c 1585           5878           217261         289678         0              0              10   28   20   
0.21/0.27	c 1841           6721           248772         328991         0              0              7   31   22    
0.21/0.31	c 2122           7713           285163         377687         0              0              9   31   22    
0.31/0.35	c 2431           8527           321046         425735         0              0              14   28   21   
0.31/0.39	c 2770           9766           366716         483752         0              0              12   28   21   
0.41/0.44	c 3142           11072          411191         539079         0              0              14   32   22   
0.41/0.50	c 3551           12647          473183         619662         0              0              7   33   21    
0.51/0.55	c 4000           13858          519053         677785         0              0              6   30   22    
0.60/0.62	c 4493           15464          585376         766945         0              0              6   33   21    
0.69/0.71	c 5035           17561          661863         867986         0              0              12   29   21   
0.79/0.80	c 5631           19886          749470         985866         0              0              12   31   20   
0.79/0.89	c 6286           22192          838334         1103791        0              0              14   32   22   
0.89/0.98	c 7006           24525          917595         1207283        0              0              15   32   22   
1.00/1.08	c 7798           27126          1016800        1333414        0              0              14   29   21   
1.19/1.21	c 8669           30192          1136608        1485279        0              0              11   33   22   
1.29/1.34	c 9627           33525          1263344        1651045        0              0              12   33   22   
1.39/1.49	c 10680          37184          1402006        1822412        0              0              11   31   20   
1.59/1.66	c 11838          41313          1560693        2023242        0              0              12   32   21   
1.79/1.84	c 13111          46051          1735181        2244424        0              0              12   32   21   
2.00/2.04	c 14511          51175          1933264        2495346        0              0              12   31   20   
2.19/2.26	c 16051          56896          2139830        2759594        0              0              12   32   20   
2.39/2.49	c 17745          62601          2350067        3028860        0              0              13   31   21   
2.69/2.75	c 19608          68741          2591232        3359332        0              0              12   34   22   
3.00/3.03	c 21657          75558          2859523        3727872        0              0              12   31   21   
3.29/3.33	c 23910          82794          3144388        4115303        0              0              13   34   21   
3.59/3.64	c 26388          90466          3440669        4533914        0              0              13   31   21   
3.89/4.00	c 29113          99210          3780359        5001441        0              0              11   32   21   
4.39/4.40	c 32110          108678         4155045        5515930        0              0              12   32   21   
4.79/4.86	c 35406          119853         4590936        6116206        0              0              11   35   21   
5.19/5.27	c 39031          130345         4976854        6649362        0              0              12   34   23   
5.79/5.85	c 43018          143994         5525050        7427239        0              0              12   36   21   
6.49/6.50	c 47403          158742         6137622        8305844        0              0              12   41   21   
7.19/7.22	c 52226          175867         6817869        9258825        0              0              12   36   22   
8.00/8.02	c 57531          194132         7566956        10318634       0              0              11   40   21   
8.79/8.89	c 63366          215277         8398391        11455260       0              0              10   37   21   
9.79/9.82	c 69784          236854         9278223        12692850       0              0              11   39   22   
10.89/10.90	c 76843          261842         10293266       14132262       0              0              11   39   22   
12.00/12.05	c 84607          288302         11382812       15658728       0              0              10   37   21   
13.29/13.35	c 93147          317723         12604310       17395439       0              0              10   37   22   
14.69/14.79	c 102541         350940         13962972       19346774       0              0              10   38   21   
16.29/16.36	c 112874         387660         15435491       21418374       0              0              10   36   21   
18.00/18.05	c 124240         427096         17016484       23670573       0              0              11   35   21   
19.89/19.91	c 136742         470562         18769157       26105993       0              0              11   37   21   
21.89/21.94	c 150494         516188         20698333       28810717       0              0              11   35   21   
24.19/24.25	c 165621         570096         22859551       31814485       0              0              10   37   21   
26.79/26.83	c 182260         630686         25295274       35152506       0              0              11   37   21   
29.39/29.49	c 200562         694525         27800593       38744967       0              0              10   35   21   
32.39/32.49	c 220694         765767         30630394       42671202       0              0              11   39   21   
35.69/35.76	c 242839         841546         33712793       47043835       0              0              10   36   21   
39.19/39.23	c 267198         928361         36965041       51570579       0              0              10   39   21   
42.79/42.85	c 293992         1022495        40413778       56055364       0              0              9   38   21    
46.89/46.95	c 323465         1124765        44241344       61331807       0              0              10   37   21   
51.59/51.68	c 355885         1245462        48693586       67289386       0              0              9   34   21    
56.79/56.83	c 391547         1374377        53520126       73915382       0              0              9   37   21    
62.49/62.59	c 430775         1523082        58912753       81372608       0              0              9   35   21    
68.49/68.51	c 473925         1681062        64483347       88883903       0              0              8   36   20    
75.39/75.47	c 521390         1852078        71034096       97842369       0              0              8   35   21    
82.48/82.56	c 573601         2025308        77640125       107099110      0              0              8   37   22    
90.88/90.93	c 631033         2232121        85461867       117956845      0              0              9   37   21    
100.28/100.38	c 694208         2462955        94325983       130089676      0              0              9   36   21    
110.38/110.41	c 763700         2708519        103741068      143215398      0              0              9   38   21    
121.88/121.98	c 840141         2992031        114599891      158110533      0              0              9   36   21    
134.38/134.42	c 924226         3297666        126334027      173913221      0              0              8   36   21    
147.68/147.77	c 1016719        3608902        138810808      191562537      0              0              9   40   21    
163.09/163.15	c 1118461        3972199        153302454      211236417      0              0              9   37   21    
178.68/178.71	c 1230377        4359152        167736181      231674959      0              0              8   38   22    
196.77/196.81	c 1353484        4799199        184739981      255528502      0              0              9   45   21    
214.87/214.97	c 1488901        5249453        201483370      279400054      0              0              9   45   22    
235.47/235.59	c 1637859        5736660        220536351      306101784      0              0              8   39   22    
258.17/258.22	c 1801712        6321132        241698266      335560468      0              0              7   38   21    
283.97/284.01	c 1981950        6971990        265820818      368493814      0              0              6   40   21    
312.86/312.94	c 2180211        7672257        292905761      406279119      0              0              8   40   21    
344.46/344.56	c 2398298        8467579        322570213      446502044      0              0              9   41   21    
379.16/379.20	c 2638193        9303247        354980294      491474484      0              0              7   39   21    
418.35/418.44	c 2902077        10230565       391713289      542223153      0              0              8   37   20    
461.35/461.43	c 3192349        11266083       432180649      597213229      0              0              8   39   21    
505.64/505.77	c 3511648        12362605       473609682      655730574      0              0              8   37   21    
555.74/555.85	c 3862876        13558320       520319156      722015513      0              0              7   38   21    
613.33/613.50	c 4249226        14959195       574287541      796447902      0              0              8   37   21    
675.53/675.62	c 4674211        16476179       632320384      877343124      0              0              8   39   21    
742.12/742.28	c 5141694        18100172       694453714      964028009      0              0              8   38   21    
813.41/813.57	c 5655925        19918992       761242990      1056090336     0              0              8   38   21    
893.81/893.97	c 6221579        21878468       836542544      1161386909     0              0              8   37   21    
982.60/982.78	c 6843798        24081185       919471916      1275690989     0              0              8   41   21    
1078.09/1078.29	c 7528238        26542650       1009115507     1397794059     0              0              8   45   21    
1181.77/1181.98	c 8281122        29141236       1104953352     1532940795     0              0              7   43   21    
1296.26/1296.40	c 9109294        31998562       1210823825     1680786471     0              0              7   45   21    
1423.75/1423.90	c 10020283       35137713       1329554193     1846469066     0              0              8   39   21    
1568.04/1568.27	c 11022370       38653380       1464521273     2031919617     0              0              7   41   21    
1726.12/1726.39	c 12124665       42557048       1611927523     2236864819     0              0              7   42   21    
1902.20/1902.40	c 13337189       46892559       1776288114     2461182911     0              0              7   39   21    
2089.58/2089.81	c 14670965       51531923       1950761896     2706439611     0              0              7   45   21    
2280.77/2281.09	c 16138118       56424927       2129013199     2951453315     0              0              8   39   21    
2400.05/2400.30	
2400.05/2400.30	c *** INTERRUPTED ***
2400.05/2400.30	c restarts              : 102         
2400.05/2400.30	c conflicts             : 16972759     (7072 /sec)
2400.05/2400.30	c decisions             : 59385365     (24743 /sec)
2400.05/2400.30	c propagations          : 3102799149  (1292802 /sec)
2400.05/2400.30	c root propagations     : 0           
2400.05/2400.30	c filter calls          : 2240782802     (933637 /sec)
2400.05/2400.30	c useless filter calls  : 1244061709     (55 %)
2400.05/2400.30	c Memory used           : 26.72 MB
2400.05/2400.30	c CPU time              : 2400.06 s
2400.05/2400.30	c real time             : 2400.3 s
2400.05/2400.30	
2400.05/2400.30	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (9211 MiB free)
  memory of node 1: 16384 MiB (15379 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4390007-1568322803/watcher-4390007-1568322803 -o /tmp/evaluation-result-4390007-1568322803/solver-4390007-1568322803 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node104-1568318532-25084 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4390007-1568322803.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=25180, runsolver pid=25177

[startup+0.100198 s]*
/proc/loadavg: 2.66 4.47 6.47 3/198 25181
/proc/meminfo: memFree=25181780/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3688 CPUtime=0.1 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1126 0 0 0 10 0 0 0 20 0 1 0 408537608 28016640 922 33554432000 4194304 6210612 140736872732256 140736872730520 5078394 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 922 815 493 0 145 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3688 KiB

[startup+0.209452 s]*
/proc/loadavg: 2.66 4.47 6.47 3/198 25181
/proc/meminfo: memFree=25181780/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3688 CPUtime=0.21 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1126 0 0 0 21 0 0 0 20 0 1 0 408537608 28016640 922 33554432000 4194304 6210612 140736872732256 140736872730520 5081893 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 922 815 493 0 145 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3688 KiB

[startup+0.30893 s]*
/proc/loadavg: 2.66 4.47 6.47 3/198 25181
/proc/meminfo: memFree=25181780/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3688 CPUtime=0.31 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1126 0 0 0 31 0 0 0 20 0 1 0 408537608 28016640 922 33554432000 4194304 6210612 140736872732256 140736872730520 5082432 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 922 815 493 0 145 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3688 KiB

[startup+0.700335 s]
/proc/loadavg: 2.66 4.47 6.47 3/198 25181
/proc/meminfo: memFree=25181780/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3688 CPUtime=0.69 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1126 0 0 0 69 0 0 0 20 0 1 0 408537608 28016640 922 33554432000 4194304 6210612 140736872732256 140736872730216 5079200 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 922 815 493 0 145 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3688 KiB

[startup+1.50034 s]
/proc/loadavg: 2.61 4.43 6.45 3/198 25181
/proc/meminfo: memFree=25181508/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3688 CPUtime=1.49 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1126 0 0 0 149 0 0 0 20 0 1 0 408537608 28016640 922 33554432000 4194304 6210612 140736872732256 140736872730216 5079889 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 922 815 493 0 145 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3688 KiB

[startup+3.10902 s]
/proc/loadavg: 2.61 4.43 6.45 3/198 25181
/proc/meminfo: memFree=25181588/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=3.1 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1173 0 0 0 310 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5078893 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+6.30034 s]
/proc/loadavg: 2.56 4.39 6.42 3/198 25181
/proc/meminfo: memFree=25181088/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=6.29 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1222 0 0 0 629 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5079205 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+12.7003 s]
/proc/loadavg: 2.52 4.35 6.40 3/198 25181
/proc/meminfo: memFree=25181336/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=12.69 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1269 0 0 0 1269 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5081394 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+25.5003 s]
/proc/loadavg: 2.44 4.27 6.35 3/198 25181
/proc/meminfo: memFree=25181432/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=25.49 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1364 0 0 0 2549 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5081319 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+51.1091 s]
/proc/loadavg: 2.26 4.05 6.21 3/198 25183
/proc/meminfo: memFree=25181124/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=51.1 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1411 0 0 0 5110 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5082450 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+102.3 s]
/proc/loadavg: 2.11 3.74 5.99 3/198 25187
/proc/meminfo: memFree=25181416/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=102.28 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1459 0 0 0 10228 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5192894 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+162.3 s]
/proc/loadavg: 2.04 3.42 5.74 3/198 25191
/proc/meminfo: memFree=25181836/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=162.28 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1507 0 0 0 16228 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5082632 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+222.3 s]
/proc/loadavg: 2.02 3.16 5.51 3/198 25197
/proc/meminfo: memFree=25181324/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=222.27 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1555 0 0 0 22227 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5079983 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+282.3 s]
/proc/loadavg: 2.05 2.97 5.29 3/198 25201
/proc/meminfo: memFree=25181632/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=282.27 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1602 0 0 0 28227 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5079064 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+342.3 s]
/proc/loadavg: 2.02 2.79 5.09 3/198 25205
/proc/meminfo: memFree=25181736/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=342.26 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1649 0 0 0 34226 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5082021 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 342.26 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+402.3 s]
/proc/loadavg: 2.05 2.66 4.90 3/198 25211
/proc/meminfo: memFree=25181528/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=402.25 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1696 0 0 0 40225 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5392179 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 402.25 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+462.3 s]
/proc/loadavg: 2.02 2.54 4.72 3/199 25223
/proc/meminfo: memFree=25181100/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=462.25 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 1743 0 0 0 46225 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5081624 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 462.25 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB


################
# More data... #
################

/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 1662.13 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.06 2.76 3/199 25339
/proc/meminfo: memFree=25179648/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=1722.12 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 2639 0 0 0 172212 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5081328 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 1722.12 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+1782.3 s]
/proc/loadavg: 2.05 2.06 2.72 3/199 25343
/proc/meminfo: memFree=25179772/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=1782.11 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 2686 0 0 0 178211 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5081860 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 1782.11 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+1842.3 s]
/proc/loadavg: 2.02 2.05 2.67 3/199 25349
/proc/meminfo: memFree=25179332/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=1842.11 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 2721 0 0 0 184211 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5081379 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 1842.11 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+1902.3 s]
/proc/loadavg: 2.05 2.06 2.64 3/199 25353
/proc/meminfo: memFree=25179160/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=1902.1 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 2756 0 0 0 190210 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5078394 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 1902.1 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+1962.3 s]
/proc/loadavg: 2.02 2.04 2.60 3/198 25357
/proc/meminfo: memFree=25179544/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=1962.1 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 2803 0 0 0 196210 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5079221 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 1962.1 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+2022.3 s]
/proc/loadavg: 2.01 2.04 2.56 3/198 25363
/proc/meminfo: memFree=25179676/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=2022.09 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 2843 0 0 0 202209 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5080456 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 2022.09 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.03 2.52 3/198 25367
/proc/meminfo: memFree=25179256/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=2082.09 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 2878 0 0 0 208209 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5078927 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 2082.09 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.03 2.49 3/198 25371
/proc/meminfo: memFree=25179272/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=2142.08 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 2925 0 0 0 214208 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5080427 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 2142.08 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.02 2.46 3/198 25377
/proc/meminfo: memFree=25179264/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=2202.07 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 2960 0 0 0 220207 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5392937 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 2202.07 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+2262.3 s]
/proc/loadavg: 2.06 2.03 2.44 3/198 25388
/proc/meminfo: memFree=25179416/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=2262.07 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 2995 0 0 0 226207 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5079170 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 2262.07 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+2322.3 s]
/proc/loadavg: 2.02 2.03 2.41 3/198 25392
/proc/meminfo: memFree=25179492/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=2322.06 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 3042 0 0 0 232206 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5380110 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 2322.06 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

[startup+2382.3 s]
/proc/loadavg: 2.01 2.02 2.38 3/198 25459
/proc/meminfo: memFree=25162484/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=2382.05 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 3077 0 0 0 238205 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5082127 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 2382.05 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.3 s]
/proc/loadavg: 2.01 2.02 2.38 3/198 25459
/proc/meminfo: memFree=25162004/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=2400.05 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 3112 0 0 0 240005 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5078659 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 2400.05 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.3 s]
# the end of solver process 25180 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2400.06 s, system=0.006999 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2400.3 s]
/proc/loadavg: 2.01 2.02 2.38 3/198 25459
/proc/meminfo: memFree=25162004/32770624 swapFree=66977612/67108860
[pid=25180] ppid=25177 vsize=27360 memory=3860 CPUtime=2400.05 cores=0,2,4,6
/proc/25180/stat : 25180 (cosoco) R 25177 25180 25053 0 -1 4202496 3112 0 0 0 240005 0 0 0 20 0 1 0 408537608 28016640 965 33554432000 4194304 6210612 140736872732256 140736872730216 5078659 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 13262848 140736872739851 140736872739953 140736872739953 140736872742862 0
/proc/25180/statm: 6840 965 856 493 0 145 0
Current children cumulated CPU time: 2400.05 s
Current children cumulated vsize: 27360 KiB
Current children cumulated memory: 3860 KiB

Child status: 1
Real time (s): 2400.3
CPU time (s): 2400.07
CPU user time (s): 2400.06
CPU system time (s): 0.006999
CPU usage (%): 99.9902
Max. virtual memory (cumulated for all children) (KiB): 27360
Max. memory (cumulated for all children) (KiB): 3860

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.06
system time used= 0.006999
maximum resident set size= 3928
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 3163
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 13
involuntary context switches= 3023


# summary of solver processes directly reported to runsolver:
#   pid: 25180
#   total CPU time (s): 2400.07
#   total CPU user time (s): 2400.06
#   total CPU system time (s): 0.006999

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.95862 second user time and 14.4866 second system time

The end

Launcher Data 

Begin job on node104 at 2019-09-12 22:03:06
IDJOB=4390007
IDBENCH=115871
IDSOLVER=2830
FILE ID=node104/4390007-1568322803
RUNJOBID= node104-1568318532-25084
PBS_JOBID= 21701142
Free space on /tmp= 56572 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/ColouredQueens/ColouredQueens-m1-s1/ColouredQueens-08.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4390007-1568322803/watcher-4390007-1568322803 -o /tmp/evaluation-result-4390007-1568322803/solver-4390007-1568322803 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node104-1568318532-25084 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4390007-1568322803.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 097ee2ac2bfb45f3aedded97da1eabe0
RANDOM SEED=511028325

node104.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        25181780 kB
MemAvailable:   31827508 kB
Buffers:          128248 kB
Cached:          6731252 kB
SwapCached:        31864 kB
Active:          1762852 kB
Inactive:        5134612 kB
Active(anon):       4856 kB
Inactive(anon):    74768 kB
Active(file):    1757996 kB
Inactive(file):  5059844 kB
Unevictable:      107804 kB
Mlocked:          107804 kB
SwapTotal:      67108860 kB
SwapFree:       66977612 kB
Dirty:              2812 kB
Writeback:             0 kB
AnonPages:        131996 kB
Mapped:            44756 kB
Shmem:             32780 kB
Slab:             286396 kB
SReclaimable:     256348 kB
SUnreclaim:        30048 kB
KernelStack:        3744 kB
PageTables:         5528 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     519808 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     86016 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 56568 MiB
End job on node104 at 2019-09-12 22:43:07