Trace number 4389456

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2520.09 2519.9

General information on the benchmark

NameLatinSquare/LatinSquare-xcsp2-qcp25/
qcp-25-264-08_X2.xml
MD5SUMe61b201f6225aab3795ad5f045ee307f
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark7.73665
Satisfiable
(Un)Satisfiability was proved
Number of variables625
Number of constraints15000
Number of domains26
Minimum domain size1
Maximum domain size25
Distribution of domain sizes[{"size":1,"count":361},{"size":25,"count":264}]
Minimum variable degree48
Maximum variable degree48
Distribution of variable degrees[{"degree":48,"count":625}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":15000}]
Number of extensional constraints15000
Number of intensional constraints0
Distribution of constraint types[{"type":"extension","count":15000}]
Optimization problemNO
Type of objective

Solver Data 

0.40/0.42	c root propagations     : 5440        
0.40/0.42	c restarts enabled, print stats at every restarts
0.40/0.42	c
0.40/0.42	c
0.40/0.42	c
0.40/0.42	c This is cosoco 2.00 --  
0.40/0.42	c
0.40/0.42	c command line: cosoco -lc -model -restarts -stick HOME/instance-4389456-1568358538.xml 
0.40/0.42	c ========================================[ Problem Statistics ]===========================================
0.40/0.42	c |                                                                                                       
0.40/0.42	c |  Parse time        :         0.40 s 
0.40/0.42	c |
0.40/0.42	c |               Variables: 625
0.40/0.42	c |            Domain Sizes: 1..25
0.40/0.42	c |
0.40/0.42	c |             Constraints: 15000
0.40/0.42	c |                   Arity: 2..2  -- Binary: 15000
0.40/0.42	c | 
0.40/0.42	c |                   Types: 
0.40/0.42	c |                          Extension: 15000  (nb tuples: 0..25) -- (shared: 9458)
0.40/0.42	c |                          
0.40/0.42	c =========================================================================================================
0.40/0.42	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.40/0.44	c 101            731            168822         12332          264            0              408   437   417
0.40/0.46	c 211            1574           330967         19469          264            0              407   460   411
0.40/0.49	c 332            2499           545275         29848          264            0              26   473   206 
0.50/0.52	c 465            3105           813793         43060          264            0              37   78   53   
0.50/0.57	c 611            4292           1340557        70406          264            0              25   102   69  
0.60/0.62	c 771            5380           1843259        98454          264            0              52   83   67   
0.60/0.68	c 947            6588           2467473        131770         264            0              48   81   67   
0.69/0.73	c 1140           7505           2952166        161520         264            0              62   91   75   
0.69/0.78	c 1352           8707           3415088        184910         264            0              11   92   50   
0.79/0.83	c 1585           9907           3893988        212148         264            0              39   96   66   
0.79/0.89	c 1841           11533          4539980        247906         264            0              31   71   48   
0.89/0.98	c 2122           13615          5348915        289572         264            0              31   83   63   
1.00/1.08	c 2431           15869          6403521        343192         264            0              8   92   68    
1.19/1.23	c 2770           19453          7818677        412599         264            0              8   114   79   
1.29/1.31	c 3142           21495          8550836        448212         264            0              39   98   65   
1.39/1.45	c 3551           25297          9914186        515702         264            0              43   121   77  
1.59/1.65	c 4000           30099          11854702       611047         264            0              43   115   84  
1.79/1.81	c 4493           34137          13379717       689911         264            0              65   109   88  
2.00/2.05	c 5035           40124          15676870       800811         264            0              55   105   84  
2.19/2.24	c 5631           44862          17489027       894250         264            0              64   116   90  
2.39/2.42	c 6286           49960          19259746       984355         264            0              31   83   66   
2.59/2.68	c 7006           56223          21767629       1114933        264            0              56   101   76  
2.79/2.89	c 7798           61957          23714935       1212758        264            0              38   106   74  
3.10/3.16	c 8669           68595          26299608       1341665        264            0              54   125   90  
3.49/3.52	c 9627           78272          29701706       1503771        264            0              39   121   82  
3.79/3.86	c 10680          86734          32984304       1678662        264            0              62   115   85  
4.19/4.21	c 11838          95967          36217967       1845147        264            0              32   110   72  
4.59/4.60	c 13111          107602         39819177       2023198        264            0              12   112   72  
5.10/5.11	c 14511          120896         44681650       2270212        264            0              54   136   90  
5.49/5.56	c 16051          133083         49062798       2505826        264            0              43   113   91  
6.00/6.05	c 17745          147118         53683668       2738605        264            0              56   117   88  
6.69/6.70	c 19608          165194         59743298       3044804        264            0              17   117   86  
7.39/7.46	c 21657          184287         67120814       3425855        264            0              45   118   87  
8.10/8.14	c 23910          205440         74915065       3830869        264            0              35   123   84  
8.79/8.82	c 26388          227718         82839869       4222772        264            0              65   131   100 
9.49/9.57	c 29113          251319         91674269       4672532        264            0              62   126   94  
10.29/10.39	c 32110          276319         101314640      5177816        264            0              59   123   90  
11.19/11.22	c 35406          302845         110755841      5687297        264            0              32   121   85  
12.19/12.24	c 39031          339331         122393981      6255170        264            0              63   145   104 
13.29/13.36	c 43018          374865         135237648      6937686        264            0              25   128   85  
14.49/14.58	c 47403          414606         149301168      7677329        264            0              53   137   95  
15.89/15.98	c 52226          465935         164930188      8439652        264            0              48   147   88  
16.89/16.95	c 57531          501681         175702009      8987085        264            0              12   103   56  
18.78/18.80	c 63366          568040         198313956      10125834       264            0              60   154   103 
20.28/20.39	c 69784          627424         218080904      11146719       264            0              11   138   99  
22.28/22.39	c 76843          701264         242740546      12377216       264            0              48   133   90  
24.28/24.30	c 84607          768919         266222465      13611089       264            0              48   129   89  
26.38/26.46	c 93147          850883         292429416      14955816       264            0              44   136   87  
29.08/29.16	c 102541         958814         326851488      16679800       264            0              46   160   92  
31.78/31.89	c 112874         1073845        363043161      18454366       264            0              50   147   98  
34.68/34.77	c 124240         1186984        401887913      20356893       264            0              58   143   101 
37.78/37.87	c 136742         1314142        442786737      22425893       264            0              41   125   82  
40.88/40.94	c 150494         1434233        483148693      24549518       264            0              36   123   83  
44.38/44.45	c 165621         1559355        531401635      27283212       264            0              49   130   86  
48.78/48.84	c 182260         1718089        591670429      30410238       264            0              38   144   98  
54.09/54.13	c 200562         1916915        662431568      34056588       264            0              38   141   83  
58.88/58.97	c 220694         2105406        727046843      37423116       264            0              42   116   82  
65.38/65.47	c 242839         2349956        814587299      41881864       264            0              40   138   89  
71.78/71.81	c 267198         2590300        898625545      46237129       264            0              41   126   82  
79.18/79.24	c 293992         2861523        999196238      51379279       264            0              53   135   88  
85.28/85.34	c 323465         3090957        1080868022     55673120       264            0              43   129   86  
92.78/92.87	c 355885         3392770        1182739698     60851753       264            0              44   140   96  
101.38/101.49	c 391547         3760148        1295273401     66300366       264            0              35   132   92  
109.99/110.05	c 430775         4080114        1403575001     71885925       264            0              19   109   71  
119.48/119.51	c 473925         4473898        1524973630     78016548       264            0              29   114   69  
124.78/124.82	c 521390         4699376        1592417287     81321016       264            0              13   106   40  
136.18/136.25	c 573601         5132066        1742458878     89262655       264            0              17   102   65  
150.69/150.79	c 631033         5656481        1934300386     99735263       264            0              29   107   64  
159.99/160.04	c 694208         6047068        2052960040     105531483      264            0              7   88   54    
173.89/173.97	c 763700         6568887        2235978707     114779632      264            0              19   146   61  
189.19/189.26	c 840141         7178212        2435713221     124659779      264            0              35   111   69  
208.59/208.66	c 924226         7911313        2696434124     138002680      264            0              8   127   83   
228.39/228.48	c 1016719        8660923        2963203618     151333418      264            0              26   114   77  
249.69/249.76	c 1118461        9457627        3249401896     165833358      264            0              30   138   79  
275.89/275.91	c 1230377        10338614       3598958457     184732395      264            0              29   130   66  
302.90/302.97	c 1353484        11294673       3969989472     203268521      264            0              22   122   84  
335.60/335.67	c 1488901        12557213       4408923215     225392522      264            0              36   137   83  
373.90/373.95	c 1637859        13979642       4922146551     251343529      264            0              30   115   80  
411.31/411.37	c 1801712        15364430       5423430814     277064327      264            0              31   115   70  
446.31/446.39	c 1981950        16652368       5894141357     300797013      264            0              35   120   79  
493.41/493.45	c 2180211        18418799       6529843126     332571728      264            0              32   130   78  
551.32/551.36	c 2398298        20628741       7302267357     371342395      264            0              23   138   79  
611.62/611.61	c 2638193        22896253       8109222482     411827266      264            0              28   168   82  
665.32/665.34	c 2902077        24945608       8822905164     448111257      264            0              29   129   75  
734.63/734.60	c 3192349        27602986       9751883119     496036966      264            0              35   126   81  
812.34/812.37	c 3511648        30569004       10791832056    548809826      264            0              28   133   80  
871.64/871.62	c 3862876        32770850       11582446305    590185088      264            0              41   114   74  
955.25/955.21	c 4249226        36086316       12664081143    644940834      264            0              16   137   66  
1047.45/1047.40	c 4674211        39613352       13893107385    707505469      264            0              23   116   77  
1161.46/1161.45	c 5141694        44061913       15406402069    782761192      264            0              37   141   82  
1292.67/1292.61	c 5655925        49154568       17156882122    869363547      264            0              35   152   89  
1436.68/1436.61	c 6221579        54750974       19084643050    964805461      264            0              33   169   91  
1584.90/1584.83	c 6843798        60409010       21060873236    1067790844     264            0              30   136   86  
1739.41/1739.33	c 7528238        66184294       23174352336    1176252375     264            0              45   133   95  
1904.53/1904.42	c 8281122        73022108       25337859666    1283326618     264            0              6   130   82   
2076.04/2075.90	c 9109294        80219468       27615297578    1399082802     264            0              34   143   83  
2277.56/2277.47	c 10020283       88520893       30262657407    1530695585     264            0              7   151   77   
2508.19/2508.08	c 11022370       97879416       33376663231    1687576980     264            0              34   157   100 
2520.08/2519.90	
2520.08/2519.90	c *** INTERRUPTED ***
2520.08/2519.90	c restarts              : 98          
2520.08/2519.90	c conflicts             : 11061542     (4389 /sec)
2520.08/2519.90	c decisions             : 98309848     (39011 /sec)
2520.08/2519.90	c propagations          : 1695678523  (672875 /sec)
2520.08/2519.90	c root propagations     : 5440        
2520.08/2519.90	c filter calls          : 33537436536    (13308252 /sec)
2520.08/2519.90	c useless filter calls  : 32049431430    (95 %)
2520.08/2519.90	c Memory used           : 73.56 MB
2520.08/2519.90	c CPU time              : 2520.05 s
2520.08/2519.90	c real time             : 2519.9 s
2520.08/2519.90	
2520.08/2519.90	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15327 MiB free)
  memory of node 1: 16384 MiB (15592 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4389456-1568358538/watcher-4389456-1568358538 -o /tmp/evaluation-result-4389456-1568358538/solver-4389456-1568358538 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node105-1568354843-23220 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4389456-1568358538.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=23250, runsolver pid=23247

[startup+0.1002 s]*
/proc/loadavg: 1.00 1.28 1.69 3/198 23251
/proc/meminfo: memFree=31656148/32770624 swapFree=66935948/67108860
[pid=23250] ppid=23247 vsize=38756 memory=15040 CPUtime=0.1 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 3923 0 0 0 10 0 0 0 20 0 1 0 412112210 39686144 3760 33554432000 4194304 6210612 140732205810896 140732205807432 140089135227023 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 9689 3760 805 493 0 2994 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 38756 KiB
Current children cumulated memory: 15040 KiB

[startup+0.209675 s]*
/proc/loadavg: 1.00 1.28 1.69 3/198 23251
/proc/meminfo: memFree=31617720/32770624 swapFree=66935948/67108860
[pid=23250] ppid=23247 vsize=50408 memory=26656 CPUtime=0.2 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 6846 0 0 0 20 0 0 0 20 0 1 0 412112210 51617792 6664 33554432000 4194304 6210612 140732205810896 140732205807432 140089141693322 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 12602 6664 805 493 0 5907 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 50408 KiB
Current children cumulated memory: 26656 KiB

[startup+0.309752 s]*
/proc/loadavg: 1.00 1.28 1.69 3/198 23251
/proc/meminfo: memFree=31603212/32770624 swapFree=66935948/67108860
[pid=23250] ppid=23247 vsize=52344 memory=28504 CPUtime=0.3 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 7317 0 0 0 30 0 0 0 20 0 1 0 412112210 53600256 7126 33554432000 4194304 6210612 140732205810896 140732205807432 5719804 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 13086 7126 805 493 0 6391 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 52344 KiB
Current children cumulated memory: 28504 KiB

[startup+0.700392 s]
/proc/loadavg: 1.00 1.28 1.69 3/198 23251
/proc/meminfo: memFree=31566864/32770624 swapFree=66935948/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51640 CPUtime=0.69 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 13145 0 0 0 68 1 0 0 20 0 1 0 412112210 77127680 12910 33554432000 4194304 6210612 140732205810896 140732205807432 5397215 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12910 851 493 0 12135 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51640 KiB

[startup+1.50038 s]
/proc/loadavg: 1.00 1.28 1.69 3/198 23251
/proc/meminfo: memFree=31566936/32770624 swapFree=66935948/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51640 CPUtime=1.49 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 13145 0 0 0 148 1 0 0 20 0 1 0 412112210 77127680 12910 33554432000 4194304 6210612 140732205810896 140732205807432 5008949 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12910 851 493 0 12135 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51640 KiB

[startup+3.10962 s]
/proc/loadavg: 0.92 1.26 1.68 3/198 23251
/proc/meminfo: memFree=31566700/32770624 swapFree=66935948/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51816 CPUtime=3.1 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 21347 0 0 0 308 2 0 0 20 0 1 0 412112210 77127680 12954 33554432000 4194304 6210612 140732205810896 140732205808856 5389268 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12954 851 493 0 12135 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51816 KiB

[startup+6.30036 s]
/proc/loadavg: 0.92 1.26 1.68 3/198 23251
/proc/meminfo: memFree=31566700/32770624 swapFree=66935948/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51816 CPUtime=6.29 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 29552 0 0 0 627 2 0 0 20 0 1 0 412112210 77127680 12954 33554432000 4194304 6210612 140732205810896 140732205808856 5008463 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12954 851 493 0 12135 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51816 KiB

[startup+12.7004 s]
/proc/loadavg: 1.09 1.28 1.68 3/198 23251
/proc/meminfo: memFree=31565912/32770624 swapFree=66935948/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51816 CPUtime=12.69 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 34220 0 0 0 1266 3 0 0 20 0 1 0 412112210 77127680 12954 33554432000 4194304 6210612 140732205810896 140732205808856 5016853 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12954 851 493 0 12135 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51816 KiB

[startup+25.5004 s]
/proc/loadavg: 1.23 1.30 1.68 3/198 23251
/proc/meminfo: memFree=31565660/32770624 swapFree=66935948/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=25.48 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 40761 0 0 0 2545 3 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5409264 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 25.48 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+51.1095 s]
/proc/loadavg: 1.43 1.34 1.69 3/198 23254
/proc/meminfo: memFree=31566876/32770624 swapFree=66935948/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=51.09 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 41435 0 0 0 5106 3 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5016909 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+102.3 s]
/proc/loadavg: 1.77 1.45 1.70 3/199 23319
/proc/meminfo: memFree=28163300/32770624 swapFree=66935952/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=102.28 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 42104 0 0 0 10225 3 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5016906 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+162.3 s]
/proc/loadavg: 3.66 2.05 1.89 2/201 23332
/proc/meminfo: memFree=25095560/32770624 swapFree=66935956/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=162.29 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 42773 0 0 0 16226 3 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5409279 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+222.3 s]
/proc/loadavg: 2.74 2.06 1.90 3/200 23401
/proc/meminfo: memFree=31023440/32770624 swapFree=66935956/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=222.29 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 43441 0 0 0 22226 3 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5017201 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+282.3 s]
/proc/loadavg: 2.67 2.18 1.96 3/201 23406
/proc/meminfo: memFree=30393268/32770624 swapFree=66935956/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=282.3 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 43442 0 0 0 28227 3 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5389275 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+342.3 s]
/proc/loadavg: 2.25 2.15 1.96 3/201 23410
/proc/meminfo: memFree=29764752/32770624 swapFree=66935956/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=342.3 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 44111 0 0 0 34227 3 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5016909 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+402.3 s]
/proc/loadavg: 2.09 2.12 1.96 3/201 23416
/proc/meminfo: memFree=29134400/32770624 swapFree=66935956/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=402.3 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 44111 0 0 0 40227 3 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5008946 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 402.3 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+462.3 s]
/proc/loadavg: 2.03 2.10 1.96 3/199 23420
/proc/meminfo: memFree=28506472/32770624 swapFree=66935956/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=462.31 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 44778 0 0 0 46228 3 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5017005 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 462.31 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB


################
# More data... #
################

/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 1782.42 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+1842.3 s]
/proc/loadavg: 2.07 2.14 2.06 3/199 23612
/proc/meminfo: memFree=30565048/32770624 swapFree=66935968/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=1842.42 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 52075 0 0 0 184238 4 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5016818 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 1842.42 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+1902.3 s]
/proc/loadavg: 2.03 2.11 2.05 3/199 23616
/proc/meminfo: memFree=30554844/32770624 swapFree=66935968/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=1902.43 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 52711 0 0 0 190239 4 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5397215 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 1902.43 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+1962.3 s]
/proc/loadavg: 2.01 2.09 2.05 3/200 23628
/proc/meminfo: memFree=30521980/32770624 swapFree=66935980/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=1962.43 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 52742 0 0 0 196239 4 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5017018 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 1962.43 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.07 2.05 3/200 23634
/proc/meminfo: memFree=30458680/32770624 swapFree=66935980/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=2022.44 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 53372 0 0 0 202240 4 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5409293 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 2022.44 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.06 2.05 3/200 23638
/proc/meminfo: memFree=30449796/32770624 swapFree=66935980/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=2082.44 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 53411 0 0 0 208240 4 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5186055 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 2082.44 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.05 2.05 3/199 23642
/proc/meminfo: memFree=30445408/32770624 swapFree=66935980/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=2142.45 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 54066 0 0 0 214241 4 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5017104 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 2142.45 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 23648
/proc/meminfo: memFree=30419100/32770624 swapFree=66935980/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=2202.45 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 54067 0 0 0 220241 4 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5016857 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 2202.45 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/198 23652
/proc/meminfo: memFree=30380140/32770624 swapFree=66935980/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=2262.46 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 54673 0 0 0 226242 4 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5008827 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 2262.46 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/198 23656
/proc/meminfo: memFree=30372388/32770624 swapFree=66935980/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=2322.47 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 54734 0 0 0 232243 4 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5017005 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 2322.47 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/198 23662
/proc/meminfo: memFree=30365288/32770624 swapFree=66935980/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=2382.47 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 55346 0 0 0 238243 4 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5389284 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 2382.47 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/198 23666
/proc/meminfo: memFree=30358912/32770624 swapFree=66935980/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=2442.48 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 55349 0 0 0 244244 4 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5409301 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 2442.48 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 23670
/proc/meminfo: memFree=30344876/32770624 swapFree=66935980/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=2502.48 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 55964 0 0 0 250244 4 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5008463 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 2502.48 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2519.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 23673
/proc/meminfo: memFree=30345188/32770624 swapFree=66935980/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=2520.08 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 56017 0 0 0 252004 4 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5016909 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 2520.08 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2519.9 s]
# the end of solver process 23250 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2520.05 s, system=0.042003 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2519.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 23673
/proc/meminfo: memFree=30345188/32770624 swapFree=66935980/67108860
[pid=23250] ppid=23247 vsize=75320 memory=51820 CPUtime=2520.08 cores=0,2,4,6
/proc/23250/stat : 23250 (cosoco) R 23247 23250 23189 0 -1 4202496 56017 0 0 0 252004 4 0 0 20 0 1 0 412112210 77127680 12955 33554432000 4194304 6210612 140732205810896 140732205808856 5016909 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8308220 8313664 29986816 140732205814795 140732205814897 140732205814897 140732205817806 0
/proc/23250/statm: 18830 12955 851 493 0 12135 0
Current children cumulated CPU time: 2520.08 s
Current children cumulated vsize: 75320 KiB
Current children cumulated memory: 51820 KiB

Child status: 1
Real time (s): 2519.9
CPU time (s): 2520.09
CPU user time (s): 2520.05
CPU system time (s): 0.042003
CPU usage (%): 100.007
Max. virtual memory (cumulated for all children) (KiB): 75320
Max. memory (cumulated for all children) (KiB): 51820

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2520.05
system time used= 0.042003
maximum resident set size= 51888
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 56059
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 22
involuntary context switches= 3168


# summary of solver processes directly reported to runsolver:
#   pid: 23250
#   total CPU time (s): 2520.09
#   total CPU user time (s): 2520.05
#   total CPU system time (s): 0.042003

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.54589 second user time and 17.6627 second system time

The end

Launcher Data 

Begin job on node105 at 2019-09-13 08:07:23
IDJOB=4389456
IDBENCH=139111
IDSOLVER=2829
FILE ID=node105/4389456-1568358538
RUNJOBID= node105-1568354843-23220
PBS_JOBID= 21701199
Free space on /tmp= 54368 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/LatinSquare/LatinSquare-xcsp2-qcp25/qcp-25-264-08_X2.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4389456-1568358538/watcher-4389456-1568358538 -o /tmp/evaluation-result-4389456-1568358538/solver-4389456-1568358538 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node105-1568354843-23220 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4389456-1568358538.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= e61b201f6225aab3795ad5f045ee307f
RANDOM SEED=971895804

node105.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.00
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31662244 kB
MemAvailable:   31854648 kB
Buffers:          136360 kB
Cached:           344924 kB
SwapCached:        68660 kB
Active:           228492 kB
Inactive:         321452 kB
Active(anon):      11432 kB
Inactive(anon):    89940 kB
Active(file):     217060 kB
Inactive(file):   231512 kB
Unevictable:      111220 kB
Mlocked:          111220 kB
SwapTotal:      67108860 kB
SwapFree:       66935948 kB
Dirty:              6220 kB
Writeback:             0 kB
AnonPages:        113312 kB
Mapped:            34772 kB
Shmem:             23608 kB
Slab:             147212 kB
SReclaimable:     119332 kB
SUnreclaim:        27880 kB
KernelStack:        3280 kB
PageTables:         5464 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     494204 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     67584 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      120192 kB
DirectMap2M:    33425408 kB

Free space on /tmp at the end= 54244 MiB
End job on node105 at 2019-09-13 08:49:23