Trace number 4408679

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2400.07 2400.2

General information on the benchmark

NameMagicSquare/MagicSquare-sum-s1/
MagicSquare-27-sum.xml
MD5SUMd104f54931e81c640cdf77e394aea107
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables729
Number of constraints57
Number of domains1
Minimum domain size729
Maximum domain size729
Distribution of domain sizes[{"size":729,"count":729}]
Minimum variable degree3
Maximum variable degree5
Distribution of variable degrees[{"degree":3,"count":676},{"degree":4,"count":52},{"degree":5,"count":1}]
Minimum constraint arity27
Maximum constraint arity729
Distribution of constraint arities[{"arity":27,"count":56},{"arity":729,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"sum","count":56}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 0           
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4408679-1569797183.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 729
0.00/0.02	c |            Domain Sizes: 729..729
0.00/0.02	c |
0.00/0.02	c |             Constraints: 57
0.00/0.02	c |                   Arity: 27..729
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 1
0.00/0.02	c |                          Sum: 56
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.21/0.26	c 101            123            1890           155088         0              0              15   17   16   
0.41/0.51	c 211            255            3750           307922         0              0              14   16   15   
0.69/0.78	c 332            399            5746           470794         0              0              14   17   15   
1.00/1.06	c 465            556            7843           635674         0              0              14   17   15   
1.29/1.36	c 611            727            10090          810710         0              0              14   17   15   
1.59/1.69	c 771            913            12460          995225         0              0              14   17   15   
2.00/2.03	c 947            1117           15021          1190554        0              0              14   17   15   
2.39/2.40	c 1140           1340           17782          1397200        0              0              14   17   15   
2.69/2.78	c 1352           1583           20691          1605655        0              0              14   17   15   
3.10/3.19	c 1585           1849           23828          1828257        0              0              14   17   15   
3.59/3.64	c 1841           2140           27168          2063267        0              0              14   17   15   
4.10/4.11	c 2122           2458           30762          2309818        0              0              14   17   15   
4.59/4.63	c 2431           2807           34727          2578059        0              0              14   17   15   
5.10/5.18	c 2770           3189           39166          2860568        0              0              14   17   15   
5.69/5.73	c 3142           3607           43974          3158502        0              0              14   17   16   
6.29/6.32	c 3551           4065           48900          3471505        0              0              14   17   16   
6.89/6.99	c 4000           4567           54759          3807501        0              0              14   17   16   
7.59/7.68	c 4493           5117           60769          4159100        0              0              14   17   16   
8.39/8.45	c 5035           5720           67545          4536616        0              0              14   18   16   
9.29/9.30	c 5631           6383           74799          4950495        0              0              14   18   16   
10.10/10.19	c 6286           7110           82593          5391040        0              0              14   18   16   
11.10/11.18	c 7006           7908           91058          5876516        0              0              14   18   16   
12.19/12.26	c 7798           8785           100391         6399049        0              0              14   18   16   
13.39/13.44	c 8669           9749           110499         6958571        0              0              14   18   16   
14.69/14.72	c 9627           10808          121573         7558029        0              0              14   18   16   
16.10/16.12	c 10680          11971          133617         8207108        0              0              14   18   16   
17.59/17.62	c 11838          13249          146254         8919287        0              0              14   18   16   
19.29/19.30	c 13111          14653          160716         9685222        0              0              14   18   16   
21.10/21.15	c 14511          16196          176531         10514204       0              0              14   18   16   
23.10/23.16	c 16051          17892          193597         11400751       0              0              14   18   16   
25.29/25.37	c 17745          19757          212433         12372758       0              0              14   18   16   
27.69/27.74	c 19608          21808          232265         13433890       0              0              14   18   16   
30.39/30.48	c 21657          24063          256083         14583924       0              0              14   18   16   
33.29/33.32	c 23910          26541          279789         15827584       0              0              14   18   16   
36.49/36.51	c 26388          29265          307005         17172847       0              0              14   18   16   
39.88/40.01	c 29113          32260          336579         18654185       0              0              14   18   16   
43.68/43.77	c 32110          35554          367812         20266106       0              0              14   19   17   
47.88/47.92	c 35406          39178          402294         22054263       0              0              14   19   17   
52.48/52.51	c 39031          43164          440230         24028066       0              0              14   19   17   
57.48/57.57	c 43018          47548          481969         26217192       0              0              14   19   17   
63.09/63.13	c 47403          52369          527853         28608242       0              0              14   19   17   
69.18/69.23	c 52226          57672          578132         31212084       0              0              14   19   17   
75.88/75.95	c 57531          63506          633335         34062811       0              0              14   19   17   
83.28/83.31	c 63366          69923          693788         37177302       0              0              14   19   17   
91.38/91.43	c 69784          76982          760318         40619280       0              0              14   19   17   
100.38/100.40	c 76843          84748          833555         44406764       0              0              14   19   17   
110.48/110.52	c 84607          93294          917465         48548871       0              0              14   19   17   
121.58/121.68	c 93147          102698         1010031        53070320       0              0              14   19   17   
133.68/133.78	c 102541         113052         1107954        58071805       0              0              14   20   17   
147.38/147.48	c 112874         124452         1220408        63600728       0              0              14   20   17   
161.78/161.88	c 124240         136989         1334860        69764185       0              0              14   20   18   
178.28/178.30	c 136742         150799         1467210        76436560       0              0              14   21   18   
195.78/195.80	c 150494         165973         1606295        83936316       0              0              14   20   18   
215.68/215.75	c 165621         182754         1760642        92851850       0              0              16   21   19   
239.77/239.80	c 182260         201424         1940459        103089602      0              0              15   22   20   
264.27/264.35	c 200562         221739         2132045        113966669      0              0              15   21   19   
292.67/292.79	c 220694         244308         2340889        126260176      0              0              15   22   20   
321.77/321.85	c 242839         268886         2562798        139393440      0              0              15   21   19   
354.87/354.96	c 267198         296092         2806846        155301454      0              0              17   22   20   
394.08/394.19	c 293992         326296         3088432        172335295      0              0              3   22   20    
435.07/435.18	c 323465         359311         3387484        192125466      0              0              4   22   20    
482.97/483.07	c 355885         395900         3729661        212999130      0              0              5   22   20    
532.97/533.06	c 391547         435887         4092862        237122451      0              0              6   22   20    
592.36/592.42	c 430775         480189         4525361        262428255      0              0              7   22   20    
654.55/654.60	c 473925         528622         4984887        292018631      0              0              8   22   20    
726.65/726.76	c 521390         582284         5506405        322770117      0              0              9   22   20    
800.74/800.80	c 573601         640927         6040063        358698699      0              0              10   22   20   
885.14/885.23	c 631033         705725         6644602        395047633      0              0              11   46   21   
957.05/957.13	c 694208         775537         7295598        426656469      0              0              12   101   81  
1036.13/1036.26	c 763700         852521         8021863        461020439      0              0              13   128   93  
1121.94/1122.10	c 840141         936560         8782275        500673756      0              0              14   74   72   
1215.93/1216.05	c 924226         1029563        9651446        541794245      0              0              15   127   98  
1346.52/1346.62	c 1016719        1136004        10671080       619543610      0              0              16   104   91  
1445.92/1446.07	c 1118461        1248317        11693061       669616335      0              0              17   156   144 
1552.40/1552.56	c 1230377        1372047        12838629       720673188      0              0              18   183   163 
1677.60/1677.70	c 1353484        1508026        14091173       779971225      0              0              19   182   132 
1799.49/1799.69	c 1488901        1659266        15505065       840587452      0              0              20   290   219 
1920.48/1920.65	c 1637859        1824026        16983678       908218937      0              0              21   290   238 
2036.38/2036.58	c 1801712        2004422        18633802       977719142      0              0              22   290   280 
2244.47/2244.66	c 1981950        2207746        20349848       1234295022     0              0              23   159   157 
2400.06/2400.20	
2400.06/2400.20	c *** INTERRUPTED ***
2400.06/2400.20	c restarts              : 80          
2400.06/2400.20	c conflicts             : 2176151      (907 /sec)
2400.06/2400.20	c decisions             : 2419603      (1008 /sec)
2400.06/2400.20	c propagations          : 1335372221  (556391 /sec)
2400.06/2400.20	c root propagations     : 0           
2400.06/2400.20	c filter calls          : 22157474       (9232 /sec)
2400.06/2400.20	c useless filter calls  : 16397986       (74 %)
2400.06/2400.20	c Memory used           : 33.36 MB
2400.06/2400.20	c CPU time              : 2400.06 s
2400.06/2400.20	c real time             : 2400.2 s
2400.06/2400.20	
2400.06/2400.20	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16375 MiB (15427 MiB free)
  memory of node 1: 16384 MiB (15338 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4408679-1569797183/watcher-4408679-1569797183 -o /tmp/evaluation-result-4408679-1569797183/solver-4408679-1569797183 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node116-1569787351-26364 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4408679-1569797183.xml 

running on 4 cores: 4-7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=28475, runsolver pid=28472

[startup+0.100159 s]*
/proc/loadavg: 2.02 2.01 2.05 3/199 28476
/proc/meminfo: memFree=31498436/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32252 memory=8836 CPUtime=0.1 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 2372 0 0 0 10 0 0 0 20 0 1 0 555659804 33026048 2209 33554432000 4194304 6211132 140727849670816 140727849665176 5149714 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8063 2209 886 493 0 1368 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32252 KiB
Current children cumulated memory: 8836 KiB

[startup+0.211163 s]*
/proc/loadavg: 2.02 2.01 2.05 3/199 28476
/proc/meminfo: memFree=31498436/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8836 CPUtime=0.21 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 2404 0 0 0 21 0 0 0 20 0 1 0 555659804 33177600 2209 33554432000 4194304 6211132 140727849670816 140727849665176 5075544 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2209 886 493 0 1405 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8836 KiB

[startup+0.310548 s]*
/proc/loadavg: 2.02 2.01 2.05 3/199 28476
/proc/meminfo: memFree=31498436/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8836 CPUtime=0.31 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 2405 0 0 0 31 0 0 0 20 0 1 0 555659804 33177600 2209 33554432000 4194304 6211132 140727849670816 140727849665176 5193760 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2209 886 493 0 1405 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8836 KiB

[startup+0.700294 s]
/proc/loadavg: 2.02 2.01 2.05 3/199 28476
/proc/meminfo: memFree=31498436/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8836 CPUtime=0.69 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 2405 0 0 0 69 0 0 0 20 0 1 0 555659804 33177600 2209 33554432000 4194304 6211132 140727849670816 140727849668776 5079063 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2209 886 493 0 1405 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8836 KiB

[startup+1.5003 s]
/proc/loadavg: 2.02 2.01 2.05 3/199 28476
/proc/meminfo: memFree=31498264/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8836 CPUtime=1.49 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 2405 0 0 0 149 0 0 0 20 0 1 0 555659804 33177600 2209 33554432000 4194304 6211132 140727849670816 140727849668776 5389855 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2209 886 493 0 1405 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8836 KiB

[startup+3.11048 s]
/proc/loadavg: 2.02 2.01 2.05 3/199 28476
/proc/meminfo: memFree=31498260/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8972 CPUtime=3.1 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 3653 0 0 0 310 0 0 0 20 0 1 0 555659804 33177600 2243 33554432000 4194304 6211132 140727849670816 140727849668776 5083013 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2243 887 493 0 1405 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8972 KiB

[startup+6.30029 s]
/proc/loadavg: 2.02 2.01 2.05 3/199 28476
/proc/meminfo: memFree=31497636/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8972 CPUtime=6.29 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 4902 0 0 0 629 0 0 0 20 0 1 0 555659804 33177600 2243 33554432000 4194304 6211132 140727849670816 140727849668776 5149706 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2243 887 493 0 1405 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8972 KiB

[startup+12.7003 s]
/proc/loadavg: 2.01 2.01 2.05 3/199 28476
/proc/meminfo: memFree=31498040/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8972 CPUtime=12.69 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 5132 0 0 0 1269 0 0 0 20 0 1 0 555659804 33177600 2243 33554432000 4194304 6211132 140727849670816 140727849668776 5193760 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2243 887 493 0 1405 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8972 KiB

[startup+25.5003 s]
/proc/loadavg: 2.01 2.01 2.05 3/200 28478
/proc/meminfo: memFree=31497688/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8972 CPUtime=25.49 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 5590 0 0 0 2549 0 0 0 20 0 1 0 555659804 33177600 2243 33554432000 4194304 6211132 140727849670816 140727849668776 5078762 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2243 887 493 0 1405 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8972 KiB

[startup+51.1105 s]
/proc/loadavg: 2.01 2.01 2.05 3/199 28479
/proc/meminfo: memFree=31498340/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8972 CPUtime=51.09 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 5819 0 0 0 5109 0 0 0 20 0 1 0 555659804 33177600 2243 33554432000 4194304 6211132 140727849670816 140727849668776 5083000 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2243 887 493 0 1405 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8972 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28482
/proc/meminfo: memFree=31498204/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8972 CPUtime=102.28 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 6050 0 0 0 10228 0 0 0 20 0 1 0 555659804 33177600 2243 33554432000 4194304 6211132 140727849670816 140727849668776 5149714 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2243 887 493 0 1405 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8972 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28488
/proc/meminfo: memFree=31497800/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8972 CPUtime=162.28 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 6285 0 0 0 16228 0 0 0 20 0 1 0 555659804 33177600 2243 33554432000 4194304 6211132 140727849670816 140727849668776 5193760 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2243 887 493 0 1405 0
Current children cumulated CPU time: 162.28 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8972 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28492
/proc/meminfo: memFree=31497384/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8976 CPUtime=222.28 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 6516 0 0 0 22228 0 0 0 20 0 1 0 555659804 33177600 2244 33554432000 4194304 6211132 140727849670816 140727849668776 5149706 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2244 887 493 0 1405 0
Current children cumulated CPU time: 222.28 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8976 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28504
/proc/meminfo: memFree=31496788/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8976 CPUtime=282.27 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 6747 0 0 0 28227 0 0 0 20 0 1 0 555659804 33177600 2244 33554432000 4194304 6211132 140727849670816 140727849668776 5149714 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2244 887 493 0 1405 0
Current children cumulated CPU time: 282.27 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8976 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28510
/proc/meminfo: memFree=31497308/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8976 CPUtime=342.27 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 6976 0 0 0 34227 0 0 0 20 0 1 0 555659804 33177600 2244 33554432000 4194304 6211132 140727849670816 140727849668776 5083016 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2244 887 493 0 1405 0
Current children cumulated CPU time: 342.27 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8976 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28514
/proc/meminfo: memFree=31497040/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8976 CPUtime=402.27 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 7209 0 0 0 40227 0 0 0 20 0 1 0 555659804 33177600 2244 33554432000 4194304 6211132 140727849670816 140727849668776 5082590 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2244 887 493 0 1405 0
Current children cumulated CPU time: 402.27 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8976 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 28518
/proc/meminfo: memFree=31497172/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=32400 memory=8976 CPUtime=462.26 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 7440 0 0 0 46226 0 0 0 20 0 1 0 555659804 33177600 2244 33554432000 4194304 6211132 140727849670816 140727849668776 5193760 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8100 2244 887 493 0 1405 0
Current children cumulated CPU time: 462.26 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8976 KiB


################
# More data... #
################

/proc/28475/statm: 8407 2493 887 493 0 1712 0
Current children cumulated CPU time: 1602.2 s
Current children cumulated vsize: 33628 KiB
Current children cumulated memory: 9972 KiB

[startup+1662.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/199 28655
/proc/meminfo: memFree=31494596/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=33628 memory=9972 CPUtime=1662.2 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 14614 0 0 0 166220 0 0 0 20 0 1 0 555659804 34435072 2493 33554432000 4194304 6211132 140727849670816 140727849668776 5148716 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8407 2493 887 493 0 1712 0
Current children cumulated CPU time: 1662.2 s
Current children cumulated vsize: 33628 KiB
Current children cumulated memory: 9972 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 28659
/proc/meminfo: memFree=31494600/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=33628 memory=9972 CPUtime=1722.19 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 15145 0 0 0 172219 0 0 0 20 0 1 0 555659804 34435072 2493 33554432000 4194304 6211132 140727849670816 140727849668776 5397248 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8407 2493 887 493 0 1712 0
Current children cumulated CPU time: 1722.19 s
Current children cumulated vsize: 33628 KiB
Current children cumulated memory: 9972 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 28665
/proc/meminfo: memFree=31493860/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=34156 memory=10704 CPUtime=1782.19 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 15747 0 0 0 178219 0 0 0 20 0 1 0 555659804 34975744 2676 33554432000 4194304 6211132 140727849670816 140727849668104 5193760 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8539 2676 887 493 0 1844 0
Current children cumulated CPU time: 1782.19 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10704 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 28669
/proc/meminfo: memFree=31493764/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=34156 memory=10800 CPUtime=1842.19 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 16464 0 0 0 184219 0 0 0 20 0 1 0 555659804 34975744 2700 33554432000 4194304 6211132 140727849670816 140727849668776 5083016 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8539 2700 887 493 0 1844 0
Current children cumulated CPU time: 1842.19 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10800 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28673
/proc/meminfo: memFree=31494520/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=34156 memory=10800 CPUtime=1902.18 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 17002 0 0 0 190218 0 0 0 20 0 1 0 555659804 34975744 2700 33554432000 4194304 6211132 140727849670816 140727849668776 5193760 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8539 2700 887 493 0 1844 0
Current children cumulated CPU time: 1902.18 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10800 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28679
/proc/meminfo: memFree=31493708/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=34156 memory=10804 CPUtime=1962.18 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 17690 0 0 0 196218 0 0 0 20 0 1 0 555659804 34975744 2701 33554432000 4194304 6211132 140727849670816 140727849668776 5078852 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8539 2701 887 493 0 1844 0
Current children cumulated CPU time: 1962.18 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10804 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28683
/proc/meminfo: memFree=31493928/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=34156 memory=10812 CPUtime=2022.18 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 18119 0 0 0 202218 0 0 0 20 0 1 0 555659804 34975744 2703 33554432000 4194304 6211132 140727849670816 140727849668776 5079027 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8539 2703 887 493 0 1844 0
Current children cumulated CPU time: 2022.18 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10812 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28755
/proc/meminfo: memFree=31493736/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=34156 memory=10812 CPUtime=2082.18 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 18950 0 0 0 208217 1 0 0 20 0 1 0 555659804 34975744 2703 33554432000 4194304 6211132 140727849670816 140727849668776 5149714 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8539 2703 887 493 0 1844 0
Current children cumulated CPU time: 2082.18 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10812 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28761
/proc/meminfo: memFree=31493096/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=34156 memory=10812 CPUtime=2142.18 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 19412 0 0 0 214217 1 0 0 20 0 1 0 555659804 34975744 2703 33554432000 4194304 6211132 140727849670816 140727849668776 5392384 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8539 2703 887 493 0 1844 0
Current children cumulated CPU time: 2142.18 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10812 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28765
/proc/meminfo: memFree=31493468/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=34156 memory=10812 CPUtime=2202.18 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 19874 0 0 0 220217 1 0 0 20 0 1 0 555659804 34975744 2703 33554432000 4194304 6211132 140727849670816 140727849668776 5193760 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8539 2703 887 493 0 1844 0
Current children cumulated CPU time: 2202.18 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10812 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28769
/proc/meminfo: memFree=31493132/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=34156 memory=10812 CPUtime=2262.17 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 20496 0 0 0 226216 1 0 0 20 0 1 0 555659804 34975744 2703 33554432000 4194304 6211132 140727849670816 140727849668776 5148716 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8539 2703 887 493 0 1844 0
Current children cumulated CPU time: 2262.17 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10812 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28775
/proc/meminfo: memFree=31492912/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=34156 memory=10812 CPUtime=2322.17 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 20947 0 0 0 232216 1 0 0 20 0 1 0 555659804 34975744 2703 33554432000 4194304 6211132 140727849670816 140727849668776 5193760 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8539 2703 887 493 0 1844 0
Current children cumulated CPU time: 2322.17 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10812 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28780
/proc/meminfo: memFree=31493140/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=34156 memory=10812 CPUtime=2382.17 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 21398 0 0 0 238216 1 0 0 20 0 1 0 555659804 34975744 2703 33554432000 4194304 6211132 140727849670816 140727849668776 5079039 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8539 2703 887 493 0 1844 0
Current children cumulated CPU time: 2382.17 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10812 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2400.2 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 28781
/proc/meminfo: memFree=31493140/32770688 swapFree=67001380/67108860
[pid=28475] ppid=28472 vsize=34156 memory=10812 CPUtime=2400.06 cores=4-7
/proc/28475/stat : 28475 (cosoco) R 28472 28475 26332 0 -1 4202496 21848 0 0 0 240005 1 0 0 20 0 1 0 555659804 34975744 2703 33554432000 4194304 6211132 140727849670816 140727849668776 5149690 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 32874496 140727849677835 140727849677937 140727849677937 140727849680846 0
/proc/28475/statm: 8539 2703 887 493 0 1844 0
Current children cumulated CPU time: 2400.06 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10812 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2400.2 s]
# the end of solver process 28475 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2400.06 s, system=0.010999 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2400.2
CPU time (s): 2400.07
CPU user time (s): 2400.06
CPU system time (s): 0.010999
CPU usage (%): 99.9946
Max. virtual memory (cumulated for all children) (KiB): 34156
Max. memory (cumulated for all children) (KiB): 10812

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.06
system time used= 0.010999
maximum resident set size= 10876
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 21898
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 16
involuntary context switches= 1873


# summary of solver processes directly reported to runsolver:
#   pid: 28475
#   total CPU time (s): 2400.07
#   total CPU user time (s): 2400.06
#   total CPU system time (s): 0.010999

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.69815 second user time and 17.7288 second system time

The end

Launcher Data 

Begin job on node116 at 2019-09-30 00:45:40
IDJOB=4408679
IDBENCH=133249
IDSOLVER=2875
FILE ID=node116/4408679-1569797183
RUNJOBID= node116-1569787351-26364
PBS_JOBID= 21705835
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/MagicSquare/MagicSquare-sum-s1/MagicSquare-27-sum.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4408679-1569797183/watcher-4408679-1569797183 -o /tmp/evaluation-result-4408679-1569797183/solver-4408679-1569797183 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node116-1569787351-26364 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4408679-1569797183.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d104f54931e81c640cdf77e394aea107
RANDOM SEED=1507008229

node116.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.12
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2667.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770688 kB
MemFree:        31503576 kB
MemAvailable:   31855072 kB
Buffers:          190836 kB
Cached:           480884 kB
SwapCached:         3344 kB
Active:           373596 kB
Inactive:         305132 kB
Active(anon):      24624 kB
Inactive(anon):    63420 kB
Active(file):     348972 kB
Inactive(file):   241712 kB
Unevictable:      108916 kB
Mlocked:          108916 kB
SwapTotal:      67108860 kB
SwapFree:       67001380 kB
Dirty:              2800 kB
Writeback:             0 kB
AnonPages:        124160 kB
Mapped:            27960 kB
Shmem:             72416 kB
Slab:             183856 kB
SReclaimable:     153296 kB
SUnreclaim:        30560 kB
KernelStack:        3760 kB
PageTables:         5084 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494204 kB
Committed_AS:     569128 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350212 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     77824 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      116160 kB
DirectMap2M:    33429504 kB

Free space on /tmp at the end= 62024 MiB
End job on node116 at 2019-09-30 01:25:41