Trace number 4390139

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2? (TO) 2400.09 2399.9

General information on the benchmark

NameMagicSquare/MagicSquare-sum-s1/
MagicSquare-27-sum.xml
MD5SUMd104f54931e81c640cdf77e394aea107
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables729
Number of constraints57
Number of domains1
Minimum domain size729
Maximum domain size729
Distribution of domain sizes[{"size":729,"count":729}]
Minimum variable degree3
Maximum variable degree5
Distribution of variable degrees[{"degree":3,"count":676},{"degree":4,"count":52},{"degree":5,"count":1}]
Minimum constraint arity27
Maximum constraint arity729
Distribution of constraint arities[{"arity":27,"count":56},{"arity":729,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"sum","count":56}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.02	c root propagations     : 0           
0.00/0.02	c restarts enabled, print stats at every restarts
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c
0.00/0.02	c This is cosoco 2.00 --  
0.00/0.02	c
0.00/0.02	c command line: cosoco -lc -model -restarts -stick HOME/instance-4390139-1568341539.xml 
0.00/0.02	c ========================================[ Problem Statistics ]===========================================
0.00/0.02	c |                                                                                                       
0.00/0.02	c |  Parse time        :         0.01 s 
0.00/0.02	c |
0.00/0.02	c |               Variables: 729
0.00/0.02	c |            Domain Sizes: 729..729
0.00/0.02	c |
0.00/0.02	c |             Constraints: 57
0.00/0.02	c |                   Arity: 27..729
0.00/0.02	c | 
0.00/0.02	c |                   Types: 
0.00/0.02	c |                          All Different: 1
0.00/0.02	c |                          Sum: 56
0.00/0.02	c |                          
0.00/0.02	c =========================================================================================================
0.00/0.02	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.21/0.23	c 101            123            1890           155088         0              0              15   17   16   
0.41/0.45	c 211            255            3750           307922         0              0              14   16   15   
0.60/0.68	c 332            399            5746           470794         0              0              14   17   15   
0.89/0.93	c 465            556            7843           635674         0              0              14   17   15   
1.10/1.19	c 611            727            10090          810710         0              0              14   17   15   
1.39/1.47	c 771            913            12460          995225         0              0              14   17   15   
1.69/1.77	c 947            1117           15021          1190554        0              0              14   17   15   
2.00/2.09	c 1140           1340           17782          1397200        0              0              14   17   15   
2.39/2.42	c 1352           1583           20691          1605655        0              0              14   17   15   
2.69/2.78	c 1585           1849           23828          1828257        0              0              14   17   15   
3.10/3.17	c 1841           2140           27168          2063267        0              0              14   17   15   
3.49/3.58	c 2122           2458           30762          2309818        0              0              14   17   15   
4.00/4.03	c 2431           2807           34727          2578059        0              0              14   17   15   
4.49/4.52	c 2770           3189           39166          2860568        0              0              14   17   15   
5.00/5.05	c 3142           3607           43974          3158502        0              0              14   17   16   
5.59/5.60	c 3551           4065           48900          3471505        0              0              14   17   16   
6.19/6.24	c 4000           4567           54759          3807501        0              0              14   17   16   
6.79/6.89	c 4493           5117           60769          4159100        0              0              14   17   16   
7.59/7.62	c 5035           5720           67545          4536616        0              0              14   18   16   
8.39/8.41	c 5631           6383           74799          4950495        0              0              14   18   16   
9.19/9.26	c 6286           7110           82593          5391040        0              0              14   18   16   
10.10/10.18	c 7006           7908           91058          5876516        0              0              14   18   16   
11.19/11.20	c 7798           8785           100391         6399049        0              0              14   18   16   
12.29/12.30	c 8669           9749           110499         6958571        0              0              14   18   16   
13.49/13.50	c 9627           10808          121573         7558029        0              0              14   18   16   
14.79/14.81	c 10680          11971          133617         8207108        0              0              14   18   16   
16.19/16.21	c 11838          13249          146254         8919287        0              0              14   18   16   
17.69/17.78	c 13111          14653          160716         9685222        0              0              14   18   16   
19.49/19.50	c 14511          16196          176531         10514204       0              0              14   18   16   
21.29/21.36	c 16051          17892          193597         11400751       0              0              14   18   16   
23.39/23.41	c 17745          19757          212433         12372758       0              0              14   18   16   
25.59/25.61	c 19608          21808          232265         13433890       0              0              14   18   16   
28.10/28.14	c 21657          24063          256083         14583924       0              0              14   18   16   
30.69/30.77	c 23910          26541          279789         15827584       0              0              14   18   16   
33.69/33.72	c 26388          29265          307005         17172847       0              0              14   18   16   
36.69/36.76	c 29113          32260          336579         18654185       0              0              14   18   16   
39.89/40.00	c 32110          35554          367812         20266106       0              0              14   19   17   
43.49/43.58	c 35406          39178          402294         22054263       0              0              14   19   17   
47.49/47.53	c 39031          43164          440230         24028066       0              0              14   19   17   
51.79/51.88	c 43018          47548          481969         26217192       0              0              14   19   17   
56.59/56.66	c 47403          52369          527853         28608242       0              0              14   19   17   
61.89/61.92	c 52226          57672          578132         31212084       0              0              14   19   17   
67.69/67.70	c 57531          63506          633335         34062811       0              0              14   19   17   
73.99/74.05	c 63366          69923          693788         37177302       0              0              14   19   17   
80.99/81.04	c 69784          76982          760318         40619280       0              0              14   19   17   
88.69/88.76	c 76843          84748          833555         44406764       0              0              14   19   17   
97.39/97.48	c 84607          93294          917465         48548871       0              0              14   19   17   
106.99/107.10	c 93147          102698         1010031        53070320       0              0              14   19   17   
117.48/117.52	c 102541         113052         1107954        58071805       0              0              14   20   17   
129.28/129.32	c 112874         124452         1220408        63600728       0              0              14   20   17   
141.68/141.71	c 124240         136989         1334860        69764185       0              0              14   20   18   
155.78/155.84	c 136742         150799         1467210        76436560       0              0              14   21   18   
170.79/170.89	c 150494         165973         1606295        83936316       0              0              14   20   18   
188.00/188.03	c 165621         182754         1760642        92851850       0              0              16   21   19   
208.59/208.69	c 182260         201424         1940459        103089602      0              0              15   22   20   
229.69/229.79	c 200562         221739         2132045        113966669      0              0              15   21   19   
254.19/254.22	c 220694         244308         2340889        126260176      0              0              15   22   20   
279.10/279.19	c 242839         268886         2562798        139393440      0              0              15   21   19   
307.60/307.63	c 267198         296092         2806846        155301454      0              0              17   22   20   
341.30/341.31	c 293992         326296         3088432        172335295      0              0              3   22   20    
376.50/376.50	c 323465         359311         3387484        192125466      0              0              4   22   20    
417.61/417.62	c 355885         395900         3729661        212999130      0              0              5   22   20    
460.51/460.53	c 391547         435887         4092862        237122451      0              0              6   22   20    
511.51/511.52	c 430775         480189         4525361        262428255      0              0              7   22   20    
564.92/564.92	c 473925         528622         4984887        292018631      0              0              8   22   20    
626.82/626.88	c 521390         582284         5506405        322770117      0              0              9   22   20    
690.43/690.44	c 573601         640927         6040063        358698699      0              0              10   22   20   
762.94/762.92	c 631033         705725         6644602        395047633      0              0              11   46   21   
824.84/824.83	c 694208         775537         7295598        426656469      0              0              12   101   81  
892.95/892.94	c 763700         852521         8021863        461020439      0              0              13   128   93  
966.85/966.86	c 840141         936560         8782275        500673756      0              0              14   74   72   
1047.76/1047.78	c 924226         1029563        9651446        541794245      0              0              15   127   98  
1160.08/1160.05	c 1016719        1136004        10671080       619543610      0              0              16   104   91  
1245.68/1245.67	c 1118461        1248317        11693061       669616335      0              0              17   156   144 
1337.48/1337.43	c 1230377        1372047        12838629       720673188      0              0              18   183   163 
1445.39/1445.35	c 1353484        1508026        14091173       779971225      0              0              19   182   132 
1550.60/1550.54	c 1488901        1659266        15505065       840587452      0              0              20   290   219 
1655.01/1654.97	c 1637859        1824026        16983678       908218937      0              0              21   290   238 
1755.32/1755.25	c 1801712        2004422        18633802       977719142      0              0              22   290   280 
1934.43/1934.35	c 1981950        2207746        20349848       1234295022     0              0              23   159   157 
2071.16/2071.09	c 2180211        2424031        22195122       1337661823     0              0              24   209   206 
2244.47/2244.33	c 2398298        2663223        24131940       1648414336     0              0              25   160   158 
2400.08/2399.90	
2400.08/2399.90	c *** INTERRUPTED ***
2400.08/2399.90	c restarts              : 82          
2400.08/2399.90	c conflicts             : 2634129      (1098 /sec)
2400.08/2399.90	c decisions             : 2914832      (1214 /sec)
2400.08/2399.90	c propagations          : 2000219449  (833398 /sec)
2400.08/2399.90	c root propagations     : 0           
2400.08/2399.90	c filter calls          : 26141149       (10892 /sec)
2400.08/2399.90	c useless filter calls  : 19278059       (73 %)
2400.08/2399.90	c Memory used           : 33.36 MB
2400.08/2399.90	c CPU time              : 2400.08 s
2400.08/2399.90	c real time             : 2399.9 s
2400.08/2399.90	
2400.08/2399.90	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (11961 MiB free)
  memory of node 1: 16384 MiB (12646 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4390139-1568341539/watcher-4390139-1568341539 -o /tmp/evaluation-result-4390139-1568341539/solver-4390139-1568341539 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node148-1568328795-19588 --watchdog 2560 cosoco -lc -model -restarts -stick HOME/instance-4390139-1568341539.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2400 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2430 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2500 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=22375, runsolver pid=22372

[startup+0.100383 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 22376
/proc/meminfo: memFree=25193304/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32252 memory=8808 CPUtime=0.1 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 2365 0 0 0 10 0 0 0 20 0 1 0 410315470 33026048 2202 33554432000 4194304 6210612 140735637801488 140735637799160 5397066 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8063 2202 879 493 0 1368 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 32252 KiB
Current children cumulated memory: 8808 KiB

[startup+0.209599 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 22376
/proc/meminfo: memFree=25193304/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8808 CPUtime=0.21 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 2396 0 0 0 21 0 0 0 20 0 1 0 410315470 33177600 2202 33554432000 4194304 6210612 140735637801488 140735637799160 5078493 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2202 879 493 0 1405 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8808 KiB

[startup+0.30911 s]*
/proc/loadavg: 2.00 2.01 2.05 3/199 22376
/proc/meminfo: memFree=25192932/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8808 CPUtime=0.31 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 2399 0 0 0 31 0 0 0 20 0 1 0 410315470 33177600 2202 33554432000 4194304 6210612 140735637801488 140735637799160 5149280 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2202 879 493 0 1405 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8808 KiB

[startup+0.700283 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22376
/proc/meminfo: memFree=25192932/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8808 CPUtime=0.69 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 2399 0 0 0 69 0 0 0 20 0 1 0 410315470 33177600 2202 33554432000 4194304 6210612 140735637801488 140735637799160 5081584 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2202 879 493 0 1405 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8808 KiB

[startup+1.50029 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22376
/proc/meminfo: memFree=25192932/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8808 CPUtime=1.49 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 2399 0 0 0 149 0 0 0 20 0 1 0 410315470 33177600 2202 33554432000 4194304 6210612 140735637801488 140735637799448 5081588 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2202 879 493 0 1405 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8808 KiB

[startup+3.10909 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22376
/proc/meminfo: memFree=25192564/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8952 CPUtime=3.1 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 3647 0 0 0 310 0 0 0 20 0 1 0 410315470 33177600 2238 33554432000 4194304 6210612 140735637801488 140735637799448 5078668 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2238 882 493 0 1405 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8952 KiB

[startup+6.30028 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22376
/proc/meminfo: memFree=25192684/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8952 CPUtime=6.29 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 4894 0 0 0 629 0 0 0 20 0 1 0 410315470 33177600 2238 33554432000 4194304 6210612 140735637801488 140735637799448 5397063 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2238 882 493 0 1405 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8952 KiB

[startup+12.7003 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 22378
/proc/meminfo: memFree=25192392/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8952 CPUtime=12.69 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 6142 0 0 0 1269 0 0 0 20 0 1 0 410315470 33177600 2238 33554432000 4194304 6210612 140735637801488 140735637799448 5149321 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2238 882 493 0 1405 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8952 KiB

[startup+25.5003 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22378
/proc/meminfo: memFree=25192460/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8952 CPUtime=25.49 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 8636 0 0 0 2549 0 0 0 20 0 1 0 410315470 33177600 2238 33554432000 4194304 6210612 140735637801488 140735637799448 5192912 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2238 882 493 0 1405 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8952 KiB

[startup+51.1091 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22379
/proc/meminfo: memFree=25191792/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8952 CPUtime=51.1 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 8863 0 0 0 5110 0 0 0 20 0 1 0 410315470 33177600 2238 33554432000 4194304 6210612 140735637801488 140735637799448 5076090 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2238 882 493 0 1405 0
Current children cumulated CPU time: 51.1 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8952 KiB

[startup+102.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 22445
/proc/meminfo: memFree=25191756/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8952 CPUtime=102.29 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 9091 0 0 0 10229 0 0 0 20 0 1 0 410315470 33177600 2238 33554432000 4194304 6210612 140735637801488 140735637799448 5079064 0 0 4096 8405026 0 0 0 17 1 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2238 882 493 0 1405 0
Current children cumulated CPU time: 102.29 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8952 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 22450
/proc/meminfo: memFree=25192544/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8952 CPUtime=162.29 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 9323 0 0 0 16229 0 0 0 20 0 1 0 410315470 33177600 2238 33554432000 4194304 6210612 140735637801488 140735637799448 5078522 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2238 882 493 0 1405 0
Current children cumulated CPU time: 162.29 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8952 KiB

[startup+222.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/200 22455
/proc/meminfo: memFree=25192248/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8956 CPUtime=222.29 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 9551 0 0 0 22229 0 0 0 20 0 1 0 410315470 33177600 2239 33554432000 4194304 6210612 140735637801488 140735637799448 5149318 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2239 882 493 0 1405 0
Current children cumulated CPU time: 222.29 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8956 KiB

[startup+282.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/201 22461
/proc/meminfo: memFree=25192108/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8956 CPUtime=282.3 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 9551 0 0 0 28230 0 0 0 20 0 1 0 410315470 33177600 2239 33554432000 4194304 6210612 140735637801488 140735637799448 5192912 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2239 882 493 0 1405 0
Current children cumulated CPU time: 282.3 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8956 KiB

[startup+342.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/201 22473
/proc/meminfo: memFree=25192416/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8956 CPUtime=342.3 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 9779 0 0 0 34230 0 0 0 20 0 1 0 410315470 33177600 2239 33554432000 4194304 6210612 140735637801488 140735637799448 5392183 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2239 882 493 0 1405 0
Current children cumulated CPU time: 342.3 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8956 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 22477
/proc/meminfo: memFree=25191788/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8956 CPUtime=402.31 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 9779 0 0 0 40231 0 0 0 20 0 1 0 410315470 33177600 2239 33554432000 4194304 6210612 140735637801488 140735637799448 5192912 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2239 882 493 0 1405 0
Current children cumulated CPU time: 402.31 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8956 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 22483
/proc/meminfo: memFree=25191488/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=32400 memory=8956 CPUtime=462.31 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 10007 0 0 0 46231 0 0 0 20 0 1 0 410315470 33177600 2239 33554432000 4194304 6210612 140735637801488 140735637799448 5149280 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8100 2239 882 493 0 1405 0
Current children cumulated CPU time: 462.31 s
Current children cumulated vsize: 32400 KiB
Current children cumulated memory: 8956 KiB


################
# More data... #
################

/proc/22375/statm: 8539 2696 882 493 0 1844 0
Current children cumulated CPU time: 1662.41 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10784 KiB

[startup+1722.3 s]
/proc/loadavg: 2.00 2.04 2.05 3/200 22595
/proc/meminfo: memFree=25188728/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=34156 memory=10784 CPUtime=1722.42 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 14978 0 0 0 172242 0 0 0 20 0 1 0 410315470 34975744 2696 33554432000 4194304 6210612 140735637801488 140735637799448 5192912 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8539 2696 882 493 0 1844 0
Current children cumulated CPU time: 1722.42 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10784 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 22599
/proc/meminfo: memFree=25189168/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=34156 memory=10792 CPUtime=1782.42 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 15658 0 0 0 178242 0 0 0 20 0 1 0 410315470 34975744 2698 33554432000 4194304 6210612 140735637801488 140735637799448 5078690 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8539 2698 882 493 0 1844 0
Current children cumulated CPU time: 1782.42 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10792 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.03 2.05 3/199 22604
/proc/meminfo: memFree=25188496/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=34156 memory=10792 CPUtime=1842.42 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 15658 0 0 0 184242 0 0 0 20 0 1 0 410315470 34975744 2698 33554432000 4194304 6210612 140735637801488 140735637799448 5078397 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8539 2698 882 493 0 1844 0
Current children cumulated CPU time: 1842.42 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10792 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/200 22610
/proc/meminfo: memFree=25188660/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=34156 memory=10792 CPUtime=1902.43 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 16118 0 0 0 190243 0 0 0 20 0 1 0 410315470 34975744 2698 33554432000 4194304 6210612 140735637801488 140735637799448 5078656 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8539 2698 882 493 0 1844 0
Current children cumulated CPU time: 1902.43 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10792 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.02 2.05 3/199 22614
/proc/meminfo: memFree=25187776/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=34156 memory=10792 CPUtime=1962.44 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 16278 0 0 0 196244 0 0 0 20 0 1 0 410315470 34975744 2698 33554432000 4194304 6210612 140735637801488 140735637799448 5080961 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8539 2698 882 493 0 1844 0
Current children cumulated CPU time: 1962.44 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10792 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 22619
/proc/meminfo: memFree=25187604/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=34156 memory=10792 CPUtime=2022.45 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 16727 0 0 0 202244 1 0 0 20 0 1 0 410315470 34975744 2698 33554432000 4194304 6210612 140735637801488 140735637799448 5192912 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8539 2698 882 493 0 1844 0
Current children cumulated CPU time: 2022.45 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10792 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 22625
/proc/meminfo: memFree=25187120/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=34156 memory=10792 CPUtime=2082.45 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 16898 0 0 0 208244 1 0 0 20 0 1 0 410315470 34975744 2698 33554432000 4194304 6210612 140735637801488 140735637799448 5078699 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8539 2698 882 493 0 1844 0
Current children cumulated CPU time: 2082.45 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10792 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 22637
/proc/meminfo: memFree=25187260/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=34156 memory=10792 CPUtime=2142.46 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 17358 0 0 0 214245 1 0 0 20 0 1 0 410315470 34975744 2698 33554432000 4194304 6210612 140735637801488 140735637799448 5192912 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8539 2698 882 493 0 1844 0
Current children cumulated CPU time: 2142.46 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10792 KiB

[startup+2202.3 s]
/proc/loadavg: 2.08 2.03 2.05 3/200 22662
/proc/meminfo: memFree=25187488/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=34156 memory=10792 CPUtime=2202.47 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 17358 0 0 0 220246 1 0 0 20 0 1 0 410315470 34975744 2698 33554432000 4194304 6210612 140735637801488 140735637799448 5192912 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8539 2698 882 493 0 1844 0
Current children cumulated CPU time: 2202.47 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10792 KiB

[startup+2262.3 s]
/proc/loadavg: 2.03 2.03 2.05 3/201 22668
/proc/meminfo: memFree=25186724/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=34156 memory=10792 CPUtime=2262.47 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 17945 0 0 0 226246 1 0 0 20 0 1 0 410315470 34975744 2698 33554432000 4194304 6210612 140735637801488 140735637799448 5082655 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8539 2698 882 493 0 1844 0
Current children cumulated CPU time: 2262.47 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10792 KiB

[startup+2322.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/200 22672
/proc/meminfo: memFree=25187668/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=34156 memory=10792 CPUtime=2322.47 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 17945 0 0 0 232246 1 0 0 20 0 1 0 410315470 34975744 2698 33554432000 4194304 6210612 140735637801488 140735637799448 5392160 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8539 2698 882 493 0 1844 0
Current children cumulated CPU time: 2322.47 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10792 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 22676
/proc/meminfo: memFree=25188220/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=34156 memory=10792 CPUtime=2382.48 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 18404 0 0 0 238247 1 0 0 20 0 1 0 410315470 34975744 2698 33554432000 4194304 6210612 140735637801488 140735637799448 5192880 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8539 2698 882 493 0 1844 0
Current children cumulated CPU time: 2382.48 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10792 KiB



Maximum CPU time exceeded: sending SIGTERM then SIGKILL

[startup+2399.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 22679
/proc/meminfo: memFree=25188076/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=34156 memory=10792 CPUtime=2400.08 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 18404 0 0 0 240007 1 0 0 20 0 1 0 410315470 34975744 2698 33554432000 4194304 6210612 140735637801488 140735637799448 5082658 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8539 2698 882 493 0 1844 0
Current children cumulated CPU time: 2400.08 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10792 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2399.9 s]
# the end of solver process 22375 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2400.08 s, system=0.011 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

[startup+2399.9 s]
/proc/loadavg: 2.00 2.01 2.05 3/201 22679
/proc/meminfo: memFree=25188076/32770624 swapFree=67004140/67108860
[pid=22375] ppid=22372 vsize=34156 memory=10792 CPUtime=2400.08 cores=1,3,5,7
/proc/22375/stat : 22375 (cosoco) R 22372 22375 19556 0 -1 4202496 18404 0 0 0 240007 1 0 0 20 0 1 0 410315470 34975744 2698 33554432000 4194304 6210612 140735637801488 140735637799448 5082658 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8308220 8313664 9957376 140735637804043 140735637804145 140735637804145 140735637807054 0
/proc/22375/statm: 8539 2698 882 493 0 1844 0
Current children cumulated CPU time: 2400.08 s
Current children cumulated vsize: 34156 KiB
Current children cumulated memory: 10792 KiB

Child status: 1
Real time (s): 2399.9
CPU time (s): 2400.09
CPU user time (s): 2400.08
CPU system time (s): 0.011
CPU usage (%): 100.008
Max. virtual memory (cumulated for all children) (KiB): 34156
Max. memory (cumulated for all children) (KiB): 10792

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2400.08
system time used= 0.011
maximum resident set size= 10860
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 18455
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 754


# summary of solver processes directly reported to runsolver:
#   pid: 22375
#   total CPU time (s): 2400.09
#   total CPU user time (s): 2400.08
#   total CPU system time (s): 0.011

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 7.67606 second user time and 16.1768 second system time

The end

Launcher Data 

Begin job on node148 at 2019-09-13 04:25:02
IDJOB=4390139
IDBENCH=133249
IDSOLVER=2830
FILE ID=node148/4390139-1568341539
RUNJOBID= node148-1568328795-19588
PBS_JOBID= 21701154
Free space on /tmp= 58796 MiB

SOLVER NAME= cosoco 2
BENCH NAME= XCSP17/MagicSquare/MagicSquare-sum-s1/MagicSquare-27-sum.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4390139-1568341539/watcher-4390139-1568341539 -o /tmp/evaluation-result-4390139-1568341539/solver-4390139-1568341539 -C 2400 -W 2500 -M 15500 --bin-var /tmp/runsolver-exch-node148-1568328795-19588 --watchdog 2560  cosoco -lc -model -restarts -stick HOME/instance-4390139-1568341539.xml

TIME LIMIT= 2400 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= d104f54931e81c640cdf77e394aea107
RANDOM SEED=1166374930

node148.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.13
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        25198360 kB
MemAvailable:   31863048 kB
Buffers:          141636 kB
Cached:          6770688 kB
SwapCached:         3904 kB
Active:          2412992 kB
Inactive:        4506856 kB
Active(anon):       4880 kB
Inactive(anon):    43524 kB
Active(file):    2408112 kB
Inactive(file):  4463332 kB
Unevictable:      109232 kB
Mlocked:          109232 kB
SwapTotal:      67108860 kB
SwapFree:       67004140 kB
Dirty:              2764 kB
Writeback:             4 kB
AnonPages:        101788 kB
Mapped:            44980 kB
Shmem:             32260 kB
Slab:             246800 kB
SReclaimable:     218156 kB
SUnreclaim:        28644 kB
KernelStack:        3520 kB
PageTables:         5536 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     528016 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     55296 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 58792 MiB
End job on node148 at 2019-09-13 05:05:02