Trace number 4299999

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 1.12? (TO) 2519.93 2520.01

General information on the benchmark

NameMagicSquare/
MagicSquare-16-sum_c18.xml
MD5SUMdc0956070aead6ed741b5a9522bbec89
Bench CategoryCSP (decision problem)
Best result obtained on this benchmark
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark
Satisfiable
(Un)Satisfiability was proved
Number of variables256
Number of constraints35
Number of domains1
Minimum domain size256
Maximum domain size256
Distribution of domain sizes[{"size":256,"count":256}]
Minimum variable degree3
Maximum variable degree4
Distribution of variable degrees[{"degree":3,"count":224},{"degree":4,"count":32}]
Minimum constraint arity16
Maximum constraint arity256
Distribution of constraint arities[{"arity":16,"count":34},{"arity":256,"count":1}]
Number of extensional constraints0
Number of intensional constraints0
Distribution of constraint types[{"type":"allDifferent","count":1},{"type":"sum","count":34}]
Optimization problemNO
Type of objective

Solver Data 

0.00/0.01	c root propagations     : 0           
0.00/0.01	c restarts enabled, print stats at every restarts
0.00/0.01	c
0.00/0.01	c
0.00/0.01	c
0.00/0.01	c This is cosoco 1.12 --  
0.00/0.01	c
0.00/0.01	c command line: HOME/cosoco -lc -model -restarts HOME/instance-4299999-1532827259.xml 
0.00/0.01	c ========================================[ Problem Statistics ]===========================================
0.00/0.01	c |                                                                                                       
0.00/0.01	c |  Parse time        :         0.01 s 
0.00/0.01	c |
0.00/0.01	c |               Variables: 256
0.00/0.01	c |            Domain Sizes: 256..256
0.00/0.01	c |
0.00/0.01	c |             Constraints: 35
0.00/0.01	c |                   Arity: 16..256
0.00/0.01	c | 
0.00/0.01	c |                   Types: 
0.00/0.01	c |                          All Different: 1
0.00/0.01	c |                          Sum: 34
0.00/0.01	c |                          
0.00/0.01	c =========================================================================================================
0.00/0.01	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
0.00/0.04	c 101            128            1521           26131          0              0              10   13   11   
0.00/0.08	c 211            266            3130           53527          0              0              9   12   10    
0.10/0.13	c 332            417            4872           82982          0              0              9   12   10    
0.10/0.18	c 465            583            6781           116206         0              0              9   12   10    
0.21/0.23	c 611            765            8796           153452         0              0              9   12   10    
0.21/0.29	c 771            963            11011          191875         0              0              9   12   10    
0.31/0.35	c 947            1180           13331          233511         0              0              9   12   10    
0.31/0.41	c 1140           1418           15895          280762         0              0              9   12   11    
0.41/0.49	c 1352           1677           18747          331383         0              0              9   12   10    
0.51/0.56	c 1585           1961           21853          386427         0              0              9   12   10    
0.60/0.65	c 1841           2272           25233          446712         0              0              9   12   10    
0.69/0.74	c 2122           2613           28907          512147         0              0              9   12   10    
0.79/0.84	c 2431           2988           32903          583047         0              0              9   12   10    
0.89/0.96	c 2770           3399           37402          661915         0              0              9   12   10    
1.00/1.08	c 3142           3849           42343          746952         0              0              9   12   11    
1.19/1.22	c 3551           4342           47787          840899         0              0              9   12   11    
1.29/1.36	c 4000           4883           53526          944121         0              0              9   12   10    
1.49/1.53	c 4493           5476           59964          1056211        0              0              9   12   10    
1.69/1.70	c 5035           6129           66827          1180224        0              0              9   12   11    
1.79/1.89	c 5631           6845           74056          1316943        0              0              9   12   11    
2.00/2.10	c 6286           7631           82408          1465558        0              0              9   12   11    
2.29/2.33	c 7006           8495           91090          1628520        0              0              9   12   11    
2.49/2.58	c 7798           9444           100967         1808268        0              0              9   12   11    
2.79/2.85	c 8669           10487          111419         2004804        0              0              9   12   11    
3.10/3.15	c 9627           11634          122865         2219115        0              0              9   12   11    
3.39/3.49	c 10680          12897          135990         2455254        0              0              9   13   11    
3.79/3.87	c 11838          14294          150663         2723058        0              0              9   13   11    
4.19/4.29	c 13111          15836          166252         3021394        0              0              9   13   11    
4.69/4.75	c 14511          17538          183501         3352807        0              0              9   13   11    
5.19/5.26	c 16051          19418          202624         3723131        0              0              9   13   11    
5.79/5.85	c 17745          21499          224468         4141739        0              0              9   13   11    
6.49/6.51	c 19608          23793          249067         4607467        0              0              9   13   11    
7.19/7.23	c 21657          26323          275938         5123528        0              0              9   13   11    
8.00/8.05	c 23910          29119          306157         5703621        0              0              9   13   11    
8.89/8.95	c 26388          32203          339138         6351940        0              0              9   13   11    
9.89/9.97	c 29113          35610          376408         7071974        0              0              9   13   11    
11.00/11.07	c 32110          39359          415571         7866152        0              0              9   13   11    
12.19/12.27	c 35406          43486          458673         8740005        0              0              9   13   11    
13.59/13.62	c 39031          48037          506343         9710183        0              0              9   13   11    
15.10/15.13	c 43018          53080          559760         10807736       0              0              9   14   11    
16.79/16.82	c 47403          58661          619336         12041245       0              0              9   14   11    
18.69/18.71	c 52226          64809          686116         13402430       0              0              9   14   11    
20.79/20.80	c 57531          71569          760555         14897474       0              0              9   14   11    
23.10/23.11	c 63366          79031          841759         16557070       0              0              9   14   12    
25.69/25.73	c 69784          87299          934315         18443294       0              0              9   14   12    
28.59/28.66	c 76843          96426          1038151        20546229       0              0              9   14   12    
31.79/31.89	c 84607          106500         1151124        22887699       0              0              9   14   12    
35.39/35.44	c 93147          117574         1274912        25451620       0              0              9   14   12    
39.29/39.32	c 102541         129743         1410457        28254719       0              0              9   14   12    
43.69/43.72	c 112874         143247         1563130        31456519       0              0              9   14   12    
48.69/48.70	c 124240         158222         1735349        35085861       0              0              9   14   12    
54.18/54.26	c 136742         174783         1927465        39127315       0              0              9   14   12    
60.48/60.58	c 150494         193260         2143747        43751199       0              0              9   14   12    
67.58/67.68	c 165621         213736         2386701        48941372       0              0              9   14   12    
75.48/75.57	c 182260         236478         2655247        54710200       0              0              9   14   12    
84.28/84.37	c 200562         261771         2952583        61168665       0              0              9   14   12    
94.28/94.30	c 220694         289762         3290713        68347573       0              0              9   14   12    
105.09/105.15	c 242839         320457         3660702        76199199       0              0              9   14   12    
116.88/116.93	c 267198         354054         4063639        84701837       0              0              9   30   13    
129.58/129.63	c 293992         390512         4494801        93972877       0              0              10   15   13   
143.47/143.53	c 323465         430760         4977764        103925291      0              0              9   30   15    
159.57/159.66	c 355885         475813         5533958        115373105      0              0              10   15   13   
175.98/176.07	c 391547         524511         6101163        127402220      0              0              9   30   18    
194.77/194.89	c 430775         578620         6748012        140886193      0              0              10   30   15   
215.47/215.56	c 473925         638263         7461283        155852715      0              0              10   30   16   
238.07/238.14	c 521390         703933         8245063        172315400      0              0              10   46   18   
263.46/263.50	c 573601         776140         9103849        190440408      0              0              10   31   19   
290.66/290.70	c 631033         855082         10052829       209799587      0              0              10   46   22   
321.75/321.88	c 694208         943200         11124851       231903114      0              0              10   31   21   
354.15/354.25	c 763700         1039650        12273352       255353239      0              0              10   61   26   
389.35/389.48	c 840141         1144627        13512297       281065405      0              0              10   47   24   
427.54/427.66	c 924226         1259766        14861066       309844383      0              0              10   46   26   
468.54/468.68	c 1016719        1385526        16325233       341140401      0              0              10   46   28   
512.94/513.07	c 1118461        1523228        17909713       375463396      0              0              10   46   29   
561.04/561.18	c 1230377        1674216        19637147       413309630      0              0              10   46   30   
612.82/612.97	c 1353484        1839309        21513380       454559193      0              0              10   46   32   
668.41/668.53	c 1488901        2020019        23543198       499628353      0              0              10   46   33   
727.92/728.10	c 1637859        2227075        26047591       544395251      0              0              10   95   53   
801.01/801.17	c 1801712        2450931        28683964       600963619      0              0              10   47   36   
868.09/868.27	c 1981950        2701050        31671901       651547977      0              0              10   127   68  
956.28/956.43	c 2180211        2970756        34782857       719638716      0              0              10   58   38   
1048.47/1048.67	c 2398298        3261925        38325002       786724847      0              0              10   59   44   
1149.47/1149.64	c 2638193        3582247        42247035       860311614      0              0              10   59   45   
1260.77/1260.94	c 2902077        3935312        46619361       941638319      0              0              10   59   46   
1388.28/1388.46	c 3192349        4350762        51787373       1049551817     0              0              12   59   45   
1529.08/1529.22	c 3511648        4811416        57618615       1171260685     0              0              12   59   46   
1704.00/1704.17	c 3862876        5287941        64028543       1293701717     0              0              12   29   26   
1881.09/1881.24	c 4249226        5810165        70035359       1428790377     0              0              9   29   26    
2098.01/2098.11	c 4674211        6391296        77932450       1580424354     0              0              11   29   26   
2317.71/2317.84	c 5141694        7029962        85403160       1747145242     0              0              9   29   26    
2519.92/2520.00	
2519.92/2520.00	c *** INTERRUPTED ***
2519.92/2520.00	c restarts              : 90          
2519.92/2520.00	c conflicts             : 5540638      (2199 /sec)
2519.92/2520.00	c decisions             : 7573862      (3006 /sec)
2519.92/2520.00	c propagations          : 1888585583  (749459 /sec)
2519.92/2520.00	c root propagations     : 0           
2519.92/2520.00	c filter calls          : 92761369       (36811 /sec)
2519.92/2520.00	c useless filter calls  : 71317498       (76 %)
2519.92/2520.00	c Memory used           : 27.60 MB
2519.92/2520.00	c CPU time              : 2519.93 s
2519.92/2520.00	
2519.92/2520.00	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (10345 MiB free)
  memory of node 1: 16384 MiB (15794 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4299999-1532827259/watcher-4299999-1532827259 -o /tmp/evaluation-result-4299999-1532827259/solver-4299999-1532827259 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532812129-2126 --watchdog 2580 HOME/cosoco -lc -model -restarts HOME/instance-4299999-1532827259.xml 

running on 4 cores: 1,3,5,7

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
Current StackSize limit: 8192 KiB

solver pid=3801, runsolver pid=3798

[startup+0.100152 s]*
/proc/loadavg: 1.92 2.05 2.07 3/188 3802
/proc/meminfo: memFree=26765516/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=27944 memory=4372 CPUtime=0.1 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 1306 0 0 0 10 0 0 0 20 0 1 0 100289113 28614656 1093 33554432000 4194304 6142532 140725251002592 140725250999224 5062509 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 6986 1093 825 476 0 308 0
Current children cumulated CPU time: 0.1 s
Current children cumulated vsize: 27944 KiB
Current children cumulated memory: 4372 KiB

[startup+0.209423 s]*
/proc/loadavg: 1.92 2.05 2.07 3/188 3802
/proc/meminfo: memFree=26765624/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=27944 memory=4372 CPUtime=0.21 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 1306 0 0 0 21 0 0 0 20 0 1 0 100289113 28614656 1093 33554432000 4194304 6142532 140725251002592 140725250999992 5131350 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 6986 1093 825 476 0 308 0
Current children cumulated CPU time: 0.21 s
Current children cumulated vsize: 27944 KiB
Current children cumulated memory: 4372 KiB

[startup+0.308841 s]*
/proc/loadavg: 1.92 2.05 2.07 3/188 3802
/proc/meminfo: memFree=26765624/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=27944 memory=4372 CPUtime=0.31 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 1306 0 0 0 31 0 0 0 20 0 1 0 100289113 28614656 1093 33554432000 4194304 6142532 140725251002592 140725250999992 5175278 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 6986 1093 825 476 0 308 0
Current children cumulated CPU time: 0.31 s
Current children cumulated vsize: 27944 KiB
Current children cumulated memory: 4372 KiB

[startup+0.700267 s]
/proc/loadavg: 1.92 2.05 2.07 3/188 3802
/proc/meminfo: memFree=26765624/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=27944 memory=4372 CPUtime=0.69 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 1306 0 0 0 69 0 0 0 20 0 1 0 100289113 28614656 1093 33554432000 4194304 6142532 140725251002592 140725250999992 5175264 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 6986 1093 825 476 0 308 0
Current children cumulated CPU time: 0.69 s
Current children cumulated vsize: 27944 KiB
Current children cumulated memory: 4372 KiB

[startup+1.50028 s]
/proc/loadavg: 1.92 2.05 2.07 3/188 3802
/proc/meminfo: memFree=26765624/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=27944 memory=4372 CPUtime=1.49 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 1306 0 0 0 149 0 0 0 20 0 1 0 100289113 28614656 1093 33554432000 4194304 6142532 140725251002592 140725250999992 5175264 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 6986 1093 825 476 0 308 0
Current children cumulated CPU time: 1.49 s
Current children cumulated vsize: 27944 KiB
Current children cumulated memory: 4372 KiB

[startup+3.10892 s]
/proc/loadavg: 1.92 2.05 2.07 3/188 3802
/proc/meminfo: memFree=26765384/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=27944 memory=4600 CPUtime=3.1 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 1516 0 0 0 310 0 0 0 20 0 1 0 100289113 28614656 1150 33554432000 4194304 6142532 140725251002592 140725250999992 5131346 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 6986 1150 871 476 0 308 0
Current children cumulated CPU time: 3.1 s
Current children cumulated vsize: 27944 KiB
Current children cumulated memory: 4600 KiB

[startup+6.30027 s]
/proc/loadavg: 1.85 2.03 2.06 3/188 3802
/proc/meminfo: memFree=26765536/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=27944 memory=4600 CPUtime=6.29 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 1724 0 0 0 629 0 0 0 20 0 1 0 100289113 28614656 1150 33554432000 4194304 6142532 140725251002592 140725250999992 5336595 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 6986 1150 871 476 0 308 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 27944 KiB
Current children cumulated memory: 4600 KiB

[startup+12.7003 s]
/proc/loadavg: 1.86 2.03 2.06 3/188 3802
/proc/meminfo: memFree=26765536/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=27944 memory=4600 CPUtime=12.69 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 1932 0 0 0 1269 0 0 0 20 0 1 0 100289113 28614656 1150 33554432000 4194304 6142532 140725251002592 140725250999992 5175278 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 6986 1150 871 476 0 308 0
Current children cumulated CPU time: 12.69 s
Current children cumulated vsize: 27944 KiB
Current children cumulated memory: 4600 KiB

[startup+25.5003 s]
/proc/loadavg: 1.89 2.03 2.06 3/188 3802
/proc/meminfo: memFree=26765864/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=27944 memory=4604 CPUtime=25.49 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 2352 0 0 0 2549 0 0 0 20 0 1 0 100289113 28614656 1151 33554432000 4194304 6142532 140725251002592 140725250999992 5058171 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 6986 1151 871 476 0 308 0
Current children cumulated CPU time: 25.49 s
Current children cumulated vsize: 27944 KiB
Current children cumulated memory: 4604 KiB

[startup+51.1089 s]
/proc/loadavg: 1.93 2.02 2.06 3/188 3802
/proc/meminfo: memFree=26766516/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=27944 memory=4608 CPUtime=51.09 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 2562 0 0 0 5109 0 0 0 20 0 1 0 100289113 28614656 1152 33554432000 4194304 6142532 140725251002592 140725250999992 5175264 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 6986 1152 871 476 0 308 0
Current children cumulated CPU time: 51.09 s
Current children cumulated vsize: 27944 KiB
Current children cumulated memory: 4608 KiB

[startup+102.3 s]
/proc/loadavg: 1.97 2.02 2.05 3/188 3803
/proc/meminfo: memFree=26767396/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=27944 memory=4608 CPUtime=102.28 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 2772 0 0 0 10228 0 0 0 20 0 1 0 100289113 28614656 1152 33554432000 4194304 6142532 140725251002592 140725250999992 5058268 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 6986 1152 871 476 0 308 0
Current children cumulated CPU time: 102.28 s
Current children cumulated vsize: 27944 KiB
Current children cumulated memory: 4608 KiB

[startup+162.3 s]
/proc/loadavg: 1.99 2.01 2.05 3/188 3804
/proc/meminfo: memFree=26767892/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=28076 memory=4608 CPUtime=162.27 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 3007 0 0 0 16227 0 0 0 20 0 1 0 100289113 28749824 1152 33554432000 4194304 6142532 140725251002592 140725250999992 5175278 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7019 1152 871 476 0 341 0
Current children cumulated CPU time: 162.27 s
Current children cumulated vsize: 28076 KiB
Current children cumulated memory: 4608 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 3805
/proc/meminfo: memFree=26767532/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=28076 memory=4676 CPUtime=222.27 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 3227 0 0 0 22227 0 0 0 20 0 1 0 100289113 28749824 1169 33554432000 4194304 6142532 140725251002592 140725250999992 5175264 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7019 1169 871 476 0 341 0
Current children cumulated CPU time: 222.27 s
Current children cumulated vsize: 28076 KiB
Current children cumulated memory: 4676 KiB

[startup+282.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 3807
/proc/meminfo: memFree=26767532/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=28076 memory=4676 CPUtime=282.26 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 3456 0 0 0 28226 0 0 0 20 0 1 0 100289113 28749824 1169 33554432000 4194304 6142532 140725251002592 140725250999992 5175273 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7019 1169 871 476 0 341 0
Current children cumulated CPU time: 282.26 s
Current children cumulated vsize: 28076 KiB
Current children cumulated memory: 4676 KiB

[startup+342.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 3808
/proc/meminfo: memFree=26767284/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=28076 memory=4692 CPUtime=342.25 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 3681 0 0 0 34225 0 0 0 20 0 1 0 100289113 28749824 1173 33554432000 4194304 6142532 140725251002592 140725250999992 5055525 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7019 1173 871 476 0 341 0
Current children cumulated CPU time: 342.25 s
Current children cumulated vsize: 28076 KiB
Current children cumulated memory: 4692 KiB

[startup+402.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 3809
/proc/meminfo: memFree=26767280/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=28076 memory=4708 CPUtime=402.24 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 3931 0 0 0 40224 0 0 0 20 0 1 0 100289113 28749824 1177 33554432000 4194304 6142532 140725251002592 140725250999992 5061721 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7019 1177 871 476 0 341 0
Current children cumulated CPU time: 402.24 s
Current children cumulated vsize: 28076 KiB
Current children cumulated memory: 4708 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 3811
/proc/meminfo: memFree=26767028/32770624 swapFree=67028488/67108860
[pid=3801] ppid=3798 vsize=28076 memory=4708 CPUtime=462.24 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 4166 0 0 0 46224 0 0 0 20 0 1 0 100289113 28749824 1177 33554432000 4194304 6142532 140725251002592 140725250999992 5058199 0 0 4096 8405026 0 0 0 17 5 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7019 1177 871 476 0 341 0
Current children cumulated CPU time: 462.24 s
Current children cumulated vsize: 28076 KiB
Current children cumulated memory: 4708 KiB


################
# More data... #
################

/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 1722.19 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4019
/proc/meminfo: memFree=26763536/32770624 swapFree=67028496/67108860
[pid=3801] ppid=3798 vsize=28256 memory=4868 CPUtime=1782.19 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 9165 0 0 0 178219 0 0 0 20 0 1 0 100289113 28934144 1217 33554432000 4194304 6142532 140725251002592 140725250999992 5175278 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 1782.19 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4020
/proc/meminfo: memFree=26763164/32770624 swapFree=67028496/67108860
[pid=3801] ppid=3798 vsize=28256 memory=4868 CPUtime=1842.19 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 9400 0 0 0 184219 0 0 0 20 0 1 0 100289113 28934144 1217 33554432000 4194304 6142532 140725251002592 140725250999992 5175264 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 1842.19 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4021
/proc/meminfo: memFree=26763164/32770624 swapFree=67028496/67108860
[pid=3801] ppid=3798 vsize=28256 memory=4868 CPUtime=1902.19 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 9654 0 0 0 190219 0 0 0 20 0 1 0 100289113 28934144 1217 33554432000 4194304 6142532 140725251002592 140725250999992 5131338 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 1902.19 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4022
/proc/meminfo: memFree=26764292/32770624 swapFree=67028496/67108860
[pid=3801] ppid=3798 vsize=28256 memory=4868 CPUtime=1962.2 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 9889 0 0 0 196220 0 0 0 20 0 1 0 100289113 28934144 1217 33554432000 4194304 6142532 140725251002592 140725250999992 5175264 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 1962.2 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/188 4023
/proc/meminfo: memFree=26763948/32770624 swapFree=67028496/67108860
[pid=3801] ppid=3798 vsize=28256 memory=4868 CPUtime=2022.2 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 10124 0 0 0 202220 0 0 0 20 0 1 0 100289113 28934144 1217 33554432000 4194304 6142532 140725251002592 140725250999992 5175278 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 2022.2 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB

[startup+2082.3 s]
/proc/loadavg: 1.96 2.00 2.04 3/187 4025
/proc/meminfo: memFree=26763796/32770624 swapFree=67028500/67108860
[pid=3801] ppid=3798 vsize=28256 memory=4868 CPUtime=2082.2 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 10124 0 0 0 208220 0 0 0 20 0 1 0 100289113 28934144 1217 33554432000 4194304 6142532 140725251002592 140725250999992 5058160 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 2082.2 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB

[startup+2142.3 s]
/proc/loadavg: 1.99 2.00 2.04 3/187 4026
/proc/meminfo: memFree=26763924/32770624 swapFree=67028500/67108860
[pid=3801] ppid=3798 vsize=28256 memory=4868 CPUtime=2142.2 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 10378 0 0 0 214220 0 0 0 20 0 1 0 100289113 28934144 1217 33554432000 4194304 6142532 140725251002592 140725250999992 5058171 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 2142.2 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 4027
/proc/meminfo: memFree=26763668/32770624 swapFree=67028500/67108860
[pid=3801] ppid=3798 vsize=28256 memory=4868 CPUtime=2202.21 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 10613 0 0 0 220221 0 0 0 20 0 1 0 100289113 28934144 1217 33554432000 4194304 6142532 140725251002592 140725250999992 5058185 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 2202.21 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 4029
/proc/meminfo: memFree=26763656/32770624 swapFree=67028500/67108860
[pid=3801] ppid=3798 vsize=28256 memory=4868 CPUtime=2262.21 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 10613 0 0 0 226221 0 0 0 20 0 1 0 100289113 28934144 1217 33554432000 4194304 6142532 140725251002592 140725250999992 5175273 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 2262.21 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 4030
/proc/meminfo: memFree=26763712/32770624 swapFree=67028500/67108860
[pid=3801] ppid=3798 vsize=28256 memory=4868 CPUtime=2322.21 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 10867 0 0 0 232221 0 0 0 20 0 1 0 100289113 28934144 1217 33554432000 4194304 6142532 140725251002592 140725250999992 5347469 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 2322.21 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/187 4038
/proc/meminfo: memFree=26762768/32770624 swapFree=67028500/67108860
[pid=3801] ppid=3798 vsize=28256 memory=4868 CPUtime=2382.21 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 11104 0 0 0 238221 0 0 0 20 0 1 0 100289113 28934144 1217 33554432000 4194304 6142532 140725251002592 140725250999992 5054357 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 2382.21 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 4062
/proc/meminfo: memFree=26762628/32770624 swapFree=67028500/67108860
[pid=3801] ppid=3798 vsize=28256 memory=4868 CPUtime=2442.21 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 11339 0 0 0 244221 0 0 0 20 0 1 0 100289113 28934144 1217 33554432000 4194304 6142532 140725251002592 140725250999992 5175264 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 2442.21 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.00 2.04 3/188 4063
/proc/meminfo: memFree=26763124/32770624 swapFree=67028500/67108860
[pid=3801] ppid=3798 vsize=28256 memory=4868 CPUtime=2502.22 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 11339 0 0 0 250222 0 0 0 20 0 1 0 100289113 28934144 1217 33554432000 4194304 6142532 140725251002592 140725250999992 5131659 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 2502.22 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.00 2.04 3/188 4063
/proc/meminfo: memFree=26763372/32770624 swapFree=67028500/67108860
[pid=3801] ppid=3798 vsize=28256 memory=4868 CPUtime=2519.92 cores=1,3,5,7
/proc/3801/stat : 3801 (cosoco) R 3798 3801 2093 0 -1 4202496 11574 0 0 0 251992 0 0 0 20 0 1 0 100289113 28934144 1217 33554432000 4194304 6142532 140725251002592 140725250999992 5175264 0 0 4096 8405026 0 0 0 17 3 0 0 0 0 0 8243016 8247936 17346560 140725251011718 140725251011848 140725251011848 140725251014606 0
/proc/3801/statm: 7064 1217 871 476 0 386 0
Current children cumulated CPU time: 2519.92 s
Current children cumulated vsize: 28256 KiB
Current children cumulated memory: 4868 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 3801 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.93 s, system=0.002041 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2519.93
CPU user time (s): 2519.93
CPU system time (s): 0.002041
CPU usage (%): 99.997
Max. virtual memory (cumulated for all children) (KiB): 28256
Max. memory (cumulated for all children) (KiB): 4868

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.93
system time used= 0.002041
maximum resident set size= 4932
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 11623
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 15
involuntary context switches= 1241


# summary of solver processes directly reported to runsolver:
#   pid: 3801
#   total CPU time (s): 2519.93
#   total CPU user time (s): 2519.93
#   total CPU system time (s): 0.002041

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 8.43461 second user time and 16.0605 second system time

The end

Launcher Data 

Begin job on node102 at 2018-07-29 03:20:59
IDJOB=4299999
IDBENCH=141518
IDSOLVER=2761
FILE ID=node102/4299999-1532827259
RUNJOBID= node102-1532812129-2126
PBS_JOBID= 21022490
Free space on /tmp= 52744 MiB

SOLVER NAME= cosoco 1.12
BENCH NAME= XCSP18/MagicSquare/MagicSquare-16-sum_c18.xml
COMMAND LINE= DIR/cosoco -lc -model -restarts BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4299999-1532827259/watcher-4299999-1532827259 -o /tmp/evaluation-result-4299999-1532827259/solver-4299999-1532827259 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node102-1532812129-2126 --watchdog 2580  HOME/cosoco -lc -model -restarts HOME/instance-4299999-1532827259.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= dc0956070aead6ed741b5a9522bbec89
RANDOM SEED=599742951

node102.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5333.51
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        26767104 kB
MemAvailable:   31931920 kB
Buffers:          219968 kB
Cached:          5200132 kB
SwapCached:        53364 kB
Active:          1222896 kB
Inactive:        4279648 kB
Active(anon):       8232 kB
Inactive(anon):    99196 kB
Active(file):    1214664 kB
Inactive(file):  4180452 kB
Unevictable:        6628 kB
Mlocked:            6628 kB
SwapTotal:      67108860 kB
SwapFree:       67028488 kB
Dirty:              2720 kB
Writeback:             0 kB
AnonPages:         35884 kB
Mapped:            39612 kB
Shmem:             22288 kB
Slab:             199224 kB
SReclaimable:     171072 kB
SUnreclaim:        28152 kB
KernelStack:        3392 kB
PageTables:         5448 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     352340 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:         0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      105856 kB
DirectMap2M:    33439744 kB

Free space on /tmp at the end= 52740 MiB
End job on node102 at 2018-07-29 04:03:00