Trace number 4407989

Some explanations

A solver is run under the control of another program named runsolver. runsolver is in charge of imposing the CPU time limit and the memory limit to the solver. It also monitors some information about the process. The trace of the execution of a solver is divided into four (or five) parts:
  1. SOLVER DATA
    This is the output of the solver (stdout and stderr).
    Note that some very long lines in this section may be truncated by your web browser ! In such a case, you may want to use the "Download as text" link to get the trace as a text file.

    When the --timestamp option is passed to the runsolver program, each line output by the solver is prepended with a timestamp which indicates at what time the line was output by the solver. Times are relative to the start of the program, given in seconds. The first timestamp (if present) is estimated CPU time. The last timestamp is wall clock time.

    As some 'v lines' may be very long (sometimes several megabytes), the 'v line' output by your solver may be split on several lines to help limit the size of the trace recorded in the database. In any case, the exact output of your solver is preserved in a trace file.
  2. VERIFIER DATA
    The output of the solver is piped to a verifier program which will search a value line "v " and, if found, will check that the given interpretation satisfies all constraints.
  3. CONVERSION SCRIPT DATA (Optionnal)
    When a conversion script is used, this section shows the messages that were output by the conversion script.
  4. WATCHER DATA
    This is the informations gathered by the runsolver program. It first prints the different limits. There's a first limit on CPU time set to X seconds (see the parameters in the trace). After this time has ellapsed, runsolver sends a SIGTERM and 2 seconds later a SIGKILL to the solver. For safety, there's also another limit set to X+30 seconds which will send a SIGXPU to the solver. The last limit is on the virtual memory used by the process (see the parameters in the trace).
    Every ten seconds, the runsolver process fetches the content of /proc/loadavg, /proc/pid/stat and /proc/pid/statm (see man proc) and prints it as raw data. This is only recorded in case we need to investigate the behaviour of a solver. The memory used by the solver (vsize) is also given every ten seconds.
    When the solver exits, runsolver prints some informations such as status and time. CPU usage is the ratio CPU Time/Real Time.
  5. LAUNCHER DATA
    These informations are related to the script which will launch the solver. The most important informations are the command line given to the solver, the md5sum of the different files and the dump of the /proc/cpuinfo and /proc/meminfo which provides some useful information on the computer.

Solver answer on this benchmark

Solver NameAnswerCPU timeWall clock time
cosoco 2.0? (TO) 2519.77 2520.01

General information on the benchmark

NameSuperSolutions/SuperSolutions-Taillard-os10/
SuperTaillard-os-10-26.xml
MD5SUM163dd1c4311ae2a810c887bcbec28782
Bench CategoryCSP (decision problem)
Best result obtained on this benchmarkUNSAT
Best value of the objective obtained on this benchmark
Best CPU time to get the best result obtained on this benchmark15.5906
Satisfiable
(Un)Satisfiability was proved
Number of variables200
Number of constraints2800
Number of domains64
Minimum domain size413
Maximum domain size511
Distribution of domain sizes[{"size":413,"count":2},{"size":414,"count":2},{"size":415,"count":2},{"size":417,"count":2},{"size":418,"count":4},{"size":420,"count":2},{"size":421,"count":4},{"size":422,"count":4},{"size":423,"count":2},{"size":425,"count":2},{"size":428,"count":4},{"size":430,"count":4},{"size":432,"count":2},{"size":434,"count":2},{"size":435,"count":2},{"size":437,"count":4},{"size":439,"count":2},{"size":440,"count":2},{"size":443,"count":4},{"size":445,"count":8},{"size":447,"count":2},{"size":448,"count":2},{"size":450,"count":2},{"size":453,"count":6},{"size":456,"count":2},"...",{"size":478,"count":2}, {"size":479,"count":2}, {"size":481,"count":10}, {"size":482,"count":2}, {"size":484,"count":2}, {"size":485,"count":2}, {"size":486,"count":6}, {"size":487,"count":2}, {"size":488,"count":2}, {"size":489,"count":2}, {"size":490,"count":4}, {"size":491,"count":4}, {"size":492,"count":4}, {"size":493,"count":2}, {"size":494,"count":2}, {"size":495,"count":4}, {"size":496,"count":4}, {"size":497,"count":2}, {"size":499,"count":4}, {"size":501,"count":2}, {"size":502,"count":4}, {"size":503,"count":8}, {"size":504,"count":4}, {"size":507,"count":2}, {"size":511,"count":4}]
Minimum variable degree19
Maximum variable degree37
Distribution of variable degrees[{"degree":19,"count":100},{"degree":37,"count":100}]
Minimum constraint arity2
Maximum constraint arity2
Distribution of constraint arities[{"arity":2,"count":2800}]
Number of extensional constraints0
Number of intensional constraints2800
Distribution of constraint types[{"type":"intension","count":2800}]
Optimization problemNO
Type of objective

Solver Data 

1.89/1.92	c root propagations     : 0           
1.89/1.92	c restarts enabled, print stats at every restarts
1.89/1.92	c
1.89/1.92	c
1.89/1.92	c
1.89/1.92	c This is cosoco 2.00 --  
1.89/1.92	c
1.89/1.92	c command line: cosoco -lc -model -restarts -stick HOME/instance-4407989-1569808816.xml 
1.89/1.92	c ========================================[ Problem Statistics ]===========================================
1.89/1.92	c |                                                                                                       
1.89/1.92	c |  Parse time        :         1.88 s 
1.89/1.92	c |
1.89/1.92	c |               Variables: 200
1.89/1.92	c |            Domain Sizes: 413..511
1.89/1.92	c |
1.89/1.92	c |             Constraints: 2800
1.89/1.92	c |                   Arity: 2..2  -- Binary: 2800
1.89/1.92	c | 
1.89/1.92	c |                   Types: 
1.89/1.92	c |                          (X != Y): 100
1.89/1.92	c |                          Intension: 2700
1.89/1.92	c |                          
1.89/1.92	c =========================================================================================================
1.89/1.92	c conflicts      decisions      filterCalls    propagations   Root Prop.     Nogoods        min/max/avg depth
3.78/3.88	c 101            114            42872          237697         0              0              6   7   6      
7.19/7.23	c 211            233            63340          774809         0              0              7   8   7      
8.68/8.77	c 332            364            88328          1236265        0              0              7   7   6      
10.58/10.69	c 465            505            110467         1620948        0              0              6   6   5      
12.98/13.09	c 611            662            154290         2117003        0              0              5   6   5      
16.88/16.94	c 771            842            236153         2588548        0              0              5   6   5      
20.09/20.15	c 947            1029           286794         3101570        0              0              6   6   5      
21.68/21.79	c 1140           1230           306107         3721859        0              0              6   6   5      
24.67/24.78	c 1352           1458           359108         4329168        0              0              5   7   6      
29.37/29.45	c 1585           1717           428823         5076010        0              0              6   9   8      
32.08/32.15	c 1841           1980           448319         5712351        0              0              6   6   5      
38.37/38.49	c 2122           2317           616554         6251294        0              0              7   11   9     
44.08/44.17	c 2431           2675           728748         6652356        0              0              23   30   29   
51.57/51.64	c 2770           3066           857066         7363212        0              0              9   12   10    
63.97/64.05	c 3142           3469           1026997        8320633        0              0              6   8   7      
71.86/72.00	c 3551           3910           1150270        9856309        0              0              7   8   7      
80.08/80.19	c 4000           4400           1307536        11049608       0              0              5   6   5      
92.47/92.56	c 4493           4910           1367111        13614698       0              0              5   5   4      
97.87/97.95	c 5035           5462           1398617        14634513       0              0              6   6   5      
105.37/105.47	c 5631           6079           1555373        16557288       0              0              4   6   4      
122.16/122.25	c 6286           6806           1812234        18459863       0              0              6   28   27    
141.85/141.99	c 7006           7602           2049445        21168138       0              0              24   26   24   
158.46/158.58	c 7798           8472           2321297        23410218       0              0              20   22   20   
175.96/176.05	c 8669           9443           2629484        24983117       0              0              22   25   24   
195.96/196.01	c 9627           10536          3028782        27449480       0              0              6   27   24    
230.74/230.80	c 10680          11689          3538566        30071904       0              0              9   48   46    
259.64/259.77	c 11838          12967          3906727        33064366       0              0              9   41   39    
285.23/285.30	c 13111          14302          4249743        37888332       0              0              6   9   7      
307.94/308.03	c 14511          15908          4750533        40211220       0              0              13   42   40   
400.22/400.34	c 16051          17574          5425257        46524419       0              0              14   66   63   
435.41/435.57	c 17745          19409          6004538        50271577       0              0              14   39   38   
462.11/462.23	c 19608          21393          6373339        55180644       0              0              14   20   19   
499.49/499.66	c 21657          23531          6739235        62217989       0              0              4   5   4      
545.00/545.14	c 23910          25927          7453171        70098144       0              0              4   8   5      
582.78/582.93	c 26388          28546          7843425        78631204       0              0              4   5   4      
662.68/662.83	c 29113          31431          8426181        90857404       0              0              3   4   3      
731.77/731.94	c 32110          35131          9913396        105298483      0              0              3   6   4      
802.07/802.23	c 35406          38688          11107595       115377197      0              0              3   7   6      
926.76/927.00	c 39031          42968          13549732       128192882      0              0              3   6   5      
973.75/974.00	c 43018          47044          13949558       141756464      0              0              3   4   3      
1105.85/1106.01	c 47403          51967          16341033       154668493      0              0              4   6   5      
1189.95/1190.13	c 52226          57023          16999554       171840780      0              0              4   5   4      
1263.43/1263.61	c 57531          62571          18031679       190008425      0              0              4   6   5      
1389.32/1389.55	c 63366          68889          20092492       208739287      0              0              4   8   7      
1563.51/1563.76	c 69784          75912          22304084       226898295      0              0              3   7   6      
1659.21/1659.49	c 76843          83125          23027148       250706296      0              0              3   4   3      
1797.60/1797.85	c 84607          91297          24751695       275907658      0              0              4   8   6      
2099.89/2100.17	c 93147          100707         28937207       296516237      0              0              3   7   6      
2386.36/2386.63	c 102541         111748         35095214       331852836      0              0              3   7   5      
2519.76/2520.01	
2519.76/2520.01	c *** INTERRUPTED ***
2519.76/2520.01	c restarts              : 49          
2519.76/2520.01	c conflicts             : 108069       (43 /sec)
2519.76/2520.01	c decisions             : 117708       (47 /sec)
2519.76/2520.01	c propagations          : 352898115   (140058 /sec)
2519.76/2520.01	c root propagations     : 0           
2519.76/2520.01	c filter calls          : 37125239       (14734 /sec)
2519.76/2520.01	c useless filter calls  : 31548168       (84 %)
2519.76/2520.01	c Memory used           : 156.18 MB
2519.76/2520.01	c CPU time              : 2519.67 s
2519.76/2520.01	c real time             : 2520.01 s
2519.76/2520.01	
2519.76/2520.01	s UNKNOWN

Verifier Data


Watcher Data 

runsolver version 3.4.0 (svn: 3012) Copyright (C) 2010-2013 Olivier ROUSSEL

This program is distributed in the hope that it will be useful,
but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
GNU General Public License for more details.

NUMA information:
  number of nodes: 2
  memory of node 0: 16374 MiB (15282 MiB free)
  memory of node 1: 16384 MiB (15473 MiB free)
  node distances:
     10  21
     21  10

command line: BIN/runsolver --timestamp -w /tmp/evaluation-result-4407989-1569808816/watcher-4407989-1569808816 -o /tmp/evaluation-result-4407989-1569808816/solver-4407989-1569808816 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1569783168-25106 --watchdog 2580 cosoco -lc -model -restarts -stick HOME/instance-4407989-1569808816.xml 

running on 4 cores: 0,2,4,6

Enforcing CPUTime limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing CPUTime limit (hard limit, will send SIGXCPU): 2550 seconds
Enforcing wall clock limit (soft limit, will send SIGTERM then SIGKILL): 2520 seconds
Enforcing VSIZE limit (soft limit, will send SIGTERM then SIGKILL): 15872000 KiB
Enforcing VSIZE limit (hard limit, stack expansion will fail with SIGSEGV, brk() and mmap() will return ENOMEM): 15923200 KiB
Linux 3.10.0-514.16.1.el7.x86_64
Starting watchdog thread
solver pid=30071, runsolver pid=30068
Current StackSize limit: 8192 KiB


[startup+0.100811 s]*
/proc/loadavg: 1.91 2.01 2.04 3/198 30072
/proc/meminfo: memFree=31491848/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=28896 memory=4920 CPUtime=0.09 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 1433 0 0 0 9 0 0 0 20 0 1 0 557137923 29589504 1230 33554432000 4194304 6211132 140728651821664 140728651818936 140387228601396 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 7224 1230 798 493 0 529 0
Current children cumulated CPU time: 0.09 s
Current children cumulated vsize: 28896 KiB
Current children cumulated memory: 4920 KiB

[startup+0.209371 s]*
/proc/loadavg: 1.91 2.01 2.04 3/198 30072
/proc/meminfo: memFree=31487376/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=33772 memory=10172 CPUtime=0.2 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 2705 0 0 0 20 0 0 0 20 0 1 0 557137923 34582528 2477 33554432000 4194304 6211132 140728651821664 140728651818936 140387212557285 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 8443 2543 816 493 0 1748 0
Current children cumulated CPU time: 0.2 s
Current children cumulated vsize: 33772 KiB
Current children cumulated memory: 10172 KiB

[startup+0.309212 s]*
/proc/loadavg: 1.91 2.01 2.04 3/198 30072
/proc/meminfo: memFree=31481328/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=39188 memory=15328 CPUtime=0.3 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 4051 0 0 0 30 0 0 0 20 0 1 0 557137923 40128512 3832 33554432000 4194304 6211132 140728651821664 140728651818936 140387212557285 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 9797 3832 816 493 0 3102 0
Current children cumulated CPU time: 0.3 s
Current children cumulated vsize: 39188 KiB
Current children cumulated memory: 15328 KiB

[startup+0.700243 s]
/proc/loadavg: 1.91 2.01 2.04 3/198 30072
/proc/meminfo: memFree=31471036/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=59624 memory=35772 CPUtime=0.68 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 9148 0 0 0 67 1 0 0 20 0 1 0 557137923 61054976 8943 33554432000 4194304 6211132 140728651821664 140728651816760 140387216035787 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 14906 8943 816 493 0 8211 0
Current children cumulated CPU time: 0.68 s
Current children cumulated vsize: 59624 KiB
Current children cumulated memory: 35772 KiB

[startup+1.50026 s]
/proc/loadavg: 1.91 2.01 2.04 3/198 30072
/proc/meminfo: memFree=31444748/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=102372 memory=78640 CPUtime=1.48 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 19838 0 0 0 146 2 0 0 20 0 1 0 557137923 104828928 19660 33554432000 4194304 6211132 140728651821664 140728651816760 5452606 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 25593 19660 816 493 0 18898 0
Current children cumulated CPU time: 1.48 s
Current children cumulated vsize: 102372 KiB
Current children cumulated memory: 78640 KiB

[startup+3.10926 s]
/proc/loadavg: 1.91 2.01 2.04 3/198 30072
/proc/meminfo: memFree=31393308/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=127056 memory=103548 CPUtime=3.09 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 29924 0 0 0 306 3 0 0 20 0 1 0 557137923 130105344 25887 33554432000 4194304 6211132 140728651821664 140728651819320 5439860 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 31764 25887 859 493 0 25069 0
Current children cumulated CPU time: 3.09 s
Current children cumulated vsize: 127056 KiB
Current children cumulated memory: 103548 KiB

[startup+6.30022 s]
/proc/loadavg: 1.92 2.01 2.04 3/198 30072
/proc/meminfo: memFree=31391516/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=128772 memory=105304 CPUtime=6.29 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 34716 0 0 0 625 4 0 0 20 0 1 0 557137923 131862528 26326 33554432000 4194304 6211132 140728651821664 140728651819320 5446131 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 32193 26326 861 493 0 25498 0
Current children cumulated CPU time: 6.29 s
Current children cumulated vsize: 128772 KiB
Current children cumulated memory: 105304 KiB

[startup+12.7002 s]
/proc/loadavg: 1.93 2.01 2.04 3/199 30081
/proc/meminfo: memFree=31387408/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=129960 memory=106460 CPUtime=12.68 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 44818 0 0 0 1264 4 0 0 20 0 1 0 557137923 133079040 26615 33554432000 4194304 6211132 140728651821664 140728651819320 5454220 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 32490 26615 861 493 0 25795 0
Current children cumulated CPU time: 12.68 s
Current children cumulated vsize: 129960 KiB
Current children cumulated memory: 106460 KiB

[startup+25.5002 s]
/proc/loadavg: 2.02 2.02 2.04 3/199 30081
/proc/meminfo: memFree=31381332/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=130620 memory=107160 CPUtime=25.47 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 58502 0 0 0 2542 5 0 0 20 0 1 0 557137923 133754880 26790 33554432000 4194304 6211132 140728651821664 140728651819624 5442996 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 32655 26790 861 493 0 25960 0
Current children cumulated CPU time: 25.47 s
Current children cumulated vsize: 130620 KiB
Current children cumulated memory: 107160 KiB

[startup+51.1094 s]
/proc/loadavg: 2.01 2.02 2.04 3/199 30083
/proc/meminfo: memFree=31374184/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=135768 memory=112236 CPUtime=51.08 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 72824 0 0 0 5102 6 0 0 20 0 1 0 557137923 139026432 28059 33554432000 4194304 6211132 140728651821664 140728651819320 5453958 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 33942 28059 861 493 0 27247 0
Current children cumulated CPU time: 51.08 s
Current children cumulated vsize: 135768 KiB
Current children cumulated memory: 112236 KiB

[startup+102.3 s]
/proc/loadavg: 2.01 2.02 2.04 3/199 30087
/proc/meminfo: memFree=31371332/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=136164 memory=112760 CPUtime=102.27 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 80661 0 0 0 10220 7 0 0 20 0 1 0 557137923 139431936 28190 33554432000 4194304 6211132 140728651821664 140728651819624 5478432 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 34041 28190 861 493 0 27346 0
Current children cumulated CPU time: 102.27 s
Current children cumulated vsize: 136164 KiB
Current children cumulated memory: 112760 KiB

[startup+162.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 30091
/proc/meminfo: memFree=31367188/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=139068 memory=115432 CPUtime=162.26 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 95349 0 0 0 16218 8 0 0 20 0 1 0 557137923 142405632 28858 33554432000 4194304 6211132 140728651821664 140728651819320 5069032 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 34767 28858 861 493 0 28072 0
Current children cumulated CPU time: 162.26 s
Current children cumulated vsize: 139068 KiB
Current children cumulated memory: 115432 KiB

[startup+222.3 s]
/proc/loadavg: 2.00 2.01 2.04 3/199 30097
/proc/meminfo: memFree=31362960/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=142632 memory=119208 CPUtime=222.24 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 97488 0 0 0 22216 8 0 0 20 0 1 0 557137923 146055168 29802 33554432000 4194304 6211132 140728651821664 140728651819320 5454212 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 35658 29802 861 493 0 28963 0
Current children cumulated CPU time: 222.24 s
Current children cumulated vsize: 142632 KiB
Current children cumulated memory: 119208 KiB

[startup+282.3 s]
/proc/loadavg: 2.06 2.03 2.05 3/199 30101
/proc/meminfo: memFree=31359952/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=145008 memory=121448 CPUtime=282.24 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 99377 0 0 0 28216 8 0 0 20 0 1 0 557137923 148488192 30362 33554432000 4194304 6211132 140728651821664 140728651819320 5443093 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 36252 30362 861 493 0 29557 0
Current children cumulated CPU time: 282.24 s
Current children cumulated vsize: 145008 KiB
Current children cumulated memory: 121448 KiB

[startup+342.3 s]
/proc/loadavg: 2.02 2.02 2.05 3/198 30106
/proc/meminfo: memFree=31350432/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=154248 memory=130676 CPUtime=342.23 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 103921 0 0 0 34215 8 0 0 20 0 1 0 557137923 157949952 32669 33554432000 4194304 6211132 140728651821664 140728651819320 5453958 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 38562 32669 861 493 0 31867 0
Current children cumulated CPU time: 342.23 s
Current children cumulated vsize: 154248 KiB
Current children cumulated memory: 130676 KiB

[startup+402.3 s]
/proc/loadavg: 2.01 2.02 2.05 3/198 30112
/proc/meminfo: memFree=31347124/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=156228 memory=132760 CPUtime=402.22 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 107449 0 0 0 40214 8 0 0 20 0 1 0 557137923 159977472 33190 33554432000 4194304 6211132 140728651821664 140728651819320 5443025 0 0 4096 8405026 0 0 0 17 4 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39057 33190 861 493 0 32362 0
Current children cumulated CPU time: 402.22 s
Current children cumulated vsize: 156228 KiB
Current children cumulated memory: 132760 KiB

[startup+462.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/198 30116
/proc/meminfo: memFree=31345552/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=157944 memory=134484 CPUtime=462.21 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 109432 0 0 0 46212 9 0 0 20 0 1 0 557137923 161734656 33621 33554432000 4194304 6211132 140728651821664 140728651819320 5446959 0 0 4096 8405026 0 0 0 17 0 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39486 33621 861 493 0 32791 0
Current children cumulated CPU time: 462.21 s
Current children cumulated vsize: 157944 KiB
Current children cumulated memory: 134484 KiB


################
# More data... #
################

/proc/30071/statm: 39948 34074 861 493 0 33253 0
Current children cumulated CPU time: 1722.11 s
Current children cumulated vsize: 159792 KiB
Current children cumulated memory: 136296 KiB

[startup+1782.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 30255
/proc/meminfo: memFree=31330036/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=159792 memory=136336 CPUtime=1782.1 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 120013 0 0 0 178200 10 0 0 20 0 1 0 557137923 163627008 34084 33554432000 4194304 6211132 140728651821664 140728651819320 140387222502222 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39948 34084 861 493 0 33253 0
Current children cumulated CPU time: 1782.1 s
Current children cumulated vsize: 159792 KiB
Current children cumulated memory: 136336 KiB

[startup+1842.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 30266
/proc/meminfo: memFree=31328168/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=159792 memory=136348 CPUtime=1842.1 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 120412 0 0 0 184200 10 0 0 20 0 1 0 557137923 163627008 34087 33554432000 4194304 6211132 140728651821664 140728651819624 5440715 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39948 34087 861 493 0 33253 0
Current children cumulated CPU time: 1842.1 s
Current children cumulated vsize: 159792 KiB
Current children cumulated memory: 136348 KiB

[startup+1902.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 30270
/proc/meminfo: memFree=31329544/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=159792 memory=136352 CPUtime=1902.09 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 120768 0 0 0 190199 10 0 0 20 0 1 0 557137923 163627008 34088 33554432000 4194304 6211132 140728651821664 140728651819624 5451642 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39948 34088 861 493 0 33253 0
Current children cumulated CPU time: 1902.09 s
Current children cumulated vsize: 159792 KiB
Current children cumulated memory: 136352 KiB

[startup+1962.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 30274
/proc/meminfo: memFree=31329972/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=159792 memory=136356 CPUtime=1962.09 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 121132 0 0 0 196199 10 0 0 20 0 1 0 557137923 163627008 34089 33554432000 4194304 6211132 140728651821664 140728651819624 5451514 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39948 34089 861 493 0 33253 0
Current children cumulated CPU time: 1962.09 s
Current children cumulated vsize: 159792 KiB
Current children cumulated memory: 136356 KiB

[startup+2022.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 30280
/proc/meminfo: memFree=31330112/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=159792 memory=136360 CPUtime=2022.09 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 121481 0 0 0 202199 10 0 0 20 0 1 0 557137923 163627008 34090 33554432000 4194304 6211132 140728651821664 140728651819624 5451553 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39948 34090 861 493 0 33253 0
Current children cumulated CPU time: 2022.09 s
Current children cumulated vsize: 159792 KiB
Current children cumulated memory: 136360 KiB

[startup+2082.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 30284
/proc/meminfo: memFree=31329708/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=159792 memory=136360 CPUtime=2082.08 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 121831 0 0 0 208198 10 0 0 20 0 1 0 557137923 163627008 34090 33554432000 4194304 6211132 140728651821664 140728651819624 5441152 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39948 34090 861 493 0 33253 0
Current children cumulated CPU time: 2082.08 s
Current children cumulated vsize: 159792 KiB
Current children cumulated memory: 136360 KiB

[startup+2142.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 30289
/proc/meminfo: memFree=31329764/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=159792 memory=136364 CPUtime=2142.08 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 122216 0 0 0 214198 10 0 0 20 0 1 0 557137923 163627008 34091 33554432000 4194304 6211132 140728651821664 140728651819624 5068958 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39948 34091 861 493 0 33253 0
Current children cumulated CPU time: 2142.08 s
Current children cumulated vsize: 159792 KiB
Current children cumulated memory: 136364 KiB

[startup+2202.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 30295
/proc/meminfo: memFree=31329468/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=159792 memory=136364 CPUtime=2202.07 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 122515 0 0 0 220197 10 0 0 20 0 1 0 557137923 163627008 34091 33554432000 4194304 6211132 140728651821664 140728651819624 5009641 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39948 34091 861 493 0 33253 0
Current children cumulated CPU time: 2202.07 s
Current children cumulated vsize: 159792 KiB
Current children cumulated memory: 136364 KiB

[startup+2262.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/199 30299
/proc/meminfo: memFree=31329376/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=159792 memory=136364 CPUtime=2262.07 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 122824 0 0 0 226197 10 0 0 20 0 1 0 557137923 163627008 34091 33554432000 4194304 6211132 140728651821664 140728651819624 140387222502232 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39948 34091 861 493 0 33253 0
Current children cumulated CPU time: 2262.07 s
Current children cumulated vsize: 159792 KiB
Current children cumulated memory: 136364 KiB

[startup+2322.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 30305
/proc/meminfo: memFree=31330004/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=159792 memory=136364 CPUtime=2322.07 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 123130 0 0 0 232197 10 0 0 20 0 1 0 557137923 163627008 34091 33554432000 4194304 6211132 140728651821664 140728651819624 5446956 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39948 34091 861 493 0 33253 0
Current children cumulated CPU time: 2322.07 s
Current children cumulated vsize: 159792 KiB
Current children cumulated memory: 136364 KiB

[startup+2382.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 30311
/proc/meminfo: memFree=31327252/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=159792 memory=136364 CPUtime=2382.06 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 123445 0 0 0 238196 10 0 0 20 0 1 0 557137923 163627008 34091 33554432000 4194304 6211132 140728651821664 140728651819624 5476851 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39948 34091 861 493 0 33253 0
Current children cumulated CPU time: 2382.06 s
Current children cumulated vsize: 159792 KiB
Current children cumulated memory: 136364 KiB

[startup+2442.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 30320
/proc/meminfo: memFree=31326244/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=159924 memory=136456 CPUtime=2442.06 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 123874 0 0 0 244196 10 0 0 20 0 1 0 557137923 163762176 34114 33554432000 4194304 6211132 140728651821664 140728651819320 5446270 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39981 34114 861 493 0 33286 0
Current children cumulated CPU time: 2442.06 s
Current children cumulated vsize: 159924 KiB
Current children cumulated memory: 136456 KiB

[startup+2502.3 s]
/proc/loadavg: 2.00 2.01 2.05 3/200 30324
/proc/meminfo: memFree=31326724/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=159924 memory=136468 CPUtime=2502.05 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 124231 0 0 0 250195 10 0 0 20 0 1 0 557137923 163762176 34117 33554432000 4194304 6211132 140728651821664 140728651819320 5451456 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39981 34117 861 493 0 33286 0
Current children cumulated CPU time: 2502.05 s
Current children cumulated vsize: 159924 KiB
Current children cumulated memory: 136468 KiB



Maximum wall clock time exceeded: sending SIGTERM then SIGKILL

[startup+2520 s]*
/proc/loadavg: 2.00 2.01 2.05 3/200 30387
/proc/meminfo: memFree=31188320/32770624 swapFree=66986684/67108860
[pid=30071] ppid=30068 vsize=159924 memory=136472 CPUtime=2519.76 cores=0,2,4,6
/proc/30071/stat : 30071 (cosoco) R 30068 30071 25075 0 -1 4202496 124559 0 0 0 251966 10 0 0 20 0 1 0 557137923 163762176 34118 33554432000 4194304 6211132 140728651821664 140728651819320 5441122 0 0 4096 8405026 0 0 0 17 2 0 0 0 0 0 8312316 8317760 22040576 140728651830283 140728651830385 140728651830385 140728651833294 0
/proc/30071/statm: 39981 34118 861 493 0 33286 0
Current children cumulated CPU time: 2519.76 s
Current children cumulated vsize: 159924 KiB
Current children cumulated memory: 136472 KiB

Sending SIGTERM to process tree (bottom up)
Sleeping 2 seconds

[startup+2520.01 s]
# the end of solver process 30071 was just reported to runsolver
# cumulated CPU time of all completed processes:  user=2519.67 s, system=0.10499 s

Solver just ended.
??? end of watcher thread
Dumping a history of the last processes samples

Child status: 1
Real time (s): 2520.01
CPU time (s): 2519.77
CPU user time (s): 2519.67
CPU system time (s): 0.10499
CPU usage (%): 99.9905
Max. virtual memory (cumulated for all children) (KiB): 159924
Max. memory (cumulated for all children) (KiB): 136472

getrusage(RUSAGE_CHILDREN,...) data:
user time used= 2519.67
system time used= 0.10499
maximum resident set size= 136540
integral shared memory size= 0
integral unshared data size= 0
integral unshared stack size= 0
page reclaims= 124609
page faults= 0
swaps= 0
block input operations= 0
block output operations= 0
messages sent= 0
messages received= 0
signals received= 0
voluntary context switches= 39
involuntary context switches= 1580


# summary of solver processes directly reported to runsolver:
#   pid: 30071
#   total CPU time (s): 2519.77
#   total CPU user time (s): 2519.67
#   total CPU system time (s): 0.10499

??? join timestamper begins
??? join timestamper ends
??? end of timestamper thread
runsolver used 9.2934 second user time and 16.7167 second system time

The end

Launcher Data 

Begin job on node104 at 2019-09-30 02:49:50
IDJOB=4407989
IDBENCH=138449
IDSOLVER=2874
FILE ID=node104/4407989-1569808816
RUNJOBID= node104-1569783168-25106
PBS_JOBID= 21705839
Free space on /tmp= 62028 MiB

SOLVER NAME= cosoco 2.0
BENCH NAME= XCSP17/SuperSolutions/SuperSolutions-Taillard-os10/SuperTaillard-os-10-26.xml
COMMAND LINE= cosoco -lc -model -restarts -stick BENCHNAME
RUNSOLVER COMMAND LINE= BIN/runsolver --timestamp -w /tmp/evaluation-result-4407989-1569808816/watcher-4407989-1569808816 -o /tmp/evaluation-result-4407989-1569808816/solver-4407989-1569808816 -C 2520 -W 2520 -M 15500 --bin-var /tmp/runsolver-exch-node104-1569783168-25106 --watchdog 2580  cosoco -lc -model -restarts -stick HOME/instance-4407989-1569808816.xml

TIME LIMIT= 2520 seconds
MEMORY LIMIT= 15500 MiB
NBCORE= 4

MD5SUM BENCH= 163dd1c4311ae2a810c887bcbec28782
RANDOM SEED=1292163238

node104.alineos.net Linux 3.10.0-514.16.1.el7.x86_64 #1 SMP Wed Apr 12 15:04:24 UTC 2017

/sys/devices/system/cpu/cpu0/cpufreq/scaling_governor:
performance

/proc/cpuinfo:
processor	: 0
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 0
initial apicid	: 0
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 1
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 0
cpu cores	: 4
apicid		: 16
initial apicid	: 16
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 2
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 2
initial apicid	: 2
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 3
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 1
cpu cores	: 4
apicid		: 18
initial apicid	: 18
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 4
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 4
initial apicid	: 4
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 5
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 2
cpu cores	: 4
apicid		: 20
initial apicid	: 20
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 6
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 0
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 6
initial apicid	: 6
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5334.09
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

processor	: 7
vendor_id	: GenuineIntel
cpu family	: 6
model		: 26
model name	: Intel(R) Xeon(R) CPU           X5550  @ 2.67GHz
stepping	: 5
microcode	: 0x19
cpu MHz		: 2668.000
cache size	: 8192 KB
physical id	: 1
siblings	: 4
core id		: 3
cpu cores	: 4
apicid		: 22
initial apicid	: 22
fpu		: yes
fpu_exception	: yes
cpuid level	: 11
wp		: yes
flags		: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni dtes64 monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm dca sse4_1 sse4_2 popcnt lahf_lm ida dtherm tpr_shadow vnmi flexpriority ept vpid
bogomips	: 5332.55
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:


/proc/meminfo:
MemTotal:       32770624 kB
MemFree:        31493632 kB
MemAvailable:   31723344 kB
Buffers:          198448 kB
Cached:           360736 kB
SwapCached:        22760 kB
Active:           417516 kB
Inactive:         288440 kB
Active(anon):     137452 kB
Inactive(anon):    91348 kB
Active(file):     280064 kB
Inactive(file):   197092 kB
Unevictable:      109640 kB
Mlocked:          109640 kB
SwapTotal:      67108860 kB
SwapFree:       66986684 kB
Dirty:              2872 kB
Writeback:             0 kB
AnonPages:        235044 kB
Mapped:            28000 kB
Shmem:             73632 kB
Slab:             166916 kB
SReclaimable:     136784 kB
SUnreclaim:        30132 kB
KernelStack:        3536 kB
PageTables:         5508 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    83494172 kB
Committed_AS:     680292 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      350232 kB
VmallocChunk:   34341910524 kB
HardwareCorrupted:     0 kB
AnonHugePages:     69632 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:      124288 kB
DirectMap2M:    33421312 kB

Free space on /tmp at the end= 62024 MiB
End job on node104 at 2019-09-30 03:31:50