[PVE-User] High rate of Multicast traffic between cluster nodes

Andrew Thrift andrew at networklabs.co.nz
Wed Apr 19 02:10:50 CEST 2017


Thanks Alexandre,

I will give this a test next week and see if it reduces the multicast.



On Wed, Apr 19, 2017 at 3:36 AM, Alexandre DERUMIER <aderumier at odiso.com> wrote:
> Hi,
>
> on my 16 nodes cluster, I need to setup
>
> totem {
>   token: 4000
>
>
> ----- Mail original -----
> De: "Andrew Thrift" <andrew at networklabs.co.nz>
> À: "proxmoxve" <pve-user at pve.proxmox.com>
> Envoyé: Lundi 10 Avril 2017 01:36:05
> Objet: [PVE-User] High rate of Multicast traffic between cluster nodes
>
> Hi,
>
> We have a PVE 4.4 cluster with 16x nodes and around 600 VM's. We
> have noticed a lot of errors in the logs relating to corosync
> re-transmits, e.g.:
>
> vmh10 corosync[29335]: [TOTEM ] Retransmit List: 514b4d 514b51 514b58
> 514b5a 514b5b 514b5d 514b5f
>
> Upon investigation we found that the number of multicast packets was
> exceeding the limit of multicast storm protection on our switch ports
> (set to 1000pps), we raised this up to 16000pps per port and were
> still seeing corosync re-transmits. Disabling all multicast storm
> protection eliminates the problem completely.
>
> Why is the rate of multicast so high from Corosync ? e.g. is it by design ?
> Is there anyway to reduce this ?
>
>
> Thanks,
>
>
>
> Andrew
> _______________________________________________
> pve-user mailing list
> pve-user at pve.proxmox.com
> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user
>
> _______________________________________________
> pve-user mailing list
> pve-user at pve.proxmox.com
> http://pve.proxmox.com/cgi-bin/mailman/listinfo/pve-user



More information about the pve-user mailing list