Scaling IP multicast on datacenter topologies

Xiaozhou Li, Michael J. Freedman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

66 Scopus citations

Abstract

IP multicast would reduce significantly both network and server overhead for many datacenter applications' communication. Unfortunately, traditional protocols for managing IP multicast, designed for arbitrary network topologies, do not scale with aggregate hardware resources in the number of supported multicast groups. Prior attempts to scale multicast in general settings are all bottlenecked by the forwarding table capacity of a single switch. This paper shows how to leverage the unique topological structure of modern datacenter networks in order to build the first scale-out multicast architecture. In our architecture, a network controller carefully partitions the multicast address space and assigns the partitions across switches in datacenters' multi-rooted tree networks. Our approach further improves scalability by locally aggregating multicast addresses at bottleneck switches that are running out of forwarding table space, at the cost of slightly inflating downstream traffic. We evaluate the system's scalability, traffic overhead, and fault tolerance through a mix of simulation and analysis. For example, experiments show that a datacenter with 27,648 servers and commodity switches with 1000-entry multicast tables can support up to 100,000 multicast groups, allowing each server to subscribe to nearly 200 multicast groups concurrently.

Original languageEnglish (US)
Title of host publicationCoNEXT 2013 - Proceedings of the 2013 ACM International Conference on Emerging Networking Experiments and Technologies
PublisherAssociation for Computing Machinery
Pages61-72
Number of pages12
ISBN (Print)9781450321013
DOIs
StatePublished - 2013
Event2013 9th ACM International Conference on Emerging Networking Experiments and Technologies, CoNEXT 2013 - Santa Barbara, CA, United States
Duration: Dec 9 2013Dec 12 2013

Publication series

NameCoNEXT 2013 - Proceedings of the 2013 ACM International Conference on Emerging Networking Experiments and Technologies

Other

Other2013 9th ACM International Conference on Emerging Networking Experiments and Technologies, CoNEXT 2013
Country/TerritoryUnited States
CitySanta Barbara, CA
Period12/9/1312/12/13

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications

Keywords

  • Datacenter networks
  • IP multicast
  • Scalability

Fingerprint

Dive into the research topics of 'Scaling IP multicast on datacenter topologies'. Together they form a unique fingerprint.

Cite this