Sonata: Query-driven streaming network telemetry

Arpit Gupta, Nicholas G. Feamster, Rob Harrison, Jennifer L. Rexford, Marco Canini, Walter Willinger

Research output: Chapter in Book/Report/Conference proceedingConference contribution

33 Scopus citations

Abstract

Managing and securing networks requires collecting and analyzing network traffic data in real time. Existing telemetry systems do not allow operators to express the range of queries needed to perform management or scale to large traffic volumes and rates. We present Sonata, an expressive and scalable telemetry system that coordinates joint collection and analysis of network traffic. Sonata provides a declarative interface to express queries for a wide range of common telemetry tasks; to enable real-time execution, Sonata partitions each query across the stream processor and the data plane, running as much of the query as it can on the network switch, at line rate. To optimize the use of limited switch memory, Sonata dynamically refines each query to ensure that available resources focus only on traffic that satisfies the query. Our evaluation shows that Sonata can support a wide range of telemetry tasks while reducing the workload for the stream processor by as much as seven orders of magnitude compared to existing telemetry systems.

Original languageEnglish (US)
Title of host publicationSIGCOMM 2018 - Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication
PublisherAssociation for Computing Machinery, Inc
Pages357-371
Number of pages15
ISBN (Electronic)9781450355674
DOIs
StatePublished - Aug 7 2018
Event2018 Conference of the ACM Special Interest Group on Data Communication, ACM SIGCOMM 2018 - Budapest, Hungary
Duration: Aug 20 2018Aug 25 2018

Publication series

NameSIGCOMM 2018 - Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication

Other

Other2018 Conference of the ACM Special Interest Group on Data Communication, ACM SIGCOMM 2018
CountryHungary
CityBudapest
Period8/20/188/25/18

All Science Journal Classification (ASJC) codes

  • Communication
  • Electrical and Electronic Engineering
  • Computer Networks and Communications
  • Signal Processing

Keywords

  • Analytics
  • Programmable switches
  • Stream processing

Fingerprint Dive into the research topics of 'Sonata: Query-driven streaming network telemetry'. Together they form a unique fingerprint.

  • Cite this

    Gupta, A., Feamster, N. G., Harrison, R., Rexford, J. L., Canini, M., & Willinger, W. (2018). Sonata: Query-driven streaming network telemetry. In SIGCOMM 2018 - Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (pp. 357-371). (SIGCOMM 2018 - Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication). Association for Computing Machinery, Inc. https://doi.org/10.1145/3230543.3230555