Zoom2Net: Constrained Network Telemetry Imputation

Fengchen Gong, Divya Raghunathan, Aarti Gupta, Maria Apostolaki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Fine-grained monitoring is crucial for multiple data-driven tasks such as debugging, provisioning, and securing networks. Yet, practical constraints in collecting, extracting, and storing data often force operators to use coarse-grained sampled monitoring, degrading the performance of the various tasks. In this work, we explore the feasibility of leveraging the correlations among coarse-grained time series to impute their fine-grained counterparts in software. We present Zoom2Net, a transformer-based model for network imputation that incorporates domain knowledge through operational and measurement constraints, ensuring that the imputed network telemetry time series are not only realistic but align with existing measurements. This approach enhances the capabilities of current monitoring infrastructures, allowing operators to gain more insights into system behaviors without the need for hardware upgrades. We evaluate Zoom2Net on four diverse datasets (e.g., cloud telemetry and Internet data transfer) and use cases (e.g., bursts analysis and traffic classification). We demonstrate that Zoom2Net consistently achieves high imputation accuracy with a zoom-in factor of up to 100 and performs better on downstream tasks compared to baselines by an average of 38%.

Original languageEnglish (US)
Title of host publicationACM SIGCOMM 2024 - Proceedings of the 2024 ACM SIGCOMM 2024 Conference
PublisherAssociation for Computing Machinery, Inc
Pages764-777
Number of pages14
ISBN (Electronic)9798400706141
DOIs
StatePublished - Aug 4 2024
Event2024 ACM SIGCOMM Conference, ACM SIGCOMM 2024 - Sydney, Australia
Duration: Aug 4 2024Aug 8 2024

Publication series

NameACM SIGCOMM 2024 - Proceedings of the 2024 ACM SIGCOMM 2024 Conference

Conference

Conference2024 ACM SIGCOMM Conference, ACM SIGCOMM 2024
Country/TerritoryAustralia
CitySydney
Period8/4/248/8/24

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Hardware and Architecture
  • Software

Keywords

  • formal methods
  • imputation
  • telemetry
  • transformer

Fingerprint

Dive into the research topics of 'Zoom2Net: Constrained Network Telemetry Imputation'. Together they form a unique fingerprint.

Cite this