TY - GEN
T1 - Zoom2Net
T2 - 2024 ACM SIGCOMM Conference, ACM SIGCOMM 2024
AU - Gong, Fengchen
AU - Raghunathan, Divya
AU - Gupta, Aarti
AU - Apostolaki, Maria
N1 - Publisher Copyright:
© 2024 Copyright is held by the owner/author(s). Publication rights licensed to ACM.
PY - 2024/8/4
Y1 - 2024/8/4
N2 - Fine-grained monitoring is crucial for multiple data-driven tasks such as debugging, provisioning, and securing networks. Yet, practical constraints in collecting, extracting, and storing data often force operators to use coarse-grained sampled monitoring, degrading the performance of the various tasks. In this work, we explore the feasibility of leveraging the correlations among coarse-grained time series to impute their fine-grained counterparts in software. We present Zoom2Net, a transformer-based model for network imputation that incorporates domain knowledge through operational and measurement constraints, ensuring that the imputed network telemetry time series are not only realistic but align with existing measurements. This approach enhances the capabilities of current monitoring infrastructures, allowing operators to gain more insights into system behaviors without the need for hardware upgrades. We evaluate Zoom2Net on four diverse datasets (e.g., cloud telemetry and Internet data transfer) and use cases (e.g., bursts analysis and traffic classification). We demonstrate that Zoom2Net consistently achieves high imputation accuracy with a zoom-in factor of up to 100 and performs better on downstream tasks compared to baselines by an average of 38%.
AB - Fine-grained monitoring is crucial for multiple data-driven tasks such as debugging, provisioning, and securing networks. Yet, practical constraints in collecting, extracting, and storing data often force operators to use coarse-grained sampled monitoring, degrading the performance of the various tasks. In this work, we explore the feasibility of leveraging the correlations among coarse-grained time series to impute their fine-grained counterparts in software. We present Zoom2Net, a transformer-based model for network imputation that incorporates domain knowledge through operational and measurement constraints, ensuring that the imputed network telemetry time series are not only realistic but align with existing measurements. This approach enhances the capabilities of current monitoring infrastructures, allowing operators to gain more insights into system behaviors without the need for hardware upgrades. We evaluate Zoom2Net on four diverse datasets (e.g., cloud telemetry and Internet data transfer) and use cases (e.g., bursts analysis and traffic classification). We demonstrate that Zoom2Net consistently achieves high imputation accuracy with a zoom-in factor of up to 100 and performs better on downstream tasks compared to baselines by an average of 38%.
KW - formal methods
KW - imputation
KW - telemetry
KW - transformer
UR - http://www.scopus.com/inward/record.url?scp=85202299353&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85202299353&partnerID=8YFLogxK
U2 - 10.1145/3651890.3672225
DO - 10.1145/3651890.3672225
M3 - Conference contribution
AN - SCOPUS:85202299353
T3 - ACM SIGCOMM 2024 - Proceedings of the 2024 ACM SIGCOMM 2024 Conference
SP - 764
EP - 777
BT - ACM SIGCOMM 2024 - Proceedings of the 2024 ACM SIGCOMM 2024 Conference
PB - Association for Computing Machinery, Inc
Y2 - 4 August 2024 through 8 August 2024
ER -