Snicket: Query-Driven Distributed Tracing

Jessica Berg, Fabian Ruffy, Khanh Nguyen, Nicholas Yang, Taegyun Kim, Anirudh Sivaraman, Ravi Netravali, Srinivas Narayana

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Increasing application complexity has caused applications to be refactored into smaller components known as microservices that communicate with each other using RPCs. Distributed tracing has emerged as an important debugging tool for such microservice-based applications. Distributed tracing follows the journey of a user request from its starting point at the application's front-end, through RPC calls made by the front-end to different microservices recursively, all the way until a response is constructed and sent back to the user. To reduce storage costs, distributed tracing systems sample traces before collecting them for subsequent querying, affecting the accuracy of queries on the collected traces. We propose an alternative system, Snicket, that tightly integrates querying and collection of traces. Snicket takes as input a database-style streaming query that expresses the analysis the developer wants to perform on the trace data. This query is compiled into a distributed collection of microservice extensions that run as "bumps-in-the-wire,"intercepting RPC requests and responses as they flow into and out of microservices. This collection of extensions implements the query, performing early filtering and computation on the traces to reduce the amount of stored data in a query-specific manner. We show that Snicket is expressive in the queries it can support and can update queries fast enough for interactive use.

Original languageEnglish (US)
Title of host publicationHotNets 2021 - Proceedings of the 20th ACM Workshop on Hot Topics in Networks
PublisherAssociation for Computing Machinery, Inc
Pages206-212
Number of pages7
ISBN (Electronic)9781450390873
DOIs
StatePublished - Nov 10 2021
Event20th ACM Workshop on Hot Topics in Networks, HotNets 2021 - Virtual, Online, United Kingdom
Duration: Nov 10 2021Nov 12 2021

Publication series

NameHotNets 2021 - Proceedings of the 20th ACM Workshop on Hot Topics in Networks

Conference

Conference20th ACM Workshop on Hot Topics in Networks, HotNets 2021
Country/TerritoryUnited Kingdom
CityVirtual, Online
Period11/10/2111/12/21

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Snicket: Query-Driven Distributed Tracing'. Together they form a unique fingerprint.

Cite this