RIPQ: Advanced photo caching on flash for Facebook

Linpeng Tang, Qi Huang, Wyatt Lloyd, Sanjeev Kumar, Kai Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Facebook uses flash devices extensively in its photo-caching stack. The key design challenge for an efficient photo cache on flash at Facebook is its workload: many small random writes are generated by inserting cache-missed content, or updating cache-hit content for advanced caching algorithms. The Flash Translation Layer on flash devices performs poorly with such a workload, lowering throughput and decreasing device lifespan. Existing coping strategies under-utilize the space on flash devices, sacrificing cache capacity, or are limited to simple caching algorithms like FIFO, sacrificing hit ratios. We overcome these limitations with the novel Restricted Insertion Priority Queue (RIPQ) framework that supports advanced caching algorithms with large cache sizes, high throughput, and long device lifespan. RIPQ aggregates small random writes, co-locates similarly prioritized content, and lazily moves updated content to further reduce device overhead. We show that two families of advanced caching algorithms, Segmented-LRU and Greedy-Dual-Size-Frequency, can be easily implemented with RIPQ. Our evaluation on Facebook’s photo trace shows that these algorithms running on RIPQ increase hit ratios up to ~20% over the current FIFO system, incur low overhead, and achieve high throughput.

Original languageEnglish (US)
Title of host publicationProceedings of the 13th USENIX Conference on File and Storage Technologies, FAST 2015
PublisherUSENIX Association
Pages373-386
Number of pages14
ISBN (Electronic)9781931971201
StatePublished - Jan 1 2015
Event13th USENIX Conference on File and Storage Technologies, FAST 2015 - Santa Clara, United States
Duration: Feb 16 2015Feb 19 2015

Publication series

NameProceedings of the 13th USENIX Conference on File and Storage Technologies, FAST 2015

Conference

Conference13th USENIX Conference on File and Storage Technologies, FAST 2015
CountryUnited States
CitySanta Clara
Period2/16/152/19/15

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture
  • Computer Networks and Communications
  • Software

Fingerprint Dive into the research topics of 'RIPQ: Advanced photo caching on flash for Facebook'. Together they form a unique fingerprint.

  • Cite this

    Tang, L., Huang, Q., Lloyd, W., Kumar, S., & Li, K. (2015). RIPQ: Advanced photo caching on flash for Facebook. In Proceedings of the 13th USENIX Conference on File and Storage Technologies, FAST 2015 (pp. 373-386). (Proceedings of the 13th USENIX Conference on File and Storage Technologies, FAST 2015). USENIX Association.