How to bid the cloud

Liang Zheng, Carlee Joe-Wong, Chee Wei Tan, Mung Chiang, Xinyu Wang

Research output: Chapter in Book/Report/Conference proceedingConference contribution

95 Scopus citations

Abstract

Amazon's Elastic Compute Cloud (EC2) uses auction-based spot pricing to sell spare capacity, allowing users to bid for cloud resources at a highly reduced rate. Amazon sets the spot price dynamically and accepts user bids above this price. Jobs with lower bids (including those already running) are interrupted and must wait for a lower spot price before resuming. Spot pricing thus raises two basic questions: how might the provider set the price, and what prices should users bid? Computing users' bidding strategies is particularly challenging: higher bid prices reduce the probability of, and thus extra time to recover from, interruptions, but may increase users' cost. We address these questions in three steps: (1) modeling the cloud provider's setting of the spot price and matching the model to historically offered prices, (2) deriving optimal bidding strategies for different job requirements and interruption overheads, and (3) adapting these strategies to MapReduce jobs with master and slave nodes having different interruption overheads. We run our strategies on EC2 for a variety of job sizes and instance types, showing that spot pricing reduces user cost by 90% with a modest increase in completion time compared to on-demand pricing.

Original languageEnglish (US)
Title of host publicationSIGCOMM 2015 - Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication
PublisherAssociation for Computing Machinery, Inc
Pages71-84
Number of pages14
ISBN (Electronic)9781450335423
DOIs
StatePublished - Aug 17 2015
EventACM Conference on Special Interest Group on Data Communication, SIGCOMM 2015 - London, United Kingdom
Duration: Aug 17 2015Aug 21 2015

Publication series

NameSIGCOMM 2015 - Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication

Other

OtherACM Conference on Special Interest Group on Data Communication, SIGCOMM 2015
CountryUnited Kingdom
CityLondon
Period8/17/158/21/15

All Science Journal Classification (ASJC) codes

  • Computer Networks and Communications
  • Signal Processing
  • Electrical and Electronic Engineering
  • Communication

Keywords

  • Cloud pricing
  • Optimization
  • Spot instance

Fingerprint Dive into the research topics of 'How to bid the cloud'. Together they form a unique fingerprint.

  • Cite this

    Zheng, L., Joe-Wong, C., Tan, C. W., Chiang, M., & Wang, X. (2015). How to bid the cloud. In SIGCOMM 2015 - Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication (pp. 71-84). (SIGCOMM 2015 - Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication). Association for Computing Machinery, Inc. https://doi.org/10.1145/2785956.2787473