Fidelity and scaling of the PARSEC benchmark inputs

Christian Bienia, Kai Li

Research output: Chapter in Book/Report/Conference proceedingConference contribution

34 Scopus citations

Abstract

A good benchmark suite should provide users with inputs that have multiple levels of fidelity for different use cases such as running on real machines, register level simulations, or gate-level simulations. Although input reduction has been explored in the past, there is a lack of understanding how to systematically scale input sets for a benchmark suite. This paper presents a framework that takes the novel view that benchmark inputs should be considered approximations of their original, full-sized inputs. It formulates the input selection problem for a benchmark as an optimization problem that maximizes the accuracy of the benchmark subject to a time constraint. The paper demonstrates how to use the proposed methodology to create several simulation input sets for the PARSEC benchmarks and how to quantify and measure their approximation error. The paper also shows which parts of the inputs are more likely to distort their original characteristics. Finally, the paper provides guidelines for users to create their own customized input sets.

Original languageEnglish (US)
Title of host publicationIEEE International Symposium on Workload Characterization, IISWC'10
DOIs
StatePublished - Dec 1 2010
Event2010 IEEE International Symposium on Workload Characterization, IISWC'10 - Atlanta, GA, United States
Duration: Dec 2 2010Dec 4 2010

Publication series

NameIEEE International Symposium on Workload Characterization, IISWC'10

Other

Other2010 IEEE International Symposium on Workload Characterization, IISWC'10
CountryUnited States
CityAtlanta, GA
Period12/2/1012/4/10

All Science Journal Classification (ASJC) codes

  • Computer Science Applications
  • Electrical and Electronic Engineering

Cite this