Automatic CPU-GPU communication management and optimization

Thomas B. Jablin, Prakash Prabhu, James A. Jablin, Nick P. Johnson, Stephen R. Beard, David I. August

Research output: Chapter in Book/Report/Conference proceedingConference contribution

114 Scopus citations

Abstract

The performance benefits of GPU parallelism can be enormous, but unlocking this performance potential is challenging. The applicability and performance of GPU parallelizations is limited by the complexities of CPU-GPU communication. To address these communications problems, this paper presents the first fully automatic system for managing and optimizing CPU-GPU communcation. This system, called the CPU-GPU Communication Manager (CGCM), consists of a run-time library and a set of compiler transformations that work together to manage and optimize CPU-GPU communication without depending on the strength of static compile-time analyses or on programmer-supplied annotations. CGCM eases manual GPU parallelizations and improves the applicability and performance of automatic GPU parallelizations. For 24 programs, CGCM-enabled automatic GPU parallelization yields a whole program geomean speedup of 5.36x over the best sequential CPU-only execution.

Original languageEnglish (US)
Title of host publicationPLDI'11 - Proceedings of the 2011 ACM Conference on Programming Language Design and Implementation
Pages142-151
Number of pages10
DOIs
StatePublished - Jul 7 2011
Event32nd ACM SIGPLAN Conference on Programming Language Design and Implementation, PLDI'11 - San Jose, CA, United States
Duration: Jun 4 2011Jun 8 2011

Publication series

NameProceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI)

Other

Other32nd ACM SIGPLAN Conference on Programming Language Design and Implementation, PLDI'11
CountryUnited States
CitySan Jose, CA
Period6/4/116/8/11

All Science Journal Classification (ASJC) codes

  • Software

Keywords

  • communication
  • gpu
  • management
  • optimization

Fingerprint Dive into the research topics of 'Automatic CPU-GPU communication management and optimization'. Together they form a unique fingerprint.

  • Cite this

    Jablin, T. B., Prabhu, P., Jablin, J. A., Johnson, N. P., Beard, S. R., & August, D. I. (2011). Automatic CPU-GPU communication management and optimization. In PLDI'11 - Proceedings of the 2011 ACM Conference on Programming Language Design and Implementation (pp. 142-151). (Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI)). https://doi.org/10.1145/1993498.1993516