Speculative decoupled software pipelining

Neil Vachharajani, Ram Rangan, Easwaran Raman, Matthew J. Bridges, Guilherme Ottoni, David I. August

Research output: Chapter in Book/Report/Conference proceedingConference contribution

90 Scopus citations

Abstract

In recent years, microprocessor manufacturers have shifted their focus from single-core to multi-core processors. To avoid burdening programmers with the responsibility of parallelizing their applications, some researchers have advocated automatic thread extraction. A recently proposed technique, Decoupled Software Pipelining (DSWP), has demonstrated promise by partitioning loops into long-running, fine-grained threads organized into a pipeline. Using a pipeline organization and execution decoupled by inter-core communication queues, DSWP offers increased execution efficiency that is largely independent of inter-core communication latency. This paper proposes adding speculation to DSWP and evaluates an automatic approach for its implementation. By speculating past infrequent dependences, the benefit of DSWP is increased by making it applicable to more loops, facilitating better balanced threads, and enabling parallelized loops to be run on more cores. Unlike prior speculative threading proposals, speculative DSWP focuses on breaking dependence recurrences. By speculatively breaking these recurrences, instructions that were formerly restricted to a single thread to ensure decoupling are now free to span multiple threads. Using an initial automatic compiler implementation and a validated processor model, this paper demonstrates significant gains using speculation for 4-core chip multiprocessor models running a variety of codes.

Original languageEnglish (US)
Title of host publication16th International Conference on Parallel Architecture and Compilation Techniques, PACT 2007
Pages49-59
Number of pages11
DOIs
StatePublished - Dec 1 2007
Event16th International Conference on Parallel Architecture and Compilation Techniques, PACT 2007 - Brasov, Romania
Duration: Sep 15 2007Sep 19 2007

Other

Other16th International Conference on Parallel Architecture and Compilation Techniques, PACT 2007
CountryRomania
CityBrasov
Period9/15/079/19/07

All Science Journal Classification (ASJC) codes

  • Software
  • Theoretical Computer Science
  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Speculative decoupled software pipelining'. Together they form a unique fingerprint.

  • Cite this

    Vachharajani, N., Rangan, R., Raman, E., Bridges, M. J., Ottoni, G., & August, D. I. (2007). Speculative decoupled software pipelining. In 16th International Conference on Parallel Architecture and Compilation Techniques, PACT 2007 (pp. 49-59). [4336199] https://doi.org/10.1109/PACT.2007.34