Token flow control

Amit Kumar, Li Shiuan Peh, Niraj Kumar Jha

Research output: Chapter in Book/Report/Conference proceedingConference contribution

90 Scopus citations

Abstract

As companies move towards many-core chips, an efficient on-chip communication fabric to connect these cores assumes critical importance. To address limitations to wire delay scalability and increasing bandwidth demands, state-of-the-art on-chip networks use a modular packet-switched design with routers at every hop which allow sharing of network channels over multiple packet flows. This, however, leads to packets going through a complex router pipeline at every hop, resulting in the overall communication energy/delay being dominated by the router overhead, as opposed to just wire energy/delay. In this work, we propose token flow control (TFC), a flow control mechanism in which nodes in the network send out tokens in their local neighborhood to communicate information about their available resources. These tokens are then used in both routing and flow control: to choose less congested paths in the network and to bypass the router pipeline along those paths. These bypass paths are formed dynamically, can be arbitrarily long and, are highly flexible with the ability to match to a packet's exact route. Hence, this allows packets to potentially skip all routers along their path from source to destination, approaching the communication energy-delay-throughput of dedicated wires. Our detailed implementation analysis shows TFC to be highly scalable and realizable at an aggressive target clock cycle delay of 21FO4 for large networks while requiring low hardware complexity. Evaluations of TFC using both synthetic traffic and traces from the SPLASH-2 benchmark suite show reduction in packet latency by up to 77.1% with upto 39.6% reduction in average router energy consumption as compared to a state-of-the-art baseline packet-switched design. For the same saturation throughput as the baseline network, TFC is able to reduce the amount of buffering by 65% leading to a 48.8% reduction in leakage energy and a 55.4% lower total router energy.

Original languageEnglish (US)
Title of host publication2008 Proceedings of the 41st Annual IEEE/ACM International Symposium on Microarchitecture, MICRO-41
Pages342-353
Number of pages12
Edition2008 PROCEEDINGS
DOIs
StatePublished - Dec 1 2008
Event2008 - 41st Annual IEEE/ACM International Symposium on Microarchitecture, MICRO-41 - Lake Como, Italy
Duration: Nov 8 2008Nov 12 2008

Publication series

NameProceedings of the Annual International Symposium on Microarchitecture, MICRO
Number2008 PROCEEDINGS
ISSN (Print)1072-4451

Other

Other2008 - 41st Annual IEEE/ACM International Symposium on Microarchitecture, MICRO-41
CountryItaly
CityLake Como
Period11/8/0811/12/08

All Science Journal Classification (ASJC) codes

  • Hardware and Architecture

Fingerprint Dive into the research topics of 'Token flow control'. Together they form a unique fingerprint.

  • Cite this

    Kumar, A., Peh, L. S., & Jha, N. K. (2008). Token flow control. In 2008 Proceedings of the 41st Annual IEEE/ACM International Symposium on Microarchitecture, MICRO-41 (2008 PROCEEDINGS ed., pp. 342-353). [4771803] (Proceedings of the Annual International Symposium on Microarchitecture, MICRO; No. 2008 PROCEEDINGS). https://doi.org/10.1109/MICRO.2008.4771803