Fully-integrated photonic tensor core for image convolutions

Bicky A. Marquez, Jagmeet Singh, Hugh Morison, Zhimu Guo, Lukas Chrostowski, Sudip Shekhar, Paul Prucnal, Bhavin J. Shastri

Research output: Contribution to journalArticlepeer-review

2 Scopus citations

Abstract

Convolutions are one of the most critical signal and image processing operations. From spectral analysis to computer vision, convolutional filtering is often related to spatial information processing involving neighbourhood operations. As convolution operations are based around the product of two functions, vectors or matrices, dot products play a key role in the performance of such operations; for example, advanced image processing techniques require fast, dense matrix multiplications that typically take more than 90% of the computational capacity dedicated to solving convolutional neural networks. Silicon photonics has been demonstrated to be an ideal candidate to accelerate information processing involving parallel matrix multiplications. In this work, we experimentally demonstrate a multiwavelength approach with fully integrated modulators, tunable filters as microring resonator weight banks, and a balanced detector to perform matrix multiplications for image convolution operations. We develop a scattering matrix model that matches the experiment to simulate large-scale versions of these photonic systems with which we predict performance and physical constraints, including inter-channel cross-talk and bit resolution.

Original languageEnglish (US)
Article number395201
JournalNanotechnology
Volume34
Issue number39
DOIs
StatePublished - Sep 24 2023

All Science Journal Classification (ASJC) codes

  • General Chemistry
  • Mechanics of Materials
  • Mechanical Engineering
  • Bioengineering
  • Electrical and Electronic Engineering
  • General Materials Science

Keywords

  • Silicon-photonics
  • fully-integrated-operations
  • image-processing
  • multiwavelength
  • parallel-vector-multiplications
  • photonic-convolutions
  • photonic-tensor-core

Fingerprint

Dive into the research topics of 'Fully-integrated photonic tensor core for image convolutions'. Together they form a unique fingerprint.

Cite this