Decoding semantic representations from functional near-infrared spectroscopy signals

Benjamin D. Zinszer, Laurie Bayet, Lauren L. Emberson, Rajeev D.S. Raizada, Richard N. Aslin

Research output: Contribution to journalArticlepeer-review

1 Scopus citations

Abstract

This study uses representational similarity-based neural decoding to test whether semantic information elicited by words and pictures is encoded in functional near-infrared spectroscopy (fNIRS) data. In experiment 1, subjects passively viewed eight audiovisual word and picture stimuli for 15 min. Blood oxygen levels were measured using the Hitachi ETG-4000 fNIRS system with a posterior array over the occipital lobe and a left lateral array over the temporal lobe. Each participant's response patterns were abstracted to representational similarity space and compared to the group average (excluding that subject, i.e., leave-one-out cross-validation) and to a distributional model of semantic representation. Mean accuracy for both decoding tasks significantly exceeded chance. In experiment 2, we compared three group-level models by averaging the similarity structures from sets of eight participants in each group. In these models, the posterior array was accurately decoded by the semantic model, while the lateral array was accurately decoded in the between-groups comparison. Our findings indicate that semantic representations are encoded in the fNIRS data, preserved across subjects, and decodable by an extrinsic representational model. These results are the first attempt to link the functional response pattern measured by fNIRS to higher-level representations of how words are related to each other.

Original languageEnglish (US)
Article number011003
JournalNeurophotonics
Volume5
Issue number1
DOIs
StatePublished - Jan 1 2018

All Science Journal Classification (ASJC) codes

  • Neuroscience (miscellaneous)
  • Radiological and Ultrasound Technology
  • Radiology Nuclear Medicine and imaging

Keywords

  • functional near-infrared spectroscopy
  • multivariate pattern analysis
  • neural decoding
  • semantic model

Fingerprint Dive into the research topics of 'Decoding semantic representations from functional near-infrared spectroscopy signals'. Together they form a unique fingerprint.

Cite this