Structured Event Memory: A neuro-symbolic model of event cognition

Nicholas T. Franklin, Kenneth A. Norman, Charan Ranganath, Jeffrey M. Zacks, Samuel J. Gershman

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Humans spontaneously organize a continuous experience into discrete events and use the learned structure of these events to generalize and organize memory. We introduce the Structured Event Memory (SEM) model of event cognition, which accounts for human abilities in event segmentation, memory, and generalization. SEM is derived from a probabilistic generative model of event dynamics defined over structured symbolic scenes. By embedding symbolic scene representations in a vector space and parametrizing the scene dynamics in this continuous space, SEM combines the advantages of structured and neural network approaches to high-level cognition. Using probabilistic reasoning over this generative model, SEM can infer event boundaries, learn event schemata, and use event knowledge to reconstruct past experience. We show that SEM can scale up to high-dimensional input spaces, producing human-like event segmentation for naturalistic video data, and accounts for a wide array of memory phenomena. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Original languageEnglish (US)
Pages (from-to)327-361
Number of pages35
JournalPsychological Review
Volume127
Issue number3
DOIs
StatePublished - Apr 1 2020

All Science Journal Classification (ASJC) codes

  • Psychology(all)

Fingerprint Dive into the research topics of 'Structured Event Memory: A neuro-symbolic model of event cognition'. Together they form a unique fingerprint.

Cite this