Memento Player: Shared Multi-Perspective Playback of Volumetrically-Captured Moments in Augmented Reality

Yimeng Liu, Jacob Ritchie, Sven Kratz, Misha Sra, Brian A. Smith, Andrés Monroy-Hernández, Rajan Vaish

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Scopus citations

Abstract

Capturing and reliving memories allow us to record, understand and share our past experiences. Currently, the most common approach to revisiting past moments is viewing photos and videos. These 2D media capture past events that reflect a recorder's first-person perspective. The development of technology for accurately capturing 3D content presents an opportunity for new types of memory reliving, allowing greater immersion without perspective limitations. In this work, we adopt 2D and 3D moment-recording techniques and build a moment-reliving experience in AR that combines both display methods. Specifically, we use AR glasses to record 2D point-of-view (POV) videos, and volumetric capture to reconstruct 3D moments in AR. We allow seamless switching between AR and POV videos to enable immersive moment reliving and viewing of high-resolution details. Users can also navigate to a specific point in time using playback controls. Control is synchronized between multiple users for shared viewing.

Original languageEnglish (US)
Title of host publicationCHI 2023 - Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450394222
DOIs
StatePublished - Apr 19 2023
Event2023 CHI Conference on Human Factors in Computing Systems, CHI 2023 - Hamburg, Germany
Duration: Apr 23 2023Apr 28 2023

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

Conference2023 CHI Conference on Human Factors in Computing Systems, CHI 2023
Country/TerritoryGermany
CityHamburg
Period4/23/234/28/23

All Science Journal Classification (ASJC) codes

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design
  • Software

Keywords

  • augmented reality
  • moment reliving
  • multi-perspective
  • shared and social experience
  • volumetric capture

Fingerprint

Dive into the research topics of 'Memento Player: Shared Multi-Perspective Playback of Volumetrically-Captured Moments in Augmented Reality'. Together they form a unique fingerprint.

Cite this