Skip to main navigation Skip to search Skip to main content

Interactive Digital Twins: Integrating XR and Motion Capture for Timber Assembly

  • Alexandra Moisi
  • , Joseph Clair Kenny
  • , Oliver Bucklin
  • , Petrus Aejmelaeus-Lindström
  • , Ananya Kango
  • , Gonzalo Casas
  • , Daniela Mitterberger
  • , Fabio Gramazio
  • , Matthias Kohler

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

As digital technologies become increasingly embedded in design and construction processes, creating responsive, data-rich environments has great potential to advance architectural, engineering, and fabrication workflows. This paper presents a novel methodology that integrates motion capture-based object tracking with extended reality interfaces to create responsive digital twins in timber assembly workflows. We developed a software infrastructure for streaming, receiving, visualizing, and storing real-time spatial data, along with specialized hardware that enables the rapid attachment and removal of markers on timber construction elements. By establishing a direct feedback loop between the physical construction site and its virtual counterpart, our system allows real-time adjustments to element positioning, orientation, and sequencing. Applied to a complex timber project, our integrated approach reduced assembly time and errors while also paving the way for more adjustable and flexible workflows. The article details the system's implementation, case study insights, and strategies for scaling adaptive, data-driven architecture, engineering, and construction workflows.

Original languageEnglish (US)
Title of host publicationProceedings
Subtitle of host publicationSCF 2025 - 10th ACM Symposium on Computational Fabrication
EditorsMariana Popescu, Ben Jones, Josephine Carstensen, Etienne Vouga, Mina Konakovic Lukovic, Stephen N. Spencer
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9798400720345
DOIs
StatePublished - Nov 19 2025
Event10th ACM Symposium on Computational Fabrication, SCF 2025 - Cambridge, United States
Duration: Nov 20 2025Nov 21 2025

Publication series

NameProceedings: SCF 2025 - 10th ACM Symposium on Computational Fabrication

Conference

Conference10th ACM Symposium on Computational Fabrication, SCF 2025
Country/TerritoryUnited States
CityCambridge
Period11/20/2511/21/25

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Mechanical Engineering
  • General Materials Science
  • Applied Mathematics

Keywords

  • Digital Fabrication
  • Digital Twins
  • Extended Reality
  • Real-Time Feedback
  • Timber Assembly

Fingerprint

Dive into the research topics of 'Interactive Digital Twins: Integrating XR and Motion Capture for Timber Assembly'. Together they form a unique fingerprint.

Cite this