Skip to main navigation Skip to search Skip to main content

RoboticTerritories: Supporting Varying Levels of Automation Through AR for Large-Scale Human-Robot Assembly

  • Joseph Clair Kenny
  • , Samuelle Bourgault
  • , Daniela Mitterberger

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Large-scale assembly through human-robot collaboration (HRC) is increasingly explored in architecture, engineering, and construction. However, prior research in HRC has primarily examined interaction scenarios for tabletop assembly. As a result, we lack task-level insight into how different levels of automation and user interaction shape workflows and user experience in large-scale assembly. To address this gap, we present RoboticTerritories, a phone-based Augmented Reality system for human-robot block assembly that supports three interaction modes: Inference, Mimic, and Realtime Mimic. Each mode offers distinct automated functionalities and user-defined control across stages of a pick-and-place assembly process. We evaluate RoboticTerritories through a formative study (n = 8) and a within-subject study (n = 12) to identify the opportunities and limitations of each interaction mode. Our results show that varying levels of automation provide complementary benefits by supporting different forms of efficiency across modes, indicating a need for multimodal HRC workflows for large-scale assembly.

Original languageEnglish (US)
Title of host publicationDIS 2026 - Proceedngs of the 2026 ACM Designing Interactive Systems Conference
EditorsChing Chiuan Yen, Jung-Joo Lee, Ellen Yi-Luen Do, Clement Zheng, Daisy Yoo, Tony Tang
PublisherAssociation for Computing Machinery, Inc
Pages2804-2828
Number of pages25
ISBN (Electronic)9798400725630
DOIs
StatePublished - Jun 12 2026
EventACM conference on Designing Interactive Systems, DIS 2026 - Singapore, Singapore
Duration: Jun 13 2026 → Jun 17 2026

Publication series

NameDIS 2026 - Proceedngs of the 2026 ACM Designing Interactive Systems Conference

Conference

ConferenceACM conference on Designing Interactive Systems, DIS 2026
Country/TerritorySingapore
CitySingapore
Period6/13/26 → 6/17/26

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Keywords

  • Augmented Reality
  • Embodied Interaction
  • Human-Robot Collaboration
  • Large-Scale Assembly
  • Robot Programming

Fingerprint

Dive into the research topics of 'RoboticTerritories: Supporting Varying Levels of Automation Through AR for Large-Scale Human-Robot Assembly'. Together they form a unique fingerprint.

Cite this