STAR: Smartphone-analogous Typing in Augmented Reality

Taejun Kim, Amy Karlson, Aakar Gupta, Tovi Grossman, Jason Wu, Parastoo Abtahi, Christopher Collins, Michael Glueck, Hemant Bhaskar Surale

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

While text entry is an essential and frequent task in Augmented Reality (AR) applications, devising an efficient and easy-to-use text entry method for AR remains an open challenge. This research presents STAR, a smartphone-analogous AR text entry technique that leverages a user's familiarity with smartphone two-thumb typing. With STAR, a user performs thumb typing on a virtual QWERTY keyboard that is overlain on the skin of their hands. During an evaluation study of STAR, participants achieved a mean typing speed of 21.9 WPM (i.e., 56% of their smartphone typing speed), and a mean error rate of 0.3% after 30 minutes of practice. We further analyze the major factors implicated in the performance gap between STAR and smartphone typing, and discuss ways this gap could be narrowed.

Original languageEnglish (US)
Title of host publicationUIST 2023 - Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9798400701320
DOIs
StatePublished - Oct 29 2023
Externally publishedYes
Event36th Annual ACM Symposium on User Interface Software and Technology, UIST 2023 - San Francisco, United States
Duration: Oct 29 2023Nov 1 2023

Publication series

NameUIST 2023 - Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology

Conference

Conference36th Annual ACM Symposium on User Interface Software and Technology, UIST 2023
Country/TerritoryUnited States
CitySan Francisco
Period10/29/2311/1/23

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Keywords

  • Augmented Reality
  • Head-Mounted Display
  • QWERTY Keyboard
  • Smartphone Typing
  • Text Entry

Fingerprint

Dive into the research topics of 'STAR: Smartphone-analogous Typing in Augmented Reality'. Together they form a unique fingerprint.

Cite this