Adaptive fog-based output security for augmented reality

Surin Ahn, Maria Gorlatova, Parinaz Naghizadeh, Mung Chiang, Prateek Mittal

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Scopus citations

Abstract

Augmented reality (AR) technologies are rapidly being adopted across multiple sectors, but little work has been done to ensure the security of such systems against potentially harmful or distracting visual output produced by malicious or bug-ridden applications. Past research has proposed to incorporate manually specified policies into AR devices to constrain their visual output. However, these policies can be cumbersome to specify and implement, and may not generalize well to complex and unpredictable environmental conditions. We propose a method for generating adaptive policies to secure visual output in AR systems using deep reinforcement learning. This approach utilizes a local fog computing node, which runs training simulations to automatically learn an appropriate policy for filtering potentially malicious or distracting content produced by an application. Through empirical evaluations, we show that these policies are able to intelligently displace AR content to reduce obstruction of real-world objects, while maintaining a favorable user experience.

Original languageEnglish (US)
Title of host publicationVR/AR Network 2018 - Proceedings of the 2018 Morning Workshop on Virtual Reality and Augmented Reality Network, Part of SIGCOMM 2018
PublisherAssociation for Computing Machinery, Inc
Pages1-6
Number of pages6
ISBN (Electronic)9781450359139
DOIs
StatePublished - Aug 7 2018
Event2nd ACM SIGCOMM Workshop on Virtual Reality and Augmented Reality Network, VR/AR Network 2018 - Budapest, Hungary
Duration: Aug 24 2018 → …

Publication series

NameVR/AR Network 2018 - Proceedings of the 2018 Morning Workshop on Virtual Reality and Augmented Reality Network, Part of SIGCOMM 2018

Other

Other2nd ACM SIGCOMM Workshop on Virtual Reality and Augmented Reality Network, VR/AR Network 2018
CountryHungary
CityBudapest
Period8/24/18 → …

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Keywords

  • Augmented reality
  • Edge computing
  • Fog computing
  • Policy optimization
  • Reinforcement learning
  • Visual output security

Fingerprint Dive into the research topics of 'Adaptive fog-based output security for augmented reality'. Together they form a unique fingerprint.

  • Cite this

    Ahn, S., Gorlatova, M., Naghizadeh, P., Chiang, M., & Mittal, P. (2018). Adaptive fog-based output security for augmented reality. In VR/AR Network 2018 - Proceedings of the 2018 Morning Workshop on Virtual Reality and Augmented Reality Network, Part of SIGCOMM 2018 (pp. 1-6). (VR/AR Network 2018 - Proceedings of the 2018 Morning Workshop on Virtual Reality and Augmented Reality Network, Part of SIGCOMM 2018). Association for Computing Machinery, Inc. https://doi.org/10.1145/3229625.3229626