Synthesis-based low-cost gaze analysis

Zhuoqing Chang, Qiang Qiu, Guillermo Sapiro

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

Gaze analysis has gained much popularity over the years due to its relevance in a wide array of applications, including humancomputer interaction, fatigue detection, and clinical mental health diagnosis. However, accurate gaze estimation from low resolution images outside of the lab (in the wild) still proves to be a challenging task. The new Intel low-cost RealSense 3D camera, capable of acquiring submillimeter resolution depth information, is currently available in laptops, and such technology is expected to become ubiquitous in other portable devices. In this paper, we focus on low-cost, scalable and real time analysis of human gaze using this RealSense camera. We exploit the direct measurement of eye surface geometry captured by the RGB-D camera, and perform gaze estimation through novel synthesis-based training and testing. Furthermore, we synthesize different eye movement appearances using a linear approach. From each 3D eye training sample captured by the RealSense camera, we synthesize multiple novel 2D views by varying the view angle to simulate head motions expected at testing. We then learn from the synthesized 2D eye images a gaze regression model using regression forests. At testing, for each captured RGB-D eye image, we first repeat the same synthesis process. For each synthesized image, we estimate the gaze from our gaze regression model, and factor-out the associated camera/head motion. In this way, we obtain multiple gaze estimations for each RGB-D eye image, and the consensus is adopted. We show that this synthesis-based training and testing significantly improves the precision in gaze estimation, opening the door to true low-cost solutions.

Original languageEnglish (US)
Title of host publicationHCI International 2016 – Posters’ Extended Abstracts - 18th International Conference, HCI International 2016, Proceedings
EditorsConstantine Stephanidis
PublisherSpringer Verlag
Pages95-100
Number of pages6
ISBN (Print)9783319405414
DOIs
StatePublished - 2016
Externally publishedYes
Event18th International Conference on Posters’ Extended Abstracts, HCI International 2016 - Toronto, Canada
Duration: Jul 17 2016Jul 22 2016

Publication series

NameCommunications in Computer and Information Science
Volume618
ISSN (Print)1865-0929

Conference

Conference18th International Conference on Posters’ Extended Abstracts, HCI International 2016
Country/TerritoryCanada
CityToronto
Period7/17/167/22/16

All Science Journal Classification (ASJC) codes

  • General Computer Science
  • General Mathematics

Fingerprint

Dive into the research topics of 'Synthesis-based low-cost gaze analysis'. Together they form a unique fingerprint.

Cite this