Skip to main navigation Skip to search Skip to main content

Exploring Complexity of Facial Dynamics in Autism Spectrum Disorder

  • Pradeep Raj Krishnappa Babu
  • , J. Matias Di Martino
  • , Zhuoqing Chang
  • , Sam Perochon
  • , Kimberly L.H. Carpenter
  • , Scott Compton
  • , Steven Espinosa
  • , Geraldine Dawson
  • , Guillermo Sapiro

Research output: Contribution to journalArticlepeer-review

Abstract

Atypical facial expression is one of the early symptoms of autism spectrum disorder (ASD) characterized by reduced regularity and lack of coordination of facial movements. Automatic quantification of these behaviors can offer novel biomarkers for screening, diagnosis, and treatment monitoring of ASD. In this work, 40 toddlers with ASD and 396 typically developing toddlers were shown developmentally-appropriate and engaging movies presented on a smart tablet during a well-child pediatric visit. The movies consisted of social and non-social dynamic scenes designed to evoke certain behavioral and affective responses. The front-facing camera of the tablet was used to capture the toddlers' face. Facial landmarks' dynamics were then automatically computed using computer vision algorithms. Subsequently, the complexity of the landmarks' dynamics was estimated for the eyebrows and mouth regions using multiscale entropy. Compared to typically developing toddlers, toddlers with ASD showed higher complexity (i.e., less predictability) in these landmarks' dynamics. This complexity in facial dynamics contained novel information not captured by traditional facial affect analyses. These results suggest that computer vision analysis of facial landmark movements is a promising approach for detecting and quantifying early behavioral symptoms associated with ASD.

Original languageEnglish (US)
Pages (from-to)919-930
Number of pages12
JournalIEEE Transactions on Affective Computing
Volume14
Issue number2
DOIs
StatePublished - Apr 1 2023
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Software
  • Human-Computer Interaction

Keywords

  • Autism spectrum disorder
  • affective state
  • complexity
  • facial dynamics
  • multiscale entropy
  • sample entropy

Fingerprint

Dive into the research topics of 'Exploring Complexity of Facial Dynamics in Autism Spectrum Disorder'. Together they form a unique fingerprint.

Cite this