Performance-driven hand-drawn animation

Ian Buck, Adam Finkelstein, Charles Jacobs, Allison Klein, David H. Salesin, Joshua Seims, Richard Szeliski, Kentaro Toyama

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Scopus citations

Abstract

We present a novel method for generating performance-driven, "hand-drawn" animation in real-time. Given an annotated set of hand-drawn faces for various expressions, our algorithm performs multi-way morphs to generate real-time animation that mimics the expressions of a user. Our system consists of a vision-based tracking component and a rendering component. Together, they form an animation system that can be used in a variety of applications, including teleconferencing, multi-user virtual worlds, compressed instructional videos, and consumer-oriented animation kits. This paper describes our algorithms in detail and illustrates the potential for this work in a teleconferencing application. Experience with our implementation suggests that there are several advantages to our hand-drawn characters over other alternatives: (1) flexibility of animation style; (2) increased compression of expression information; and (3) masking of errors made by the face tracking system that are distracting in photorealistic animations.

Original languageEnglish (US)
Title of host publicationSIGGRAPH 2006 - ACM SIGGRAPH 2006 Courses
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)1595933646, 9781595933645
DOIs
StatePublished - Jul 30 2006
Event2006 ACM SIGGRAPH Courses, SIGGRAPH 2006 - Boston, United States
Duration: Jul 30 2006Aug 3 2006

Publication series

NameSIGGRAPH 2006 - ACM SIGGRAPH 2006 Courses

Other

Other2006 ACM SIGGRAPH Courses, SIGGRAPH 2006
Country/TerritoryUnited States
CityBoston
Period7/30/068/3/06

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Software
  • Human-Computer Interaction

Keywords

  • Animation
  • Face tracking
  • Image morphing
  • Non-photorealistic rendering

Fingerprint

Dive into the research topics of 'Performance-driven hand-drawn animation'. Together they form a unique fingerprint.

Cite this