Video puppetry: A performative interface for cutout animation

Connelly Barnes, David E. Jacobs, Jason Sanders, Dan B. Goldman, Szymon Rusinkiewicz, Adam Finkelstein, Maneesh Agrawala

Research output: Chapter in Book/Report/Conference proceedingConference contribution

31 Scopus citations

Abstract

We present a video-based interface that allows users of all skill levels to quickly create cutout-style animations by performing the character motions. The puppeteer first creates a cast of physical puppets using paper, markers and scissors. He then physically moves these puppets to tell a story. Using an inexpensive overhead camera our system tracks the motions of the puppets and renders them on a new background while removing the puppeteer's hands. Our system runs in real-time (at 30 fps) so that the puppeteer and the audience can immediately see the animation that is created. Our system also supports a variety of constraints and effects including articulated characters, multi-track animation, scene changes, camera controls, 21/2-D environments, shadows, and animation cycles. Users have evaluated our system both quantitatively and qualitatively: In tests of low-level dexterity, our system has similar accuracy to a mouse interface. For simple story telling, users prefer our system over either a mouse interface or traditional puppetry. We demonstrate that even first-time users, including an eleven-yearold, can use our system to quickly turn an original story idea into an animation.

Original languageEnglish (US)
Title of host publicationACM SIGGRAPH Asia 2008 Papers, SIGGRAPH Asia'08
StatePublished - 2008
EventACM SIGGRAPH Asia 2008 Papers, SIGGRAPH Asia 2008 - Singapore, Singapore
Duration: Dec 10 2008Dec 13 2008

Publication series

NameACM SIGGRAPH Asia 2008 Papers, SIGGRAPH Asia'08

Other

OtherACM SIGGRAPH Asia 2008 Papers, SIGGRAPH Asia 2008
Country/TerritorySingapore
CitySingapore
Period12/10/0812/13/08

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Software

Keywords

  • Animation
  • Real-time
  • Tangible user interface
  • Vision

Fingerprint

Dive into the research topics of 'Video puppetry: A performative interface for cutout animation'. Together they form a unique fingerprint.

Cite this