ToonCap: A layered deformable model for capturing poses from cartoon characters

Characters in traditional artwork such as children’s books or cartoon animations are typically drawn once, in xed poses, with little opportunity to change the characters’ appearance or re-use them in a dierent animation. To enable these applications one can t a consistent parametric deformable model — a puppet — to dier-ent images of a character, thus establishing consistent segmentation, dense semantic correspondence, and deformation parameters across poses. In this work, we argue that a layered deformable puppet is a natural representation for hand-drawn characters, providing an eective way to deal with the articulation, expressive deformation, and occlusion that are common to this style of artwork. Our main contribution is an automatic pipeline for tting these models to unlabeled images depicting the same character in various poses. We demonstrate that the output of our pipeline can be used directly for editing and re-targeting animations.