Multi-feature matching of fresco fragments

Corey Toler-Franklin, Benedict Brown, Tim Weyrich, Thomas Funkhouser, Szymon Rusinkiewicz

Research output: Chapter in Book/Report/Conference proceedingConference contribution

32 Scopus citations

Abstract

We present a multiple-feature approach for determining matches between small fragments of archaeological artifacts such as Bronze-Age and Roman frescoes. In contrast with traditional 2D and 3D shape matching approaches, we introduce a set of feature descriptors that are based on not only color and shape, but also normal maps. These are easy to acquire and combine high data quality with discriminability and robustness to some types of deterioration. Our feature descriptors range from general-purpose to domain-specific, and are quick to compute and match. We have tested our system on three datasets of fresco fragments, demonstrating that multi-cue matching using different subsets of features leads to different tradeoffs between efficiency and effectiveness. In particular, we show that normal-based features are more effective than color-based ones at similar computational complexity, and that 3D features are more discriminative than ones based on 2D or normals, but at higher computational cost. We also demonstrate how machine learning techniques can be used to effectively combine our new features with traditional ones. Our results show good retrieval performance, significantly improving upon the match prediction rate of state-of-the-art 3D matching algorithms, and are expected to extend to general matching problems in applications such as texture synthesis and forensics.

Original languageEnglish (US)
Title of host publicationProceedings of ACM SIGGRAPH Asia 2010, SIGGRAPH Asia 2010
Volume29
Edition6
DOIs
StatePublished - Dec 1 2010
EventACM SIGGRAPH Asia 2010, SIGGRAPH Asia 2010 - Seoul, Korea, Republic of
Duration: Dec 15 2010Dec 18 2010

Other

OtherACM SIGGRAPH Asia 2010, SIGGRAPH Asia 2010
CountryKorea, Republic of
CitySeoul
Period12/15/1012/18/10

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'Multi-feature matching of fresco fragments'. Together they form a unique fingerprint.

  • Cite this

    Toler-Franklin, C., Brown, B., Weyrich, T., Funkhouser, T., & Rusinkiewicz, S. (2010). Multi-feature matching of fresco fragments. In Proceedings of ACM SIGGRAPH Asia 2010, SIGGRAPH Asia 2010 (6 ed., Vol. 29). [1866207] https://doi.org/10.1145/1866158.1866207