Crowdsourcing quality control for Dark Energy Survey images

P. Melchior, E. Sheldon, A. Drlica-Wagner, E. S. Rykoff, T. M.C. Abbott, F. B. Abdalla, S. Allam, A. Benoit-Lévy, D. Brooks, E. Buckley-Geer, A. Carnero Rosell, M. Carrasco Kind, J. Carretero, M. Crocce, C. B. D'Andrea, L. N. da Costa, S. Desai, P. Doel, A. E. Evrard, D. A. FinleyB. Flaugher, J. Frieman, E. Gaztanaga, D. W. Gerdes, D. Gruen, R. A. Gruendl, K. Honscheid, D. J. James, M. Jarvis, K. Kuehn, T. S. Li, M. A.G. Maia, M. March, J. L. Marshall, B. Nord, R. Ogando, A. A. Plazas, A. K. Romer, E. Sanchez, V. Scarpine, I. Sevilla-Noarbe, R. C. Smith, M. Soares-Santos, E. Suchyta, M. E.C. Swanson, G. Tarle, V. Vikram, A. R. Walker, W. Wester, Y. Zhang

Research output: Contribution to journalArticlepeer-review

10 Scopus citations

Abstract

We have developed a crowdsourcing web application for image quality control employed by the Dark Energy Survey. Dubbed the "DES exposure checker", it renders science-grade images directly to a web browser and allows users to mark problematic features from a set of predefined classes. Users can also generate custom labels and thus help identify previously unknown problem classes. User reports are fed back to hardware and software experts to help mitigate and eliminate recognized issues. We report on the implementation of the application and our experience with its over 100 users, the majority of which are professional or prospective astronomers but not data management experts. We discuss aspects of user training and engagement, and demonstrate how problem reports have been pivotal to rapidly correct artifacts which would likely have been too subtle or infrequent to be recognized otherwise. We conclude with a number of important lessons learned, suggest possible improvements, and recommend this collective exploratory approach for future astronomical surveys or other extensive data sets with a sufficiently large user base. We also release open-source code of the web application and host an online demo version at http://des-exp-checker.pmelchior.net.

Original languageEnglish (US)
Pages (from-to)99-108
Number of pages10
JournalAstronomy and Computing
Volume16
DOIs
StatePublished - Jul 1 2016
Externally publishedYes

All Science Journal Classification (ASJC) codes

  • Astronomy and Astrophysics
  • Computer Science Applications
  • Space and Planetary Science

Keywords

  • Human-centered computing: Collaborative filtering
  • Information systems: Crowdsourcing
  • Surveys

Fingerprint

Dive into the research topics of 'Crowdsourcing quality control for Dark Energy Survey images'. Together they form a unique fingerprint.

Cite this