ProxImaL: Efficient image optimization using proximal algorithms

Felix Heide, Steven Diamond, Matthias Nießner, Jonathan Ragan-Kelley, Wolfgang Heidrich, Gordon Wetzstein

Research output: Contribution to journalConference article

25 Scopus citations

Abstract

Computational photography systems are becoming increasingly diverse, while computational resources-for example on mobile platforms-are rapidly increasing. As diverse as these camera systems may be, slightly different variants of the underlying image processing tasks, such as demosaicking, deconvolution, denoising, inpainting, image fusion, and alignment, are shared between all of these systems. Formal optimization methods have recently been demonstrated to achieve state-of-the-art quality for many of these applications. Unfortunately, different combinations of natural image priors and optimization algorithms may be optimal for different problems, and implementing and testing each combination is currently a time-consuming and error-prone process. ProxImaL is a domain-specific language and compiler for image optimization problems that makes it easy to experiment with different problem formulations and algorithm choices. The language uses proximal operators as the fundamental building blocks of a variety of linear and nonlinear image formation models and cost functions, advanced image priors, and noise models. The compiler intelligently chooses the best way to translate a problem formulation and choice of optimization algorithm into an efficient solver implementation. In applications to the image processing pipeline, deconvolution in the presence of Poisson-distributed shot noise, and burst denoising, we show that a few lines of ProxImaL code can generate highly efficient solvers that achieve state-of-the-art results. We also show applications to the nonlinear and nonconvex problem of phase retrieval.

Original languageEnglish (US)
Article numbera84
JournalACM Transactions on Graphics
Volume35
Issue number4
DOIs
StatePublished - Jul 11 2016
Externally publishedYes
EventACM SIGGRAPH 2016 - Anaheim, United States
Duration: Jul 24 2016Jul 28 2016

All Science Journal Classification (ASJC) codes

  • Computer Graphics and Computer-Aided Design

Keywords

  • Computational photography
  • Digital image processing
  • Optimization

Fingerprint Dive into the research topics of 'ProxImaL: Efficient image optimization using proximal algorithms'. Together they form a unique fingerprint.

  • Cite this

    Heide, F., Diamond, S., Nießner, M., Ragan-Kelley, J., Heidrich, W., & Wetzstein, G. (2016). ProxImaL: Efficient image optimization using proximal algorithms. ACM Transactions on Graphics, 35(4), [a84]. https://doi.org/10.1145/2897824.2925875