Inverse Lighting for Photography

Stephen R. Marschner and Donald P. Greenberg

In Proceedings of IS&T/SID Fifth Color Imaging Conference, pages 262-265. Held in Scottsdale, AZ, November 1997.

Abstract

We introduce a technique for improving photographs using inverse lighting, a new process based on algorithms developed in computer graphics for computing the reflection of light in 3D space. From a photograph and a 3D surface model for the object pictured, inverse lighting estimates the directional distribution of the incident light. We then use this information to process the photograph digitally to alter the lighting on the object.

Inverse lighting is a specific example of the general idea of inverse rendering. This refers to the practice of using the methods of computer graphics, which normally are used to render images from scene information, to infer scene information from images. Our system uses physically based rendering technology to construct a linear least squares system that we solve to find the lighting. As an application, the results are then used to simulate a change in the incident light in the photograph.

An implementation is described that uses 3D models from a laser range scanner and photographs from a high-resolution color CCD camera. We demonstrate the system on a simple test object and a human face.

Availability

This paper is available as a 0.2M PDF file, as a 2.4M PostScript file or as a 0.7M gzipped PostScript file. To view the PDF file you will need Adobe Acrobat Reader if you don't already have it.

Copyright 1997 IS&T. "Posted with permission of IS&T: The Society for Imaging Science and Technology, sole copyright owners of IS&T's Fifth Color Imaging Conference: Color Science, Systems, and Applications."


Steve Marschner