Specularity  Removal & Editing
             Home / Resume / Research / Blog  

Abstract

We present a unified framework for separating specular and diffuse reflection components in images and videos of textured scenes. This can be used for specularity removal and for independently processing, filtering, and recombining the two components. A family of  solutions appropriate for differing image sources (still images vs. videos), differing prior information (e.g., highly vs. lightly textured scenes), or differing prior computations (e.g., optical flow) is introduced. In contrast to many other methods, explicit segmentation and/or manual intervention are not required. We present results on high-quality images and video acquired in the laboratory in addition to images taken from the Internet. Results on the latter demonstrate robustness to low dynamic range, JPEG artifacts, and lack of knowledge of illuminant color. Empirical comparison to physical removal of specularities using polarization is provided. Finally, an interesting application termed “Dichromatic Editing” is presented in which the diffuse and the specular components are processed independently to produce a variety of visual effects.

Original Image Diffuse Component Specular Component

Results

Several examples of dichromatic separation and editing can be found here. You can watch the SIGGRAPH video [38.4MB].

Publications: