The USC Andrew and Erna Viterbi School of Engineering USC Signal and Image Processing Institute USC Ming Hsieh Department of Electrical and Computer Engineering University of Southern California

Technical Report USC-SIPI-216

“Shape from Shading with Perspective Projection”

by Kyoung Mu Lee and C.-C. Jay Kuo

September 1992

Most conventional SFS (Shape from Shading) algorithms have been developed under the assumption of orthographic projection. However, the assumption is not valid when an object is not far away from the camera and, therefore, it causes severe reconstruction error in many real applications. In this research, we develop a new iterative algorithm for recovering surface heights from shaded images obtained with perspective projection. By dividing an image into a set of nonoverlapping triangular domains and approximating a smooth surface by the union of triangular surface patches, we can relate image brightness in the image plane directly to surface nodal heights in the world space via a linearized reflectance map based on the perspective projection model. To determine the surface height, we consider the minimization of a cost functional defined to be the sum of squares of brightness error by solving a system of equations parameterized by nodal heights. Furthermore, we apply an successive linearization scheme in which the linearization of the reflectance map is performed with respect to surface nodal heights obtained from the previous iteration so that approximation error of the reflectance map is reduced and accuracy of reconstructed surface is improved iteratively. The proposed method reconstructs surface heights directly, and does not require any additional integrability constraint. Simulation results for synthetic and real images are demonstrated to show the performance and efficiency of our new method.

To download the report in PDF format click here: USC-SIPI-216.pdf (1.9Mb)