The USC Andrew and Erna Viterbi School of Engineering USC Signal and Image Processing Institute USC Ming Hsieh Department of Electrical Engineering University of Southern California

Technical Report USC-SIPI-113

“New Algorithms for Reconstruction of a 3-D Depth Map from One or More Images”

by Min Shao, Tal Simchony, and Rama Chellappa

November 1987

New algorithms are developed to recover the depth and orientation maps of a surface from its image intensities. They combine the advantages of stereo vision and shape-from-shading (SFS) methods. These algorithms generate dense surface depth and orientation maps accurately and unambiguously. Previous SFS algorithms can not be directly extended to combine stereo images because the recovery of surface depth and that of orientation are separated in these formulations. A new SFS algorithm is proposed to couple the generation of the depth and orientation maps. The new formulation also ensures that the reconstructed surface depth and its orientation are consistent. The SFS algorithm for a single image is next extended to utilize stereo images. The correspondence over stereo images is established simultaneously with the generation of surface depth and orientation. An alternative approach is also suggested for combining stereo and SFS techniques. This approach can be used to combine needle maps which are directly available from other sources such as photometric stereo. Finally, we discuss the use of embedding techniques to combine sparse depth measurements.

To download the report in PDF format click here: USC-SIPI-113.pdf (4.1Mb)