“New Algorithms for Reconstruction of a 3-D Depth Map from One or More Images”
by Min Shao, Tal Simchony, and Rama Chellappa
November 1987
New algorithms are developed to recover the depth and orientation maps of a surface from its image intensities. They combine the advantages of stereo vision and shape-from-shading (SFS) methods. These algorithms generate dense surface depth and orientation maps accurately and unambiguously. Previous SFS algorithms can not be directly extended to combine stereo images because the recovery of surface depth and that of orientation are separated in these formulations. A new SFS algorithm is proposed to couple the generation of the depth and orientation maps. The new formulation also ensures that the reconstructed surface depth and its orientation are consistent. The SFS algorithm for a single image is next extended to utilize stereo images. The correspondence over stereo images is established simultaneously with the generation of surface depth and orientation. An alternative approach is also suggested for combining stereo and SFS techniques. This approach can be used to combine needle maps which are directly available from other sources such as photometric stereo. Finally, we discuss the use of embedding techniques to combine sparse depth measurements.