M.Sc Thesis

M.Sc StudentHendel Tal
SubjectA Solution to the Stereo Correspondence Problem Using
Constraints Imposed by Physical Surfaces
and the Gradient Disparity Limit
DepartmentDepartment of Biomedical Engineering
Supervisor ASSOCIATE PROF. Moshe Gur
Full Thesis textFull thesis text - English Version


It has long been realized that the first stage in the attainment of stereoscopic depth is the establishment of correspondence between matching features in the two retinal images. The brain seems to solve this correspondence problem (or matching problem) easily, best demonstrated by the vivid sense of stereoscopic depth that we get from random-dot stereograms, but efforts to understand how the brain achieves this feat have shown the problem to be surprisingly difficult. This work offers a solution to the stereo correspondence problem that is accurate, robust and biologically feasible.

Firstly, it is suggested that prior to the matching process itself a preceding stage ought to take place. This preceding step, which is dubbed de-convergence, serves to cancel the effects of vergence and version on the two retinal projections. It is shown that if the retinal images go through a de-convergence process, vertical disparities are eliminated from them thus allowing the search for corresponding points to be conducted only along horizontal lines. A very desirable outcome of the de-convergence process is that the laws of visual direction emerge as a natural corollary of the need to fuse corresponding points.

Secondly, a detailed analysis of the constraints imposed on the "behavior" of points in the retinal projections is performed assuming that points tend to lie on continuous smooth surfaces, rather than be randomly positioned in space. The outcome of this analysis is the idea that in order to find its corresponding point, every point has to define its own Signature, which is a description of the point's neighborhood in several levels of preciseness, and then look for the point in the other retinal projection with the most similar Signature. This Signature idea is then developed into an algorithm. An implementation of the algorithm is tested on various textured surfaces with excellent results. It is further shown that algorithm integrates the two rivaling notions of binocular fusion- Panum's fusional areas and the disparity gradient limit. Moreover, the recognition of monocular points is incorporated naturally into the algorithm without the requirement to add a special stage for this purpose, a requirement that appears in some previously suggested correspondence algorithms. Lastly, it is argued that the new algorithm is consistent with psychophysical and biological observations.