As a consequence of the depth loss caused by the acquisition process, the use of a single two-dimensional image does not allow a three dimensional reconstruction of the world without the use of any a-priori knowledge. In addition, when the target is the reconstruction of the 3D space, the solution gets more and more complex due to the larger amount of computation required by well-known approaches, such as the processing of stereo images.
The traditional approach to stereo vision can be divided into four steps:
More precisely, since IPM can be used to recover the texture of a specific surface (the road plane in the previous discussion), when it is applied to both stereo images (with different parameters reflecting the different acquisition setup of the two cameras) it provides two instances of the given surface, namely two partially overlapping patches. These two patches, thanks to the knowledge of the vision system setup, can be brought to correspondence, so that the homologous points share the same coordinates in the two remapped images.