In this paper, we present a two-layer generative model that incorporates generic middle-level visual knowledge for dense stereo reconstruction. The visual knowledge is represented by a dictionary of surface primitives including various categories of boundary discontinuities and junctions in parametric form. Given a stereo pair, we first compute a primal sketch representation which decomposes the image into a structural part for object boundaries and high intensity contrast represented by a 2D sketch graph, and a structure less part represented by Markov random field on pixels. Then we label the sketch graph and compute the 3D sketch (like a wire-frame) by fitting the primitive dictionary to the sketch graph. The surfaces between the 3D sketches are filled in by computing the depth of the MRP model on the structureless part. These two levels interact closely since the MRF is used to propagate information between the primitives, and at the same time, the primitives act as boundary conditions for the MRF. The two processes maximize a Bayesian posterior probability jointly. We propose an MCMC algorithm that simultaneously infers the 3D primitive types and parameters and estimates the depth of the scene. Our experiments show that this representation can infer the depth map with sharp boundaries and junctions for textureless images, curve objects and free-form shapes.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Incorporating visual knowledge representation in stereo reconstruction


    Beteiligte:
    Barbu, A. (Autor:in) / Song-Chun Zhu, (Autor:in)


    Erscheinungsdatum :

    01.01.2005


    Format / Umfang :

    665652 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Incorporating Visual Knowledge Representation in Stereo Reconstruction

    Barbu, A. / Zhu, S.-C. / IEEE | British Library Conference Proceedings | 2005


    Using Partial Shape Knowledge for Stereo Reconstruction

    Zhao, W. / Nandhakumar, N. / IEEE; Computer Society; Technical Committee for Pattern Analysis and Machine Intelligence | British Library Conference Proceedings | 1995



    Incorporating Differential Constraints in a 3D Reconstruction Process. Application to Stereo

    Lengagne, R. / Fua, P. / IEEE | British Library Conference Proceedings | 2001


    GPU-friendly multi-view stereo reconstruction using surfel representation and graph cuts

    Chang, J. Y. / Park, H. / Park, I. K. et al. | British Library Online Contents | 2011