In this paper, we propose a novel semantic segmentation-based stereo reconstruction method that can keep up with the accuracy of the state-of-the art approaches while running in real time. The solution follows the classic stereo pipeline, each step in the stereo workflow being enhanced by additional information from semantic segmentation. Therefore, we introduce several improvements to computation, aggregation, and optimization by adapting existing techniques to integrate additional surface information given by each semantic class. For the cost computation and optimization steps, we propose new genetic algorithms that can incrementally adjust the parameters for better solutions. Furthermore, we propose a new post-processing edge-aware filtering technique relying on an improved convolutional neural network (CNN) architecture for disparity refinement. We obtain the competitive results at 30 frames/s, including segmentation.


    Access

    Download


    Export, share and cite



    Title :

    Real-Time Semantic Segmentation-Based Stereo Reconstruction


    Contributors:


    Publication date :

    2020-04-01


    Size :

    2634976 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Real-time Underwater 3D Reconstruction Method Based on Stereo Camera

    Hou, Jun / Ye, Xiufen | British Library Conference Proceedings | 2022


    CNN-based Fisheye Image Real-Time Semantic Segmentation

    Saez, Alvaro / Bergasa, Luis M. / Romeral, Eduardo et al. | IEEE | 2018


    Efficient ConvNet for real-time semantic segmentation

    Romera, Eduardo / Alvarez, Jose M. / Bergasa, Luis M. et al. | IEEE | 2017


    Efficient ConvNet for Real-Time Semantic Segmentation

    Romera, Eduardo / Alvarez, José M. / Bergasa, Luis M. et al. | British Library Conference Proceedings | 2017