In this paper, we propose a novel semantic segmentation-based stereo reconstruction method that can keep up with the accuracy of the state-of-the art approaches while running in real time. The solution follows the classic stereo pipeline, each step in the stereo workflow being enhanced by additional information from semantic segmentation. Therefore, we introduce several improvements to computation, aggregation, and optimization by adapting existing techniques to integrate additional surface information given by each semantic class. For the cost computation and optimization steps, we propose new genetic algorithms that can incrementally adjust the parameters for better solutions. Furthermore, we propose a new post-processing edge-aware filtering technique relying on an improved convolutional neural network (CNN) architecture for disparity refinement. We obtain the competitive results at 30 frames/s, including segmentation.
Real-Time Semantic Segmentation-Based Stereo Reconstruction
IEEE Transactions on Intelligent Transportation Systems ; 21 , 4 ; 1514-1524
2020-04-01
2634976 byte
Article (Journal)
Electronic Resource
English
Real-time Underwater 3D Reconstruction Method Based on Stereo Camera
British Library Conference Proceedings | 2022
|CNN-based Fisheye Image Real-Time Semantic Segmentation
IEEE | 2018
|Efficient ConvNet for real-time semantic segmentation
IEEE | 2017
|Efficient ConvNet for Real-Time Semantic Segmentation
British Library Conference Proceedings | 2017
|