UAV-based automatic railway inspection is expected to have the potential to reform the inspection of railways. In this area, real-time railway scene parsing is quite essential. However, the limited computation resources of the UAV onboard computer pose a huge challenge for the algorithm to juggle a precise prediction with strong timeliness. Concerning this issue, this paper proposes a novel algorithm named deep fully decoupled residual convolutional network, which consists of fully decoupled residual blocks (Non-bottleneck-FDs) to deal with the dilemma between the high demand of real-time and limited resources. The residual block is constructed based on a new convolution which divides the standard convolution into three sequential convolutions to decouple the conventional operational correlations fully. Furthermore, a customized auxiliary line loss (LL) function is proposed to constrain the segmentation of railway and non-railway simultaneously without increasing the computation complexity. The proposed LL can force the predicted railway areas to concentrate in long strip areas precisely and inhibit their appearances in other impossible local areas. Subsequently, an integrated loss backpropagation strategy of the LL and cross-entropy function is presented. A comprehensive set of experiments are conducted for verification. Experiments demonstrate the superior performance of our approach with a more than $2\times $ reduction in parameters and computation cost. Moreover, our approach also has a faster inference speed than the most existing lightweight architectures while providing comparable or higher accuracy. It is proven that our approach can reconcile the precise prediction with strong timeliness for railway scene parsing within the limitation of onboard computers. Besides, the results also imply its highest performance in terms of local details and edges of railway areas.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Fully Decoupled Residual ConvNet for Real-Time Railway Scene Parsing of UAV Aerial Images


    Contributors:
    Tong, Lei (author) / Wang, Zhipeng (author) / Jia, Limin (author) / Qin, Yong (author) / Wei, Yanbin (author) / Yang, Huaizhi (author) / Geng, Yixuan (author)


    Publication date :

    2022-09-01


    Size :

    5646365 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic Segmentation

    Romera, Eduardo / Alvarez, Jose M. / Bergasa, Luis M. et al. | IEEE | 2018


    Efficient ConvNet for real-time semantic segmentation

    Romera, Eduardo / Alvarez, Jose M. / Bergasa, Luis M. et al. | IEEE | 2017


    Efficient ConvNet for Real-Time Semantic Segmentation

    Romera, Eduardo / Alvarez, José M. / Bergasa, Luis M. et al. | British Library Conference Proceedings | 2017


    Real-time Driver Drowsiness Detection System using Cascaded ConvNet Framework

    Singh, Nongmeikapam Thoiba / Saurav / Pathak, Nishant et al. | IEEE | 2023


    Efficient scene parsing by sampling unary potentials in a fully-connected CRF

    Horne, Lachlan / Alvarez, Jose M. / Salzmann, Mathieu et al. | IEEE | 2015