High-quality fusion images with infrared and visible information contribute to intelligent and safe driving. In the infrared and visible fusion images, the useless noise information in infrared image makes the fusion image unclear, which leads to the loss of texture information from visible image. In order to solve this problem, we propose a novel two-stage network (i.e., SOSMaskFuse) that can effectively reduce the noise and extract the important thermal information in infrared images as well as display sufficient texture details of visible images. In the first stage of this network, a salient object segmentation (SOS) network is proposed. Infrared images are fed into the SOS network to obtain the corresponding binarization mask of the region of interest. In the second stage, in each layer of features extracted by the encoder network, the newly proposed IMV-F (infrared mask visible fusion) fusion strategy uses the mask to decompose both infrared and visible images into infrared-foreground, visible-foreground, infrared-background and visible-background, and then fuses the foreground and background parts separately into fused-foreground and fused-background. Finally, the decoder network reconstructs the fused features into the final fused image. Compared with eighteen competitive algorithms on three public datasets, the experimental results indicate that our proposed network can produce high quality fused images with clear background texture information while highlighting infrared thermal information. Our proposed SOSMaskFuse generally outperforms the eighteen compared methods from both the quantitative and qualitative perspectives.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    SOSMaskFuse: An Infrared and Visible Image Fusion Architecture Based on Salient Object Segmentation Mask


    Contributors:
    Li, Guofa (author) / Qian, Xuanhu (author) / Qu, Xingda (author)


    Publication date :

    2023-09-01


    Size :

    5156691 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Fusion of Infrared and Visible Light Images Based on Region Segmentation

    Kun, L. / Lei, G. / Huihui, L. et al. | British Library Online Contents | 2009


    Infrared and visible maritime image fusion based on PIAFusion

    Ni, Qian / Cao, Chunyan / Zhu, Hongna et al. | SPIE | 2023


    Image Fusion Processing Method Based on Infrared and Visible Light

    Lin, Xiaogong / Yang, Ronghao | British Library Conference Proceedings | 2019


    Salient Object Subitizing

    Zhang, J. / Ma, S. / Sameki, M. et al. | British Library Online Contents | 2017


    Neural Style Transfer Based Infrared-Visible Fusion

    KM, Lokesh Kumar / N, Aishwarya / B, Ashwin | IEEE | 2023