Various unfavourable conditions such as fog, snow and rain may degrade image quality and pose tremendous threats to the safety of autonomous driving. Numerous image-denoising solutions have been proposed to improve visibility under adverse weather conditions. However, previous studies have been limited in robustness, generalization ability, and interpretability as they were designed for specific scenarios. To address this problem, we introduce an interpretable image denoising framework via Dual Disentangled Representation Learning (DDRL) to enhance robustness and interpretability by decomposing an image into content factors (e.g., objects) and context factors (e.g., weather conditions). DDRL consists of two Disentangled Representation Learning (DRL) blocks. In each DRL block, an input image is deconstructed into the latent content distribution and the weather distribution by minimizing their mutual information. To mitigate the impacts of weather styles, we incorporated a content discriminator and adversarial objectives to learn the decomposable interaction between two DRL blocks. Furthermore, we standardized the weather feature space, enabling our method to be applicable to various downstream tasks such as diverse degraded image generation. We evaluated DDRL under three weather conditions including fog, rain, and snow. The experimental results demonstrate that DDRL shows competitive performance with good generalization capability and high robustness under numerous weather conditions. Furthermore, quantitative analysis shows that DDRL can capture interpretable variations of weather factors and decompose them for safe and reliable all-weather autonomous driving.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    An Interpretable Image Denoising Framework via Dual Disentangled Representation Learning


    Contributors:

    Published in:

    Publication date :

    2024-01-01


    Size :

    4297628 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Understanding and Modeling Urban Mobility Dynamics via Disentangled Representation Learning

    Zhang, Hailong / Wu, Yuankai / Tan, Huachun et al. | IEEE | 2022


    Image denoising via sparse representation using rotational dictionary

    Tang, Y. / Xu, N. / Jiang, A. et al. | British Library Online Contents | 2014



    Disentangled Variational Auto-Encoder for Semi-supervised Learning

    Li, Yang / Pan, Quan / Wang, Suhang et al. | ArXiv | 2017

    Free access

    The DUDE framework for continuous tone image denoising

    Motta, G. / Ordentlich, E. / Ramirez, I. et al. | IEEE | 2005