The inherent sparsity of LiDAR data often leads to extremely sparse depth maps, which poses a challenge for the development of LiDAR-based egocentric vehicles, such as self-driving cars and mobile robots. To overcome this limitation, guided depth completion methods use calibrated camera images to create precise, dense depth predictions from sparse LiDAR data. However, the extreme reliance on camera image limits its generalization of guided depth completion, especially its robustness to weather and light. In this paper, we aim to utilize camera images only during training phase to improve unguided depth completion, and discard camera in the inference phase. We comprehensively analyze the pivotal role of camera images in the depth completion task and emphasize the significance of the frequency distribution within the local windows, quantitatively demonstrating its substantial contribution. Subsequently, we introduce cross-modality knowledge distillation to align LiDAR features with camera features in the frequency domain, yielding corresponding guidance features. We devise a guidance and selection module to mitigate unavoidable inaccuracies in knowledge distillation, while it can enhance depth features and adeptly selects more precise encoded values from both the guidance branch and the unguided input. To further refine the completion result, we propose a progressive depth completion module incorporating two sub-networks connected by an attention for refinement module. We denominate our method as Better Unguided Network (BUNet) and evaluate its efficacy on the KITTI depth completion benchmark and NYUv2 dataset, demonstrating its superiority over methods that exclude camera images during the inference phase.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Towards Better Unguided Depth Completion via Cross-Modality Knowledge Distillation in the Frequency Domain


    Beteiligte:
    Liu, Moyun (Autor:in) / Chen, Bing (Autor:in) / Chen, Youping (Autor:in) / Xie, Jingming (Autor:in) / Yao, Lei (Autor:in) / Zhang, Yang (Autor:in) / Hu, Qin (Autor:in) / Du, Jiawei (Autor:in) / Zhou, Joey Tianyi (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.11.2024


    Format / Umfang :

    8567254 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    LiDAR Depth Completion Using Color-Embedded Information via Knowledge Distillation

    Hwang, Sangwon / Lee, Junhyeop / Kim, Woo Jin et al. | IEEE | 2022



    Improved Accuracy of Unguided Articulated Robots

    DeVlieg, Russell / Szallay, Todd | SAE | 2009


    A PROBABILISTIC APPROACH TO UNGUIDED AIRDROP

    Klein, Benjamin / Rogers, Jonathan | British Library Conference Proceedings | 2015


    Aeroballistic optimization of unguided artillery rockets

    KNOCHE, H.-G. / GREGORIOU, G. | AIAA | 1978