Target-driven visual navigation presents great potentials in scientific and industrial fields. It takes the target and environment observations as input. However, during training, we found that the agent sometimes got stuck in specific locations. Based on the analysis on visual information from a novel causal perspective, one of the most critical hurdles is the neglect of confounders in environments, which often leads to spurious correlations. Mitigating the confounding effect helps to discover the real causality and therefore are taken into consideration in other fields such as object detection. In this article, we propose Causal Intervention Visual Navigation (CIVN), based on deep reinforcement learning (DRL) and causal intervention. We realize causal intervention using front-door adjustment as most confounders are hard to model explicitly. Specifically, CIVN is implemented by Causal Attention, which is a reasonable approximation of causal intervention for visual navigation. Causal attention provides high-quality representation, which is leveraged by DRL and reduces the number of “stuck”. It is worth mentioned that causal intervention is for the first time applied by us in solving the confounding effect in target-driven visual navigation. Extensive experiments on AI2-THOR demonstrate that CIVN achieves better performance than prior arts. Specifically, the generalization for unknown targets and scenes is improved by a large margin, which is a basic research topic in visual navigation. Moreover, to obtain better generalization, we propose a novel experiment utilizing pre-trained models firstly.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Target-Driven Visual Navigation by Using Causal Intervention


    Contributors:
    Zhao, Xinzhou (author) / Wang, Tian (author) / Li, Yanjing (author) / Zhang, Baochang (author) / Liu, Kexin (author) / Liu, Deyuan (author) / Wang, Chuanyun (author) / Snoussi, Hichem (author)

    Published in:

    Publication date :

    2024-01-01


    Size :

    2010572 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Navigation using selected visual landmarks

    KERZNER DANIEL TODD / SEYFI AHMAD / MEYER TIMON et al. | European Patent Office | 2023

    Free access

    NAVIGATION USING SELECTED VISUAL LANDMARKS

    KERZNER DANIEL TODD / SEYFI AHMAD / MEYER TIMON et al. | European Patent Office | 2021

    Free access

    NAVIGATION USING SELECTED VISUAL LANDMARKS

    KERZNER DANIEL TODD / REZVANI BABAK / TOURNIER GLENN et al. | European Patent Office | 2023

    Free access

    AUTONOMOUS NAVIGATION USING VISUAL ODOMETRY

    LIAO MIAO / LI MING / HONG SOONHAC | European Patent Office | 2017

    Free access