Various deep reinforcement learning (DRL) approaches have been applied for robot navigation with promising results. Besides avoiding pedestrians during navigation, a robot can also make sounds to aware nearby pedestrians, which normally results a more effective and safer moving trajectory in a crowded environment. However, it is challenging to train such an interactive navigation policy, i.e., outputs both navigation and interactive actions, in DRL. Generally, an interactive navigation policy needs to avoid collisions with pedestrians while reaching the target, make as few sounds as possible, and be robust to diverse environments while different pedestrians may respond differently to the sounds. In this paper, we propose a DRL based interactive navigation approach to meet above requirements. In specific, we first develop a simulation platform that can model different responses of pedestrians w.r.t. the sounds. Then we introduce a reward function that can effectively result proper interactive actions in diverse environments. At last, we use a PPO based method to train the interactive navigation policy. We evaluate our approach in various crowded pedestrian environments and compare its performance with multiple existing methods. The experimental results show that our approach meets the three requirements and outperforms others. Moreover, we show that the reward function can also be used to extend an existing DRL based navigation approach to learn an interactive navigation policy satisfying the requirements. We also deploy the trained policy on a robot and demonstrate its performance in real-world crowded environments.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Interactive Robot Navigation in Crowded Pedestrian Environments Based on Deep Reinforcement Learning


    Beteiligte:
    Chen, Shuyan (Autor:in) / Qiu, Quecheng (Autor:in) / Ma, Jun (Autor:in) / Yao, Shunyi (Autor:in) / Chen, Guangda (Autor:in) / Ji, Jianmin (Autor:in)


    Erscheinungsdatum :

    01.12.2022


    Format / Umfang :

    1165909 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    NavG: Risk-Aware Navigation in Crowded Environments Based on Reinforcement Learning with Guidance Points

    Zhang, Qianyi / Luo, Wentao / Liu, Boyi et al. | ArXiv | 2025

    Freier Zugriff

    The Emotionally Intelligent Robot: Improving Social Navigation in Crowded Environments

    Bera, Aniket / Randhavane, Tanmay / Prinja, Rohan et al. | ArXiv | 2019

    Freier Zugriff

    Dynamic trajectory planning for mobile robot navigation in crowded environments

    PRIMATESTA, STEFANO / RUSSO, LUDOVICO ORLANDO / BONA, Basilio | BASE | 2016

    Freier Zugriff

    Temporal Based Deep Reinforcement Learning for Crowded Lane Merging Maneuvers

    Martinez Gomez, Luis Miguel / Daza, Ivan Garcia / Sotelo Vazquez, Miguel Angel | IEEE | 2023