[Objectives] In order to realize intelligent obstacle avoidance of unmanned vessel in unknown waters,[Methods] an intelligent obstacle avoidance decision-making model of the unmanned vessel based on Deep Reinforcement Learning(DRL)is established. Here we analyze the problems encountered in the unmanned vessel's intelligent obstacle avoidance decision-making,propose the design criteria of the intelligent obstacle avoidance decision-making,and then accordingly establish a decision-making model based on Markov Decision Process(MDP),through which obtain the optimal strategy by value function to make the maximum returns in behavior mapping of the unmanned vessel status and to design an excitation function specially composed of target approaching,off course and safety. Finally,carry out the simulation tests respectively in static and dynamic waters.[Results] The results show that the proposed intelligent decision-making method can effectively avoid obstacles,and ensure the safe navigation of the unmanned vessel in unknown waters.[Conclusions] The proposed method can provide a theoretical reference for autonomous navigation of the unmanned vessel.


    Access

    Download


    Export, share and cite



    Title :

    Method for intelligent obstacle avoidance decision-making of unmanned vessel in unknown waters


    Contributors:
    WANG Chengbo (author) / ZHANG Xinyu (author) / ZHANG Jiawei (author) / LIU Shuo (author)


    Publication date :

    2018




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    UNMANNED AIRCRAFT OBSTACLE AVOIDANCE

    SCHULTZ STEPHEN L / MONACO JOHN | European Patent Office | 2018

    Free access

    Unmanned aircraft obstacle avoidance

    SCHULTZ STEPHEN L / MONACO JOHN | European Patent Office | 2019

    Free access

    Intelligent unmanned sneaking device with autonomous obstacle avoidance function

    CHEN JIAHAO / WU LONGWEN / DAI YAN | European Patent Office | 2024

    Free access

    Obstacle avoidance device for unmanned aerial vehicle and obstacle avoidance method thereof

    ZHUANG XIAOBO / JIN JING / ZHUANG BITAI | European Patent Office | 2024

    Free access

    Obstacle avoidance method for unmanned vehicle

    ZHU XIANG | European Patent Office | 2020

    Free access