An approach to the problem of autonomous mobile robot obstacle avoidance using Reinforcement Learning, more precisely Q-Learning, is presented in this paper. Reinforcement Learning in Robotics has been a challenging topic for the past few years. The ability to equip a robot with a powerful enough tool to allow an autonomous discovery of an optimal behavior through trial-and-error interactions with its environment has been a reason for numerous deep research projects. In this paper, two different Q-Learning approaches are presented as well as an extensive hyperparameter study. These algorithms were developed for a simplistically simulated Bot'n Roll ONE A (Fig. 1). The simulated robot communicates with the control script via ROS. The robot must surpass three levels of iterative complexity mazes similar to the ones presented on RoboParty [1] educational event challenge. For both algorithms, an extensive hyperparameter search was taken into account by testing hundreds of simulations with different parameters. Both Q-Learning solutions develop different strategies trying to solve the three labyrinths, enhancing its learning ability as well as discovering different approaches to certain situations, and finishing the task in complex environments.


    Access

    Download


    Export, share and cite



    Title :

    Q-learning for autonomous mobile robot obstacle avoidance


    Contributors:

    Publication date :

    2019-04-01



    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Autonomous obstacle avoidance structure and obstacle avoidance method for electric power inspection robot

    NING XUEFENG / LI YUANJIA / YAO JUNQIN et al. | European Patent Office | 2023

    Free access

    MOBILE ROBOT HAVING ACTIVE OBSTACLE AVOIDANCE CAPABILITY

    BAO HUIFANG / ZHANG JINSI / FANG JIE et al. | European Patent Office | 2025

    Free access

    Obstacle avoidance robot

    YUAN MINGHAI / CAI XIANXIAN / LI FAN et al. | European Patent Office | 2020

    Free access

    Motion planning of obstacle avoidance for autonomous mobile robot using hierarchical fuzzy rules and learning automata

    Aoki, T. / Horiuchi, A. / Suzuki, T. et al. | British Library Online Contents | 1996