The robot exploration problem focuses on maximizing the volumetric map of a previously unknown environment. This is a relevant problem in several applications, such as search and rescue and monitoring, which require autonomous robots to examine the surroundings efficiently. Graph-based planning approaches embed the exploration information into a graph describing the global map while the robot incrementally builds it. Nevertheless, even if graph-based representations are computational and memory-efficient, the exploration decision-making problem complexity increases according to the graph size that grows at each iteration. In this paper, we propose a novel Graph Neural Network (GNN) approach trained with Reinforcement Learning (RL) that solves the decision-making problem for autonomous exploration. The learned policy represents the exploration expansion criterion, solving the decision-making problem efficiently and generalizing to different graph topologies and, consequently, environments. We validate the proposed approach with an aerial robot equipped with a depth camera in a benchmark exploration scenario using a high-performance physics engine for environment rendering. We compare the results against a state-of-the-art planning exploration algorithm, showing that the proposed approach matches its performance in terms of explored mapped volume. Additionally, our approach consistently maintains its performance regardless of the objective function used to explore the environment.


    Access

    Download


    Export, share and cite



    Title :

    Learning Heuristics for Efficient Environment Exploration Using Graph Neural Networks



    Publication date :

    2023-01-01



    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    629




    Efficient Heuristics for Clustering and Power Allocation in Small Cell Networks

    Driouch, Elmahdi / Ajib, Wessam / Assi, Chadi | IEEE | 2015



    Synthesizing Traffic Datasets Using Graph Neural Networks

    Rodriguez-Criado, Daniel / Chli, Maria / Manso, Luis J. et al. | IEEE | 2023


    Heuristics prediction of olympic medals using machine learning

    Thirumalai, Chandrasegar / Monica, S / Vijayalakshmi, A | IEEE | 2017