Nano-size unmanned aerial vehicles (UAVs), with few centimeters of diameter and sub-10 Watts of total power budget, have so far been considered incapable of running sophisticated visual-based autonomous navigation software without external aid from base-stations, ad-hoc local positioning infrastructure, and powerful external computation servers. In this work, we present what is, to the best of our knowledge, the first 27g nano-UAV system able to run aboard an end-to-end, closed-loop visual pipeline for autonomous navigation based on a state-of-the-art deep-learning algorithm, built upon the open-source CrazyFlie 2.0 nano-quadrotor. Our visual navigation engine is enabled by the combination of an ultra-low power computing device (the GAP8 system-on-chip) with a novel methodology for the deployment of deep convolutional neural networks (CNNs). We enable onboard real-time execution of a state-of-the-art deep CNN at up to 18Hz. Field experiments demonstrate that the system's high responsiveness prevents collisions with unexpected dynamic obstacles up to a flight speed of 1.5m/s. In addition, we also demonstrate the capability of our visual navigation engine of fully autonomous indoor navigation on a 113m previously unseen path. To share our key findings with the embedded and robotics communities and foster further developments in autonomous nano-UAVs, we publicly release all our code, datasets, and trained networks.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    An Open Source and Open Hardware Deep Learning-Powered Visual Navigation Engine for Autonomous Nano-UAVs


    Beteiligte:

    Erscheinungsdatum :

    01.01.2019



    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Open-Source Hardware/Software Architecture for Autonomous Powerline-Aware Drone Navigation and Recharging

    Nyboe, Frederik Falk / Malle, Nicolaj Haarhoj / Hoang, Viet Duong et al. | IEEE | 2023


    Visual Navigation of UAVs in Indoor Corridor Environments using Deep Learning

    Akremi, Mohamed Sanim / Neji, Najett / Tabia, Hedi | IEEE | 2023



    An Open-Source Framework to Design, Tune, and Fly Nonlinear Control Systems for Autonomous UAVs

    Gramuglia, Mattia / Kumar, Giri Mugundan / Orlando, Giorgio A. et al. | AIAA | 2025


    Open Source Integrated Planner for Autonomous Navigation in Highly Dynamic Environments

    Darweesh, Hatem / Takeuchi, Eijiro / Takeda, Kazuya et al. | British Library Online Contents | 2017