Despite the recent developments in obstacle avoidance and other safety features, autonomous Unmanned Aerial Vehicles (UAVs) continue to face safety challenges. No previous work investigated the relationship between the behavioral uncertainty of a UAV, characterized in this work by inconsistent or erratic control signal patterns, and the unsafety of its flight. By quantifying uncertainty, it is possible to develop a predictor for unsafety, which acts as a flight supervisor. We conducted a large-scale empirical investigation of safety violations using PX4-Autopilot, an open-source UAV software platform. Our dataset of over 5,000 simulated flights, created to challenge obstacle avoidance, allowed us to explore the relation between uncertain UAV decisions and safety violations: up to 89% of unsafe UAV states exhibit significant decision uncertainty, and up to 74% of uncertain decisions lead to unsafe states. Based on these findings, we implemented Superialist (Supervising Autonomous Aerial Vehicles), a runtime uncertainty detector based on autoencoders, the state-of-the-art technology for anomaly detection. Superialist achieved high performance in detecting uncertain behaviors with up to 96% precision and 93% recall. Despite the observed performance degradation when using the same approach for predicting unsafety (up to 74% precision and 87% recall), Superialist enabled early prediction of unsafe states up to 50 seconds in advance.


    Access

    Download


    Export, share and cite



    Title :

    When Uncertainty Leads to Unsafety: Empirical Insights into the Role of Uncertainty in Unmanned Aerial Vehicle Safety



    Publication date :

    2025


    Remarks:

    39 pages


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Road Unsafety - Social Costs

    Zukowska, J. | British Library Conference Proceedings | 2005


    Robust adaptive control of quadrotor unmanned aerial vehicle with uncertainty

    Islam, S. / Faraz, M. / Ashour, R. K. et al. | IEEE | 2015


    Modelling road unsafety by a system approach

    Lassarre, S. / Institut National de Recherche sur les Transports et leur Securite | British Library Conference Proceedings | 1989