As part of the DARPA Assured Autonomy program, our team has developed or evaluated a number of technologies to address gaps in traditional hardware and software assurance processes that make it difficult or impossible to demonstrate the correctness and safety of machine learning (ML) components. These include new approaches for testing and completeness metrics, formal analysis of neural networks, input domain shift assessment, and run-time monitoring and enforcement architectures. Although many of these tools and methods were successfully applied to demonstration platforms, most have not been evaluated on real-world product development efforts in a certification context. In this paper, we describe our evaluation of these new assurance methods and tools applied to ML-based systems that will soon be undergoing certification.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Evaluation of New Assurance Tools for Airborne Machine Learning-Based Functions


    Contributors:


    Publication date :

    2024-09-29


    Size :

    1007177 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Toward Design Assurance of Machine-Learning Airborne Systems

    Dmitriev, Konstantin / Schumann, Johann / Holzapfel, Florian | TIBKAT | 2022


    Toward Design Assurance of Machine-Learning Airborne Systems

    Dmitriev, Konstantin / Schumann, Johann / Holzapfel, Florian | AIAA | 2022


    Towards Design Assurance Level C for Machine-Learning Airborne Applications

    Dmitriev, Konstantin / Schumann, Johann / Holzapfel, Florian | IEEE | 2022


    Safety Assurance of Machine Learning for Perception Functions

    Burton, Simon / Hellert, Christian / Hüger, Fabian et al. | Springer Verlag | 2022

    Free access

    Performance evaluation of airborne separation assurance for free flight

    Bilimoria, Karl / Sheth, Kapil / Lee, Hilda et al. | AIAA | 2000