Due to the immense testing effort, the development and release of automated driving functions is increasingly dependent on simulations in addition to real world testing. In order to trust the simulation results, the deviations have to be quantified compared to tests on real roads. That is a prerequisite to decide if the required simulation fidelity is achieved or not. Therefore, several single quantitative and qualitative metrics are combined in this work to a multivariate scoring value for scenario-based testing in virtual environments. The approach focuses on deviations of the driven trajectories as well as the conducted maneuvers and the criticality in the traffic situations. However, the built framework for quantifying the gap compared to real world testing is generally formulated to be extendable for further features. Furthermore, scoring levels are introduced for classification. The practicable usage of the defined metric is demonstrated based on a resimulation of a scenario extracted from real driving data. The results are classified and thus the deviations are interpretable according to the used weighting factors.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Towards a Multivariate Scoring Metric for the Evaluation of Simulation Scenarios in Automated Driving


    Contributors:


    Publication date :

    2022-10-08


    Size :

    715259 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Formulating a dissimilarity metric for comparison of driving scenarios for Automated Driving Systems

    Mahadikar, Bharath Bhaskar / Rajesh, Nishant / Kurian, Kevin Tom et al. | IEEE | 2024


    Towards threat metric evaluation in complex urban scenarios

    Schneider, Patrick / Butz, Martin / Heinzemann, Christian et al. | IEEE | 2021


    DRIVING SIMULATION SCORING SYSTEM

    DEAKINS CHUCK / MARTIN WILLIAM / STALEY TRAVIS et al. | European Patent Office | 2019

    Free access

    Driving simulation scoring system

    DEAKINS CHUCK / MARTIN WILLIAM / STALEY TRAVIS et al. | European Patent Office | 2022

    Free access

    Model Predictive Instantaneous Safety Metric for Evaluation of Automated Driving Systems

    Weng, Bowen / Rao, Sughosh J. / Deosthale, Eeshan et al. | IEEE | 2020