In automated driving, pedestrian detection by sensors pose a particular challenge caused by smaller sizes than vehicles, occlusion through objects, and loose movement across the street geometry. Due to their vulnerability, analyzing and predicting pedestrian behavior and intention is vital when developing automated vehicles. However, while interpreting a pedestrian's intention is critical for path-planning algorithms, perception functions are more challenged by a pedestrian's pose and animation. Training machine learning models on unbalanced data sets that mainly consist of regular walking pedestrians may lead to the models' inability to detect pedestrians with anomalous body poses, such as during stumbling or falling. Recent work has been proposed to enhance data sets collected in real traffic by synthetic data generated by simulation software. The freedom inside a simulation framework allows a developer to test automated driving software in hazardous scenarios that may occur with less frequency in real traffic. With this work, we introduce a framework for generating manually defined pedestrian animations rarely recorded in real traffic. Using the CARLA simulation framework, we enhance the existing functionalities with a module to simulate pedestrian animations that differ from the already implemented standing, walking, and running. Additionally, we test the pedestrian animations for their impact on perception performance using a YOLOv5 object detector, custom trained on synthetic data.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Enhancing CARLA Traffic Simulation with Pedestrian Animation for Testing Perception Functions in Automated Driving




    Publication date :

    2023-09-24


    Size :

    2573944 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Generation of V2X messages from Carla Simulator for cooperative perception: Application to pedestrian safety

    Grosset, Juliette / Bonnin, Jean-Marie / Fougeres, Alain-Jerome et al. | IEEE | 2024


    Validation Method of a Self-Driving Architecture for Unexpected Pedestrian Scenario in CARLA Simulator

    Gutierrez, Rodrigo / Arango, J. Felipe / Gomez-Huelamo, Carlos et al. | IEEE | 2021


    Injecting Conflict Situations in Autonomous Driving Simulation Using CARLA

    Mihaylova, Tsvetomila / Reitmann, Stefan / Topp, Elin A. et al. | IEEE | 2025


    Injecting Conflict Situations in Autonomous Driving Simulation using CARLA

    Mihaylova, Tsvetomila / Reitmann, Stefan / Topp, Elin A. et al. | ArXiv | 2025

    Free access

    VALIDATION METHOD OF A SELF-DRIVING ARCHITECTURE FOR UNEXPECTED PEDESTRIAN SCENARIO IN CARLA SIMULATOR

    Gutiérrez, Rodrigo / Arango, J. Felipe / Gomez-Huélamo, Carlos et al. | British Library Conference Proceedings | 2021