Driving safety is a top priority for autonomous vehicles. Orthogonal to prior work handling accident-prone traffic events by algorithm designs at the policy level, we investigate a Closed-loop Adversarial Training (CAT) framework for safe end-to-end driving in this paper through the lens of environment augmentation. CAT aims to continuously improve the safety of driving agents by training the agent on safety-critical scenarios that are dynamically generated over time. A novel resampling technique is developed to turn log-replay real-world driving scenarios into safety-critical ones via probabilistic factorization, where the adversarial traffic generation is modeled as the multiplication of standard motion prediction sub-problems. Consequently, CAT can launch more efficient physical attacks compared to existing safety-critical scenario generation methods and yields a significantly less computational cost in the iterative learning pipeline. We incorporate CAT into the MetaDrive simulator and validate our approach on hundreds of driving scenarios imported from real-world driving datasets. Experimental results demonstrate that CAT can effectively generate adversarial scenarios countering the agent being trained. After training, the agent can achieve superior driving safety in both log-replay and safety-critical traffic scenarios on the held-out test set. Code and data are available at https://metadriverse.github.io/cat.


    Access

    Download


    Export, share and cite



    Title :

    CAT: Closed-loop Adversarial Training for Safe End-to-End Driving


    Contributors:
    Zhang, Linrui (author) / Peng, Zhenghao (author) / Li, Quanyi (author) / Zhou, Bolei (author)

    Publication date :

    2023


    Remarks:

    7th Conference on Robot Learning (CoRL 2023)


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Closed loop driving device

    PARK DAE YEOB / BAEK SEUNG CHAN / HWANG IL SOON et al. | European Patent Office | 2022

    Free access

    Intelligent driving function algorithm safe self-evolution method based on data closed loop

    ZENG XIANGRUI / WANG ZHUO / LI MIN et al. | European Patent Office | 2025

    Free access

    Automatic driving closed-loop information system

    CAO CHUMU / CAO JINMO / CAO CHUNGENG | European Patent Office | 2020

    Free access

    ITS for safe driving- Assistant system for Safe driving by Informative Supervision and Training

    Goshi, K. / Matsunaga, K. / Kuroki, D. et al. | Tema Archive | 2001