End to end learning systems are becoming increasingly common in autonomous driving research, from perception, to planning and control. In particular, distributed reinforcement learning systems have demonstrated their applicability to the intersection navigation scenario. Such systems learn via a scalar reward signal from the environment and its design is crucial to the overall performance at the task. In this paper, we investigate an alternative approach to achieving desirable behavior by instead applying constraints to the action spaces and policies of the agents while maintaining a relatively sparse reward regimen. Initial experiments in a simulation environment have demonstrated the efficacy of this approach with simple restrictions in a discrete action space when compared to traditional traffic signal controllers and other Q-learning MARL algorithms. The performance analysis suggest that a more flexible action restriction may be more appropriate but nonetheless validates the utility of the approach by minimising delay and time loss, which we hope will stimulate additional research in policy constraints for autonomous driving.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Constrained Multi-Agent Reinforcement Learning Policies for Cooperative Intersection Navigation and Traffic Compliance


    Contributors:


    Publication date :

    2023-09-24


    Size :

    507927 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Multi-agent reinforcement learning traffic signal cooperative control method considering intersection heterogeneity

    BIE YIMING / JI YUTING / JI JINHUA et al. | European Patent Office | 2024

    Free access




    Large-Scale Mixed-Traffic and Intersection Control using Multi-agent Reinforcement Learning

    Liu, Songyang / Fan, Muyang / Li, Weizi et al. | ArXiv | 2025

    Free access