With the adoption of autonomous vehicles on our roads, we will witness a mixed-autonomy environment where autonomous and human-driven vehicles must learn to co-exist by sharing the same road infrastructure. To attain socially-desirable behaviors, autonomous vehicles must be instructed to consider the utility of other vehicles around them in their decision-making process. Particularly, we study the maneuver planning problem for autonomous vehicles and investigate how a decentralized reward structure can induce altruism in their behavior and incentivize them to account for the interest of other autonomous and human-driven vehicles. This is a challenging problem due to the ambiguity of a human driver's willingness to cooperate with an autonomous vehicle. Thus, in contrast with the existing works which rely on behavior models of human drivers, we take an end-to-end approach and let the autonomous agents to implicitly learn the decision-making process of human drivers only from experience. We introduce a multi-agent variant of the synchronous Advantage Actor-Critic (A2C) algorithm and train agents that coordinate with each other and can affect the behavior of human drivers to improve traffic flow and safety.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Altruistic Maneuver Planning for Cooperative Autonomous Vehicles Using Multi-agent Advantage Actor-Critic


    Beteiligte:
    Toghi, Behrad (Autor:in) / Valiente, Rodolfo (Autor:in) / Sadigh, Dorsa (Autor:in) / Pedarsani, Ramtin (Autor:in) / Fallah, Yaser P. (Autor:in)

    Erscheinungsdatum :

    2021


    Anmerkungen:

    Accepted to 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021) - Workshop on Autonomous Driving: Perception, Prediction and Planning


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Actor-Critic Policy Learning in Cooperative Planning

    Redding, Joshua / Geramifard, Alborz / Choi, Han-Lim et al. | AIAA | 2010


    Actor-Critic Policy Learning in Cooperative Planning

    Redding, J. / Geramifard, A. / Choi, H.-L. et al. | British Library Conference Proceedings | 2010


    Factored Multi-Agent Soft Actor-Critic for Cooperative Multi-Target Tracking of UAV Swarms

    Longfei Yue / Rennong Yang / Jialiang Zuo et al. | DOAJ | 2023

    Freier Zugriff


    Fast Maneuver Planning for Cooperative Automated Vehicles

    Heb, Daniel / Lattarulo, Ray / Perez, Joshue et al. | IEEE | 2018