A multi-intelligence federated reinforcement learning (FRL)-based vehicle-road cooperative control system and method at the complex intersection use a vehicle-road cooperative control framework based on the Road Side Unit (RSU) static processing module and the vehicle-based dynamic processing module. The historical road information is supplied by the proposed RSU module. The Federated Twin Delayed Deep Deterministic policy gradient (FTD3) algorithm is proposed to connect the federated learning (FL) module and the reinforcement learning (RL) module. The FTD3 algorithm transmits only neural network parameters instead of vehicle samples to protect privacy. Firstly, FTD3 selects only specific networks for aggregation to reduce the communication cost. Secondly, FTD3 realizes the deep combination of FL and RL by aggregating target critic networks with smaller Q-values. Thirdly, RSU neural network participates in aggregation rather than training, and only shared global model parameters are used.


    Access

    Download


    Export, share and cite



    Title :

    Multi-intelligence federal reinforcement learning-based vehicle-road cooperative control system and method at complex intersection


    Contributors:
    CAI YINGFENG (author) / LU SIKAI (author) / CHEN LONG (author) / WANG HAI (author) / YUAN CHAOCHUN (author) / LIU QINGCHAO (author) / LI YICHENG (author)

    Publication date :

    2024-01-02


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS




    Multi-intersection signal cooperative control method based on deep reinforcement learning

    MA CHANGXI / LIU YAN / ZHAO HONGXING et al. | European Patent Office | 2025

    Free access


    Intersection signal-vehicle trajectory cooperative control method in vehicle-road cooperative environment

    YANG XIAOGUANG / LONG KEKE / MA CHENGYUAN et al. | European Patent Office | 2020

    Free access

    Vehicle-road cooperative traffic control system and method for intersection

    LIAN LANXIANG | European Patent Office | 2023

    Free access