The invention discloses a real-time three-dimensional multi-machine conflict resolution method based on graph reinforcement learning, and the method comprises the steps: constructing a three-dimensional air traffic interaction scene, carrying out the modeling of the scene into a graph, and obtaining the convolution features of the graph as model input; and establishing a conflict buffer model, and designing a reward function to guide the aircraft to minimize an additional flight distance while ensuring a safety interval. A D3QN reinforcement learning algorithm is adopted for training, the optimal avoidance action of the aircraft is obtained, and real-time multi-aircraft conflict resolution in the high-density airspace is achieved.

    本发明公开了一种基于图强化学习的实时三维多机冲突解脱方法,本发明构建了三维空中交通交互场景并将其建模为图,获得图卷积特征作为模型输入。建立冲突缓冲模型,设计奖励函数引导航空器在保证安全间隔的同时最小化额外飞行距离。采用D3QN强化学习算法训练,获得航空器最佳避让动作,实现了高密度空域实时多机冲突解脱。


    Access

    Download


    Export, share and cite



    Title :

    Multi-machine real-time three-dimensional conflict resolution method based on graph reinforcement learning


    Additional title:

    一种基于图强化学习的多机实时三维冲突解脱方法


    Contributors:
    LI GUIYI (author) / LING-LONG SIYU (author) / OUYANG YUXIANG (author) / XU FUWANG (author)

    Publication date :

    2025-02-18


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    Graph Reinforcement Learning for Multi-Aircraft Conflict Resolution

    Li, Yumeng / Zhang, Yunhe / Guo, Tong et al. | IEEE | 2024


    Multi-UAV Conflict Resolution with Graph Convolutional Reinforcement Learning

    Isufaj, Ralvi / Omeri, Marsel / Piera, Miquel Angel | ArXiv | 2021

    Free access


    Utilizing Reinforcement Learning to Learn Safe Conflict Resolution

    Brandon Waddell / Swee Balachandran / Tanner Slagel et al. | NTRS | 2020