The invention discloses a real-time three-dimensional multi-machine conflict resolution method based on graph reinforcement learning, and the method comprises the steps: constructing a three-dimensional air traffic interaction scene, carrying out the modeling of the scene into a graph, and obtaining the convolution features of the graph as model input; and establishing a conflict buffer model, and designing a reward function to guide the aircraft to minimize an additional flight distance while ensuring a safety interval. A D3QN reinforcement learning algorithm is adopted for training, the optimal avoidance action of the aircraft is obtained, and real-time multi-aircraft conflict resolution in the high-density airspace is achieved.

    本发明公开了一种基于图强化学习的实时三维多机冲突解脱方法,本发明构建了三维空中交通交互场景并将其建模为图,获得图卷积特征作为模型输入。建立冲突缓冲模型,设计奖励函数引导航空器在保证安全间隔的同时最小化额外飞行距离。采用D3QN强化学习算法训练,获得航空器最佳避让动作,实现了高密度空域实时多机冲突解脱。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Multi-machine real-time three-dimensional conflict resolution method based on graph reinforcement learning


    Weitere Titelangaben:

    一种基于图强化学习的多机实时三维冲突解脱方法


    Beteiligte:
    LI GUIYI (Autor:in) / LING-LONG SIYU (Autor:in) / OUYANG YUXIANG (Autor:in) / XU FUWANG (Autor:in)

    Erscheinungsdatum :

    18.02.2025


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung



    Graph Reinforcement Learning for Multi-Aircraft Conflict Resolution

    Li, Yumeng / Zhang, Yunhe / Guo, Tong et al. | IEEE | 2024


    Multi-UAV Conflict Resolution with Graph Convolutional Reinforcement Learning

    Isufaj, Ralvi / Omeri, Marsel / Piera, Miquel Angel | ArXiv | 2021

    Freier Zugriff


    Utilizing Reinforcement Learning to Learn Safe Conflict Resolution

    Brandon Waddell / Swee Balachandran / Tanner Slagel et al. | NTRS | 2020