Most reinforcement learning approaches used in behavior generation utilize vectorial information as input. However, this requires the network to have a pre-defined input-size – in semantic environments this means assuming the maximum number of vehicles. Additionally, this vectorial representation is not invariant to the order and number of vehicles. To mitigate the above-stated disadvantages, we propose combining graph neural networks with actor-critic reinforcement learning. As graph neural networks apply the same network to every vehicle and aggregate incoming edge information, they are invariant to the number and order of vehicles. This makes them ideal candidates to be used as networks in semantic environments – environments consisting of objects lists. Graph neural networks exhibit some other advantages that make them favorable to be used in semantic environments. The relational information is explicitly given and does not have to be inferred. Moreover, graph neural networks propagate information through the network and can gather higher-degree information. We demonstrate our approach using a highway lane-change scenario and compare the performance of graph neural networks to conventional ones. We show that graph neural networks are capable of handling scenarios with a varying number and order of vehicles during training and application.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Graph Neural Networks and Reinforcement Learning for Behavior Generation in Semantic Environments


    Contributors:


    Publication date :

    2020-10-19


    Size :

    252839 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Automatic Intersection Management in Mixed Traffic Using Reinforcement Learning and Graph Neural Networks

    Klimke, Marvin / Völz, Benjamin / Buchholz, Michael | ArXiv | 2023

    Free access

    Reinforcement learning of dynamic behavior by using recurrent neural networks

    Onat, A. / Kita, H. / Nishikawa, Y. | British Library Online Contents | 1997




    AUTONOMOUS BEHAVIOR GENERATION WITH HIERARCHICAL REINFORCEMENT LEARNING

    SOLEYMAN SEAN / KHOSLA DEEPAK | European Patent Office | 2021

    Free access