In this paper, we propose the combined use of reinforcement learning and game theory to provide autonomous, distributed control of a Tactical Sensing Grid (TSG) consisting of multiple sensor platforms. This paper builds upon our previously reported successful, generalizable control of a single multi-modality sensor platform using online reinforcement learning. We use game theory to solve an assignment problem allocating sensor platforms to known targets in a scenario. We formulate this assignment problem as a potential game, a type of game for which multiple algorithms are known to converge to Nash equilibria. Our formulation guarantees that, under mild assumptions, all Nash equilibria result in all known targets being allocated to a given sensor. We leverage this potential game formulation to propose a method for optimizing situational awareness in a TSG that is robust to dynamic network topologies, where online reinforcement learning is used to control each individual sensor platform and game theory is used locally (in the geospatial sense) to allocate nearby sensor platforms to known targets in their vicinity. We present simulation results to illustrate how sensor node negotiations lead to near-optimal assignments of sensors to targets as scenarios evolve over time.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Multiagent Reinforcement Learning and Game-Theoretic Optimization for Autonomous Sensor Control


    Beteiligte:
    Ravier, Robert (Autor:in) / Garagic, Denis (Autor:in) / Galoppo, Travis (Autor:in) / Rhodes, Bradley J. (Autor:in) / Zulch, Peter (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    02.03.2024


    Format / Umfang :

    1521024 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    A Unified Game-Theoretic Approach to Multiagent Reinforcement Learning

    Lanctot, M / Zambaldi, V / Gruslys, A et al. | BASE | 2017

    Freier Zugriff

    Autonomous Bus Fleet Control Using Multiagent Reinforcement Learning

    Sung-Jung Wang / S. K. Jason Chang | DOAJ | 2021

    Freier Zugriff


    Feudal multiagent reinforcement learning for interdomain collaborative routing optimization

    Li, Zhuo / Zhou, Xu / De Turck, Filip et al. | BASE | 2022

    Freier Zugriff

    Multiagent reinforcement learning for autonomous driving in traffic zones with unsignalized intersections

    Spatharis, Christos / Blekas, Konstantinos | Taylor & Francis Verlag | 2024