In this paper, we propose the combined use of reinforcement learning and game theory to provide autonomous, distributed control of a Tactical Sensing Grid (TSG) consisting of multiple sensor platforms. This paper builds upon our previously reported successful, generalizable control of a single multi-modality sensor platform using online reinforcement learning. We use game theory to solve an assignment problem allocating sensor platforms to known targets in a scenario. We formulate this assignment problem as a potential game, a type of game for which multiple algorithms are known to converge to Nash equilibria. Our formulation guarantees that, under mild assumptions, all Nash equilibria result in all known targets being allocated to a given sensor. We leverage this potential game formulation to propose a method for optimizing situational awareness in a TSG that is robust to dynamic network topologies, where online reinforcement learning is used to control each individual sensor platform and game theory is used locally (in the geospatial sense) to allocate nearby sensor platforms to known targets in their vicinity. We present simulation results to illustrate how sensor node negotiations lead to near-optimal assignments of sensors to targets as scenarios evolve over time.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multiagent Reinforcement Learning and Game-Theoretic Optimization for Autonomous Sensor Control


    Contributors:


    Publication date :

    2024-03-02


    Size :

    1521024 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    A Unified Game-Theoretic Approach to Multiagent Reinforcement Learning

    Lanctot, M / Zambaldi, V / Gruslys, A et al. | BASE | 2017

    Free access

    Autonomous Bus Fleet Control Using Multiagent Reinforcement Learning

    Sung-Jung Wang / S. K. Jason Chang | DOAJ | 2021

    Free access


    Feudal multiagent reinforcement learning for interdomain collaborative routing optimization

    Li, Zhuo / Zhou, Xu / De Turck, Filip et al. | BASE | 2022

    Free access

    Multiagent reinforcement learning for autonomous driving in traffic zones with unsignalized intersections

    Spatharis, Christos / Blekas, Konstantinos | Taylor & Francis Verlag | 2024