For a wireless avionics communication system, a Multi-arm bandit game is mathematically formulated, which includes channel states, strategies, and rewards. The simple case includes only two agents sharing the spectrum which is fully studied in terms of maximizing the cumulative reward over a finite time horizon. An Upper Confidence Bound (UCB) algorithm is used to achieve the optimal solutions for the stochastic Multi-Arm Bandit (MAB) problem. Also, the MAB problem can also be solved from the Markov game framework perspective. Meanwhile, Thompson Sampling (TS) is also used as benchmark to evaluate the proposed approach performance. Numerical results are also provided regarding minimizing the expectation of the regret and choosing the best parameter for the upper confidence bound.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Dynamic multi-arm bandit game based multi-agents spectrum sharing strategy design


    Contributors:
    Lu, Jingyang (author) / Li, Lun (author) / Shen, Dan (author) / Chen, Genshe (author) / Jia, Bin (author) / Blasch, Erik (author) / Pham, Khanh (author)


    Publication date :

    2017-09-01


    Size :

    1124305 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Multi-agent task assignment in the bandit framework

    Le Ny, J. / Dahleh, M. / Feron, E. | Tema Archive | 2006




    A multi-armed bandit framework for efficient UAV-based cooperative jamming coverage

    Cabezas, X. A. (X. A. F.) / Osorio, D. P. (D. P. M.) / Juntti, M. (M.) | BASE | 2023

    Free access