UAV has become a promising development direction in 5G era because of its flexible deployment and economic efficiency. UAV with communication function can serve many scenes, such as traffic congestion, limited base station conditions, emergency rescue and so on. However, UAV has limited airborne energy, throughput and energy efficiency are the main bottlenecks of UAV as an air base station. Based on the consideration of various factors such as channel, user, UAV speed and transmission power, this paper constructs a reinforcement learning model for UAV energy efficiency, and puts forward the description of environment matrix to quantify the environmental parameters and participate in the action value evaluation. Firstly, based on the existing conditions, a constrained model is established to maximize the information throughput per unit energy consumption by combining historical empirical data with the exploration of a certain degree of freedom. In addition, we establish strong constraints on UAV energy to avoid unnecessary consumption as much as possible. The experimental results show that the algorithm proposed in this paper shows good performance in the simulation stage and excellent stability in the open environment.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Trajectory design for energy efficiency maximization in UAV based on reinforcement learning


    Contributors:
    Cheng, Qianqian (author) / Su, Yu (author) / Qiu, Yuhe (author) / Zhou, Jian (author) / Wang, Shuijie (author)

    Conference:

    7th International Symposium on Advances in Electrical, Electronics, and Computer Engineering ; 2022 ; Xishuangbanna,China


    Published in:

    Proc. SPIE ; 12294 ; 122943G


    Publication date :

    2022-10-19





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Reinforcement Learning-Based Solar Sail Trajectory Design

    Yuan, Hao / Zhong, Zikai / Wang, Jie et al. | IEEE | 2024



    Cognitive Radio Network Throughput Maximization with Deep Reinforcement Learning

    Ong, Kevin Shen Hoong / Zhang, Yang / Niyato, Dusit | IEEE | 2019


    A Fairness-Aware UAV Trajectory Design with Reinforcement Learning

    Xu, Bowei / Peng, Liang / Wang, Xiaoxiang et al. | Springer Verlag | 2022