In this work, we investigate a trajectory design problem in uplink unmanned aerial vehicles (UAVs)-enabled data collection system for massive time-sensitive Internet of Things (IoT) services. Although UAV has the advantages of automatic maneuverability and flexible mobility, it is challenging to guarantee the information freshness of collected data under the limited flying energy constraint. Thus we employ Age of Information (AoI) as a new metric to characterize the information freshness and formulate a joint power control and trajectory design optimization problem to minimize average AoI. In order to solve this non-convex problem, we decompose it as a power control subtask and trajectory design subtask, and propose a multi-agent deep reinforcement learning (DRL)-based scheme to solve the subtasks with independent state space, action space and reward function. Simulation results show that the proposed scheme can obtain better performance gain compared to the benchmark scheme and has the superior stability under different settings.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Joint Power Control and UAV Trajectory Design for Information Freshness via Deep Reinforcement Learning


    Contributors:
    Li, Xinmin (author) / Yin, Baolin (author) / Yan, Jiaxin (author) / Zhang, Xiaoqiang (author) / Wei, Ran (author)


    Publication date :

    2022-06-01


    Size :

    1162517 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Data Freshness and Energy-Efficient UAV Navigation Optimization: A Deep Reinforcement Learning Approach

    Abedin, Sarder Fakhrul / Munir, Md. Shirajum / Tran, Nguyen H. et al. | IEEE | 2021


    Data-efficient Deep Reinforcement Learning for Vehicle Trajectory Control

    Frauenknecht, Bernd / Ehlgen, Tobias / Trimpe, Sebastian | IEEE | 2023


    Learning to Schedule Joint Radar-Communication Requests for Optimal Information Freshness

    Lee, Joash / Niyato, Dusit / Guan, Yong Liang et al. | IEEE | 2021


    LEARNING TO SCHEDULE JOINT RADAR-COMMUNICATION REQUESTS FOR OPTIMAL INFORMATION FRESHNESS

    Lee, Joash / Niyato, Dusit / Guan, Yong Liang et al. | British Library Conference Proceedings | 2021


    DEEP REINFORCEMENT LEARNING BASED AGGRESSIVE FLIGHT TRAJECTORY TRACKER

    Shadeed, Omar / Hasanzade, Mehmet / Koyuncu, Emre | TIBKAT | 2021