We consider radio resource scheduling in a network of multiple non-coordinated in-X subnetworks which move with respect to each other. Each subnetwork is controlled by an independent agent, scheduling resources to devices within the subnetwork. The only information about decisions of other agents is through interference measurements which are non-stationary due to subnetwork mobility and fast fading effects. The agents aim is to serve the devices in their subnetwork with a fixed data rate and a high reliability. The problem is cast as a multi-agent non-stationary Markov Decision Process (MDP), with unknown transition functions. We approach the problem via Multi-Agent Deep Reinforcement Learning (DRL), leveraging Long Short Term Memory (LSTM) networks to handle the non-stationarity and Deep Deterministic Policy Gradient (DDPG) to manage high-dimensional continuous action spaces. Candidate actions given by DRL are quantized to discrete actions by a novel binary tree search method subject to reliability constraints. Simulation results indicate that the proposed LSTM-based DRL scheduling strategy outperforms strategies based on Feed Forward Neural Networks, Centralized Training with Decentralized Execution approaches found in the literature, and conventional heuristic approaches.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multi-Agent Reinforcement Learning Approach Scheduling for In-X Subnetworks


    Contributors:


    Publication date :

    2024-10-07


    Size :

    830847 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    Freight train scheduling via decentralised multi-agent deep reinforcement learning

    Bretas, Allan / Mendes, Alexandre / Chalup, Stephan K. | TIBKAT | 2021

    Free access


    An Analysis of Interfacing Between Signal Subnetworks

    Tsao, Shou-min | Online Contents | 1996


    Distributed charging station scheduling method and device based on multi-agent reinforcement learning

    LEI TIAN / WANG ZHENGZHUO / CHEN XIAOWEI et al. | European Patent Office | 2025

    Free access