Future communication subsystems of space exploration missions can potentially benefit from software-defined radios (SDRs) controlled by machine learning algorithms. In this paper, we propose a novel hybrid radio resource allocation management control algorithm that integrates multi-objective reinforcement learning and deep artificial neural networks. The objective is to efficiently manage communications system resources by monitoring performance functions with common dependent variables that result in conflicting goals. The uncertainty in the performance of thousands of different possible combinations of radio parameters makes the trade-off between exploration and exploitation in reinforcement learning (RL) much more challenging for future critical space-based missions. Thus, the system should spend as little time as possible on exploring actions, and whenever it explores an action, it should perform at acceptable levels most of the time. The proposed approach enables on-line learning by interactions with the environment and restricts poor resource allocation performance through ‘virtual environment exploration’. Improvements in the multi-objective performance can be achieved via transmitter parameter adaptation on a packet-basis, with poorly predicted performance promptly resulting in rejected decisions. Simulations presented in this work considered the DVB-S2 standard adaptive transmitter parameters and additional ones expected to be present in future adaptive radio systems. Performance results are provided by analysis of the proposed hybrid algorithm when operating across a satellite communication channel from Earth to GEO orbit during clear sky conditions. The proposed approach constitutes part of the core cognitive engine proof-of-concept to be delivered to the NASA Glenn Research Center SCaN Testbed located on-board the International Space Station.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multi-objective reinforcement learning-based deep neural networks for cognitive space communications




    Publication date :

    2017-06-01


    Size :

    2328747 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Multi-Objective Reinforcement Learning for Cognitive Radio-Based Satellite Communications

    Ferreira, Paulo Victor R. / Paffenroth, Randy / Wyglinski, Alexander M. et al. | NTRS | 2016


    Multi-Objective Reinforcement Learning for Cognitive Radio--Based Satellite Communications

    Ferreira, Paulo / Paffenroth, Randy / Wyglinski, Alexander et al. | AIAA | 2016


    MULTI-OBJECTIVE REINFORCEMENT LEARNING FOR COGNITIVE RADIO—BASED SATELLITE COMMUNICATIONS (AIAA 2016-5726)

    Ferreira, Paulo / Paffenroth, Randy / Wyglinski, Alexander et al. | British Library Conference Proceedings | 2016


    Reinforcement Learning Applied to Cognitive Space Communications

    Schubert, Carson D. / Roche, Rigoberto / Briones, Janette C. | IEEE | 2019


    Urban Driving with Multi-Objective Deep Reinforcement Learning

    Li, Changjian / Czarnecki, Krzysztof | ArXiv | 2018

    Free access