Reinforcement learning (RL) algorithms have been successfully used in the area of Intelligent Transportation Systems (ITS) for applications such as energy management strategies (EMS) of hybrid electric vehicles, autonomous driving, traffic light cycle control and bottleneck decongestion. In this work, we investigate a distributional RL algorithm on an EMS problem as a case study to show the benefits of estimating the uncertainty associated with different actions at different states. The uncertainty estimation is highly beneficial to ITS applications as randomness and uncertainty are intrinsic characteristics of real-world problems due to incomplete knowledge of the environment and the stochastic nature of some real-world systems and human behaviors. The modeled uncertainty has the form of a return distribution for taking an action at a certain state. We provide a case study to show that only considering the expected reward value would result in a loss of important information such as the spread. By modeling the return distribution, domain knowledge can be incorporated to make the results more interpretable. Also, risk-sensitive strategies can be developed to build more robust solutions using a chosen utility function.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Uncertainty Estimation with Distributional Reinforcement Learning for Applications in Intelligent Transportation Systems: A Case Study


    Contributors:


    Publication date :

    2019-10-01


    Size :

    1329539 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Uncertainty-Driven Distributional Reinforcement Learning for Flight Control

    Homola, Marek / Li, Yifei / Van Kampen, Erik-Jan | AIAA | 2025


    Reinforcement learning in intelligent transportation systems: recent developments

    Yu, Ye / Wang, Quanquan / Wang, Yukai et al. | British Library Conference Proceedings | 2021



    Distributional Reinforcement Learning For Automated Driving Vehicle

    Naveen, A M / Ravish, Roopa / Ranga Swamy, Shanta | IEEE | 2022


    ADDRESSING INHERENT UNCERTAINTY: RISK-SENSITIVE BEHAVIOR GENERATION FOR AUTOMATED DRIVING USING DISTRIBUTIONAL REINFORCEMENT LEARNING

    Bernhard, Julian / Pollok, Stefan / Knoll, Alois | British Library Conference Proceedings | 2019