Reinforcement learning (RL)-based energy management is one of the current hot spots of hybrid electric vehicles. Recent advances in RL-based energy management focus on energy-saving performance but less considers the constrained setting for training safety. This article proposes an RL framework named coach–actor–double-critic (CADC) for the optimization of energy management considered as the constrained Markov decision process (CMDP). A bilevel onboard controller includes a neural network (NN)-based strategy actor and rule-based strategy coach for online energy management. Once the output of the actor exceeds the constrained range of feasible solutions, the coach would take charge of energy management to ensure safety. By using the Lagrangian relaxation, the optimization for CMDP transforms into an unconstrained dual problem to minimize the energy consumption while minimizing the coach participation. The parameters of the actor are updated in a manner of policy gradient through RL training with the Lagrangian value function. Double-critic with the same structure synchronously estimates the value function to avoid overestimate bias. Several experiments with the bus trajectories data demonstrate the optimality, self-learning ability, and adaptability of CADC. The results indicate that CADC outperforms the existing RL-based strategies and reaches above 95% energy-saving rate of the off-line global optimum.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Deep Reinforcement Learning-Based Energy Management Framework With Lagrangian Relaxation for Plug-In Hybrid Electric Vehicle


    Beteiligte:
    Zhang, Hailong (Autor:in) / Peng, Jiankun (Autor:in) / Tan, Huachun (Autor:in) / Dong, Hanxuan (Autor:in) / Ding, Fan (Autor:in)


    Erscheinungsdatum :

    01.09.2021


    Format / Umfang :

    5094378 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Advanced Energy Management Strategies for Plug-In Hybrid Electric Vehicles via Deep Reinforcement Learning

    Mousa, Amr / Weiss, Gerhard Benedikt | British Library Conference Proceedings | 2022


    Hybrid electric vehicle adaptive energy management framework based on model reinforcement learning

    SHI CUIDUO / ZHAO KEGANG / LIANG ZHIHAO | Europäisches Patentamt | 2023

    Freier Zugriff


    Fuel cell hybrid electric vehicle energy management method based on deep reinforcement learning

    MA YAN / LUAN YU | Europäisches Patentamt | 2024

    Freier Zugriff