This article tackles the computational burden of propagating uncertainties in the model predictive controller-based policy of the probabilistic model-based reinforcement learning (MBRL) system for an unmanned surface vehicles system (USV). We proposed filtered probabilistic model predictive control using the unscented Kalman filter (FPMPC-UKF) that introduces the unscented Kalman filter (UKF) for a more efficient uncertainty propagation in MBRL. A USV control system based on FPMPC-UKF is developed and evaluated by position-keeping and target-reaching tasks in a real USV data-driven simulation. The experimental results demonstrate a significant superiority of the proposed method in balancing the control performance and computational burdens under different levels of disturbances compared with the related works of USV, and therefore indicate its potential in more challenging USV scenarios with limited computational resources.


    Access

    Download


    Export, share and cite



    Title :

    Efficient Uncertainty Propagation in Model-Based Reinforcement Learning Unmanned Surface Vehicle Using Unscented Kalman Filter


    Contributors:
    Jincheng Wang (author) / Lei Xia (author) / Lei Peng (author) / Huiyun Li (author) / Yunduan Cui (author)


    Publication date :

    2023




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Unscented Kalman Filter

    Zarchan, Paul / Musoff, Howard | AIAA | 2015


    Three-dimensional positioning of unmanned vehicle in field based on unscented Kalman Filter

    Li, Xiaolong / Zhang, Chi / Jin, Ma et al. | British Library Conference Proceedings | 2022



    Unscented Kalman filter for vehicle state estimation

    Antonov, S. / Fehn, A. / Kugi, A. | Taylor & Francis Verlag | 2011


    Unscented Kalman filter for vehicle state estimation

    Antonov,S. / Fehn,A. / Kugi,A. et al. | Automotive engineering | 2011