Model-free reinforcement learning (RL) for legged locomotion commonly relies on a physics simulator that can accurately predict the behaviors of every degree of freedom of the robot. In contrast, approximate reduced-order models are commonly used for many model predictive control strategies. In this work we abandon the conventional use of high-fidelity dynamics models in RL and we instead seek to understand what can be achieved when using RL with a much simpler centroidal model when applied to quadrupedal locomotion. We show that RL-based control of the accelerations of a centroidal model is surprisingly effective, when combined with a quadratic program to realize the commanded actions via ground contact forces. It allows for a simple reward structure, reduced computational costs, and robust sim-to-real transfer. We show the generality of the method by demonstrating flat-terrain gaits, stepping-stone locomotion, two-legged in-place balance, balance beam locomotion, and direct sim-to-real transfer.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    GLiDE: Generalizable Quadrupedal Locomotion in Diverse Environments with a Centroidal Model


    Additional title:

    Springer Proceedings in Advanced Robotics


    Contributors:

    Conference:

    International Workshop on the Algorithmic Foundations of Robotics ; 2022 ; , MD, USA June 22, 2022 - June 24, 2022



    Publication date :

    2022-12-15


    Size :

    17 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    GLIiDE: Generalizable Quadrupedal Locomotion in Diverse Environments with a Centroidal Model

    Xie, Zhaoming / Da, Xingye / Babich, Buck et al. | TIBKAT | 2023


    Direct Centroidal Control for Balanced Humanoid Locomotion

    Ficht, Grzegorz / Behnke, Sven | TIBKAT | 2023


    Direct Centroidal Control for Balanced Humanoid Locomotion

    Ficht, Grzegorz / Behnke, Sven | Springer Verlag | 2022


    Playful DoggyBot: Learning Agile and Precise Quadrupedal Locomotion

    Duan, Xin / Zhuang, Ziwen / Zhao, Hang et al. | ArXiv | 2024

    Free access

    Quadrupedal locomotion based in a purely reflex controller

    Ferreira, Cesar / Matos, Vitor / Santos, Cristina P. et al. | IEEE | 2014