For systems with complex and unstable dynamics, such as humanoids, the use of model-based control within a hierarchical framework remains the tool of choice. This is due to the challenges associated with applying model-free reinforcement learning on such problems, such as sample inefficiency and limits on exploration of state space in the absence of safety/stability guarantees. However, relying purely on physics-based models comes with its own set of problems. For instance, the necessary limits on expressiveness imposed by committing to fixed basis functions, and consequently, their limited ability to learn from data gathered on-line. This gap between theoretical models and real-world dynamics gives rise to a need to incorporate a learning component at some level within the model-based control framework. In this work, we present a highly redundant wheeled inverted-pendulum humanoid as a testbed for experimental validation of some recent approaches proposed to deal with these fundamental issues in the field of robotics, such as: 1. Semi-parametric Gaussian Process-based approaches to computed-torque control of serial robots [1] 2. Probabilistic Differential Dynamic Programming framework for trajectory planning by high-level controllers [2, 3] 3. Barrier Certificate based safe-learning approaches for data collection to learn the dynamics of inherently unstable systems [4]. We discuss how a typical model-based hierarchical control framework can be extended to incorporate approaches for learning at various stages of control design and hierarchy, based on the aforementioned tools.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Semi-parametric Approaches to Learning in Model-Based Hierarchical Control of Complex Systems


    Additional title:

    Springer Proceedings in Advanced Robotics



    Conference:

    International Symposium on Experimental Robotics ; 2018 ; Buenos Aires, Argentina November 05, 2018 - November 08, 2018



    Publication date :

    2020-01-23


    Size :

    11 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Semi-parametric Approaches to Learning in Model-Based Hierarchical Control of Complex Systems

    Zafar, Munzir / Mehmood, Areeb / Khan, Mouhyemen et al. | TIBKAT | 2020


    OCM-based parametric learning model

    ZACHARIAS, GREG / BRUN, HEIDI | AIAA | 1988


    Semi-Active Lateral Interconnected Air Suspension Hierarchical Control

    Sun, Li Qin ;Cui, Zhen | Trans Tech Publications | 2014


    A COMPARISON OF PARAMETRIC AND NON-PARAMETRIC MACHINE LEARNING APPROACHES FOR THE UNCERTAIN LAMBERT PROBLEM

    Gueho, Damien / Singla, Puneet / Melton, Robert G. et al. | TIBKAT | 2020