For task-nonspecific robot work in changing environment, most researches on developmental learning based on cognitive psychology advocate a staged developmental process and an explicit hierarchical action model. Though progress has been made by existing developmental learning approaches, there are still two open-ended inevitable problems: a) when numerous tasks are involved, the learning speed is not always satisfactory; b) when these tasks are not specified in advance, the hierarchical action model is hard to design beforehand or learn automatically. In order to solve these two problems, this paper proposes a new developmental reinforcement learning approach presented with its model and algorithms. In our model, any one of actor-critic learning models is encapsulated as a learning infrastructure to build an implicit action model called reward-policy mapping, and a self-motivated module is used for autonomous robots. The proposed approach efficaciously supports the implementation of an autonomous, interactive, cumulative and online learning process of task-nonspecific robots. The simulation results show that, to learn to perform nearly twenty thousand tasks, the proposed approach just needs half of the time that its counterpart, the actor-critic learning algorithm encapsulated, needs.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A developmental actor-critic reinforcement learning approach for task-nonspecific robot


    Contributors:
    Li, Xiaoan (author) / Yang, Yuan (author) / Sun, Yunming (author) / Zhang, Lu (author)


    Publication date :

    2016-08-01


    Size :

    231701 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    Actor-Critic Reinforcement Learning for Control With Stability Guarantee

    Han, M / Zhang, L / Wang, J et al. | BASE | 2020

    Free access

    Intrinsically Motivated Actor-Critic for Robot Motor Learning

    Hafez, Muhammad Burhan / Universität Hamburg / Universität Hamburg, Fakultät für Mathematik, Informatik und Naturwissenschaften et al. | TIBKAT | 2020


    Actor-Critic Reinforcement Learning Approach to Relative Motion Guidance in Near-Rectilinear Orbit

    Scorsoglio, Andrea / Furfaro, Roberto / Linares, Richard et al. | TIBKAT | 2019


    Improving Generalization of Reinforcement Learning with Minimax Distributional Soft Actor-Critic

    Ren, Yangang / Duan, Jingliang / Li, Shengbo Eben et al. | IEEE | 2020