An open problem in hierarchical reinforcement learning is how to automatically generate hierarchies, e.g. options. We consider an immune clustering approach for automatic construction of options in a dynamic environment. The learning agent generates an undirected edge-weighted topological graph of the environment state transitions online. An immune clustering algorithm is then used to partition the state space. A second immune response algorithm is used to update the clusters when a new state being encountered later. Local strategies for reaching the different parts of the space are separately learned and added to the model in a form of options. By our approach, the options not only can be automatically generated but also can be dynamically updated.
Automatic option generation in hierarchical reinforcement learning via immune clustering
2006-01-01
2823841 byte
Conference paper
Electronic Resource
English
AUTONOMOUS BEHAVIOR GENERATION WITH HIERARCHICAL REINFORCEMENT LEARNING
European Patent Office | 2021
|European Patent Office | 2024
|Automatic driving method and device based on hierarchical reinforcement learning
European Patent Office | 2023
|Hierarchical Reinforcement Learning Under Mixed Observability
TIBKAT | 2023
|