Safe operations of autonomous mobile robots in close proximity to humans, creates a need for enhanced trajectory tracking (with low tracking errors). Linear optimal control techniques such as Linear Quadratic Regulator (LQR) and Model Predictive Control (MPC) have been used successfully for low-speed applications while leveraging their model-based methodology with manageable computational demands. However, model and parameter uncertainties or other unmodeled nonlinearities may cause poor control actions and constraint violations. Nonlinear MPC has emerged as an alternate optimal-control approach but needs to overcome real-time deployment challenges (including fast sampling time, design complexity, and limited computational resources). In recent years, the optimal control-based deployments have benefitted enormously from the ability of Deep Neural Networks (DNNs) to serve as universal function approximators. This has led to deployments in a plethora of previously inaccessible applications – but many aspects of generalizability, benchmarking, and systematic verification and validation coupled with benchmarking have emerged. This paper presents a novel approach to fusing Deep Reinforcement Learning-based (DRL) longitudinal control with a traditional PID lateral controller for autonomous navigation. Our approach follows (i) Generation of an adequate fidelity simulation scenario via a Real2Sim approach; (ii) training a DRL agent within this framework; (iii) Testing the performance and generalizability on alternate scenarios. We use an initial tuned set of the lateral PID controller gains for observing the vehicle response over a range of velocities. Then we use a DRL framework to generate policies for an optimal longitudinal controller that successfully complements the lateral PID to give the best tracking performance for the vehicle.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Hybrid Reinforcement Learning based controller for autonomous navigation


    Contributors:


    Publication date :

    2022-06-01


    Size :

    950414 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Safe Deep Reinforcement Learning-Based Controller (SDRLC) for Autonomous Navigation of Planetary Rovers

    Jana, Ravi Kiran / Majumder, Rudrashis / K S, Bharathwaj et al. | IEEE | 2024


    Autonomous UAV Navigation Using Reinforcement Learning

    Pham, Huy X. / La, Hung M. / Feil-Seifer, David et al. | ArXiv | 2018

    Free access


    Autonomous Quantum Reinforcement Learning for Robot Navigation

    Mohan, Arjun / Jayabalan, Sudharsan / Mohan, Archana | Springer Verlag | 2016


    Autonomous vehicle navigation with deep reinforcement learning

    Cabañeros López, Àlex | BASE | 2019

    Free access