The optimal control of nonlinear systems is traditionally obtained by the application of the Pontryagin minimum principle. Despite the success of this methodology in finding the optimal control for complex systems, the resulting open-loop trajectory is guaranteed to be only locally optimal. Furthermore, the computation of open-loop solutions is computationally intensive, which rules out its application in feedback controllers, reducing its robustness against disturbances. In principle, these issues can be addressed by solving the Hamilton–Jacobi–Bellman (HJB) partial differential equation (PDE). However, the space complexity of the problem is exponential with respect to the number of dimensions of the system. Moreover, the value function of the HJB equation may be nondifferentiable, which renders traditional PDE solution methods impractical. Therefore, extant methods are suitable only for special problem classes such as those involving affine systems or where the value function is differentiable. To deal with these issues, this work introduces a methodology for the solution of the HJB equation for general nonlinear systems that combines PDE viscosity solutions, quasi–Monte Carlo grids, and kriging regression to implement globally optimal nonlinear feedback controllers for practical applications. The effectiveness of the method is illustrated with smooth and nondifferentiable problems with finite and infinite horizons.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Optimal Nonlinear Control Using Hamilton–Jacobi–Bellman Viscosity Solutions on Unstructured Grids


    Contributors:

    Published in:

    Publication date :

    2020-01-01




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    A feedback optimal control by Hamilton–Jacobi–Bellman equation

    Zhu, Jinghao | British Library Online Contents | 2017


    The Minimum Principle and Hamilton–Jacobi–Bellman Equation

    Böhme, Thomas J. / Frank, Benjamin | Springer Verlag | 2017



    New Lambert Algorithm Using the Hamilton-Jacobi-Bellman Equation

    Bando, Mai / Yamakawa, Hiroshi | AIAA | 2010