The goal here is to design a path-planning algorithm to guide unmanned aerial vehicles (UAVs) for tracking multiple ground targets based on the theory of partially observable Markov decision processes (POMDPs). This study shows how to exploit the generality and flexibility of the POMDP framework by incorporating a variety of features of interest naturally into the framework, which is accomplished by plugging in the appropriate models. Specifically, this study shows how to incorporate the following features by appropriately formulating the POMDP action space, state-transition law, and objective function: (1) control UAVs with both forward acceleration and bank angle subject to constraints, (2) account for the effect of wind disturbance on UAVs, (3) avoid collisions between UAVs and obstacles and among UAVs, (4) track targets while evading threats, (5) track evasive targets, and (6) mitigate track swaps.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    UAV Guidance Algorithms via Partially Observable Markov Decision Processes



    Published in:

    Handbook of Unmanned Aerial Vehicles ; Chapter : 59 ; 1775-1810


    Publication date :

    2014-08-09


    Size :

    36 pages




    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Position validation strategies using partially observable Markov decision processes

    Kochenderfer, Mykel J. / Shih, Kevin J. / Chryssanthacopoulos, James P. et al. | IEEE | 2011

    Free access

    Signal Source Localization Using Partially Observable Markov Decision Processes

    Dressel, Louis K. / Kochenderfer, Mykel J. | AIAA | 2015


    Position validation strategies using partially observable Markov decision processes

    Kochenderfer, Mykel J. / Shih, Kevin J. / Chryssanthacopoulos, James P. et al. | IEEE | 2011


    Unmanned Aircraft Collision Avoidance Using Partially Observable Markov Decision Processes

    S. Temizer / M. J. Koehenderfer / L. P. Kaelbling et al. | NTIS | 2009