Real-time object tracking on a drone under a dynamic environment has been a challenging issue for many years, with existing approaches using off-line calculation or powerful computation units on board. This paper presents a new lightweight real-time onboard object tracking approach with multi-inertial sensing data, wherein a highly energy-efficient drone is built based on the Snapdragon flight board of Qualcomm. The flight board uses a digital signal processor core of the Snapdragon 801 processor to realize PX4 autopilot, an open-source autopilot system oriented toward inexpensive autonomous aircraft. It also uses an ARM core to realize Linux, robot operating systems, open-source computer vision library, and related algorithms. A lightweight moving object detection algorithm is proposed that extracts feature points in the video frame using the oriented FAST and rotated binary robust independent elementary features algorithm and adapts a local difference binary algorithm to construct the image binary descriptors. The K-nearest neighbor method is then used to match the image descriptors. Finally, an object tracking method is proposed that fuses inertial measurement unit data, global positioning system data, and the moving object detection results to calculate the relative position between coordinate systems of the object and the drone. All the algorithms are run on the Qualcomm platform in real time. Experimental results demonstrate the superior performance of our method over the state-of-the-art visual tracking method.
Real-Time Object Tracking on a Drone With Multi-Inertial Sensing Data
IEEE Transactions on Intelligent Transportation Systems ; 19 , 1 ; 131-139
2018-01-01
2006874 byte
Article (Journal)
Electronic Resource
English
Drone Detection and Tracking in Real-Time by Fusion of Different Sensing Modalities
DOAJ | 2022
|Weather Drone for real time 3D AQI sensing
IEEE | 2024
|Object tracking method using multi-camera based drone and object tracking system using the same
European Patent Office | 2023
Object tracking method using multi-camera based drone and object tracking system using the same
European Patent Office | 2022
|