In this paper, we present an end-to-end real-time detection and collision avoidance framework in an autonomous vehicle using a monocular RGB camera. The proposed system is able to run on embedded hardware in the vehicle to perform real-time detection of small objects. RetinaNet architecture with ResNet50 backbone is used to develop the object detection model using RGB images. A quantized version of the object detection inference model is implemented in the vehicle using NVIDIA Jetson AGX Xavier. A geometric method is used to estimate the distance to the detected object which is forwarded to a MicroAutoBox device that implements the control system of the vehicle and is responsible for maneuvering around the detected objects. The pipeline is implemented on a passenger vehicle and demonstrated in challenging conditions using different obstacles on a predefined set of waypoints. Our results show that the system is capable of detecting objects that appear in an image area as small as 20×30 pixels in a 1280×720 image and can run at a speed of 24 frames per second (FPS) on the embedded device in the vehicle. A data analyzer is also employed to visualize the real-time performance of the system.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Real-time Detection and Avoidance of Obstacles in the Path of Autonomous Vehicles Using Monocular RGB Camera


    Weitere Titelangaben:

    Sae Int. J. Adv. and Curr. Prac. in Mobility


    Beteiligte:

    Kongress:

    WCX SAE World Congress Experience ; 2022



    Erscheinungsdatum :

    29.03.2022


    Format / Umfang :

    11 pages




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Print


    Sprache :

    Englisch




    Real-time Detection and Avoidance of Obstacles in the Path of Autonomous Vehicles Using Monocular RGB Camera

    Mallik, Apurbaa / Gaopande, Meghana Laxmidhar / Singh, Gurjeet et al. | British Library Conference Proceedings | 2022


    Basic Micro-Aerial Vehicles (MAVs) obstacles avoidance using monocular computer vision

    Kong, Lim-Kwan / Sheng, Jie / Teredesai, Ankur | IEEE | 2014


    OBSTACLE AVOIDANCE USING A MONOCULAR CAMERA

    Hatch, Kyle / Mern, John M. / Kochenderfer, Mykel J. | TIBKAT | 2021


    Obstacle Avoidance Using a Monocular Camera

    Hatch, Kyle / Mern, John M. / Kochenderfer, Mykel J. | AIAA | 2021


    Real-time Obstacles Avoidance for Vehicles in the Urban Grand Challenge

    Jian Yang / Zhihua Qu / Jing Wang et al. | AIAA | 2007