An automated vehicle operating in an urban environment must be able to perceive and recognise objects and obstacles in a three-dimensional world for navigation and path planning. In order to plan and execute accurate and sophisticated driving maneuvers, a high-level contextual understanding of the surroundings is essential. Due to the recent progress in image processing, it is now possible to obtain high definition semantic information in 2D from monocular cameras, though cameras cannot reliably provide the high accuracy 3D information provided by lasers. The fusion of these two sensor modalities can overcome the shortcomings of each individual sensor, though there are a number of important challenges that need to be addressed in a probabilistic manner. In this paper we address the common, yet challenging, LIDAR/camera/semantic fusion problems which are seldom approached in a wholly probabilistic manner. Our approach is capable of using a multi-sensor platform to build a three-dimensional semantic voxelized map that considers the uncertainty of all of the processes involved. We present a probabilistic pipeline that incorporates uncertainty from the sensor readings (cameras, LIDAR, IMU and wheel encoders), compensation for the motion of the vehicle, and heuristic label probabilities for the semantic images depicted in Fig. 1. We also present a novel and efficient viewpoint validation algorithm to check for occlusions within the camera frame. A probabilistic projection is performed from the camera images to the LIDAR point cloud. Each labelled LIDAR scan then feeds into an octree map-building algorithm that updates the class probabilities of the map voxels every time a new observation is available. We validate our approach using a set of qualitative and quantitative experiments using the USyd Campus Dataset.1 These tests demonstrate the usefulness of a probabilistic sensor fusion approach by evaluating the performance of the perception system in a typical autonomous vehicle application.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Camera-LIDAR Integration: Probabilistic Sensor Fusion for Semantic Mapping


    Beteiligte:
    Berrio, Julie Stephany (Autor:in) / Shan, Mao (Autor:in) / Worrall, Stewart (Autor:in) / Nebot, Eduardo (Autor:in)


    Erscheinungsdatum :

    01.07.2022


    Format / Umfang :

    6228371 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Fusion of Camera and Lidar Data for Large Scale Semantic Mapping

    Westfechtel, Thomas / Ohno, Kazunori / Bezerra Neto, Ranulfo Plutarco et al. | IEEE | 2019


    Sensor Fusion of Camera and Lidar Using Kalman Filter

    Kunjumon, Reshma / Sangeetha Gopan, G. S. | Springer Verlag | 2021


    Robust Camera Lidar Sensor Fusion Via Deep Gated Information Fusion Network

    Kim, Jaekyum / Choi, Jaehyung / Kim, Yechol et al. | IEEE | 2018


    LIDAR-Camera Fusion Where LIDAR and Camera Validly See Different Things

    BLAU CHAIM / SPRINGER OFER / ROSENBLUM KEVIN et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    MetroLoc: Metro Vehicle Mapping and Localization With LiDAR-Camera-Inertial Integration

    Wang, Yusheng / Song, Weiwei / Wang, Yapeng et al. | IEEE | 2025