Low-latency instance segmentation of LiDAR point clouds is crucial in real-world applications because it serves as an initial and frequently-used building block in a robot’s perception pipeline, where every task adds further delay. Particularly in dynamic environments, this total delay can result in significant positional offsets of dynamic objects, as seen in highway scenarios. To address this issue, we employ a new technique, which we call continuous clustering. Unlike most existing clustering approaches, which use a full revolution of the LiDAR sensor, we process the data stream in a continuous and seamless fashion. Our approach does not rely on the concept of complete or partial sensor rotations with multiple discrete range images; instead, it views the range image as a single and infinitely horizontally growing entity. Each new column of this continuous range image is processed as soon it is available. Obstacle points are clustered to existing instances in real-time and it is checked at a high-frequency which instances are completed in order to publish them without waiting for the completion of the revolution or some other integration period. In the case of rotating sensors, no problematic discontinuities between the points of the end and the start of a scan are observed. In this work we describe the two-layered data structure and the corresponding algorithm for continuous clustering. It is able to achieve an average latency of just 5 ms with respect to the latest timestamp of all points in the cluster. We are publishing the source code at https://github.com/UniBwTAS/continuous_clustering.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Low Latency Instance Segmentation by Continuous Clustering for LiDAR Sensors


    Contributors:


    Publication date :

    2024-06-02


    Size :

    2630941 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Supervised Clustering for Radar Applications: On the Way to Radar Instance Segmentation

    Schumann, Ole / Hahn, Markus / Dickmann, Jurgen et al. | IEEE | 2018


    Instance Segmentation as Image Segmentation Annotation

    Watanabe, Thomio / Wolf, Denis F. | IEEE | 2019


    INSTANCE SEGMENTATION AS IMAGE SEGMENTATION ANNOTATION

    Watanabe, Thomio / Wolf, Denis F. | British Library Conference Proceedings | 2019


    Instance segmentation imaging system

    PHILION JONAH / ZHAO YIBIAO | European Patent Office | 2023

    Free access

    Instance segmentation imaging system

    PHILION JONAH / ZHAO YIBIAO | European Patent Office | 2020

    Free access