Cooperative perception algorithms based on fusing sensing data across multiple connected automated vehicles (CAVs) have shown promising performance to enhance the existing individual perception algorithm in terms of object detection tracking. However, existing cooperative perception algorithms are only developed offline given the constraints from data sharing and computational resources and none of them have been verified in real-time conditions. In this work, we propose a real-time cooperative perception framework called CooperFuse, which achieves cooperative perception in a late fusion scheme. Based on object detection and tracking results from individual vehicle, the late fusion cooperative perception algorithm considers object detection confidence score, kinematics, and dynamics consistency as well as scale consistency of detected objects. The algorithm computes the kinematic and dynamic consistency of the objects by solving for the energy consumption of inter-frame trajectories, and determines scale consistency by calculating inter-frame scale changes, enabling feature-based bounding box fusion. The experimental results demonstrate the real-time performance of the proposed algorithm and reveal its effective improvements in feature fusion and object detection accuracy when dealing with heterogeneous detection models across different cooperative intelligent agents.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    CooperFuse: A Real-Time Cooperative Perception Fusion Framework


    Contributors:
    Zheng, Zhaoliang (author) / Xia, Xin (author) / Gao, Letian (author) / Xiang, Hao (author) / Ma, Jiaqi (author)


    Publication date :

    2024-06-02


    Size :

    2022234 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    A Novel Probabilistic V2X Data Fusion Framework for Cooperative Perception

    Shan, Mao / Narula, Karan / Worrall, Stewart et al. | IEEE | 2022


    DETC2019-98001 Data Association and Fusion Framework for Decentralized Multi-Vehicle Cooperative Perception

    Yoon, DoHyun Daniel / Ali, G. G. Nawaz / Aylew, Beshah | British Library Conference Proceedings | 2019


    Sensor Fusion for Improved Cooperative Perception in CCAM

    Pinho, Hugo / Ferreira, Joaquim | IEEE | 2024


    Cooperative Perception System And Cooperative Perception Method

    LEE JUN HYUNG / KIM HYOUNG SOO / YANG IN CHUL | European Patent Office | 2024

    Free access

    Data Fusion with Split Covariance Intersection for Cooperative Perception

    Lima, Antoine / Bonnifait, Philippe / Cherfaoui, Veronique et al. | IEEE | 2021