In the 5G NR and 6G, vehicle-to-everything (V2X) communication has emerged as a crucial technology. In this paper, we present a novel task-oriented communications (ToC) approach that employs large multi-modal models (LMMs) for V2X tasks such as traffic management. The key idea of the proposed multi-modal task-oriented communications (MMToC) is to extract essential information relevant to vehicular tasks from the various sensing data, integrate the information, and infer the output of vehicular tasks using LMMs. Unlike traditional communication methods focusing on bit-level metrics such as bits per second and error rate, MMToC enhances task efficiency and performance by optimizing information transmission methods for specific vehicular tasks. MMToC exchanges only the essential feature vectors needed for vehicular tasks, thereby reducing communication overhead and improving task performance. Numerical results demonstrate that the proposed MMToC technique significantly increases average vehicle speed by more than 40% compared to conventional methods.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Task-oriented V2X Communications using Large Multi-modality Model


    Contributors:


    Publication date :

    2024-10-07


    Size :

    27341487 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Multi-Task Cross-Modality Attention-Fusion for 2D Object Detection

    Sun, Huawei / Feng, Hao / Stettinger, Georg et al. | IEEE | 2023


    Task-Oriented Semantic Communications for Speech Transmission

    Weng, Zhenzi / Qin, Zhijin / Tao, Xiaoming | IEEE | 2023


    Task Demand Oriented Lite Edge Communications for IoT

    Zhang, Junying / Du, Qinghe / Ren, Yijing et al. | IEEE | 2024


    DEFECT DETECTION USING MULTI-MODALITY SENSOR DATA

    TANG LUAN / CHEN YUNCONG / CHENG WEI et al. | European Patent Office | 2024

    Free access

    Machine Learning Multi-Modality Fusion Approaches Outperform Single-Modality & Traditional Approaches

    Garagic, Denis / Pelgrift, Daniel / Peskoe, Jacob et al. | IEEE | 2021