The invention discloses a high-speed emergency lane occupation alarm method based on multi-mode large model area generation, and the method comprises the following steps: S10, building a multi-mode large model, building the multi-mode large model based on a Transform deep neural network, and carrying out the multi-mode large model; the multi-modal large model comprises a text information extraction module, a picture feature extraction module and a multi-modal feature fusion module; s20, collecting and processing picture data, collecting the picture data of the expressway, and manually labeling areas and describing picture information; s30, training a multi-modal large model; s40, emergency lane occupation warning is carried out; the method has the beneficial effects that the problems of high marking cost, low generalization performance, inflexibility and non-automation of emergency lane area generation in a high-speed scene are solved by using the multi-modal large model.

    本发明公开了一种基于多模态大模型区域生成的高速应急车道占用告警方法,该方法包括以下步骤:S10、多模态大模型的搭建,基于Transformer深度神经网络搭建多模态大模型,所述多模态大模型包括文本信息提取模块、图片特征提取模块以及多模态特征融合模块;S20、图片数据的收集和处理,收集高速公路的图片数据,并通过人工标注区域和描述图片信息;S30、多模态大模型的训练;S40、应急车道占用告警;本发明的有益效果是:利用多模态大模型解决在高速场景下应急车道区域生成的标注成本高、泛化性能低、不灵活、不自动化的问题。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    High-speed emergency lane occupation alarm method based on multi-mode large model region generation


    Weitere Titelangaben:

    基于多模态大模型区域生成的高速应急车道占用告警方法


    Beteiligte:
    LIN ZHIKUN (Autor:in) / JIANG YING (Autor:in) / CAI ZHONGPENG (Autor:in) / HE YIBING (Autor:in) / ZHANG SHENLI (Autor:in)

    Erscheinungsdatum :

    13.12.2024


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G06V / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    Emergency lane occupation identification method and device

    WEI DONGDONG / LU XIAODONG | Europäisches Patentamt | 2021

    Freier Zugriff

    Emergency lane occupation behavior management system based on AI

    GE JIANHUI | Europäisches Patentamt | 2024

    Freier Zugriff

    High-speed emergency lane occupation prevention system with electric vehicle battery gradient utilization technology

    LIU ZONGFENG / LIU HONGSHUO / WANG NINGNING et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Alarm device and method based on emergency hedge lane

    WANG YONGFEI / SHEN SHIZHAO / TU XIAOBING et al. | Europäisches Patentamt | 2020

    Freier Zugriff

    Recognition and analysis equipment applied to emergency lane occupation

    SHANG ZIJUN / SHANG SHANG'EN / PENG ZUNXUAN et al. | Europäisches Patentamt | 2022

    Freier Zugriff