The invention discloses a highway key information intelligent extraction system based on multi-modal deep learning, which relates to the technical field of highway monitoring and comprises a cloud computing terminal, a data acquisition module, an edge computing module, an information extraction module and an early warning module. Multi-modal data of a plurality of road sections are acquired through a data acquisition module, and task load calculation and data preprocessing are performed on the multi-modal data of each road section through an edge calculation module so as to decide to perform cloud processing or local processing on the multi-modal data. The information extraction module extracts information of the multi-modal data of each road section after data preprocessing to obtain road key information of each road section, the road key information is encrypted and then transmitted to the early warning module, and the early warning module analyzes the data according to the road key information of each road section and sends the analyzed data to the early warning module. And the abnormal road section is positioned.

    本发明公开了一种基于多模态深度学习的公路关键信息智能提取系统,涉及了公路监护技术领域,包括云计算终端、数据采集模块、边缘计算模块、信息提取模块以及预警模块。通过数据采集模块采集若干个公路区段各自的多模态数据,通过边缘计算模块对每个公路区段的多模态数据进行任务量计算以及数据预处理,以决定对多模态数据进行云端处理或本地处理,通过信息提取模块对每个公路区段数据预处理后的多模态数据进行信息提取,获得每个公路区段的公路关键信息,对公路关键信息进行加密后传输至预警模块,由预警模块根据每个公路区段的公路关键信息进行数据分析,以定位出存在异常的公路区段。


    Access

    Download


    Export, share and cite



    Title :

    Highway key information intelligent extraction system based on multi-modal deep learning


    Additional title:

    一种基于多模态深度学习的公路关键信息智能提取系统


    Contributors:
    LIU CONGYANG (author) / LI HAIFENG (author) / ZHANG HAIXIA (author) / HAO ZHIGANG (author) / YANG ZHAOTIAN (author) / ZHANG YICHAO (author) / WU YUNWEI (author) / ZHAO XIAOYU (author) / CUI GAIMEI (author) / SHANG WEI (author)

    Publication date :

    2025-04-29


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    H04L TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION , Übertragung digitaler Information, z.B. Telegrafieverkehr / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung



    Federal learning-based multi-modal highway congestion identification method and system

    YAO LINGYUN / ZOU YING / GUO JIANPING et al. | European Patent Office | 2023

    Free access

    Evidential deep learning-based multi-modal environment perception for intelligent vehicles

    Geletu, Mihreteab Negash / Giurgi, Danut-Vasile / Josso-Laurain, Thomas et al. | IEEE | 2023



    Intelligent traffic multi-modal information fusion system based on edge calculation

    SU SHIPENG / ZHOU JUN / JIANG JIANLI et al. | European Patent Office | 2024

    Free access