The invention discloses a highway key information intelligent extraction system based on multi-modal deep learning, which relates to the technical field of highway monitoring and comprises a cloud computing terminal, a data acquisition module, an edge computing module, an information extraction module and an early warning module. Multi-modal data of a plurality of road sections are acquired through a data acquisition module, and task load calculation and data preprocessing are performed on the multi-modal data of each road section through an edge calculation module so as to decide to perform cloud processing or local processing on the multi-modal data. The information extraction module extracts information of the multi-modal data of each road section after data preprocessing to obtain road key information of each road section, the road key information is encrypted and then transmitted to the early warning module, and the early warning module analyzes the data according to the road key information of each road section and sends the analyzed data to the early warning module. And the abnormal road section is positioned.
本发明公开了一种基于多模态深度学习的公路关键信息智能提取系统,涉及了公路监护技术领域,包括云计算终端、数据采集模块、边缘计算模块、信息提取模块以及预警模块。通过数据采集模块采集若干个公路区段各自的多模态数据,通过边缘计算模块对每个公路区段的多模态数据进行任务量计算以及数据预处理,以决定对多模态数据进行云端处理或本地处理,通过信息提取模块对每个公路区段数据预处理后的多模态数据进行信息提取,获得每个公路区段的公路关键信息,对公路关键信息进行加密后传输至预警模块,由预警模块根据每个公路区段的公路关键信息进行数据分析,以定位出存在异常的公路区段。
Highway key information intelligent extraction system based on multi-modal deep learning
一种基于多模态深度学习的公路关键信息智能提取系统
2025-04-29
Patent
Electronic Resource
Chinese
IPC: | H04L TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION , Übertragung digitaler Information, z.B. Telegrafieverkehr / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung |
Federal learning-based multi-modal highway congestion identification method and system
European Patent Office | 2023
|Intelligent traffic multi-modal information fusion system based on edge calculation
European Patent Office | 2024
|NTIS | 1996