The invention provides a cloud intelligent driving control system based on a multi-modal large model, and belongs to the technical field of automatic driving. The system comprises a cloud multi-modal large model analysis and control module, a real-time remote driving takeover module, an advanced prediction and risk avoidance module, a cloud intelligent driving collaboration and optimization module, a multi-modal fault diagnosis and remote repair module and a real-time communication and interaction enhancement module. The system realizes cloud remote monitoring and control of the autonomous vehicle through interaction and cooperation among different modules, and assists the autonomous vehicle through remote control, so that the autonomous vehicle runs more safely; the early prediction and risk avoidance module of the system sets the prediction of the sight line of the vehicle and the prediction of the sight line of the vehicle, and sets corresponding prediction methods for the vehicles in two different environments for prediction in a mode of extracting different matrix samples, so that the prediction accuracy of the cloud system and the safety of the automatic driving vehicle are improved.

    本发明提出了基于多模态大模型的云端智能驾驶控制系统,属于自动驾驶技术领域,该系统包括云端多模态大模型分析与控制模块、实时远程驾驶接管模块、提前预测与躲避风险模块、云端智能驾驶协同与优化模块、多模态故障诊断与远程修复模块和实时通信与增强互动模块;该系统通过不同模块之间的交互和协同实现云端远程对自动驾驶车辆的监测和控制,通过远程控制辅助自动驾驶车辆,使得自动驾驶车辆行驶更安全;该系统的提前预测与躲避风险模块通过设置超车辆视线的预测和车辆视线的预测,通过提取不同矩阵样本的方式分别对两种不同环境的车辆设置对应的预测方法进行预测,增加了云端系统预测的准确性和自动驾驶车辆的安全性。


    Access

    Download


    Export, share and cite



    Title :

    Cloud intelligent driving control system based on multi-modal large model


    Additional title:

    基于多模态大模型的云端智能驾驶控制系统


    Contributors:
    LIANG XIAOHUI (author) / CHEN RONGBO (author) / CAI YIJIA (author) / YANG HAO (author)

    Publication date :

    2025-02-25


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G07C TIME OR ATTENDANCE REGISTERS , Zeit- oder Anwesenheitskontrollgeräte



    Intelligent airplane inspection system based on multi-modal large model

    QIN YONGHUI / WANG YANXIA | European Patent Office | 2025

    Free access

    Multi-modal interaction method and system based on intelligent driving function

    ZHANG WENHUI / HE JINPENG / LOU XINYANG | European Patent Office | 2024

    Free access

    Adaptive driving behavior evaluation and training system based on multi-modal large model

    LIANG XIAOHUI / CHEN RONGBO / CAI YIJIA et al. | European Patent Office | 2025

    Free access

    Automatic driving model based on multi-modal large model, training method and automatic driving method

    HUANG JIZHOU / ZENG ZENGFENG | European Patent Office | 2025

    Free access

    Automatic driving vehicle dynamic pick-up management system based on multi-modal large model

    LIANG XIAOHUI / CHEN RONGBO / CAI YIJIA et al. | European Patent Office | 2025

    Free access