The invention discloses a method and a system for collecting decision data by an intelligent agent driven by a multi-modal large model. The method comprises the following steps: collecting original data of a predetermined sensor, calculating information entropy and a normalized mass score, and generating a fusion feature vector through self-adaptive multi-modal information fusion; time sequence sensitive multi-mode alignment processing is carried out on the image, and time sequence alignment features are obtained by combining timestamp embedding and a self-attention mechanism; based on this, decision distribution is generated by using a Bayesian neural network, uncertainty is evaluated, and a final decision and index set is generated; evaluating a task score in combination with task description, and making an execution plan according to a resource state; initializing the model, generating synthetic data, optimizing the model and storing experience. According to the invention, the efficient decision-making process of the intelligent trolley is realized, and the execution capability and task completion precision of the intelligent trolley are improved.

    本发明公开了一种多模态大模型驱动的智能体收集决策数据的方法及系统,该方法包括采集预定传感器原始数据,计算信息熵与归一化质量分数,经自适应多模态信息融合生成融合特征向量;对其做时序敏感多模态对齐处理,结合时间戳嵌入与自注意力机制得时序对齐特征;基于此用贝叶斯神经网络生成决策分布,评估不确定性并生成最终决策及指标集;结合任务描述评估任务得分,根据资源状态制定执行计划;初始化模型,生成合成数据,优化模型并存储经验。本发明实现了智能小车的高效决策过程,同时提升了智能小车的执行能力和任务完成精度。


    Access

    Download


    Export, share and cite



    Title :

    Method and system for collecting decision data by multi-modal large model driven intelligent agent


    Additional title:

    多模态大模型驱动的智能体收集决策数据的方法及系统


    Contributors:
    LI CHENGHUA (author) / YANG BO (author) / HU QINGHAO (author) / WANG PEISONG (author) / ZHANG YIFAN (author)

    Publication date :

    2025-04-11


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung



    Intelligent airplane inspection system based on multi-modal large model

    QIN YONGHUI / WANG YANXIA | European Patent Office | 2025

    Free access

    Cloud intelligent driving control system based on multi-modal large model

    LIANG XIAOHUI / CHEN RONGBO / CAI YIJIA et al. | European Patent Office | 2025

    Free access

    AR-HUD intelligent adjusting system and method based on multi-modal large model

    YIN YUSHAN | European Patent Office | 2024

    Free access

    Deep reinforcement learning-based ethical-driven multi-modal decision-making method

    LI XUEYUAN / GAO XIN / LUAN TIAN et al. | European Patent Office | 2023

    Free access

    High fidelity data-driven multi-modal simulation

    AUSTIN DILL / YUNMING SHAO / SILVIO MAETA et al. | European Patent Office | 2023

    Free access