The invention discloses a method and a system for collecting decision data by an intelligent agent driven by a multi-modal large model. The method comprises the following steps: collecting original data of a predetermined sensor, calculating information entropy and a normalized mass score, and generating a fusion feature vector through self-adaptive multi-modal information fusion; time sequence sensitive multi-mode alignment processing is carried out on the image, and time sequence alignment features are obtained by combining timestamp embedding and a self-attention mechanism; based on this, decision distribution is generated by using a Bayesian neural network, uncertainty is evaluated, and a final decision and index set is generated; evaluating a task score in combination with task description, and making an execution plan according to a resource state; initializing the model, generating synthetic data, optimizing the model and storing experience. According to the invention, the efficient decision-making process of the intelligent trolley is realized, and the execution capability and task completion precision of the intelligent trolley are improved.
本发明公开了一种多模态大模型驱动的智能体收集决策数据的方法及系统,该方法包括采集预定传感器原始数据,计算信息熵与归一化质量分数,经自适应多模态信息融合生成融合特征向量;对其做时序敏感多模态对齐处理,结合时间戳嵌入与自注意力机制得时序对齐特征;基于此用贝叶斯神经网络生成决策分布,评估不确定性并生成最终决策及指标集;结合任务描述评估任务得分,根据资源状态制定执行计划;初始化模型,生成合成数据,优化模型并存储经验。本发明实现了智能小车的高效决策过程,同时提升了智能小车的执行能力和任务完成精度。
Method and system for collecting decision data by multi-modal large model driven intelligent agent
多模态大模型驱动的智能体收集决策数据的方法及系统
2025-04-11
Patent
Electronic Resource
Chinese
IPC: | G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung |
Intelligent airplane inspection system based on multi-modal large model
European Patent Office | 2025
|Cloud intelligent driving control system based on multi-modal large model
European Patent Office | 2025
|AR-HUD intelligent adjusting system and method based on multi-modal large model
European Patent Office | 2024
|Deep reinforcement learning-based ethical-driven multi-modal decision-making method
European Patent Office | 2023
|