The invention discloses a multi-modal interaction method and system based on an intelligent driving function. The multi-modal interaction method comprises the following steps: acquiring an intelligent driving function scene and a corresponding intelligent driving function; judging the fault occurrence time in the intelligent driving function scene; carrying out interaction hierarchy division according to the fault occurrence opportunity; if the fault occurrence time is before function activation and when a user manually activates a function, prompting an intelligent driving function fault corresponding to the intelligent driving function scene, and performing interaction by using a corresponding interaction mode according to divided interaction levels; and if the fault occurrence opportunity is function activation and when the intelligent driving function performs lane cruising, performing interaction by using a corresponding interaction mode according to the divided interaction levels based on the fault state of a sensing sensor corresponding to the intelligent driving function scene and/or the function state of the intelligent driving function.
一种基于智能驾驶功能的多模态交互方法及系统,所述多模态交互方法包括:获取智能驾驶功能场景及其对应的智能驾驶功能;判断所述智能驾驶功能场景下的故障发生时机;针对所述故障发生时机进行交互层级的划分;若所述故障发生时机为功能激活前,且当用户手动激活功能时,提示所述智能驾驶功能场景对应的智能驾驶功能故障,并按划分的交互层级使用对应的交互方式进行交互;若所述故障发生时机为功能激活中,且当所述智能驾驶功能车道巡航时,基于所述智能驾驶功能场景对应的感知传感器的故障状态和/或所述智能驾驶功能的功能状态按划分的交互层级使用对应的交互方式进行交互。
Multi-modal interaction method and system based on intelligent driving function
基于智能驾驶功能的多模态交互方法及系统
2024-08-06
Patent
Electronic Resource
Chinese
IPC: | B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion |
Cloud intelligent driving control system based on multi-modal large model
European Patent Office | 2025
|Driving fatigue intervention method and system based on multi-modal perception interaction
European Patent Office | 2025
|Intelligent driving interaction method, interaction system and vehicle
European Patent Office | 2023
|Automatic driving method and system based on multi-view multi-modal fusion
European Patent Office | 2024
|European Patent Office | 2023
|