The invention discloses a multi-modal interaction method and system based on an intelligent driving function. The multi-modal interaction method comprises the following steps: acquiring an intelligent driving function scene and a corresponding intelligent driving function; judging the fault occurrence time in the intelligent driving function scene; carrying out interaction hierarchy division according to the fault occurrence opportunity; if the fault occurrence time is before function activation and when a user manually activates a function, prompting an intelligent driving function fault corresponding to the intelligent driving function scene, and performing interaction by using a corresponding interaction mode according to divided interaction levels; and if the fault occurrence opportunity is function activation and when the intelligent driving function performs lane cruising, performing interaction by using a corresponding interaction mode according to the divided interaction levels based on the fault state of a sensing sensor corresponding to the intelligent driving function scene and/or the function state of the intelligent driving function.

    一种基于智能驾驶功能的多模态交互方法及系统,所述多模态交互方法包括:获取智能驾驶功能场景及其对应的智能驾驶功能;判断所述智能驾驶功能场景下的故障发生时机;针对所述故障发生时机进行交互层级的划分;若所述故障发生时机为功能激活前,且当用户手动激活功能时,提示所述智能驾驶功能场景对应的智能驾驶功能故障,并按划分的交互层级使用对应的交互方式进行交互;若所述故障发生时机为功能激活中,且当所述智能驾驶功能车道巡航时,基于所述智能驾驶功能场景对应的感知传感器的故障状态和/或所述智能驾驶功能的功能状态按划分的交互层级使用对应的交互方式进行交互。


    Access

    Download


    Export, share and cite



    Title :

    Multi-modal interaction method and system based on intelligent driving function


    Additional title:

    基于智能驾驶功能的多模态交互方法及系统


    Contributors:
    ZHANG WENHUI (author) / HE JINPENG (author) / LOU XINYANG (author)

    Publication date :

    2024-08-06


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion



    Cloud intelligent driving control system based on multi-modal large model

    LIANG XIAOHUI / CHEN RONGBO / CAI YIJIA et al. | European Patent Office | 2025

    Free access

    Driving fatigue intervention method and system based on multi-modal perception interaction

    YUAN XINYI / XIA YONG / WANG YOULAN et al. | European Patent Office | 2025

    Free access

    Intelligent driving interaction method, interaction system and vehicle

    YUAN MENG / GUO YANGDONG / SI HUACHAO et al. | European Patent Office | 2023

    Free access

    Automatic driving method and system based on multi-view multi-modal fusion

    LIU CHUNSHENG / SUN JINYING / CHANG FALIANG et al. | European Patent Office | 2024

    Free access

    Man-machine interaction method of intelligent driving system, intelligent driving system and automobile

    KUANG FENGQI / ZHAO YUNHUI | European Patent Office | 2023

    Free access