The invention relates to a head-up display adjusting method, system and device based on emotion recognition and a medium. The method comprises the following steps: acquiring a face video frame sequence of a driver and a physiological signal sequence corresponding to the face video frame sequence; inputting the face video frame sequence into an expression recognition model, and extracting an expression feature sequence of the face video frame sequence; extracting a physiological feature sequence from the physiological signal sequence according to a physiological feature extraction model; inputting the expression feature sequence and the physiological feature sequence into a multi-modal emotion recognition model to generate an emotion category; and dynamically adjusting the head-up display content on the vehicle according to a preset adjustment strategy based on the emotion category. The head-up display content is dynamically adjusted according to the emotion of the driver, and the driving safety is improved.

    本发明涉及一种基于情绪识别的抬头显示调整方法、系统、设备和介质。方法包括:获取驾驶员的面部视频帧序列以及与之对应的生理信号序列;将所述面部视频帧序列输入至表情识别模型,提取所述面部视频帧序列的表情特征序列;依据生理特征提取模型,从所述生理信号序列中提取生理特征序列;将所述表情特征序列和所述生理特征序列输入至多模态情绪识别模型,生成情绪类别;基于所述情绪类别,依据预设的调整策略,动态调整车辆上抬头显示的内容。本发明根据驾驶员情绪动态调整抬头显示内容,提升了行车安全性。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Head-up display adjusting method, system and device based on emotion recognition and medium


    Weitere Titelangaben:

    基于情绪识别的抬头显示调整方法、系统、设备和介质


    Beteiligte:
    LEE JIN-HAN (Autor:in) / MO ZHIQIANG (Autor:in)

    Erscheinungsdatum :

    25.02.2025


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G06V / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60K Anordnung oder Einbau von Antriebseinheiten oder von Kraft- bzw. Drehmomentübertragungen in Fahrzeugen , ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung



    Driving mode adjusting method, system and device based on emotion recognition and medium

    JANG YOUNG-BAE | Europäisches Patentamt | 2023

    Freier Zugriff

    Head-up display adjusting method, device and equipment and head-up display system

    YAN KAILIE / XU JIEMING / CHEN TING | Europäisches Patentamt | 2024

    Freier Zugriff

    Vehicle head-up display system adjusting method and device, vehicle and storage medium

    WANG YONGQUAN / GAO MIN / YANG XUEFANG | Europäisches Patentamt | 2024

    Freier Zugriff

    Adjusting system and adjusting method for head-up display height

    WANG YUHANG | Europäisches Patentamt | 2025

    Freier Zugriff

    Head-up display position adjusting method and device, equipment and storage medium

    REN HAISHAN / JIANG KUN / LI WENBO et al. | Europäisches Patentamt | 2024

    Freier Zugriff