The invention provides a driver watching behavior safety reminding method and device suitable for an intelligent cabin. The method comprises the following steps that S1, an intelligent cabin touch screen man-machine interaction data set is constructed; s2, time sequence data feature extraction; s3, preprocessing the data, and constructing a time sequence matrix; s4, a mixed depth model CNN-BiLSTM-Attention based on the BiLSTM, the CNN and the attention mechanism is constructed; s5, CNN-BiLSTM-Attention training, testing, tuning and integrating are carried out on the CNN-BiLSTM-Attention; and S6, executing a gazing behavior safety reminding method based on a prediction result of the gazing area. The method has the beneficial effects that the sending opportunity of the safety prompt information is determined according to the driver watching area prediction result, the distraction theory and the safe driving theory, interaction with the driver is actively carried out through visual information and voice information, and the driver is prompted to standardize the watching behavior of the driver. According to the method, aiming at an intelligent cabin full-touch screen interaction scene, the watching area of the driver can be foreseen, active interaction with the driver is achieved to improve the driving safety, and man-machine conflicts can be effectively avoided.

    本发明提供了一种适用智能座舱的驾驶人注视行为安全提醒方法及装置,包括以下步骤:S1:构建智能座舱触控屏人机交互数据集;S2:时间序列数据特征提取;S3:数据预处理,并构建时间序列矩阵;S4:构建基于BiLSTM、CNN和注意力机制的混合深度模型CNN‑BiLSTM‑Attention;S5:CNN‑BiLSTM‑Attention训练、测试、调优和集成;S6:基于注视区域的预测结果执行注视行为安全提醒方法。有益效果:根据驾驶人注视区域预测结果、分心理论以及安全驾驶理论,确定安全提示信息发送时机,通过视觉信息和语音信息主动和驾驶人进行交互,提示驾驶人规范自己的注视行为。该方法针对智能座舱全触控屏交互场景,能够预知驾驶人的注视区域,主动和驾驶人交互以提高驾驶安全性,能够有效避免人机冲突。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Driver watching behavior safety reminding method and device suitable for intelligent cabin


    Weitere Titelangaben:

    一种适用智能座舱的驾驶人注视行为安全提醒方法及装置


    Beteiligte:
    ZHAO XIA (Autor:in) / LI CHAO (Autor:in) / SUN XIAOQIANG (Autor:in) / CAI YINGFENG (Autor:in) / CHEN LONG (Autor:in) / LIU QINGCHAO (Autor:in) / WANG CHENBO (Autor:in) / DONG XUAN (Autor:in)

    Erscheinungsdatum :

    08.11.2024


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G06V / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung



    Intelligent driver behavior monitoring and safety reminding system and control method thereof

    HU XIAO / XIA RONGXIN / LUO JIE | Europäisches Patentamt | 2025

    Freier Zugriff

    Safety auxiliary reminding device for vehicle driver

    WANG YUPENG / SUN XIAOBING | Europäisches Patentamt | 2024

    Freier Zugriff

    Driver driving safety reminding device and system thereof

    PAN XIUJIANG | Europäisches Patentamt | 2023

    Freier Zugriff

    Safety reminding device for intelligent driving

    LING HESONG / ZHANG ERYONG / YAO CHENGYUN | Europäisches Patentamt | 2021

    Freier Zugriff

    Intelligent safety reminding saddle

    YU RONGDI / YU YANJIE / YAN CHUNSHUO et al. | Europäisches Patentamt | 2023

    Freier Zugriff