The invention provides a driver watching behavior safety reminding method and device suitable for an intelligent cabin. The method comprises the following steps that S1, an intelligent cabin touch screen man-machine interaction data set is constructed; s2, time sequence data feature extraction; s3, preprocessing the data, and constructing a time sequence matrix; s4, a mixed depth model CNN-BiLSTM-Attention based on the BiLSTM, the CNN and the attention mechanism is constructed; s5, CNN-BiLSTM-Attention training, testing, tuning and integrating are carried out on the CNN-BiLSTM-Attention; and S6, executing a gazing behavior safety reminding method based on a prediction result of the gazing area. The method has the beneficial effects that the sending opportunity of the safety prompt information is determined according to the driver watching area prediction result, the distraction theory and the safe driving theory, interaction with the driver is actively carried out through visual information and voice information, and the driver is prompted to standardize the watching behavior of the driver. According to the method, aiming at an intelligent cabin full-touch screen interaction scene, the watching area of the driver can be foreseen, active interaction with the driver is achieved to improve the driving safety, and man-machine conflicts can be effectively avoided.

    本发明提供了一种适用智能座舱的驾驶人注视行为安全提醒方法及装置,包括以下步骤:S1:构建智能座舱触控屏人机交互数据集;S2:时间序列数据特征提取;S3:数据预处理,并构建时间序列矩阵;S4:构建基于BiLSTM、CNN和注意力机制的混合深度模型CNN‑BiLSTM‑Attention;S5:CNN‑BiLSTM‑Attention训练、测试、调优和集成;S6:基于注视区域的预测结果执行注视行为安全提醒方法。有益效果:根据驾驶人注视区域预测结果、分心理论以及安全驾驶理论,确定安全提示信息发送时机,通过视觉信息和语音信息主动和驾驶人进行交互,提示驾驶人规范自己的注视行为。该方法针对智能座舱全触控屏交互场景,能够预知驾驶人的注视区域,主动和驾驶人交互以提高驾驶安全性,能够有效避免人机冲突。


    Access

    Download


    Export, share and cite



    Title :

    Driver watching behavior safety reminding method and device suitable for intelligent cabin


    Additional title:

    一种适用智能座舱的驾驶人注视行为安全提醒方法及装置


    Contributors:
    ZHAO XIA (author) / LI CHAO (author) / SUN XIAOQIANG (author) / CAI YINGFENG (author) / CHEN LONG (author) / LIU QINGCHAO (author) / WANG CHENBO (author) / DONG XUAN (author)

    Publication date :

    2024-11-08


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G06V / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung



    Intelligent driver behavior monitoring and safety reminding system and control method thereof

    HU XIAO / XIA RONGXIN / LUO JIE | European Patent Office | 2025

    Free access

    Safety auxiliary reminding device for vehicle driver

    WANG YUPENG / SUN XIAOBING | European Patent Office | 2024

    Free access

    Driver driving safety reminding device and system thereof

    PAN XIUJIANG | European Patent Office | 2023

    Free access

    Safety reminding device for intelligent driving

    LING HESONG / ZHANG ERYONG / YAO CHENGYUN | European Patent Office | 2021

    Free access

    Intelligent safety reminding saddle

    YU RONGDI / YU YANJIE / YAN CHUNSHUO et al. | European Patent Office | 2023

    Free access