The invention provides a driver watching behavior safety reminding method and device suitable for an intelligent cabin. The method comprises the following steps that S1, an intelligent cabin touch screen man-machine interaction data set is constructed; s2, time sequence data feature extraction; s3, preprocessing the data, and constructing a time sequence matrix; s4, a mixed depth model CNN-BiLSTM-Attention based on the BiLSTM, the CNN and the attention mechanism is constructed; s5, CNN-BiLSTM-Attention training, testing, tuning and integrating are carried out on the CNN-BiLSTM-Attention; and S6, executing a gazing behavior safety reminding method based on a prediction result of the gazing area. The method has the beneficial effects that the sending opportunity of the safety prompt information is determined according to the driver watching area prediction result, the distraction theory and the safe driving theory, interaction with the driver is actively carried out through visual information and voice information, and the driver is prompted to standardize the watching behavior of the driver. According to the method, aiming at an intelligent cabin full-touch screen interaction scene, the watching area of the driver can be foreseen, active interaction with the driver is achieved to improve the driving safety, and man-machine conflicts can be effectively avoided.
本发明提供了一种适用智能座舱的驾驶人注视行为安全提醒方法及装置,包括以下步骤:S1:构建智能座舱触控屏人机交互数据集;S2:时间序列数据特征提取;S3:数据预处理,并构建时间序列矩阵;S4:构建基于BiLSTM、CNN和注意力机制的混合深度模型CNN‑BiLSTM‑Attention;S5:CNN‑BiLSTM‑Attention训练、测试、调优和集成;S6:基于注视区域的预测结果执行注视行为安全提醒方法。有益效果:根据驾驶人注视区域预测结果、分心理论以及安全驾驶理论,确定安全提示信息发送时机,通过视觉信息和语音信息主动和驾驶人进行交互,提示驾驶人规范自己的注视行为。该方法针对智能座舱全触控屏交互场景,能够预知驾驶人的注视区域,主动和驾驶人交互以提高驾驶安全性,能够有效避免人机冲突。
Driver watching behavior safety reminding method and device suitable for intelligent cabin
一种适用智能座舱的驾驶人注视行为安全提醒方法及装置
08.11.2024
Patent
Elektronische Ressource
Chinesisch
IPC: | G06V / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung |
Intelligent driver behavior monitoring and safety reminding system and control method thereof
Europäisches Patentamt | 2025
|Driver driving safety reminding device and system thereof
Europäisches Patentamt | 2023
|