The invention provides a driving state monitoring method, device, equipment and system, a medium and a vehicle. The driving state monitoring method comprises the following steps: acquiring visual information and audio information in a current vehicle cabin; analyzing the visual information through a visual analysis model to obtain a first analysis result of a visual side; the first analysis result comprises at least one of behavior features and facial features; analyzing the audio information through an audio analysis model to obtain a second analysis result of the audio side; the second analysis result comprises at least one of voice features and semantic features; and according to at least one of the first analysis result and the second analysis result, determining whether the driving state of the driver in the current vehicle is dangerous driving or not. According to the technical scheme, the driving state of the driver can be comprehensively, accurately and automatically monitored.
本申请提供了一种驾驶状态监测方法、装置、设备、系统、介质及交通工具。驾驶状态监测方法包括:获取当前交通工具座舱内的视觉信息和音频信息;通过视觉解析模型对视觉信息进行解析,得到视觉侧的第一解析结果;第一解析结果包括行为特征和面部特征中的至少一种;通过音频解析模型对音频信息进行解析,得到音频侧的第二解析结果;第二解析结果包括语音特征和语义特征中的至少一种;根据第一解析结果和第二解析结果中的至少一种解析结果,确定当前交通工具中的驾驶员的驾驶状态是否为危险驾驶。本申请的技术方案,可以实现对驾驶员驾驶状态的全面且准确的自动监测。
Driving state monitoring method, device, equipment, system, medium and vehicle
驾驶状态监测方法、装置、设备、系统、介质及交通工具
2024-06-28
Patent
Electronic Resource
Chinese
Driving state monitoring method, driving state monitoring device, vehicle and storage medium
European Patent Office | 2024
|Vehicle driving state monitoring method, terminal equipment and storage medium
European Patent Office | 2020
|European Patent Office | 2021
|European Patent Office | 2022
|European Patent Office | 2021
|