The invention discloses a fatigue driving detection method, system and device based on multi-modal feature fusion and a medium, and the method comprises the steps: obtaining the face image information of a driver, and extracting the eye feature data and mouth feature data of the driver; acquiring a brain wave signal of a driver, and extracting concentration feature data and relaxation feature data of the driver; acquiring a steering wheel grip strength signal of a driver, and extracting grip strength change feature data of the driver; performing feature fusion on the eye feature data, the mouth feature data, the concentration feature data, the relaxation feature data and the grip change feature data to obtain multi-modal feature data; and inputting the multi-modal characteristic data into a fatigue state detection model to obtain a fatigue degree detection value of the driver, and judging whether the driver is in fatigue driving or not according to the fatigue degree detection value. The fatigue driving detection accuracy and the driving safety of the user are improved, and the method can be applied to the technical field of vehicle monitoring.

    本发明公开了多模态特征融合的疲劳驾驶检测方法、系统、装置及介质,方法包括:获取驾驶人员的人脸图像信息,提取得到驾驶人员的眼部特征数据和嘴部特征数据;获取驾驶人员的脑电波信号,提取得到驾驶人员的专注度特征数据和放松度特征数据;获取驾驶人员的方向盘握力信号,提取得到驾驶人员的握力变化特征数据;对眼部特征数据、嘴部特征数据、专注度特征数据、放松度特征数据以及握力变化特征数据进行特征融合,得到多模态特征数据;将多模态特征数据输入到疲劳状态检测模型,得到驾驶人员的疲劳程度检测值,根据疲劳程度检测值判断驾驶人员是否疲劳驾驶。本发明提高了疲劳驾驶检测的准确性以及用户的行车安全性,可应用于车辆监测技术领域。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Fatigue driving detection method, system and device based on multi-modal feature fusion and medium


    Weitere Titelangaben:

    多模态特征融合的疲劳驾驶检测方法、系统、装置及介质


    Beteiligte:
    CHEN HAIXUAN (Autor:in)

    Erscheinungsdatum :

    09.05.2025


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    G06V / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / A61B DIAGNOSIS , Diagnostik / G06F ELECTRIC DIGITAL DATA PROCESSING , Elektrische digitale Datenverarbeitung



    Fatigue driving detection method and system based on multi-modal feature fusion

    YE LUOQI / CHEN XI / FENG PEIHUA | Europäisches Patentamt | 2025

    Freier Zugriff

    Fatigue Driving Detection Based on Multi Feature Fusion

    Deng, Wanghua / Zhan, Zeyan / Yu, Yi et al. | IEEE | 2019


    Fatigue driving state detection for tanker truck drivers based on multi-feature fusion

    Zhang, Ning / Zhang, Ziyi / Ma, Chuanyi et al. | SPIE | 2024


    Fatigue driving detection method based on multi-information fusion

    MENG SIHONG | Europäisches Patentamt | 2020

    Freier Zugriff

    Fatigue driving detection model based on multi-feature fusion and semi-supervised active learning

    Li, Xu / Hong, Lin / Wang, Jian-chun et al. | IET | 2019

    Freier Zugriff