The invention discloses an intelligent cabin sun shield automatic adjusting system based on facial expression recognition, which is characterized in that a multi-task convolutional neural network and a lightweight network MobileNetV3 network are cooperatively used to form the intelligent cabin sun shield automatic adjusting system for facial expression recognition; the MTCNN is used for detecting and intercepting a human face area in real time, and marking five feature points including human eyes, a nose and mouth corners for human face alignment operation; the MobileNetV3 network is a lightweight network which can be applied to a vehicle and is used for identifying the facial expression of a driver. According to the method, the human face is detected in real time through the MTCNN model, the facial expression in the driving process is recognized through the MobileNetV3small model, the automobile sun shield is automatically adjusted in time, interference of strong light to a driver is relieved, and safe and intelligent driving is achieved.

    本发明公开了一种基于人脸表情识别的智慧座舱遮阳板自动调节系统,包括将多任务卷积神经网络和轻量级网络MobileNetV3网络配合使用,组成用于人脸表情识别的智慧座舱遮阳板自动调节系统;MTCNN用于实时检测截取人脸区域,并标出人眼、鼻子和嘴角共五处特征点用于人脸对齐操作;MobileNetV3网络是一种可应用于车载的轻量级网络,用于识别驾驶员的面部表情。本发明通过MTCNN模型实时检测人脸,利用MobileNetV3_small模型识别行车过程中的面部表情,及时自动调整汽车遮阳板,缓解强光线对驾驶者的干扰,实现安全、智能驾驶。


    Access

    Download


    Export, share and cite



    Title :

    Intelligent cabin sun shield automatic adjusting system based on facial expression recognition


    Additional title:

    一种基于人脸表情识别的智慧座舱遮阳板自动调节系统


    Contributors:
    LIU XINHUA (author) / QI PENG (author) / HAO JINGBIN (author) / HUA DEZHENG (author) / LIU ZHENGGUANG (author) / LIU XIAOFAN (author) / LU HE (author) / LIU HAO (author) / ZHOU HAO (author) / WANG QINGQING (author)

    Publication date :

    2023-12-22


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR / B60J WINDOWS, WINDSCREENS, NON-FIXED ROOFS, DOORS, OR SIMILAR DEVICES FOR VEHICLES , Fenster, Windschutzscheiben und bewegbare Dächer, Türen oder Ähnliches für Fahrzeuge / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06V



    Automatic cabin adjusting method, automatic cabin adjusting system and vehicle-mounted terminal

    HU XIAOJIAN / ZHU HEQUN | European Patent Office | 2021

    Free access

    Cabin control method and device based on facial recognition, intelligent cabin and vehicle

    LIU TONG / LI JIALONG / XU KAITING | European Patent Office | 2023

    Free access

    Seat adjusting method of intelligent cabin and intelligent cabin

    WANG ZHIBIN / DENG CHAO / WU FENGYAN et al. | European Patent Office | 2025

    Free access

    Automobile intelligent cabin adjusting method, device and system based on video recognition

    WU DAZHI / XIAO JIE | European Patent Office | 2020

    Free access

    Intelligent cabin light adjusting method and system

    XIA GUOYING | European Patent Office | 2025

    Free access