The invention discloses a traffic light identification method and device based on multi-sensor fusion, and is used for solving the technical problems that the current traffic light color identification accuracy and reliability are low, driver state monitoring is lacked, and a reminding mechanism is not intelligent enough. The method comprises the steps of obtaining an infrared reflection intensity image by scanning an area in front of a vehicle, and generating three-dimensional point cloud data containing traffic lights; performing space-time alignment processing based on the three-dimensional point cloud data and the infrared reflection intensity image to obtain aligned point cloud data and an aligned infrared image; according to the aligned point cloud data and the aligned infrared image, color state comprehensive identification based on feature matching fusion is carried out, and a color state identification result of the traffic light can be rapidly and accurately obtained; when it is detected that the traffic light is changed from the red light to the green light, the attention state of the driver is analyzed to judge whether reminding information is sent to the driver or not, and therefore traffic light change intelligent reminding can be achieved according to the actual analysis condition of driver state monitoring.
本发明公开了一种多传感器融合的交通灯识别方法及装置,用于解决当前交通灯颜色识别准确性和可靠性较低,缺乏司机状态监测以及提醒机制不够智能的技术问题。所述方法包括:通过扫描车辆前方区域,获取红外反射强度图像,生成包含交通灯的三维点云数据;基于三维点云数据与红外反射强度图像进行时空对齐处理,获得对齐点云数据以及对齐红外图像;根据对齐点云数据以及对齐红外图像进行基于特征匹配融合的颜色状态综合识别,可以快速且准确地获得交通灯的颜色状态识别结果;当检测到交通灯由红灯转变为绿灯时,对司机进行注意力状态分析,以判断是否向司机发出提醒信息,从而可以根据司机状态监测的实际分析情况实现交通灯变化智能提醒。
Multi-sensor fusion traffic light identification method and device
多传感器融合的交通灯识别方法及装置
2025-04-15
Patent
Electronic Resource
Chinese
Traffic event identification and processing system based on multi-sensor data fusion technology
European Patent Office | 2021
|Multi-source data fusion traffic hidden danger identification method and system
European Patent Office | 2025
|