The present invention relates to an apparatus and a method for robustly estimating the three-dimensional behavior of a passenger by fusing, through a particle filter, information obtained by a vehicle interior camera and a vehicle interior information sensor. A passenger behavior estimation system of the present invention comprises: a camera which captures at least one passenger in a vehicle; sensors which obtain vehicle information; an image processing device which processes images obtained from the camera to obtain key point information of the at least one passenger and object tracking information provided by tracking the at least one passenger; and a vehicle safety controller which estimates the behavior of the passenger using the particle filter based on the vehicle information obtained by the sensors, and the key point information and object tracking information obtained by the image processing device.
본 발명은 차량 실내 카메라와 차량 내부 정보 센서를 통해 획득한 정보를 파티클 필터를 통해 융합하여 강건하게 승객의 3차원 거동을 추정하는 장치 및 방법에 관한 것으로, 승객 거동 추정 시스템은 차량 내의 상기 적어도 하나의 승객을 촬영하는 카메라, 차량 정보를 획득하는 센서들, 상기 카메라로부터 획득한 이미지들을 처리하여 상기 적어도 하나의 승객의 키포인트 정보 및 상기 적어도 하나의 승객을 추적하여 제공하는 객체 추적 정보를 획득하는 영상 처리 장치 및 상기 센서들을 통해 획득한 차량 정보, 상기 영상 처리 장치로부터 획득한 키포인트 정보 및 객체 추적 정보를 기초로 파티클 필터를 사용하여 상기 승객의 거동을 추정하는 차량 안전 제어기를 포함할 수 있다.
Apparatus and Method for Estimating Behavior of a Passenger of a Vehicle
차량 승객 거동 추정 장치 및 방법
2023-09-25
Patent
Electronic Resource
Korean
IPC: | G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / B60N SEATS SPECIALLY ADAPTED FOR VEHICLES , Sitze besonders für Fahrzeuge ausgebildet / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / H04N PICTORIAL COMMUNICATION, e.g. TELEVISION , Bildübertragung, z.B. Fernsehen / B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR |
European Patent Office | 2022
|Method and device for estimating vehicle passenger state
European Patent Office | 2015
|VEHICLE BEHAVIOR ESTIMATING DEVICE AND VEHICLE BEHAVIOR ESTIMATING METHOD
European Patent Office | 2025
|VEHICLE BEHAVIOR ESTIMATING METHOD, VEHICLE BEHAVIOR ESTIMATING DEVICE, AND VEHICLE CONTROLLER
European Patent Office | 2020
|European Patent Office | 2017
|