A computer vision module facilitates multi-sensor vision of AVs based on privileged information learning. The module may input first sensor data captured by a first sensor into an already-trained privileged model, input second sensor data captured by a second sensor into a first backbone of a target model, and input third sensor data captured by a third sensor into a second backbone of the target model. The three sensors may be of different types. To train the target model, internal parameters of the target model may be modified to minimize a loss, which may include a privilege loss, which indicates a difference between a latent representation of the first sensor data and a latent representation of the second sensor data, and another privileged loss, which indicates a difference between the latent representation of the first sensor data and a latent representation of the third sensor data.
MULTI-SENSOR VISION FOR AUTONOMOUS VEHICLE BASED ON PRIVILEGED INFORMATION LEARNIN
MULTISENSORVISION FÜR AUTONOMES FAHRZEUG AUF DER BASIS VON PRIVILEGIERTEN INFORMATIONSLERNVORGÄNGEN
VISION À CAPTEURS MULTIPLES POUR VÉHICULE AUTONOME SUR LA BASE D'INFORMATIONS PRIVILÉGIÉES APPRENANTES
2025-02-26
Patent
Electronic Resource
English
IPC: | B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen |
MULTI-SENSOR VISION FOR AUTONOMOUS VEHICLE BASED ON PRIVILEGED INFORMATION LEARNING
European Patent Office | 2025
|Vision-Based Deep Reinforcement Learning of UAV Autonomous Navigation Using Privileged Information
ArXiv | 2024
|Privileged Information in Mishap Investigation
Online Contents | 1994