A computer vision module facilitates multi-sensor vision of AVs based on privileged information learning. The module may input first sensor data captured by a first sensor into an already-trained privileged model, input second sensor data captured by a second sensor into a first backbone of a target model, and input third sensor data captured by a third sensor into a second backbone of the target model. The three sensors may be of different types. To train the target model, internal parameters of the target model may be modified to minimize a loss, which may include a privilege loss, which indicates a difference between a latent representation of the first sensor data and a latent representation of the second sensor data, and another privileged loss, which indicates a difference between the latent representation of the first sensor data and a latent representation of the third sensor data.


    Access

    Download


    Export, share and cite



    Title :

    MULTI-SENSOR VISION FOR AUTONOMOUS VEHICLE BASED ON PRIVILEGED INFORMATION LEARNIN


    Additional title:

    MULTISENSORVISION FÜR AUTONOMES FAHRZEUG AUF DER BASIS VON PRIVILEGIERTEN INFORMATIONSLERNVORGÄNGEN
    VISION À CAPTEURS MULTIPLES POUR VÉHICULE AUTONOME SUR LA BASE D'INFORMATIONS PRIVILÉGIÉES APPRENANTES


    Contributors:

    Publication date :

    2025-02-26


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    MULTI-SENSOR VISION FOR AUTONOMOUS VEHICLE BASED ON PRIVILEGED INFORMATION LEARNING

    GRAZIOLI FILIPPO / MÖLLER SVEN / UNZUETA MARC et al. | European Patent Office | 2025

    Free access


    Vision-Based Deep Reinforcement Learning of UAV Autonomous Navigation Using Privileged Information

    Wang, Junqiao / Yu, Zhongliang / Zhou, Dong et al. | ArXiv | 2024

    Free access


    Privileged vehicle passage method, device and system

    CHEN CHONGFENG / LIU KAI / HAO FEI | European Patent Office | 2016

    Free access