Techniques for machine-trained analysis for multimodal machine learning vehicle manipulation are described. A computing device captures a plurality of information channels, wherein the plurality of information channels includes contemporaneous audio information and video information from an individual. A multilayered convolutional computing system learns trained weights using the audio information and the video information from the plurality of information channels. The trained weights cover both the audio information and the video information and are trained simultaneously. The learning facilitates cognitive state analysis of the audio information and the video information. A computing device within a vehicle captures further information and analyzes the further information using trained weights. The further information that is analyzed enables vehicle manipulation. The further information can include only video data or only audio data. The further information can include a cognitive state metric.


    Access

    Download


    Export, share and cite



    Title :

    MULTIMODAL MACHINE LEARNING FOR VEHICLE MANIPULATION


    Contributors:

    Publication date :

    2020-07-30


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    G06V / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion



    Multimodal machine learning for vehicle manipulation

    EL KALIOUBY RANA / MAVADATI SEYEDMOHAMMAD / MISHRA TANIYA et al. | European Patent Office | 2023

    Free access

    Multimodal Machine Learning for Pedestrian Detection

    Aledhari, Mohammed / Razzak, Rehma / Parizi, Reza M. et al. | IEEE | 2021


    MULTIMODAL VEHICLE

    CAMPANA LUDOVICO | European Patent Office | 2018

    Free access

    Multimodal vehicle

    CAMPANA LUDOVICO | European Patent Office | 2024

    Free access

    MULTIMODAL VEHICLE

    CAMPANA LUDOVICO | European Patent Office | 2020

    Free access