Techniques for machine-trained analysis for multimodal machine learning vehicle manipulation are described. A computing device captures a plurality of information channels, wherein the plurality of information channels includes contemporaneous audio information and video information from an individual. A multilayered convolutional computing system learns trained weights using the audio information and the video information from the plurality of information channels. The trained weights cover both the audio information and the video information and are trained simultaneously. The learning facilitates cognitive state analysis of the audio information and the video information. A computing device within a vehicle captures further information and analyzes the further information using trained weights. The further information that is analyzed enables vehicle manipulation. The further information can include only video data or only audio data. The further information can include a cognitive state metric.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Multimodal machine learning for vehicle manipulation


    Beteiligte:

    Erscheinungsdatum :

    18.07.2023


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    IPC:    G06V / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion



    MULTIMODAL MACHINE LEARNING FOR VEHICLE MANIPULATION

    EL KALIOUBY RANA / MAVADATI SEYEDMOHAMMAD / MISHRA TANIYA et al. | Europäisches Patentamt | 2020

    Freier Zugriff

    Multimodal Machine Learning for Pedestrian Detection

    Aledhari, Mohammed / Razzak, Rehma / Parizi, Reza M. et al. | IEEE | 2021


    MULTIMODAL VEHICLE

    CAMPANA LUDOVICO | Europäisches Patentamt | 2018

    Freier Zugriff

    Machine Learning for Robot Grasping and Manipulation

    Kroemer, Oliver B. | BASE | 2015

    Freier Zugriff

    Multimodal vehicle

    CAMPANA LUDOVICO | Europäisches Patentamt | 2024

    Freier Zugriff