An autonomous vehicle including a microphone array of a plurality of microphones, a visual sensor network configured to receive visual signals, at least one processor, and at least one memory storing instructions is disclosed. The instructions, when executed by the at least one processor, cause the at least one processor to: (i) generate spatial beamforming maps locating a sound source using a beamforming model corresponding to acoustic signals received at the plurality of microphones of the microphone array; (ii) apply a synthetic aperture expansion to the acoustic signals to increase resolution of the spatial beamforming maps; and (iii) generate a future visual frame based at least partially upon temporal information extracted from the spatial beamforming maps and visualization maps generated based on the visual signals received by the visual sensor network.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    FUTURE VISUAL FRAME PREDICTION FOR AUTONOMOUS VEHICLES USING LONG-RANGE ACOUSTIC BEAMFORMING AND SYNTHETIC APERTURE EXPANSION


    Beteiligte:
    HEIDE FELIX (Autor:in) / D'SOUZA JIM ALDON (Autor:in)

    Erscheinungsdatum :

    19.12.2024


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / H04R LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS , Lautsprecher, Mikrofone, Schallplatten-Tonabnehmer oder ähnliche akustische, elektromechanische Wandler



    OBJECT DETECTION FOR AUTONOMOUS VEHICLES USING LONG-RANGE ACOUSTIC BEAMFORMING AND SYNTHETIC APERTURE EXPANSION

    HEIDE FELIX / D'SOUZA JIM ALDON | Europäisches Patentamt | 2024

    Freier Zugriff

    Airborne synthetic aperture acoustic imaging

    Soumekh, M. | Tema Archiv | 1997


    Map Building Fusing Acoustic and Visual Information using Autonomous Underwater Vehicles

    Kunz, C. / Singh, H. | British Library Online Contents | 2013


    Experimental Performance Investigation of Digital Beamforming on Synthetic Aperture Radar

    Kim, Junghyo / Younis, Marwan / Wiesbeck, Werner | Deutsches Zentrum für Luft- und Raumfahrt (DLR) | 2008

    Freier Zugriff

    Future of synthetic aperture radar

    Barath, F. T. | NTRS | 1978