An autonomous vehicle including a microphone array of a plurality of microphones, a visual sensor network configured to receive visual signals, at least one processor, and at least one memory storing instructions is disclosed. The instructions, when executed by the at least one processor, cause the at least one processor to: (i) generate spatial beamforming maps locating a sound source using a beamforming model corresponding to acoustic signals received at the plurality of microphones of the microphone array; (ii) apply a synthetic aperture expansion to the acoustic signals to increase resolution of the spatial beamforming maps; and (iii) generate a future visual frame based at least partially upon temporal information extracted from the spatial beamforming maps and visualization maps generated based on the visual signals received by the visual sensor network.


    Access

    Download


    Export, share and cite



    Title :

    FUTURE VISUAL FRAME PREDICTION FOR AUTONOMOUS VEHICLES USING LONG-RANGE ACOUSTIC BEAMFORMING AND SYNTHETIC APERTURE EXPANSION


    Contributors:

    Publication date :

    2024-12-19


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / H04R LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS , Lautsprecher, Mikrofone, Schallplatten-Tonabnehmer oder ähnliche akustische, elektromechanische Wandler



    OBJECT DETECTION FOR AUTONOMOUS VEHICLES USING LONG-RANGE ACOUSTIC BEAMFORMING AND SYNTHETIC APERTURE EXPANSION

    HEIDE FELIX / D'SOUZA JIM ALDON | European Patent Office | 2024

    Free access

    Airborne synthetic aperture acoustic imaging

    Soumekh, M. | Tema Archive | 1997


    Map Building Fusing Acoustic and Visual Information using Autonomous Underwater Vehicles

    Kunz, C. / Singh, H. | British Library Online Contents | 2013


    Future of synthetic aperture radar

    Barath, F. T. | NTRS | 1978


    Experimental Performance Investigation of Digital Beamforming on Synthetic Aperture Radar

    Kim, Junghyo / Younis, Marwan / Wiesbeck, Werner | German Aerospace Center (DLR) | 2008

    Free access