An autonomous vehicle including a microphone array of a plurality of microphones, a visual sensor network configured to receive visual signals, at least one processor, and at least one memory storing instructions is disclosed. The instructions, when executed by the at least one processor, cause the at least one processor to: (i) generate spatial beamforming maps locating a sound source using a beamforming model corresponding to acoustic signals received at the plurality of microphones of the microphone array; (ii) apply a synthetic aperture expansion to the acoustic signals to increase resolution of the spatial beamforming maps; and (iii) generate a future visual frame based at least partially upon temporal information extracted from the spatial beamforming maps and visualization maps generated based on the visual signals received by the visual sensor network.
FUTURE VISUAL FRAME PREDICTION FOR AUTONOMOUS VEHICLES USING LONG-RANGE ACOUSTIC BEAMFORMING AND SYNTHETIC APERTURE EXPANSION
2024-12-19
Patent
Electronic Resource
English
IPC: | B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / H04R LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS , Lautsprecher, Mikrofone, Schallplatten-Tonabnehmer oder ähnliche akustische, elektromechanische Wandler |
European Patent Office | 2024
|Airborne synthetic aperture acoustic imaging
Tema Archive | 1997
|Map Building Fusing Acoustic and Visual Information using Autonomous Underwater Vehicles
British Library Online Contents | 2013
|Future of synthetic aperture radar
NTRS | 1978
|Experimental Performance Investigation of Digital Beamforming on Synthetic Aperture Radar
German Aerospace Center (DLR) | 2008
|