Aspects of the disclosed technology provide solutions for searching voxel data, such as voxelized Light Detection and Ranging (LiDAR) point cloud data and in particular, for using multi-modal embeddings for searching objects within a voxel data set. A process of the disclosed technology can include steps for receiving sensor data, wherein the sensor data represents a real-world environment encountered by an autonomous vehicle (AV) and wherein the sensor data comprises point cloud data representing a plurality of objects; generating a voxel representation for the plurality of objects; generating, based on the voxel representation for the plurality of objects, a corresponding set of first embeddings; receiving a text string; generating a second embedding corresponding to the text string; and identifying a matching object among the plurality of objects based on a comparison of the set of first embeddings and the second embedding. System and machine-readable media are also provided.
VOXEL SEARCH USING MULTI-MODAL EMBEDDINGS
13.03.2025
Patent
Elektronische Ressource
Englisch
IPC: | B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL |
Multi-View Image Coding using 3-D Voxel Models
British Library Conference Proceedings | 2005
|Multi-view image coding using 3-D voxel models
IEEE | 2005
|3D mapping with multi-resolution occupied voxel lists
British Library Online Contents | 2010
|System and method for generating multi-resolution voxel spaces
Europäisches Patentamt | 2025
|