Aspects of the disclosed technology provide solutions for searching voxel data, such as voxelized Light Detection and Ranging (LiDAR) point cloud data and in particular, for using multi-modal embeddings for searching objects within a voxel data set. A process of the disclosed technology can include steps for receiving sensor data, wherein the sensor data represents a real-world environment encountered by an autonomous vehicle (AV) and wherein the sensor data comprises point cloud data representing a plurality of objects; generating a voxel representation for the plurality of objects; generating, based on the voxel representation for the plurality of objects, a corresponding set of first embeddings; receiving a text string; generating a second embedding corresponding to the text string; and identifying a matching object among the plurality of objects based on a comparison of the set of first embeddings and the second embedding. System and machine-readable media are also provided.


    Access

    Download


    Export, share and cite



    Title :

    VOXEL SEARCH USING MULTI-MODAL EMBEDDINGS


    Contributors:

    Publication date :

    2025-03-13


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL



    Multi-view image coding using 3-D voxel models

    Yongying Gao, / Radha, H. | IEEE | 2005


    Multi-View Image Coding using 3-D Voxel Models

    Gao, Y. / Radha, H. | British Library Conference Proceedings | 2005


    3D mapping with multi-resolution occupied voxel lists

    Ryde, J. | British Library Online Contents | 2010


    System and method for generating multi-resolution voxel spaces

    ARMSTRONG HIROTATSU / BLAES PATRICK / BOSSE MICHAEL CARSTEN et al. | European Patent Office | 2025

    Free access

    Articulated body posture estimation from multi-camera voxel data

    Mikic, I. / Trivedi, M. / Hunter, E. et al. | IEEE | 2001