Traffic cameras are essential in urban areas, playing a crucial role in intelligent transportation systems. Multiple cameras at intersections enhance law enforcement capabilities, traffic management, and pedestrian safety. However, efficiently managing and analyzing multi-camera feeds poses challenges due to the vast amount of data. Analyzing such huge video data requires advanced analytical tools. While Large Language Models (LLMs) like ChatGPT, equipped with retrieval-augmented generation (RAG) systems, excel in text-based tasks, integrating them into traffic video analysis demands converting video data into text using a Vision-Language Model (VLM), which is time-consuming and delays the timely utilization of traffic videos for generating insights and investigating incidents. To address these challenges, we propose TrafficLens, a tailored algorithm for multi-camera traffic intersections. TrafficLens employs a sequential approach, utilizing overlapping coverage areas of cameras. It iteratively applies VLMs with varying token limits, using previous outputs as prompts for subsequent cameras, enabling rapid generation of detailed textual descriptions while reducing processing time. Additionally, TrafficLens intelligently bypasses redundant VLM invocations through an object-level similarity detector. Experimental results with real-world datasets demonstrate that TrafficLens reduces video-to-text conversion time by up to 4× while maintaining information accuracy.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    TrafficLens: Multi-Camera Traffic Video Analysis Using LLMs


    Beteiligte:


    Erscheinungsdatum :

    24.09.2024


    Format / Umfang :

    831118 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    A research on traffic calculation using stereo video camera

    Yoshida, H. / Muraki, H. / Tanaka, S. et al. | Tema Archiv | 2006


    Traffic Control Enhancement with Video Camera Images Using AI

    Singh, Kriti / Jain, P. C. | Springer Verlag | 2020


    Real-time road traffic classification using on-board bus video camera

    Parisot, C. / Meessen, J. / Carincotte, C. et al. | IEEE | 2008


    Intelligent traffic multi-angle snapshot camera

    HUANG SHILUN | Europäisches Patentamt | 2023

    Freier Zugriff

    Infrastructure Camera Video Data Processing of Traffic at Roundabouts

    Patil, Jagruti / Tulpule, Punit | SAE Technical Papers | 2021