Visual object tracking is a fundamental component of transportation systems, especially for intelligent driving. Despite achieving state-of-the-art performance in visual tracking, recent single-branch trackers tend to overlook the weak prior assumptions associated with the Vision Transformer (ViT) encoder and inference pipeline in visual tracking. Moreover, the effectiveness of discriminative trackers remains constrained due to the adoption of the dual-branch pipeline. To tackle the inferior effectiveness of vanilla ViT, we propose an Adaptive ViT Model Prediction tracker (AViTMP) to design a customised tracking method. This method bridges the single-branch network with discriminative models for the first time. Specifically, in the proposed encoder AViT encoder, we introduce a tracking-tailored Adaptor module for vanilla ViT and a joint target state embedding to enrich the target-prior embedding paradigm. Then, we combine the AViT encoder with a discriminative transformer-specific model predictor to predict the accurate location. Furthermore, to mitigate the limitations of conventional inference practice, we present a novel inference pipeline called CycleTrack, which bolsters the tracking robustness in the presence of distractors via bidirectional cycle tracking verification. In the experiments, we evaluated AViTMP on eight tracking benchmarks for a comprehensive assessment, including LaSOT, LaSOTExtSub, AVisT, etc. The experimental results unequivocally establish that, under fair comparison, AViTMP achieves state-of-the-art performance, especially in terms of long-term tracking and robustness.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    AViTMP: A Tracking-Specific Transformer for Single-Branch Visual Tracking


    Contributors:

    Published in:

    Publication date :

    2025-02-01


    Size :

    3449872 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Transformer Sub-Patch Matching for High-Performance Visual Object Tracking

    Tang, Chuanming / Hu, Qintao / Zhou, Gaofan et al. | IEEE | 2023


    Parallel Visual Tracking

    Roberts, J. / Charnley, D. / IFAC | British Library Conference Proceedings | 1993


    SPECIFIC OBJECT TRACKING DEVICE AND SPECIFIC OBJECT TRACKING SYSTEM

    YAMAMOTO KAZUMA / MASUDA MAKOTO | European Patent Office | 2020

    Free access

    Predictive visual tracking [2056-12]

    Wavering, A. J. / Lumia, R. / SPIE | British Library Conference Proceedings | 1993


    Feature Tracking For Visual Odometry

    HUNT SHAWN | European Patent Office | 2019

    Free access