With its powerful visual-language alignment capability, CLIP performs well in zero-shot and few-shot learning tasks. However, we found in experiments that CLIP's logits suffer from serious inter-class confusion problems in downstream tasks, and the ambiguity between categories seriously affects the accuracy. To address this challenge, we propose a novel method called Logits DeConfusion, which effectively learns and eliminates inter-class confusion in logits by combining our Multi-level Adapter Fusion (MAF) module with our Inter-Class Deconfusion (ICD) module. Our MAF extracts features from different levels and fuses them uniformly to enhance feature representation. Our ICD learnably eliminates inter-class confusion in logits with a residual structure. Experimental results show that our method can significantly improve the classification performance and alleviate the inter-class confusion problem. The code is available at https://github.com/LiShuo1001/LDC.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Logits DeConfusion with CLIP for Few-Shot Learning


    Beteiligte:
    Li, Shuo (Autor:in) / Liu, Fang (Autor:in) / Hao, Zehua (Autor:in) / Wang, Xinyi (Autor:in) / Li, Lingling (Autor:in) / Liu, Xu (Autor:in) / Chen, Puhua (Autor:in) / Ma, Wenping (Autor:in)

    Erscheinungsdatum :

    2025


    Anmerkungen:

    CVPR 2025


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Knowledge Distillation with Refined Logits

    Sun, Wujie / Chen, Defang / Lyu, Siwei et al. | ArXiv | 2024

    Freier Zugriff

    Exploiting Features and Logits in Heterogeneous Federated Learning

    Chan, Yun-Hin / Ngai, Edith C. -H. | ArXiv | 2022

    Freier Zugriff

    NormKD: Normalized Logits for Knowledge Distillation

    Chi, Zhihao / Zheng, Tu / Li, Hengjia et al. | ArXiv | 2023

    Freier Zugriff

    Principal components analysis of the logits of the survivorship function

    Mitra, S. / Levin, M. L. / International Union for the Scientific Study of Population | British Library Conference Proceedings | 1993


    Adaptive Temperature Based on Logits Correlation in Knowledge Distillation

    Matsuyama, Kazuhiro / Anjum, Usman / Matsuyama, Satoko et al. | ArXiv | 2025

    Freier Zugriff