Federated Distillation (FD) offers an innovative approach to distributed machine learning, leveraging knowledge distillation for efficient and flexible cross-device knowledge transfer without necessitating the upload of extensive model parameters to a central server. While FD has gained popularity, its vulnerability to poisoning attacks remains underexplored. To address this gap, we previously introduced FDLA (Federated Distillation Logits Attack), a method that manipulates logits communication to mislead and degrade the performance of client models. However, the impact of FDLA on participants with different identities and the effects of malicious modifications at various stages of knowledge transfer remain unexplored. To this end, we present PCFDLA (Peak-Controlled Federated Distillation Logits Attack), an advanced and more stealthy logits poisoning attack method for FD. PCFDLA enhances the effectiveness of FDLA by carefully controlling the peak values of logits to create highly misleading yet inconspicuous modifications. Furthermore, we introduce a novel metric for better evaluating attack efficacy, demonstrating that PCFDLA maintains stealth while being significantly more disruptive to victim models compared to its predecessors. Experimental results across various datasets confirm the superior impact of PCFDLA on model accuracy, solidifying its potential threat in federated distillation systems.


    Access

    Download


    Export, share and cite



    Title :

    Peak-Controlled Logits Poisoning Attack in Federated Distillation


    Contributors:
    Tang, Yuhan (author) / Zhang, Aoxu (author) / Wu, Zhiyuan (author) / Gao, Bo (author) / Wen, Tian (author) / Wang, Yuwei (author) / Sun, Sheng (author)

    Publication date :

    2024


    Remarks:

    arXiv admin note: text overlap with arXiv:2401.03685


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Knowledge Distillation with Refined Logits

    Sun, Wujie / Chen, Defang / Lyu, Siwei et al. | ArXiv | 2024

    Free access

    NormKD: Normalized Logits for Knowledge Distillation

    Chi, Zhihao / Zheng, Tu / Li, Hengjia et al. | ArXiv | 2023

    Free access

    Exploiting Features and Logits in Heterogeneous Federated Learning

    Chan, Yun-Hin / Ngai, Edith C. -H. | ArXiv | 2022

    Free access

    Logit Poisoning Attack in Distillation-based Federated Learning and its Countermeasures

    Yu, Yonghao / Zhu, Shunan / Hu, Jinglu | ArXiv | 2024

    Free access

    Adaptive Temperature Based on Logits Correlation in Knowledge Distillation

    Matsuyama, Kazuhiro / Anjum, Usman / Matsuyama, Satoko et al. | ArXiv | 2025

    Free access