Federated Distillation (FD) offers an innovative approach to distributed machine learning, leveraging knowledge distillation for efficient and flexible cross-device knowledge transfer without necessitating the upload of extensive model parameters to a central server. While FD has gained popularity, its vulnerability to poisoning attacks remains underexplored. To address this gap, we previously introduced FDLA (Federated Distillation Logits Attack), a method that manipulates logits communication to mislead and degrade the performance of client models. However, the impact of FDLA on participants with different identities and the effects of malicious modifications at various stages of knowledge transfer remain unexplored. To this end, we present PCFDLA (Peak-Controlled Federated Distillation Logits Attack), an advanced and more stealthy logits poisoning attack method for FD. PCFDLA enhances the effectiveness of FDLA by carefully controlling the peak values of logits to create highly misleading yet inconspicuous modifications. Furthermore, we introduce a novel metric for better evaluating attack efficacy, demonstrating that PCFDLA maintains stealth while being significantly more disruptive to victim models compared to its predecessors. Experimental results across various datasets confirm the superior impact of PCFDLA on model accuracy, solidifying its potential threat in federated distillation systems.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Peak-Controlled Logits Poisoning Attack in Federated Distillation


    Beteiligte:
    Tang, Yuhan (Autor:in) / Zhang, Aoxu (Autor:in) / Wu, Zhiyuan (Autor:in) / Gao, Bo (Autor:in) / Wen, Tian (Autor:in) / Wang, Yuwei (Autor:in) / Sun, Sheng (Autor:in)

    Erscheinungsdatum :

    2024


    Anmerkungen:

    arXiv admin note: text overlap with arXiv:2401.03685


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Knowledge Distillation with Refined Logits

    Sun, Wujie / Chen, Defang / Lyu, Siwei et al. | ArXiv | 2024

    Freier Zugriff

    NormKD: Normalized Logits for Knowledge Distillation

    Chi, Zhihao / Zheng, Tu / Li, Hengjia et al. | ArXiv | 2023

    Freier Zugriff

    Exploiting Features and Logits in Heterogeneous Federated Learning

    Chan, Yun-Hin / Ngai, Edith C. -H. | ArXiv | 2022

    Freier Zugriff

    Logit Poisoning Attack in Distillation-based Federated Learning and its Countermeasures

    Yu, Yonghao / Zhu, Shunan / Hu, Jinglu | ArXiv | 2024

    Freier Zugriff

    Adaptive Temperature Based on Logits Correlation in Knowledge Distillation

    Matsuyama, Kazuhiro / Anjum, Usman / Matsuyama, Satoko et al. | ArXiv | 2025

    Freier Zugriff