The increasing complexity of modern power systems and the proliferation of data-driven applications in smart grids demand advanced machine learning models for enhanced efficiency, reliability, and sustainability. However, deploying large language models (LLMs) in smart grids faces challenges such as high communication overhead, limited bandwidth, and data privacy concerns. Federated learning (FL) has emerged as a solution by enabling decentralized model training across distributed devices without sharing raw data, thereby preserving privacy. Yet, the size of LLMs imposes significant communication constraints in FL environments, especially in bandwidth-limited smart grid networks. This paper proposes a novel approach leveraging *Low-Rank Adaptation* (LoRA) to enhance the communication efficiency of LLMs in federated learning for smart grid applications. By injecting low-rank matrices into LLM layers, LoRA significantly reduces the number of model parameters updated during training, thereby minimizing the communication overhead while maintaining model performance. We present a comprehensive analysis of this approach, focusing on its impact on model accuracy, communication cost, and scalability in distributed smart grid environments. Our findings demonstrate that LoRA-enhanced federated LLMs provide an effective balance between communication efficiency, privacy preservation, and performance, offering a promising solution for future AI-driven smart grids.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Federated Large Language Models for Smart Grid: A Communication Efficient LoRA Approach


    Contributors:
    Deng, Xiaozhi (author) / Ma, Tengteng (author) / Li, Haobin (author) / Lu, Mingxin (author)


    Publication date :

    2024-10-23


    Size :

    510071 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    A Federated Learning Approach With Imperfect Labels in LoRa-Based Transportation Systems

    Kumar, Ramakant / Mishra, Rahul / Gupta, Hari Prabhat | IEEE | 2023


    Autopilot Unmanned Smart Boat Vehicle (AUSV) Communication with LoRa RFM95

    Arfianto, Afif Zuhri / Rahmat, Mohammad Basuki / Dhiyavia, Fuad et al. | BASE | 2020

    Free access

    Vehicle to Vehicle Communication and Smart Traffic Management Using LoRa

    Thangam, S. / Thodathara, Harshitha Reddy / Aryagopal et al. | Springer Verlag | 2025


    Autopilot Unmanned Smart Boat Vehicle (AUSV) Communication with LoRa RFM95

    Afif Zuhri Arfianto / Mohammad Basuki Rahmat / Fuad Dhiyavia et al. | DOAJ | 2020

    Free access

    Developing Ship Electronic Lookout Using LoRA Fine-Tuned Large Language Model

    Ma, Feng / Wang, Xiumin / Lv, Weiqian et al. | Springer Verlag | 2025