Consider a device that is connected to an edge processor via a communication channel. The device holds local data that is to be offloaded to the edge processor so as to train a machine learning model, e.g., for regression or classification. Transmission of the data to the learning processor, as well as training based on Stochastic Gradient Descent (SGD), must be both completed within a time limit. Assuming that communication and computation can be pipelined, this letter investigates the optimal choice for the packet payload size, given the overhead of each data packet transmission and the ratio between the computation and the communication rates. This amounts to a tradeoff between bias and variance, since communicating the entire data set first reduces the bias of the training process but it may not leave sufficient time for learning. Analytical bounds on the expected optimality gap are derived so as to enable an effective optimization, which is validated in numerical results.


    Access

    Download


    Export, share and cite



    Title :

    Optimizing Pipelined Computation and Communication for Latency-Constrained Edge Learning


    Contributors:

    Publication date :

    2019-09-01


    Remarks:

    Skatchkovsky , N & Simeone , O 2019 , ' Optimizing Pipelined Computation and Communication for Latency-Constrained Edge Learning ' , IEEE COMMUNICATIONS LETTERS , vol. 23 , no. 9 , 8736251 , pp. 1542-1546 . https://doi.org/10.1109/LCOMM.2019.2922658



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629





    Optimizing Communication and Computation for Multi-UAV Information Gathering Applications

    Thammawichai, Mason / Baliyarasimhuni, Sujit P. / Kerrigan, Eric C. et al. | IEEE | 2018


    Edge-to-cloud Latency Aware User Association in Wireless Hierarchical Federated Learning

    Gau, Rung-Hung / Liang, Di-Chun / Wang, Ting-Yu et al. | IEEE | 2024


    Hierarchical Federated Learning with Edge Optimization in Constrained Networks

    Zhang, Xiaoyang / Tham, Chen-Khong / Wang, Wenyi | IEEE | 2024