English
Related papers

Related papers: ELSA: Efficient LLM-Centric Split Aggregation for …

200 papers

As a paradigm of distributed machine learning, federated learning typically requires all edge devices to train a complete model locally. However, with the increasing scale of artificial intelligence models, the limited resources on edge…

Machine Learning · Computer Science 2024-12-11 Junhe Zhang , Wanli Ni , Dongyu Wang

Large language models (LLMs) have demonstrated exceptional proficiency in understanding and generating human language, but efficient inference on resource-constrained embedded devices remains challenging due to large model sizes and…

Hardware Architecture · Computer Science 2025-07-15 Weihong Xu , Haein Choi , Po-kai Hsu , Shimeng Yu , Tajana Rosing

Large language model (LLM) inference at the network edge is a promising serving paradigm that leverages distributed edge resources to run inference near users and enhance privacy. Existing edge-based LLM inference systems typically adopt…

Systems and Control · Electrical Eng. & Systems 2025-10-14 Bingjie Zhu , Zhixiong Chen , Liqiang Zhao , Hyundong Shin , Arumugam Nallanathan

Smart farming systems encounter significant challenges, including limited resources, the need for data privacy, and poor connectivity in rural areas. To address these issues, we present eEnergy-Split, an energy-efficient framework that…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-09-03 Keiwan Soltani , Vishesh Kumar Tanwar , Ashish Gupta , Sajal K. Das

As a promising paradigm federated Learning (FL) is widely used in privacy-preserving machine learning, which allows distributed devices to collaboratively train a model while avoiding data transmission among clients. Despite its immense…

Machine Learning · Computer Science 2023-08-29 Jinglong Shen , Xiucheng Wang , Nan Cheng , Longfei Ma , Conghao Zhou , Yuan Zhang

With the widespread application of edge computing and cloud systems in AI-driven applications, how to maintain efficient performance while ensuring data privacy has become an urgent security issue. This paper proposes a federated…

Cryptography and Security · Computer Science 2025-06-24 Huaiying Luo , Cheng Ji

Large Language Models (LLMs) suffer severe catastrophic forgetting when adapted sequentially to new tasks in a continual learning (CL) setting. Existing approaches are fundamentally limited: replay-based methods are impractical and…

Machine Learning · Computer Science 2026-01-08 Shristi Das Biswas , Yue Zhang , Anwesan Pal , Radhika Bhargava , Kaushik Roy

Federated Learning (FL) has emerged as a promising solution in Edge Computing (EC) environments to process the proliferation of data generated by edge devices. By collaboratively optimizing the global machine learning models on distributed…

Machine Learning · Computer Science 2024-02-14 Yongzhe Jia , Xuyun Zhang , Amin Beheshti , Wanchun Dou

Distributed machine learning (ML) at network edge is a promising paradigm that can preserve both network bandwidth and privacy of data providers. However, heterogeneous and limited computation and communication resources on edge servers (or…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-24 Qing Han , Shusen Yang , Xuebin Ren , Cong Zhao , Jingqi Zhang , Xinyu Yang

Private data holds promise for improving LLMs due to its high quality, but its scattered distribution across data silos and the high computational demands of LLMs limit their deployment in federated environments. To address this, the…

Computation and Language · Computer Science 2026-01-05 Zishuai Zhang , Hainan zhang , Weihua Li , Qinnan zhang , jin Dong , Yongxin Tong , Zhiming Zheng

As mobile devices increasingly become focal points for advanced applications, edge computing presents a viable solution to their inherent computational limitations, particularly in deploying large language models (LLMs). However, despite…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-01 Chang Liu , Jun Zhao

In the realm of the Internet of Things (IoT), deploying deep learning models to process data generated or collected by IoT devices is a critical challenge. However, direct data transmission can cause network congestion and inefficient…

Machine Learning · Computer Science 2023-11-10 Hengliang Tang , Zihang Zhao , Detian Liu , Yang Cao , Shiqiang Zhang , Siqing You

Federated Learning(FL) is a privacy-preserving machine learning paradigm where a global model is trained in-situ across a large number of distributed edge devices. These systems are often comprised of millions of user devices and only a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-05 Yuanli Wang , Lei Huang

Federated learning (FL) is a distributed Machine Learning (ML) framework that is capable of training a new global model by aggregating clients' locally trained models without sharing users' original data. Federated learning as a service…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-15 Wentao Gao , Omid Tavallaie , Shuaijun Chen , Albert Zomaya

Natural Language Processing (NLP) operations, such as semantic sentiment analysis and text synthesis, often raise privacy concerns and demand significant on-device computational resources. Centralized learning (CL) on the edge provides an…

Machine Learning · Computer Science 2025-07-08 Ahmed Y. Radwan , Mohammad Shehab , Mohamed-Slim Alouini

Federated Learning (FL) has emerged as a transformative approach for enabling distributed machine learning while preserving user privacy, yet it faces challenges like communication inefficiencies and reliance on centralized infrastructures,…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-29 Sai Puppala , Ismail Hossain , Md Jahangir Alam , Sajedul Talukder , Zahidur Talukder , Syed Bahauddin

Mobile devices contribute more than half of the world's web traffic, providing massive and diverse data for powering various federated learning (FL) applications. In order to avoid the communication bottleneck on the parameter server (PS)…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-03 Yunming Liao , Yang Xu , Hongli Xu , Zhiwei Yao , Liusheng Huang , Chunming Qiao

Split federated learning (SFL) has emerged as a promising paradigm to democratize machine learning (ML) on edge devices by enabling layer-wise model partitioning. However, existing SFL approaches suffer significantly from the straggler…

Machine Learning · Computer Science 2025-06-11 Zheng Lin , Zhe Chen , Xianhao Chen , Wei Ni , Yue Gao

In the ever-changing world of technology, continuous authentication and comprehensive access management are essential during user interactions with a device. Split Learning (SL) and Federated Learning (FL) have recently emerged as promising…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Mohamad Wazzeh , Mohamad Arafeh , Hani Sami , Hakima Ould-Slimane , Chamseddine Talhi , Azzam Mourad , Hadi Otrok

Large Language Models (LLMs) have revolutionized intelligent services by enabling logical reasoning, tool use, and interaction with external systems as agents. The advancement of LLMs is frequently hindered by the scarcity of high-quality…

Machine Learning · Computer Science 2024-12-12 Panlong Wu , Kangshuo Li , Junbao Nan , Fangxin Wang