English
Related papers

Related papers: Adaptive Layer Splitting for Wireless LLM Inferenc…

200 papers

Edge intelligent applications like VR/AR and language model based chatbots have become widespread with the rapid expansion of IoT and mobile devices. However, constrained edge devices often cannot serve the increasingly large and complex…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-28 Zongshun Zhang , Ibrahim Matta

Generative Artificial Intelligence (GAI) is taking the world by storm with its unparalleled content creation ability. Large Language Models (LLMs) are at the forefront of this movement. However, the significant resource demands of LLMs…

Machine Learning · Computer Science 2024-05-14 Xinyuan Zhang , Jiang Liu , Zehui Xiong , Yudong Huang , Gaochang Xie , Ran Zhang

Cell-free network is considered as a promising architecture for satisfying more demands of future wireless networks, where distributed access points coordinate with an edge cloud processor to jointly provide service to a smaller number of…

Information Theory · Computer Science 2021-02-08 Weilai Li , Wanli Ni , Hui Tian , Meihui Hua

The scaling laws have become the de facto guidelines for designing large language models (LLMs), but they were studied under the assumption of unlimited computing resources for both training and inference. As LLMs are increasingly used as…

Transformer-based large language models (LLMs) have demonstrated impressive capabilities in a variety of natural language processing (NLP) tasks. Nonetheless, it is challenging to deploy and fine-tune LLMs on mobile edge devices with…

Machine Learning · Computer Science 2023-11-23 Yuhao Chen , Yuxuan Yan , Qianqian Yang , Yuanchao Shu , Shibo He , Jiming Chen

Recent advancements in decentralized learning, such as Federated Learning (FL), Split Learning (SL), and Split Federated Learning (SplitFed), have expanded the potentials of machine learning. SplitFed aims to minimize the computational…

Artificial Intelligence · Computer Science 2024-05-31 Chamani Shiranthika , Parvaneh Saeedi , Ivan V. Bajić

We report a novel, computationally efficient approach for solving hard nonlinear problems of reinforcement learning (RL). Here we combine umbrella sampling, from computational physics/chemistry, with optimal control methods. The approach is…

Machine Learning · Computer Science 2025-02-28 Egor E. Nuzhin , Nikolai V. Brilliantov

Large language models (LLMs) have shown remarkable promise but remain challenging to continually improve through traditional finetuning, particularly when integrating capabilities from other specialized LLMs. Popular methods like ensemble…

Computation and Language · Computer Science 2025-06-02 Zhenglun Kong , Zheng Zhan , Shiyue Hou , Yifan Gong , Xin Meng , Pengwei Sui , Peiyan Dong , Xuan Shen , Zifeng Wang , Pu Zhao , Hao Tang , Stratis Ioannidis , Yanzhi Wang

Federated learning (FL) is a distributed learning paradigm that enables a large number of mobile devices to collaboratively learn a model under the coordination of a central server without sharing their raw data. Despite its practical…

Machine Learning · Computer Science 2021-09-14 Bing Luo , Xiang Li , Shiqiang Wang , Jianwei Huang , Leandros Tassiulas

Deep reinforcement learning (DRL) has long been a promising solution for sequential resource management in wireless networks. However, conventional DRL methods are fundamentally limited by their reliance on unimodal policy distributions,…

Large language models (LLMs) excel in most NLP tasks but also require expensive cloud servers for deployment due to their size, while smaller models that can be deployed on lower cost (e.g., edge) devices, tend to lag behind in terms of…

An increasing number of mobile applications rely on Machine Learning (ML) routines for analyzing data. Executing such tasks at the user devices saves the energy spent on transmitting and processing large data volumes at distant…

Networking and Internet Architecture · Computer Science 2022-01-11 Apostolos Galanopoulos , George Iosifidis , Theodoros Salonidis , Douglas J. Leith

Distributed machine learning (DML) techniques, such as federated learning, partitioned learning, and distributed reinforcement learning, have been increasingly applied to wireless communications. This is due to improved capabilities of…

Machine Learning · Computer Science 2020-12-04 S. Hu , X. Chen , W. Ni , E. Hossain , X. Wang

Edge intelligence paradigm is increasingly demanded by the emerging autonomous systems, such as robotics. Beyond ensuring privacy-preserving operation and resilience in connectivity-limited environments, edge deployment offers significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-05 Benjamin Kubwimana , Qijing Huang

With rapid advances in containerization techniques, the serverless computing model is becoming a valid candidate execution model in edge networking, similar to the widely used cloud model for applications that are stateless, single purpose…

Networking and Internet Architecture · Computer Science 2023-05-23 Mounir Bensalem , Erkan Ipek , Admela Jukan

Federated learning (FL) enables distributed learning across edge devices while protecting data privacy. However, the learning accuracy decreases due to the heterogeneity of devices' data, and the computation and communication latency…

Machine Learning · Computer Science 2024-01-17 Xiaonan Liu , Tharmalingam Ratnarajah , Mathini Sellathurai , Yonina C. Eldar

Distributed machine learning (ML) at network edge is a promising paradigm that can preserve both network bandwidth and privacy of data providers. However, heterogeneous and limited computation and communication resources on edge servers (or…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-24 Qing Han , Shusen Yang , Xuebin Ren , Cong Zhao , Jingqi Zhang , Xinyu Yang

The combination of Federated Learning (FL), Multimodal Large Language Models (MLLMs), and edge-cloud computing enables distributed and real-time data processing while preserving privacy across edge devices and cloud infrastructure. However,…

Neural and Evolutionary Computing · Computer Science 2025-02-19 Gaith Rjouba , Hanae Elmekki , Saidul Islam , Jamal Bentahar , Rachida Dssouli

Large Language Models (LLMs) have demonstrated impressive capabilities in natural language tasks, but their safety and morality remain contentious due to their training on internet text corpora. To address these concerns, alignment…

Computation and Language · Computer Science 2024-08-06 Mohammad Bahrami Karkevandi , Nishant Vishwamitra , Peyman Najafirad

Large language models (LLMs) exhibit impressive capabilities across a wide range of tasks, yet the choice of which model to use often involves a trade-off between performance and cost. More powerful models, though effective, come with…

Machine Learning · Computer Science 2025-02-25 Isaac Ong , Amjad Almahairi , Vincent Wu , Wei-Lin Chiang , Tianhao Wu , Joseph E. Gonzalez , M Waleed Kadous , Ion Stoica