English
Related papers

Related papers: ReviveMoE: Fast Recovery for Hardware Failures in …

200 papers

In the context of Machine Learning as a Service (MLaaS) clouds, the extensive use of Large Language Models (LLMs) often requires efficient management of significant query loads. When providing real-time inference services, several…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-25 Yiyuan He , Minxian Xu , Jingfeng Wu , Wanyi Zheng , Kejiang Ye , Chengzhong Xu

Large language models (LLMs) have brought a great breakthrough to the natural language processing (NLP) community, while leading the challenge of handling concurrent customer queries due to their high throughput demands. Data multiplexing…

Computation and Language · Computer Science 2024-10-08 Yige Xu , Xu Guo , Zhiwei Zeng , Chunyan Miao

Large Language Models (LLMs) have achieved remarkable success across a wide range of tasks, but serving them efficiently at scale remains a critical challenge due to their substantial computational and latency demands. While most existing…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-04 Yifan Sun , Gholamreza Haffari , Minxian Xu , Rajkumar Buyya , Adel N. Toosi

Sparsely-activated Mixture-of-Experts (MoE) architecture has increasingly been adopted to further scale large language models (LLMs). However, frequent failures still pose significant challenges as training scales. The cost of even a single…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-27 Yongji Wu , Wenjie Qu , Xueshen Liu , Tianyang Tao , Yifan Qiao , Zhuang Wang , Wei Bai , Yuan Tian , Jiaheng Zhang , Z. Morley Mao , Matthew Lentz , Danyang Zhuo , Ion Stoica

Serverless computing has rapidly emerged as a popular cloud computing paradigm. It enables developers to implement function-level tasks, i.e., serverless functions, without managing infrastructure. While reducing operational overhead, it…

Software Engineering · Computer Science 2025-11-24 Jinfeng Wen , Yuehan Sun

The QMoE model provides a practical approach for compression of massive Mixture-of-Experts (MoE) models. QMoE offers a solution geared towards memory limitations that often reach terabyte scales, and it has the advantage of working with…

Performance · Computer Science 2025-09-30 Jack Cashman , Jiaqi Nie

Mixture-of-Experts (MoE) Large Language Models (LLMs) face a trilemma of load imbalance, parameter redundancy, and communication overhead. We introduce a unified framework based on dynamic expert clustering and structured compression to…

Computation and Language · Computer Science 2026-02-06 Peijun Zhu , Ning Yang , Baoliang Tian , Jiayu Wei , Weihao Zhang , Haijun Zhang , Pin Lv

With the breakthrough progress of large language models (LLMs) in natural language processing and multimodal tasks, efficiently deploying them on resource-constrained edge devices has become a critical challenge. The Mixture of Experts…

Machine Learning · Computer Science 2025-08-12 Tuo Zhang , Ning Li , Xin Yuan , Wenchao Xu , Quan Chen , Song Guo , Haijun Zhang

The proliferation of large language models (LLMs) has driven the adoption of Mixture-of-Experts (MoE) architectures as a promising solution to scale model capacity while controlling computational costs. However, deploying MoE models in…

Networking and Internet Architecture · Computer Science 2025-08-14 Muqing Li , Ning Li , Xin Yuan , Wenchao Xu , Quan Chen , Song Guo , Haijun Zhang

Serving Large Language Models (LLMs) in production faces significant challenges from highly variable request patterns and severe resource fragmentation in serverless clusters. Current systems rely on static pipeline configurations that…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-12 Yanying Lin , Shijie Peng , Chengzhi Lu , Chengzhong Xu , Kejiang Ye

Mixture of experts (MoE) is a popular technique to improve capacity of Large Language Models (LLMs) with conditionally-activated parallel experts. However, serving MoE models on memory-constrained devices is challenging due to the large…

Artificial Intelligence · Computer Science 2024-05-30 Rui Kong , Yuanchun Li , Qingtian Feng , Weijun Wang , Xiaozhou Ye , Ye Ouyang , Linghe Kong , Yunxin Liu

The Mixture-of-Experts (MoE) architecture has become increasingly popular as a method to scale up large language models (LLMs). To save costs, heterogeneity-aware training solutions have been proposed to utilize GPU clusters made up of both…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-08 Yongji Wu , Xueshen Liu , Shuowei Jin , Ceyu Xu , Feng Qian , Z. Morley Mao , Matthew Lentz , Danyang Zhuo , Ion Stoica

Mixture of Experts (MoE) models have enabled the scaling of Large Language Models (LLMs) and Vision Language Models (VLMs) by achieving massive parameter counts while maintaining computational efficiency. However, MoEs introduce several…

Link failures occur frequently in Internet Service Provider (ISP) networks and pose significant challenges for Traffic Engineering (TE). Existing TE schemes either reroute traffic over vulnerable static paths, leading to performance…

Networking and Internet Architecture · Computer Science 2025-09-03 Jingyi Guan , Kun Qiu , Jin Zhao

Multimodal Automated Program Repair (MAPR) extends traditional program repair by requiring models to jointly reason over source code, textual issue descriptions, and visual artifacts such as GUI screenshots. While recent LLM-based repair…

Software Engineering · Computer Science 2026-03-19 Ruize Ma , Yilei Jiang , Shilin Zhang , Zheng Ma , Yi Feng , Vincent Ng , Zhi Wang , Xiangyu Yue , Chuanyi Li , Lewei Lu

Modern deployment of large language models (LLMs) frequently involves both inference serving and continuous retraining to stay aligned with evolving data and user feedback. Common practices separate these workloads onto distinct servers in…

Artificial Intelligence · Computer Science 2025-07-30 Yufei Li , Zexin Li , Yinglun Zhu , Cong Liu

Fault-tolerant distributed applications require mechanisms to recover data lost via a process failure. On modern cluster systems it is typically impractical to request replacement resources after such a failure. Therefore, applications have…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-26 Lukas Hübner , Demian Hespe , Peter Sanders , Alexandros Stamatakis

The growing complexity of LLM usage today, e.g., multi-round conversation and retrieval-augmented generation (RAG), makes contextual states (i.e., KV cache) reusable across user requests. Given the capacity constraints of GPU memory, only a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-08 Shiwei Gao , Youmin Chen , Jiwu Shu

As the complexity of System-on-Chip (SoC) designs grows, the shift-left paradigm necessitates the rapid development of high-fidelity reference models (typically written in SystemC) for early architecture exploration and verification. While…

Software Engineering · Computer Science 2026-04-28 Yifan Zhang , Jianmin Ye , Jiahao Yang , Xi Wang

Efficiently deploying large language models (LLMs) in real-world scenarios remains a critical challenge, primarily due to hardware heterogeneity, inference framework limitations, and workload complexities.Efficiently deploying large…

Artificial Intelligence · Computer Science 2025-01-28 Yanyu Chen , Ganhong Huang