English
Related papers

Related papers: The MoE-Empowered Edge LLMs Deployment: Architectu…

200 papers

Edge-cloud synergies provide a promising paradigm for privacy-preserving deployment of foundation models, where lightweight on-device models adapt to domain-specific data and cloud-hosted models coordinate knowledge sharing. However, in…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-17 Yuze Liu , Shibo Chu , Tiehua Zhang , Hao Zhou , Zhishu Shen , Jinze Wang , Jianzhong Qi , Feng Xia

Deep Learning (DL) model-based AI services are increasingly offered in a variety of predictive analytics services such as computer vision, natural language processing, speech recognition. However, the quality of the DL models can degrade…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-11-04 Anirban Bhattacharjee , Ajay Dev Chhokra , Hongyang Sun , Shashank Shekhar , Aniruddha Gokhale , Gabor Karsai , Abhishek Dubey

The Mobile Edge Computing (MEC) system located close to the client allows mobile smart devices to offload their computations onto edge servers, enabling them to benefit from low-latency computing services. Both cloud service providers and…

Neural and Evolutionary Computing · Computer Science 2023-12-08 Yanheng Guo , Yan Zhang , Linjie Wu , Mengxia Li , Xingjuan Cai , Jinjun Chen

AI agents based on multimodal large language models (LLMs) are expected to revolutionize human-computer interaction and offer more personalized assistant services across various domains like healthcare, education, manufacturing, and…

Artificial Intelligence · Computer Science 2024-02-20 Minrui Xu , Dusit Niyato , Jiawen Kang , Zehui Xiong , Shiwen Mao , Zhu Han , Dong In Kim , Khaled B. Letaief

Mixture-of-experts (MoE) architectures used in large language models (LLMs) achieve state-of-the-art performance across diverse tasks yet face practical challenges such as deployment complexity and low activation efficiency. Expert pruning…

Machine Learning · Computer Science 2025-12-23 Xican Yang , Yuanhe Tian , Yan Song

The rise of LLMs such as ChatGPT and Claude fuels the need for AI agents capable of real-time task handling. However, migrating data-intensive, multi-modal edge workloads to cloud data centers, traditionally used for agent deployment,…

Artificial Intelligence · Computer Science 2025-08-06 Xingdan Wang , Jiayi He , Zhiqing Tang , Jianxiong Guo , Jiong Lou , Liping Qian , Tian Wang , Weijia Jia

Mobile edge computing (MEC) is considered a novel paradigm for computation-intensive and delay-sensitive tasks in fifth generation (5G) networks and beyond. However, its uncertainty, referred to as dynamic and randomness, from the mobile…

Information Theory · Computer Science 2022-06-22 Peng Wei , Kun Guo , Ye Li , Jue Wang , Wei Feng , Shi Jin , Ning Ge , Ying-Chang Liang

Mixture-of-Experts (MoE) activates only a subset of experts during inference, allowing the model to maintain low inference FLOPs and latency even as the parameter count scales up. However, since MoE dynamically selects the experts, all the…

Machine Learning · Computer Science 2025-05-27 Shibo Jie , Yehui Tang , Kai Han , Yitong Li , Duyu Tang , Zhi-Hong Deng , Yunhe Wang

Facing a vast amount of connections, huge performance demands, and the need for reliable connectivity, the sixth generation of communication networks (6G) is envisioned to implement disruptive technologies that jointly spur connectivity,…

Information Theory · Computer Science 2023-10-26 Robert-Jeron Reifert , Hayssam Dahrouj , Basem Shihada , Aydin Sezgin , Tareq Y. Al-Naffouri , Mohamed-Slim Alouini

Adapting medical Large Language Models to local languages can reduce barriers to accessing healthcare services, but data scarcity remains a significant challenge, particularly for low-resource languages. To address this, we first construct…

Computation and Language · Computer Science 2025-02-11 Guorui Zheng , Xidong Wang , Juhao Liang , Nuo Chen , Yuping Zheng , Benyou Wang

Edge intelligence paradigm is increasingly demanded by the emerging autonomous systems, such as robotics. Beyond ensuring privacy-preserving operation and resilience in connectivity-limited environments, edge deployment offers significant…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-05 Benjamin Kubwimana , Qijing Huang

Large artificial intelligence models (LAMs) possess human-like abilities to solve a wide range of real-world problems, exemplifying the potential of experts in various domains and modalities. By leveraging the communication and computation…

Networking and Internet Architecture · Computer Science 2025-05-02 Zixin Wang , Yuanming Shi , Yong Zhou , Jingyang Zhu , Khaled. B. Letaief

The trend of massive connectivity pushes forward the explosive growth of end devices. The emergence of various applications has prompted a demand for pervasive connectivity and more efficient computing paradigms. On the other hand, the lack…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Zelin Ji , Zhijin Qin

Large Language Models (LLMs) based on Mixture-of-Experts (MoE) are pivotal in industrial applications for their ability to scale performance efficiently. However, standard MoEs enforce uniform expert sizes,creating a rigidity that fails to…

Computation and Language · Computer Science 2026-04-29 Zhicheng Ma , Xiang Liu , Zhaoxiang Liu , Ning Wang , Yi Shen , Kai Wang , Shuming Shi , Shiguo Lian

Mobile Edge Computing (MEC) is an emerging paradigm that provides computing, storage, and networking resources within the edge of the mobile Radio Access Network (RAN). MEC servers are deployed on generic computing platform within the RAN…

Networking and Internet Architecture · Computer Science 2017-04-12 Tuyen X. Tran , Abolfazl Hajisami , Parul Pandey , Dario Pompili

The QMoE model provides a practical approach for compression of massive Mixture-of-Experts (MoE) models. QMoE offers a solution geared towards memory limitations that often reach terabyte scales, and it has the advantage of working with…

Performance · Computer Science 2025-09-30 Jack Cashman , Jiaqi Nie

Mobile Edge Computing (MEC), which incorporates the Cloud, edge nodes and end devices, has shown great potential in bringing data processing closer to the data sources. Meanwhile, Federated learning (FL) has emerged as a promising…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-04-26 Wentai Wu , Ligang He , Weiwei Lin , Rui Mao

The recent success of specialized Large Language Models (LLMs) in domains such as mathematical reasoning and coding has led to growing interest in methods for merging these expert LLMs into a unified Mixture-of-Experts (MoE) model, with the…

Computation and Language · Computer Science 2025-02-18 Yuhang Zhou , Giannis Karamanolakis , Victor Soto , Anna Rumshisky , Mayank Kulkarni , Furong Huang , Wei Ai , Jianhua Lu

Mixture of experts (MoE) architectures have become a cornerstone for scaling up and are a key component in most large language models such as GPT-OSS, DeepSeek-V3, Llama-4, and Gemini-2.5. However, systematic research on MoE remains…

Computation and Language · Computer Science 2026-02-11 Nam V. Nguyen , Thong T. Doan , Luong Tran , Van Nguyen , Quang Pham

Efficient adaption of large language models (LLMs) on edge devices is essential for applications requiring continuous and privacy-preserving adaptation and inference. However, existing tuning techniques fall short because of the high…

‹ Prev 1 4 5 6 7 8 10 Next ›