Machine Learning · Computer Science
DSD: A Distributed Speculative Decoding Solution for Edge-Cloud Agile Large Model Serving
Fengze Yu, Leshu Li, Brad McDanel, Sai Qian Zhang
2025-12-02
Distributed, Parallel, and Cluster Computing · Computer Science
Recursive Offloading for LLM Serving in Multi-tier Networks
Zhiyuan Wu, Sheng Sun, Yuwei Wang, Min Liu +4
2025-05-27
Distributed, Parallel, and Cluster Computing · Computer Science
DisCEdge: Distributed Context Management for Large Language Models at the Edge
Mohammadreza Malekabbasi, Minghe Wang, David Bermbach
2026-04-09
Cryptography and Security · Computer Science
Distributed Threat Intelligence at the Edge Devices: A Large Language Model-Driven Approach
Syed Mhamudul Hasan, Alaa M. Alotaibi, Sajedul Talukder, Abdur R. Shahid
2024-10-10
Computation and Language · Computer Science
LLMs as On-demand Customizable Service
Souvika Sarkar, Mohammad Fakhruddin Babar, Monowar Hasan, Shubhra Kanti Karmaker
2024-01-31
Cryptography and Security · Computer Science
AgenTEE: Confidential LLM Agent Execution on Edge Devices
Sina Abdollahi, Mohammad M Maheri, Javad Forough, Amir Al Sadi +4
2026-05-07
Cryptography and Security · Computer Science
DistilLock: Safeguarding LLMs from Unauthorized Knowledge Distillation on the Edge
Asmita Mohanty, Gezheng Kang, Lei Gao, Murali Annavaram
2025-10-21
Machine Learning · Computer Science
dLLM-Cache: Accelerating Diffusion Large Language Models with Adaptive Caching
Zhiyuan Liu, Yicun Yang, Yaojie Zhang, Junjie Chen +4
2025-06-10
Computation and Language · Computer Science
Crayon: Customized On-Device LLM via Instant Adapter Blending and Edge-Server Hybrid Inference
Jihwan Bang, Juntae Lee, Kyuhong Shim, Seunghan Yang +1
2024-06-12
Distributed, Parallel, and Cluster Computing · Computer Science
Unlock the Potential of Fine-grained LLM Serving via Dynamic Module Scaling
Jingfeng Wu, Yiyuan He, Minxian Xu, Xitong Gao +2
2025-07-25
Machine Learning · Computer Science
Intra-request branch orchestration for efficient LLM reasoning
Weifan Jiang, Rana Shahout, Yilun Du, Michael Mitzenmacher +1
2025-09-30
Computation and Language · Computer Science
Token Level Routing Inference System for Edge Devices
Jianshu She, Wenhao Zheng, Zhengzhong Liu, Hongyi Wang +3
2025-04-11
Distributed, Parallel, and Cluster Computing · Computer Science
AcceLLM: Accelerating LLM Inference using Redundancy for Load Balancing and Data Locality
Ilias Bournias, Lukas Cavigelli, Georgios Zacharopoulos
2024-11-11
Distributed, Parallel, and Cluster Computing · Computer Science
DeepServe: Serverless Large Language Model Serving at Scale
Junhao Hu, Jiang Xu, Zhixia Liu, Yulong He +17
2025-06-10
Performance · Computer Science
Less is More: Optimizing Function Calling for LLM Execution on Edge Devices
Varatheepan Paramanayakam, Andreas Karatzas, Iraklis Anagnostopoulos, Dimitrios Stamoulis
2024-11-26
Machine Learning · Computer Science
Duo-LLM: A Framework for Studying Adaptive Computation in Large Language Models
Keivan Alizadeh, Iman Mirzadeh, Hooman Shahrokhi, Dmitry Belenko +5
2024-10-16
Hardware Architecture · Computer Science
Llumnix: Dynamic Scheduling for Large Language Model Serving
Biao Sun, Ziming Huang, Hanyu Zhao, Wencong Xiao +3
2024-06-07
Distributed, Parallel, and Cluster Computing · Computer Science
DeServe: Towards Affordable Offline LLM Inference via Decentralization
Linyu Wu, Xiaoyuan Liu, Tianneng Shi, Zhe Ye +1
2025-01-28
Systems and Control · Electrical Eng. & Systems
Efficient LLM Inference over Heterogeneous Edge Networks with Speculative Decoding
Bingjie Zhu, Zhixiong Chen, Liqiang Zhao, Hyundong Shin +1
2025-10-14
Distributed, Parallel, and Cluster Computing · Computer Science
Synera: Synergistic LLM Serving across Device and Cloud at Scale
Genglin Wang, Liekang Zeng, Bufang Yang, Kaiwei Liu +5
2025-11-12