中文
相关论文

相关论文: Cached Model-as-a-Resource: Provisioning Large Lan…

200 篇论文

Edge intelligence delivers low-latency inference, yet most edge analytics remain hard-coded and must be redeployed as conditions change. When data patterns shift or new questions arise, engineers often need to write new scripts and push…

分布式、并行与集群计算 · 计算机科学 2026-04-14 Chinmaya Kumar Dehury , Siddharth Singh Kushwaha , Qiyang Zhang , Alaa Saleh , Praveen Kumar Donta

Large language model (LLM) inference at the network edge is a promising serving paradigm that leverages distributed edge resources to run inference near users and enhance privacy. Existing edge-based LLM inference systems typically adopt…

系统与控制 · 电气工程与系统科学 2025-10-14 Bingjie Zhu , Zhixiong Chen , Liqiang Zhao , Hyundong Shin , Arumugam Nallanathan

Large language models (LLMs) are emerging as key enablers of automation in domains such as telecommunications, assisting with tasks including troubleshooting, standards interpretation, and network optimization. However, their deployment in…

信号处理 · 电气工程与系统科学 2026-05-12 Qiushuo Hou , Sangwoo Park , Matteo Zecchin , Yunlong Cai , Guanding Yu , Osvaldo Simeone , Tommaso Melodia

The evolution of wireless networks gravitates towards connected intelligence, a concept that envisions seamless interconnectivity among humans, objects, and intelligence in a hyper-connected cyber-physical world. Edge artificial…

信息论 · 计算机科学 2023-12-27 Yifei Shen , Jiawei Shao , Xinjie Zhang , Zehong Lin , Hao Pan , Dongsheng Li , Jun Zhang , Khaled B. Letaief

With the proliferation of edge devices, there is a significant increase in attack surface on these devices. The decentralized deployment of threat intelligence on edge devices, coupled with adaptive machine learning techniques such as the…

密码学与安全 · 计算机科学 2024-10-10 Syed Mhamudul Hasan , Alaa M. Alotaibi , Sajedul Talukder , Abdur R. Shahid

Future sixth-generation (6G) mobile networks are envisioned to be equipped with a diverse set of powerful, yet highly specialized, optimization experts. Such a promising vision is concurrently expected to give rise to the need for scalable…

机器学习 · 计算机科学 2026-05-06 Robert-Jeron Reifert , Alaa Alameer Ahmad , Hayssam Dahrouj , Aydin Sezgin

Large language models (LLMs) have revolutionized natural language processing with their exceptional understanding, synthesizing, and reasoning capabilities. However, deploying LLMs on resource-constrained edge devices presents significant…

分布式、并行与集群计算 · 计算机科学 2025-02-25 Yue Zheng , Yuhao Chen , Bin Qian , Xiufang Shi , Yuanchao Shu , Jiming Chen

Edge intelligence paradigm is increasingly demanded by the emerging autonomous systems, such as robotics. Beyond ensuring privacy-preserving operation and resilience in connectivity-limited environments, edge deployment offers significant…

分布式、并行与集群计算 · 计算机科学 2025-11-05 Benjamin Kubwimana , Qijing Huang

With the advent of Fifth Generation (5G) and Sixth Generation (6G) communication technologies, as well as the Internet of Things (IoT), semantic communication is gaining attention among researchers as current communication technologies are…

网络与互联网体系结构 · 计算机科学 2024-07-31 Alakesh Kalita

The air-ground integrated network is a key component of future sixth generation (6G) networks to support seamless and near-instant super-connectivity. There is a pressing need to intelligently provision various services in 6G networks,…

网络与互联网体系结构 · 计算机科学 2022-03-29 Chao Dong , Yun Shen , Yuben Qu , Qihui Wu , Fan Wu , Guihai Chen

Generative artificial intelligence (GAI) is a promising technique towards 6G networks, and generative foundation models such as large language models (LLMs) have attracted considerable interest from academia and telecom industry. This work…

系统与控制 · 电气工程与系统科学 2025-03-25 Hao Zhou , Chengming Hu , Dun Yuan , Ye Yuan , Di Wu , Xue Liu , Zhu Han , Charlie Zhang

Edge computing enables real-time data processing closer to its source, thus improving the latency and performance of edge-enabled AI applications. However, traditional AI models often fall short when dealing with complex, dynamic tasks that…

网络与互联网体系结构 · 计算机科学 2025-07-02 Haoxiang Luo , Yinqiu Liu , Ruichen Zhang , Jiacheng Wang , Gang Sun , Dusit Niyato , Hongfang Yu , Zehui Xiong , Xianbin Wang , Xuemin Shen

This paper investigates compact large language model (LLM) deployment and world-model-assisted inference offloading in mobile edge computing (MEC) networks. We first propose an edge compact LLM deployment (ECLD) framework that jointly…

网络与互联网体系结构 · 计算机科学 2026-02-17 Ruichen Zhang , Xiaofeng Luo , Jiayi He , Dusit Niyato , Jiawen Kang , Zehui Xiong , Yonghui Li

The efficiency of large language models (LLMs) remains a critical challenge, particularly in contexts where computational resources are limited. Traditional attention mechanisms in these models, while powerful, require significant…

计算与语言 · 计算机科学 2024-07-19 Bingli Liao , Danilo Vasconcellos Vargas

Large language models (LLMs) have shown great potential in natural language processing and content generation. However, current LLMs heavily rely on cloud computing, leading to prolonged latency, high bandwidth cost, and privacy concerns.…

分布式、并行与集群计算 · 计算机科学 2024-05-24 Mingjin Zhang , Jiannong Cao , Xiaoming Shen , Zeyang Cui

Large Language Models (LLMs) were shown to struggle with long-term planning, which may be caused by the limited way in which they explore the space of possible solutions. We propose an architecture where a Reinforcement Learning (RL) Agent…

机器学习 · 计算机科学 2024-10-18 Yoav Alon , Cristina David

Large Language Models (LLMs) exhibit remarkable human-like predictive capabilities. However, it is challenging to deploy LLMs to provide efficient and adaptive inference services at the edge. This paper proposes a novel Cloud-Edge…

分布式、并行与集群计算 · 计算机科学 2025-06-10 Hongpeng Jin , Yanzhao Wu

The integration of agentic AI, powered by large language models (LLMs) with autonomous reasoning, planning, and execution, into unmanned aerial vehicle (UAV) swarms opens new operational possibilities and brings the vision of the Internet…

机器人学 · 计算机科学 2026-01-22 Thuan Minh Nguyen , Vu Tuan Truong , Long Bao Le

The rise of LLMs such as ChatGPT and Claude fuels the need for AI agents capable of real-time task handling. However, migrating data-intensive, multi-modal edge workloads to cloud data centers, traditionally used for agent deployment,…

人工智能 · 计算机科学 2025-08-06 Xingdan Wang , Jiayi He , Zhiqing Tang , Jianxiong Guo , Jiong Lou , Liping Qian , Tian Wang , Weijia Jia

The emergence of large language models (LLMs) opens new frontiers for unmanned aerial vehicle (UAVs), yet existing systems remain confined to predefined tasks due to hardware-software co-design challenges. This paper presents the first…

机器人学 · 计算机科学 2025-03-12 Ji Zhao , Xiao Lin