中文
相关论文

相关论文: A QoE-Aware Split Inference Accelerating Algorithm…

200 篇论文

Optimizing the deployment of large language models (LLMs) in edge computing environments is critical for enhancing privacy and computational efficiency. Toward efficient wireless LLM inference in edge computing, this study comprehensively…

机器学习 · 计算机科学 2024-09-12 Yuxuan Chen , Rongpeng Li , Xiaoxue Yu , Zhifeng Zhao , Honggang Zhang

With the aim of accomplishing intelligence tasks, semantic communications transmit task-related information only, yielding significant performance gains over conventional communications. To guarantee user requirements for different types of…

信号处理 · 电气工程与系统科学 2023-05-12 Lei Yan , Zhijin Qin , Rui Zhang , Yongzhao Li , Geoffrey Ye Li

Large Artificial Intelligence Models (LAMs) powered by massive datasets, extensive parameter scales, and extensive computational resources, leading to significant transformations across various industries. Yet, their practical deployment on…

机器学习 · 计算机科学 2026-04-22 Xianke Qiang , Hongda Liu , Xinran Zhang , Zheng Chang , Ying-Chang Liang

This paper designs a helper-assisted resource allocation strategy in non-orthogonal multiple access (NOMA)-enabled mobile edge computing (MEC) systems, in order to guarantee the quality of service (QoS) of the energy/delay-sensitive user…

信息论 · 计算机科学 2023-01-26 Mengmeng Ren , Long Yang , Hai Jiang , Jian Chen , Yuchen Zhou

With the development of Edge Computing and Artificial Intelligence (AI) technologies, edge devices are witnessed to generate data at unprecedented volume. The Edge Intelligence (EI) has led to the emergence of edge devices in various…

信息检索 · 计算机科学 2021-06-22 Jiayan Gu , Yan Wu , Ashiq Anjum , John Panneerselvam , Yao Lu , Bo Yuan

Large language models (LLMs) have shown great potential in natural language processing and content generation. However, current LLMs heavily rely on cloud computing, leading to prolonged latency, high bandwidth cost, and privacy concerns.…

分布式、并行与集群计算 · 计算机科学 2024-05-24 Mingjin Zhang , Jiannong Cao , Xiaoming Shen , Zeyang Cui

Deep neural networks (DNNs) sustain high performance in today's data processing applications. DNN inference is resource-intensive thus is difficult to fit into a mobile device. An alternative is to offload the DNN inference to a cloud…

分布式、并行与集群计算 · 计算机科学 2021-01-18 Beibei Zhang , Tian Xiang , Hongxuan Zhang , Te Li , Shiqiang Zhu , Jianjun Gu

Entity Alignment (EA) aims to match equivalent entities that refer to the same real-world objects and is a key step for Knowledge Graph (KG) fusion. Most neural EA models cannot be applied to large-scale real-life KGs due to their excessive…

人工智能 · 计算机科学 2022-08-23 Bing Liu , Wen Hua , Guido Zuccon , Genghong Zhao , Xia Zhang

Edge computing has become a very popular service that enables mobile devices to run complex tasks with the help of network-based computing resources. However, edge clouds are often resource-constrained, which makes resource allocation a…

分布式、并行与集群计算 · 计算机科学 2024-04-02 Caroline Rublein , Fidan Mehmeti , Mark Mahon , Thomas F. La Porta

In recent years, deep learning models have become ubiquitous in industry and academia alike. Deep neural networks can solve some of the most complex pattern-recognition problems today, but come with the price of massive compute and memory…

分布式、并行与集群计算 · 计算机科学 2022-05-24 Shreshth Tuli , Giuliano Casale , Nicholas R. Jennings

Owing to the large volume of sensed data from the enormous number of IoT devices in operation today, centralized machine learning algorithms operating on such data incur an unbearable training time, and thus cannot satisfy the requirements…

信号处理 · 电气工程与系统科学 2020-07-21 Shashank Jere , Qiang Fan , Bodong Shang , Lianjun Li , Lingjia Liu

Edge Learning (EL) pushes the computational resources toward the edge of 5G/6G network to assist mobile users requesting delay-sensitive and energy-aware intelligent services. A common challenge in running inference tasks from remote is to…

信号处理 · 电气工程与系统科学 2023-05-04 Francesco Binucci , Paolo Banelli , Paolo Di Lorenzo , Sergio Barbarossa

Large language models (LLMs) have achieved near-human performance across diverse reasoning tasks, yet their deployment on resource-constrained Internet-of-Things (IoT) devices remains impractical due to massive parameter footprints and…

机器学习 · 计算机科学 2025-11-07 Mingyu Sung , Vikas Palakonda , Suhwan Im , Sunghwan Moon , Il-Min Kim , Sangseok Yun , Jae-Mo Kang

Distributed inference techniques can be broadly classified into data-distributed and model-distributed schemes. In data-distributed inference (DDI), each worker carries the entire Machine Learning (ML) model but processes only a subset of…

分布式、并行与集群计算 · 计算机科学 2024-12-18 Teng Li , Hulya Seferoglu

Generative Artificial Intelligence (GAI) is taking the world by storm with its unparalleled content creation ability. Large Language Models (LLMs) are at the forefront of this movement. However, the significant resource demands of LLMs…

机器学习 · 计算机科学 2024-05-14 Xinyuan Zhang , Jiang Liu , Zehui Xiong , Yudong Huang , Gaochang Xie , Ran Zhang

With the increasing reliance of users on smart devices, bringing essential computation at the edge has become a crucial requirement for any type of business. Many such computations utilize Convolution Neural Networks (CNNs) to perform AI…

机器学习 · 计算机科学 2022-01-17 Tanmay Jain , Avaneesh , Rohit Verma , Rajeev Shorey

In this paper, we provide joint subcarrier assignment and power allocation schemes for quality-of-service (QoS)-constrained energy-efficiency (EE) optimization in the downlink of an orthogonal frequency division multiple access…

信息论 · 计算机科学 2016-11-01 Jie Tang , Daniel K. C. So , Emad Alsusa , Khairi Ashour Hamdi , Arman Shojaeifard , Kai-Kit Wong

With the breakthrough progress of large language models (LLMs) in natural language processing and multimodal tasks, efficiently deploying them on resource-constrained edge devices has become a critical challenge. The Mixture of Experts…

机器学习 · 计算机科学 2025-08-12 Tuo Zhang , Ning Li , Xin Yuan , Wenchao Xu , Quan Chen , Song Guo , Haijun Zhang

The massive growth in the utilization of edge AI has made the applications of machine learning models ubiquitous in different domains. Despite the computation and communication efficiency of these systems, due to limited computation…

分布式、并行与集群计算 · 计算机科学 2025-11-18 Mohammad Mahdi Kamani , Zhongwei Cheng , Lin Chen

As machine learning models scale in size and complexity, their computational requirements become a significant barrier. Mixture-of-Experts (MoE) models alleviate this issue by selectively activating relevant experts. Despite this, MoE…

机器学习 · 计算机科学 2024-10-23 Jialong Li , Shreyansh Tripathi , Lakshay Rastogi , Yiming Lei , Rui Pan , Yiting Xia