中文
相关论文

相关论文: Deep Partial Updating: Towards Communication Effic…

200 篇论文

Quantization is widely employed in both cloud and edge systems to reduce the memory occupation, latency, and energy consumption of deep neural networks. In particular, mixed-precision quantization, i.e., the use of different bit-widths for…

机器学习 · 计算机科学 2023-01-26 Matteo Risso , Alessio Burrello , Luca Benini , Enrico Macii , Massimo Poncino , Daniele Jahier Pagliari

Residual connections are pivotal for deep neural networks, enabling greater depth by mitigating vanishing gradients. However, in standard residual updates, the module's output is directly added to the input stream. This can lead to updates…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Giyeong Oh , Woohyun Cho , Siyeol Kim , Suhwan Choi , Youngjae Yu

We consider an information updating system where a source produces updates as requested by a transmitter. The transmitter further processes these updates in order to generate $partial$ $updates$, which have smaller information compared to…

信息论 · 计算机科学 2020-01-30 Melih Bastopcu , Sennur Ulukus

Deep neural networks achieve state-of-the-art and sometimes super-human performance across various domains. However, when learning tasks sequentially, the networks easily forget the knowledge of previous tasks, known as "catastrophic…

计算机视觉与模式识别 · 计算机科学 2021-05-18 Shixiang Tang , Dapeng Chen , Jinguo Zhu , Shijie Yu , Wanli Ouyang

Freshness-aware computation offloading has garnered great attention recently in the edge computing arena, with the aim of promptly obtaining up-to-date information and minimizing the transmission of outdated data. However, most of the…

网络与互联网体系结构 · 计算机科学 2024-01-24 Nan Qiao , Sheng Yue , Yongmin Zhang , Ju Ren

The present paper considers leveraging network topology information to improve the convergence rate of ADMM for decentralized optimization, where networked nodes work collaboratively to minimize the objective. Such problems can be solved…

最优化与控制 · 数学 2019-05-28 Meng Ma , Bingcong Li , Georgios B. Giannakis

Moving beyond just interconnected devices, the increasing interplay between communication and computation has fed the vision of real-time networked control systems. To obtain timely situational awareness, IoT devices continuously sample…

分布式、并行与集群计算 · 计算机科学 2022-09-28 Xiaoqi Qin , Yanlin Li , Xianxin Song , Nan Ma , Chuan Huang , Ping Zhang

We consider a many-to-one wireless architecture for federated learning at the network edge, where multiple edge devices collaboratively train a model using local data. The unreliable nature of wireless connectivity, together with…

网络与互联网体系结构 · 计算机科学 2021-02-17 Junshan Zhang , Na Li , Mehmet Dedeoglu

Motivated by the proliferation of Internet-of-Thing (IoT) devices and the rapid advances in the field of deep learning, there is a growing interest in pushing deep learning computations, conventionally handled by the cloud, to the edge of…

机器学习 · 计算机科学 2024-09-25 Marco Palena , Tania Cerquitelli , Carla Fabiana Chiasserini

The large computing and memory cost of deep neural networks (DNNs) often precludes their use in resource-constrained devices. Quantizing the parameters and operations to lower bit-precision offers substantial memory and energy savings for…

机器学习 · 计算机科学 2023-09-01 Clemens JS Schaefer , Siddharth Joshi , Shan Li , Raul Blazquez

Task-oriented communication presents a promising approach to improve the communication efficiency of edge inference systems by optimizing learning-based modules to extract and transmit relevant task information. However, real-time…

计算机视觉与模式识别 · 计算机科学 2024-12-03 Songjie Xie , Hengtao He , Shenghui Song , Jun Zhang , Khaled B. Letaief

Distributed learning algorithms aim to leverage distributed and diverse data stored at users' devices to learn a global phenomena by performing training amongst participating devices and periodically aggregating their local models'…

机器学习 · 计算机科学 2021-02-04 Naram Mhaisen , Alaa Awad , Amr Mohamed , Aiman Erbad , Mohsen Guizani

Deep-learning-based intelligent services have become prevalent in cyber-physical applications including smart cities and health-care. Deploying deep-learning-based intelligence near the end-user enhances privacy protection, responsiveness,…

In recent years, deep learning-based image compression, particularly through generative models, has emerged as a pivotal area of research. Despite significant advancements, challenges such as diminished sharpness and quality in…

图像与视频处理 · 电气工程与系统科学 2024-09-18 Ryugo Morita , Hitoshi Nishimura , Ko Watanabe , Andreas Dengel , Jinjia Zhou

Offloading time-sensitive, computationally intensive tasks-such as advanced learning algorithms for autonomous driving-from vehicles to nearby edge servers, vehicle-to-infrastructure (V2I) systems, or other collaborating vehicles via…

网络与互联网体系结构 · 计算机科学 2024-08-08 Nazish Tahir , Ramviyas Parasuraman , Haijian Sun

Deep neural networks generally involve some layers with mil- lions of parameters, making them difficult to be deployed and updated on devices with limited resources such as mobile phones and other smart embedded systems. In this paper, we…

计算机视觉与模式识别 · 计算机科学 2016-08-29 Xing Wang , Jie Liang

DNN inference can be accelerated by distributing the workload among a cluster of collaborative edge nodes. Heterogeneity among edge devices and accuracy-performance trade-offs of DNN models present a complex exploration space while catering…

分布式、并行与集群计算 · 计算机科学 2024-03-27 Zain Taufique , Antonio Miele , Pasi Liljeberg , Anil Kanduri

Edge inference techniques partition and distribute Deep Neural Network (DNN) inference tasks among multiple edge nodes for low latency inference, without considering the core-level heterogeneity of edge nodes. Further, default DNN inference…

分布式、并行与集群计算 · 计算机科学 2024-11-26 Zain Taufique , Aman Vyas , Antonio Miele , Pasi Liljeberg , Anil Kanduri

Edge computing and artificial intelligence (AI), especially deep learning for nowadays, are gradually intersecting to build a novel system, called edge intelligence. However, the development of edge intelligence systems encounters some…

机器学习 · 计算机科学 2021-12-07 Di Liu , Hao Kong , Xiangzhong Luo , Weichen Liu , Ravi Subramaniam

Edge computing promises to offer low-latency and ubiquitous computation to numerous devices at the network edge. For delay-sensitive applications, link delays can have a direct impact on service quality. These delays can fluctuate…

网络与互联网体系结构 · 计算机科学 2025-03-04 Jiaming Cheng , Duong Thuy Anh Nguyen , Ni Trieu , Duong Tung Nguyen