English
Related papers

Related papers: Deep Partial Updating: Towards Communication Effic…

200 papers

Quantization is widely employed in both cloud and edge systems to reduce the memory occupation, latency, and energy consumption of deep neural networks. In particular, mixed-precision quantization, i.e., the use of different bit-widths for…

Machine Learning · Computer Science 2023-01-26 Matteo Risso , Alessio Burrello , Luca Benini , Enrico Macii , Massimo Poncino , Daniele Jahier Pagliari

Residual connections are pivotal for deep neural networks, enabling greater depth by mitigating vanishing gradients. However, in standard residual updates, the module's output is directly added to the input stream. This can lead to updates…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Giyeong Oh , Woohyun Cho , Siyeol Kim , Suhwan Choi , Youngjae Yu

We consider an information updating system where a source produces updates as requested by a transmitter. The transmitter further processes these updates in order to generate $partial$ $updates$, which have smaller information compared to…

Information Theory · Computer Science 2020-01-30 Melih Bastopcu , Sennur Ulukus

Deep neural networks achieve state-of-the-art and sometimes super-human performance across various domains. However, when learning tasks sequentially, the networks easily forget the knowledge of previous tasks, known as "catastrophic…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Shixiang Tang , Dapeng Chen , Jinguo Zhu , Shijie Yu , Wanli Ouyang

Freshness-aware computation offloading has garnered great attention recently in the edge computing arena, with the aim of promptly obtaining up-to-date information and minimizing the transmission of outdated data. However, most of the…

Networking and Internet Architecture · Computer Science 2024-01-24 Nan Qiao , Sheng Yue , Yongmin Zhang , Ju Ren

The present paper considers leveraging network topology information to improve the convergence rate of ADMM for decentralized optimization, where networked nodes work collaboratively to minimize the objective. Such problems can be solved…

Optimization and Control · Mathematics 2019-05-28 Meng Ma , Bingcong Li , Georgios B. Giannakis

Moving beyond just interconnected devices, the increasing interplay between communication and computation has fed the vision of real-time networked control systems. To obtain timely situational awareness, IoT devices continuously sample…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-09-28 Xiaoqi Qin , Yanlin Li , Xianxin Song , Nan Ma , Chuan Huang , Ping Zhang

We consider a many-to-one wireless architecture for federated learning at the network edge, where multiple edge devices collaboratively train a model using local data. The unreliable nature of wireless connectivity, together with…

Networking and Internet Architecture · Computer Science 2021-02-17 Junshan Zhang , Na Li , Mehmet Dedeoglu

Motivated by the proliferation of Internet-of-Thing (IoT) devices and the rapid advances in the field of deep learning, there is a growing interest in pushing deep learning computations, conventionally handled by the cloud, to the edge of…

Machine Learning · Computer Science 2024-09-25 Marco Palena , Tania Cerquitelli , Carla Fabiana Chiasserini

The large computing and memory cost of deep neural networks (DNNs) often precludes their use in resource-constrained devices. Quantizing the parameters and operations to lower bit-precision offers substantial memory and energy savings for…

Machine Learning · Computer Science 2023-09-01 Clemens JS Schaefer , Siddharth Joshi , Shan Li , Raul Blazquez

Task-oriented communication presents a promising approach to improve the communication efficiency of edge inference systems by optimizing learning-based modules to extract and transmit relevant task information. However, real-time…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Songjie Xie , Hengtao He , Shenghui Song , Jun Zhang , Khaled B. Letaief

Distributed learning algorithms aim to leverage distributed and diverse data stored at users' devices to learn a global phenomena by performing training amongst participating devices and periodically aggregating their local models'…

Machine Learning · Computer Science 2021-02-04 Naram Mhaisen , Alaa Awad , Amr Mohamed , Aiman Erbad , Mohsen Guizani

Deep-learning-based intelligent services have become prevalent in cyber-physical applications including smart cities and health-care. Deploying deep-learning-based intelligence near the end-user enhances privacy protection, responsiveness,…

Machine Learning · Computer Science 2022-02-23 Sina Shahhosseini , Dongjoo Seo , Anil Kanduri , Tianyi Hu , Sung-soo Lim , Bryan Donyanavard , Amir M. Rahmani , Nikil Dutt

In recent years, deep learning-based image compression, particularly through generative models, has emerged as a pivotal area of research. Despite significant advancements, challenges such as diminished sharpness and quality in…

Image and Video Processing · Electrical Eng. & Systems 2024-09-18 Ryugo Morita , Hitoshi Nishimura , Ko Watanabe , Andreas Dengel , Jinjia Zhou

Offloading time-sensitive, computationally intensive tasks-such as advanced learning algorithms for autonomous driving-from vehicles to nearby edge servers, vehicle-to-infrastructure (V2I) systems, or other collaborating vehicles via…

Networking and Internet Architecture · Computer Science 2024-08-08 Nazish Tahir , Ramviyas Parasuraman , Haijian Sun

Deep neural networks generally involve some layers with mil- lions of parameters, making them difficult to be deployed and updated on devices with limited resources such as mobile phones and other smart embedded systems. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2016-08-29 Xing Wang , Jie Liang

DNN inference can be accelerated by distributing the workload among a cluster of collaborative edge nodes. Heterogeneity among edge devices and accuracy-performance trade-offs of DNN models present a complex exploration space while catering…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-27 Zain Taufique , Antonio Miele , Pasi Liljeberg , Anil Kanduri

Edge inference techniques partition and distribute Deep Neural Network (DNN) inference tasks among multiple edge nodes for low latency inference, without considering the core-level heterogeneity of edge nodes. Further, default DNN inference…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Zain Taufique , Aman Vyas , Antonio Miele , Pasi Liljeberg , Anil Kanduri

Edge computing and artificial intelligence (AI), especially deep learning for nowadays, are gradually intersecting to build a novel system, called edge intelligence. However, the development of edge intelligence systems encounters some…

Machine Learning · Computer Science 2021-12-07 Di Liu , Hao Kong , Xiangzhong Luo , Weichen Liu , Ravi Subramaniam

Edge computing promises to offer low-latency and ubiquitous computation to numerous devices at the network edge. For delay-sensitive applications, link delays can have a direct impact on service quality. These delays can fluctuate…

Networking and Internet Architecture · Computer Science 2025-03-04 Jiaming Cheng , Duong Thuy Anh Nguyen , Ni Trieu , Duong Tung Nguyen