English
Related papers

Related papers: CoDeC: Communication-Efficient Decentralized Conti…

200 papers

Edge machine learning involves the deployment of learning algorithms at the wireless network edge so as to leverage massive mobile data for enabling intelligent applications. The mainstream edge learning approach, federated learning, has…

Information Theory · Computer Science 2020-06-24 Yuqing Du , Sheng Yang , Kaibin Huang

In 5G and Beyond networks, Artificial Intelligence applications are expected to be increasingly ubiquitous. This necessitates a paradigm shift from the current cloud-centric model training approach to the Edge Computing based collaborative…

Networking and Internet Architecture · Computer Science 2020-06-02 Wei Yang Bryan Lim , Jer Shyuan Ng , Zehui Xiong , Dusit Niyato , Cyril Leung , Chunyan Miao , Qiang Yang

This paper proposes a deep learning framework to design distributed compression strategies in which distributed agents need to compress high-dimensional observations of a source, then send the compressed bits via bandwidth limited links to…

Information Theory · Computer Science 2022-03-10 Foad Sohrabi , Tao Jiang , Wei Yu

Split learning is a promising privacy-preserving distributed learning scheme that has low computation requirement at the edge device but has the disadvantage of high communication overhead between edge device and server. To reduce the…

Machine Learning · Computer Science 2022-03-10 Xing Chen , Jingtao Li , Chaitali Chakrabarti

Decentralized optimization is an emerging paradigm in distributed learning in which agents achieve network-wide solutions by peer-to-peer communication without the central server. Since communication tends to be slower than computation,…

Optimization and Control · Mathematics 2023-03-14 Zhuoqing Song , Weijian Li , Kexin Jin , Lei Shi , Ming Yan , Wotao Yin , Kun Yuan

Currently, progressively larger deep neural networks are trained on ever growing data corpora. As this trend is only going to increase in the future, distributed training schemes are becoming increasingly relevant. A major issue in…

Machine Learning · Computer Science 2018-05-23 Felix Sattler , Simon Wiedemann , Klaus-Robert Müller , Wojciech Samek

In hierarchical cognitive radio networks, edge or cloud servers utilize the data collected by edge devices for modulation classification, which, however, is faced with problems of the computation load, transmission overhead, and data…

Signal Processing · Electrical Eng. & Systems 2024-07-31 Peihao Dong , Chaowei He , Shen Gao , Fuhui Zhou , Qihui Wu

Federated learning (FL) has emerged as a promising paradigm within edge computing (EC) systems, enabling numerous edge devices to collaboratively train artificial intelligence (AI) models while maintaining data privacy. To overcome the…

Machine Learning · Computer Science 2025-08-13 Yuze Liu , Tiehua Zhang , Zhishu Shen , Libing Wu , Shiping Chen , Jiong Jin

With rise of machine learning (ML) and the proliferation of smart mobile devices, recent years have witnessed a surge of interest in performing ML in wireless edge networks. In this paper, we consider the problem of jointly improving data…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-31 Xin Zhang , Minghong Fang , Jia Liu , Zhengyuan Zhu

Decentralized learning (DL) leverages edge devices for collaborative model training while avoiding coordination by a central server. Due to privacy concerns, DL has become an attractive alternative to centralized learning schemes since…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-08 Martijn de Vos , Akash Dhasade , Anne-Marie Kermarrec , Erick Lavoie , Johan Pouwelse , Rishi Sharma

We propose Adaptive Compressed Gradient Descent (AdaCGD) - a novel optimization algorithm for communication-efficient training of supervised machine learning models with adaptive compression level. Our approach is inspired by the recently…

Machine Learning · Computer Science 2022-11-02 Maksim Makarenko , Elnur Gasanov , Rustem Islamov , Abdurakhmon Sadiev , Peter Richtarik

In this paper, we consider decentralized optimization problems where agents have individual cost functions to minimize subject to subspace constraints that require the minimizers across the network to lie in low-dimensional subspaces. This…

Optimization and Control · Mathematics 2023-08-01 Roula Nassif , Stefan Vlaski , Marco Carpentiero , Vincenzo Matta , Marc Antonini , Ali H. Sayed

Big data, including applications with high security requirements, are often collected and stored on multiple heterogeneous devices, such as mobile devices, drones and vehicles. Due to the limitations of communication costs and security…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-05 Hao Chen , Yu Ye , Ming Xiao , Mikael Skoglund , H. Vincent Poor

Federated learning is a promising framework to mitigate data privacy and computation concerns. However, the communication cost between the server and clients has become the major bottleneck for successful deployment. Despite notable…

Machine Learning · Computer Science 2022-05-03 Yang He , Hui-Po Wang , Maximilian Zenk , Mario Fritz

This paper proposes a communication strategy for decentralized learning on wireless systems. Our discussion is based on the decentralized parallel stochastic gradient descent (D-PSGD), which is one of the state-of-the-art algorithms for…

Networking and Internet Architecture · Computer Science 2020-02-26 Koya Sato , Yasuyuki Satoh , Daisuke Sugimura

This paper studies the decentralized optimization and learning problem where multiple interconnected agents aim to learn an optimal decision function defined over a reproducing kernel Hilbert space by jointly minimizing a global objective…

Machine Learning · Computer Science 2021-07-01 Ping Xu , Yue Wang , Xiang Chen , Zhi Tian

We consider a mobile edge computing problem, in which mobile users offload their computation tasks to computing nodes (e.g., base stations) at the network edge. The edge nodes compute the requested functions and communicate the computed…

Information Theory · Computer Science 2017-06-26 Songze Li , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

Machine Learning has proven useful in the recent years as a way to achieve failure prediction for industrial systems. However, the high computational resources necessary to run learning algorithms are an obstacle to its widespread…

Artificial Intelligence · Computer Science 2020-01-22 Nicolas Aussel , Sophie Chabridon , Yohan Petetin

Emerging applications in multi-agent environments such as internet-of-things, networked sensing, autonomous systems and federated learning, call for decentralized algorithms for finite-sum optimizations that are resource-efficient in terms…

Machine Learning · Statistics 2021-12-03 Boyue Li , Zhize Li , Yuejie Chi

By integrating edge computing with parallel computing, distributed edge computing (DEC) makes use of distributed devices in edge networks to perform computing in parallel, which can substantially reduce service delays. In this paper, we…

Networking and Internet Architecture · Computer Science 2020-02-10 Xiaowen Gong
‹ Prev 1 4 5 6 7 8 10 Next ›