English
Related papers

Related papers: On Analog Gradient Descent Learning over Multiple …

200 papers

Automatic Modulation Recognition (AMR) is critical in identifying various modulation types in wireless communication systems. Recent advancements in deep learning have facilitated the integration of algorithms into AMR techniques. However,…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Narges Rashvand , Kenneth Witham , Gabriel Maldonado , Vinit Katariya , Aly Sultan , Gunar Schirner , Hamed Tabkhi

Representation learning is a widely adopted framework for learning in data-scarce environments to obtain a feature extractor or representation from various different yet related tasks. Despite extensive research on representation learning,…

Machine Learning · Computer Science 2025-12-30 Donghwa Kang , Shana Moothedath

State-of-the-art training algorithms for deep learning models are based on stochastic gradient descent (SGD). Recently, many variations have been explored: perturbing parameters for better accuracy (such as in Extragradient), limiting SGD…

Machine Learning · Computer Science 2022-03-23 Amirkeivan Mohtashami , Martin Jaggi , Sebastian U. Stich

The susceptibility of deep neural networks to untrustworthy predictions, including out-of-distribution (OOD) data and adversarial examples, still prevent their widespread use in safety-critical applications. Most existing methods either…

Machine Learning · Computer Science 2021-02-25 Leo Schwinn , An Nguyen , René Raab , Leon Bungert , Daniel Tenbrinck , Dario Zanca , Martin Burger , Bjoern Eskofier

Recently years, the attempts on distilling mobile data into useful knowledge has been led to the deployment of machine learning algorithms at the network edge. Principal component analysis (PCA) is a classic technique for extracting the…

Information Theory · Computer Science 2022-04-04 Zezhong Zhang , Guangxu Zhu , Rui Wang , Vincent K. N. Lau , Kaibin Huang

We study the performance of decentralized stochastic gradient descent (DSGD) in a wireless network, where the nodes collaboratively optimize an objective function using their local datasets. Unlike the conventional setting, where the nodes…

Signal Processing · Electrical Eng. & Systems 2020-03-10 Emre Ozfatura , Stefano Rini , Deniz Gunduz

Massive random access is an important technology for achieving ultra-massive connectivity in next-generation wireless communication systems. It aims to address key challenges during the initial access phase, including active user detection…

Information Theory · Computer Science 2026-02-09 Keke Ying , Zhen Gao , Sheng Chen , Tony Q. S. Quek , H. Vincent Poor

Motivated by the growing demand for serving large language model inference requests, we study distributed load balancing for global serving systems with network latencies. We consider a fluid model in which continuous flows of requests…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-16 Santiago R. Balseiro , Vahab S. Mirrokni , Bartek Wydrowski

Channel allocation is the task of assigning channels to users such that some objective (e.g., sum-rate) is maximized. In centralized networks such as cellular networks, this task is carried by the base station which gathers the channel…

Information Theory · Computer Science 2019-12-05 S. M. Zafaruddin , Ilai Bistritz , Amir Leshem , Dusit Niyato

Federated learning allows edge devices to collaboratively learn a shared model while keeping the training data on device, decoupling the ability to do model training from the need to store the data in the cloud. We propose Federated matched…

Machine Learning · Computer Science 2020-02-18 Hongyi Wang , Mikhail Yurochkin , Yuekai Sun , Dimitris Papailiopoulos , Yasaman Khazaeni

This paper presents adaptive bidirectional minimum mean-square error (MMSE) parameter estimation algorithms for fast-fading channels. The time correlation between successive channel gains is exploited to improve the estimation and tracking…

Information Theory · Computer Science 2013-06-12 Patrick Clarke , Rodrigo C. de Lamare

It is well known that biology-inspired self-maintaining algorithms in wireless sensor nodes achieve near optimum time division multiple access (TDMA) characteristics in a decentralized manner and with very low complexity. We extend such…

Networking and Internet Architecture · Computer Science 2012-05-18 Dujdow Buranapanichkit , Yiannis Andreopoulos

The distributed subgradient method (DSG) is a widely discussed algorithm to cope with large-scale distributed optimization problems in the arising machine learning applications. Most exisiting works on DSG focus on ideal communication…

Signal Processing · Electrical Eng. & Systems 2022-08-24 Zhaoyue Xia , Jun Du , Yong Ren

Stochastic gradient algorithms have been the main focus of large-scale learning problems and they led to important successes in machine learning. The convergence of SGD depends on the careful choice of learning rate and the amount of the…

Machine Learning · Computer Science 2015-11-03 Caglar Gulcehre , Marcin Moczulski , Yoshua Bengio

Adaptive gradient methods have been increasingly adopted by deep learning community due to their fast convergence and reduced sensitivity to hyper-parameters. However, these methods come with limitations, such as increased memory…

Machine Learning · Computer Science 2024-12-17 Corrado Coppola , Lorenzo Papa , Irene Amerini , Laura Palagi

The ability to learn sequentially from different data sites is crucial for a deep network in solving practical medical image diagnosis problems due to privacy restrictions and storage limitations. However, adapting on incoming site leads to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Dunyuan Xu , Xi Wang , Jingyang Zhang , Pheng-Ann Heng

In this paper, we consider nonconvex minimax optimization, which is gaining prominence in many modern machine learning applications such as GANs. Large-scale edge-based collection of training data in these applications calls for…

Optimization and Control · Mathematics 2022-03-10 Pranay Sharma , Rohan Panda , Gauri Joshi , Pramod K. Varshney

Decentralized optimization algorithms have recently attracted increasing attention due to its wide applications in all areas of science and engineering. In these algorithms, a collection of agents collaborate to minimize the average of a…

Optimization and Control · Mathematics 2024-09-18 Shujing Feng , Xin Jiang

It is commonly believed that gradient compression in federated learning (FL) enjoys significant improvement in communication efficiency with negligible performance degradation. In this paper, we find that gradient compression induces…

Machine Learning · Computer Science 2026-02-13 Yujie Gu , Richeng Jin , Zhaoyang Zhang , Huaiyu Dai

With increasing density and heterogeneity in unlicensed wireless networks, traditional MAC protocols, such as carrier-sense multiple access with collision avoidance (CSMA/CA) in Wi-Fi networks, are experiencing performance degradation. This…

Networking and Internet Architecture · Computer Science 2024-06-05 Jiantao Xin , Wei Xu , Bin Cao , Taotao Wang , Shengli Zhang