English
Related papers

Related papers: q-LMF: Quantum Calculus-based Least Mean Fourth Al…

200 papers

Classifiers that are linear in their parameters, and trained by optimizing a convex loss function, have predictable behavior with respect to changes in the training data, initial conditions, and optimization. Such desirable properties are…

Machine Learning · Computer Science 2020-12-22 Alessandro Achille , Aditya Golatkar , Avinash Ravichandran , Marzia Polito , Stefano Soatto

Large language model (LLM) training is often bottlenecked by memory constraints and stochastic gradient noise in extremely high-dimensional parameter spaces. Motivated by empirical evidence that many LLM gradient matrices are effectively…

Machine Learning · Computer Science 2026-03-24 Zehao Li , Tao Ren , Zishi Zhang , Xi Chen , Yijie Peng

In this work, we present an energy-efficient distributed learning framework using low-resolution ADCs and coarsely quantized signals for Internet of Things (IoT) networks. In particular, we develop a distributed quantization-aware…

Machine Learning · Computer Science 2021-02-24 A. Danaee , R. C. de Lamare , V. H. Nascimento

The goal of quantum channel discrimination and estimation is to determine the identity of an unknown channel from a discrete or continuous set, respectively. The query complexity of these tasks is equal to the minimum number of times one…

Quantum Physics · Physics 2026-02-25 Zixin Huang , Johannes Jakob Meyer , Theshani Nuradha , Mark M. Wilde

The so-called constrained least mean-square algorithm is one of the most commonly used linear-equality-constrained adaptive filtering algorithms. Its main advantages are adaptability and relative simplicity. In order to gain analytical…

Systems and Control · Computer Science 2015-02-26 Reza Arablouei , Kutluyıl Doğançay , Stefan Werner

Downlink precoding is considered for multi-path multi-input single-output channels where the base station uses orthogonal frequency-division multiplexing and low-resolution signaling. A quantized coordinate minimization (QCM) algorithm is…

Information Theory · Computer Science 2022-08-30 Andrei Stefan Nedelcu , Fabian Steiner , Gerhard Kramer

We introduce a novel family of adaptive robust equalizers for highly challenging underwater acoustic (UWA) channel equalization. Since the underwater environment is highly non-stationary and subjected to impulsive noise, we use adaptive…

Sound · Computer Science 2015-12-22 Dariush Kari , Muhammed Omer Sayin , Suleyman Serdar Kozat

Compute-and-Forward (C&F) has been proposed as an efficient strategy to reduce the backhaul load for the distributed antenna systems. Finding the optimal coefficients in C&F has commonly been treated as a shortest vector problem (SVP),…

Information Theory · Computer Science 2017-04-18 Qinhui Huang , Alister Burr

Low complexity joint estimation of synchronization impairments and channel in a single-user MIMO-OFDM system is presented in this letter. Based on a system model that takes into account the effects of synchronization impairments such as…

Information Theory · Computer Science 2013-04-30 Renu Jose , Sooraj K. Ambat , K. V. S. Hari

We propose Q-learning with Adjoint Matching (QAM), a novel TD-based reinforcement learning (RL) algorithm that tackles a long-standing challenge in continuous-action RL: efficient optimization of an expressive diffusion or flow-matching…

Machine Learning · Computer Science 2026-05-20 Qiyang Li , Sergey Levine

This paper introduces a novel constraint adaptive filtering algorithm based on a relative logarithmic cost function which is termed as Constrained Least Mean Logarithmic Square (CLMLS). The proposed CLMLS algorithm elegantly adjusts the…

Systems and Control · Computer Science 2018-01-22 Vinay Chakravarthi Gogineni , Subrahmanyam Mula

Quantum federated learning (QFL) has recently received increasing attention, where quantum neural networks (QNNs) are integrated into federated learning (FL). In contrast to the existing static QFL methods, we propose slimmable QFL…

Machine Learning · Computer Science 2022-07-22 Won Joon Yun , Jae Pyoung Kim , Soyi Jung , Jihong Park , Mehdi Bennis , Joongheon Kim

The aim of this paper is to propose a least mean squares (LMS) strategy for adaptive estimation of signals defined over graphs. Assuming the graph signal to be band-limited, over a known bandwidth, the method enables reconstruction, with…

Machine Learning · Computer Science 2016-11-17 Paolo Di Lorenzo , Sergio Barbarossa , Paolo Banelli , Stefania Sardellitti

Quantum federated learning (QFL) combines the robust data processing of quantum computing with the privacy-preserving features of federated learning (FL). However, in large-scale wireless networks, optimizing sum-rate is crucial for…

Information Theory · Computer Science 2026-03-03 Shaba Shaon , Christopher G. Brinton , Dinh C. Nguyen

A fundamental issue for federated learning (FL) is how to achieve optimal model performance under highly dynamic communication environments. This issue can be alleviated by the fact that modern edge devices usually can connect to the edge…

Machine Learning · Computer Science 2021-09-21 Haizhou Du , Xiaojie Feng , Qiao Xiang , Haoyu Liu

Invariable step size based least-mean-square error (ISS-LMS) was considered as a very simple adaptive filtering algorithm and hence it has been widely utilized in many applications, such as adaptive channel estimation. It is well known that…

Information Theory · Computer Science 2015-01-29 Beiyi Liu , Guan Gui , Li Xu , Nobuhiro Shimoi

We propose Local Momentum Tracking (LMT), a novel distributed stochastic gradient method for solving distributed optimization problems over networks. To reduce communication overhead, LMT enables each agent to perform multiple local updates…

Optimization and Control · Mathematics 2025-11-10 Kun Huang , Shi Pu

Federated learning (FL) has emerged as a widely adopted paradigm for enabling edge learning with distributed data while ensuring data privacy. However, the traditional FL with deep neural networks trained via backpropagation can hardly meet…

Machine Learning · Computer Science 2025-11-05 Jierui Zhang , Jianhao Huang , Kaibin Huang

This paper investigates the low-complex linear minimum mean squared error (LMMSE) channel estimation in an extra-large scale MIMO system with the spherical wave model (SWM). We model the extra-large scale MIMO channels using the SWM in the…

Information Theory · Computer Science 2023-10-24 Xumin Pu , Zhinan Sun , Qianbin Chen , Shi Jin

Upon compressing perceptually relevant signals, conventional quantization generally results in unnatural outcomes at low rates. We propose distribution preserving quantization (DPQ) to solve this problem. DPQ is a new quantization concept…

Information Theory · Computer Science 2011-08-19 Minyue Li , Janusz Klejsa , W. Bastiaan Kleijn