English
Related papers

Related papers: Partial Diffusion Recursive Least-Squares for Dist…

200 papers

Recently, diffusion models (DMs) have been increasingly used in audio processing tasks, including speech super-resolution (SR), which aims to restore high-frequency content given low-resolution speech utterances. This is commonly achieved…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-22 Chin-Yun Yu , Sung-Lin Yeh , György Fazekas , Hao Tang

Over the past few years, several approaches utilizing score-based diffusion have been proposed to sample from probability distributions, that is without having access to exact samples and relying solely on evaluations of unnormalized…

Machine Learning · Statistics 2025-04-15 Maxence Noble , Louis Grenioux , Marylou Gabrié , Alain Oliviero Durmus

We introduce a novel optimization algorithm for image recovery under learned sparse and low-rank constraints, which we parameterize as weighted extensions of the $\ell_p^p$-vector and $\mathcal S_p^p$ Schatten-matrix quasi-norms for…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Stamatios Lefkimmiatis , Iaroslav Koshelev

We propose a minimum distance estimation method for robust regression in sparse high-dimensional settings. The traditional likelihood-based estimators lack resilience against outliers, a critical issue when dealing with high-dimensional…

Methodology · Statistics 2013-07-12 Aurélie C. Lozano , Nicolai Meinshausen

For a multi-agent system state estimation resting upon noisy measurements constitutes a problem related to several application scenarios. Adopting the standard least-squares approach, in this work we derive both the (centralized) analytic…

Systems and Control · Electrical Eng. & Systems 2022-02-22 Marco Fabris , Giulia Michieletto , Angelo Cenedese

Relating a set of variables X to a response y is crucial in chemometrics. A quantitative prediction objective can be enriched by qualitative data interpretation, for instance by locating the most influential features. When high-dimensional…

Machine Learning · Statistics 2023-04-21 Louna Alsouki , Laurent Duval , Clément Marteau , Rami El Haddad , François Wahl

Partial Least Squares (PLS) is a widely used method for data integration, designed to extract latent components shared across paired high-dimensional datasets. Despite decades of practical success, a precise theoretical understanding of its…

Machine Learning · Statistics 2025-12-18 Victor Léger , Florent Chatelain

Distribution regression seeks to estimate the conditional distribution of a multivariate response given a continuous covariate. This approach offers a more complete characterization of dependence than traditional regression methods.…

Statistics Theory · Mathematics 2025-06-10 Rong Tang , Yun Yang

In conventional distributed Kalman filtering, employing diffusion strategies, each node transmits its state estimate to all its direct neighbors in each iteration. In this paper we propose a partial diffusion Kalman filter (PDKF) for state…

Systems and Control · Computer Science 2017-05-26 Vahid Vahidpour , Amir Rastegarnia , Azam Khalili , Wael Bazzi , Saeid Sanei

The deluge of networked data motivates the development of algorithms for computation- and communication-efficient information processing. In this context, three data-adaptive censoring strategies are introduced to considerably reduce the…

Systems and Control · Computer Science 2018-01-16 Zifeng Wang , Zheng Yu , Qing Ling , Dimitris Berberidis , Georgios B. Giannakis

The rise of digital and mobile communications has recently made the world more connected and networked, resulting in an unprecedented volume of data flowing between sources, data centers, or processes. While these data may be processed in a…

Machine Learning · Statistics 2018-09-21 Ibrahim El Khalil Harrane , Rémi Flamary , Cédric Richard

Spatial frequency estimation from a mixture of noisy sinusoids finds applications in various fields. While subspace-based methods offer cost-effective super-resolution parameter estimation, they demand precise array calibration, posing…

Signal Processing · Electrical Eng. & Systems 2024-10-23 Tianyi Liu , Sai Pavan Deram , Khaled Ardah , Martin Haardt , Marc E. Pfetsch , Marius Pesavento

This paper considers optimization problems over networks where agents have individual objectives to meet, or individual parameter vectors to estimate, subject to subspace constraints that require the objectives across the network to lie in…

Multiagent Systems · Computer Science 2020-04-22 Roula Nassif , Stefan Vlaski , Ali H. Sayed

This paper proposes distributed adaptive algorithms based on the conjugate gradient (CG) method and the diffusion strategy for parameter estimation over sensor networks. We present sparsity-aware conventional and modified distributed CG…

Information Theory · Computer Science 2015-11-23 Rodrigo C. de Lamare

The problem of network-constrained averaging is to compute the average of a set of values distributed throughout a graph G using an algorithm that can pass messages only along graph edges. We study this problem in the noisy setting, in…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-15 Nima Noorshams , Martin Wainwright

Distributional Reinforcement Learning (DistRL) improves upon expectation-based methods by modeling full return distributions, but standard approaches often remain far from parsimonious. Categorical methods (e.g., C51) rely on fixed supports…

Artificial Intelligence · Computer Science 2026-05-06 Simo Alami C. , Rim Kaddah , Jesse Read , Marie-Paule Cani

The least mean-square (LMS) filter is one of the most common adaptive linear estimation algorithms. In many practical scenarios, and particularly in digital communications systems, the signal of interest (SOI) and the input signal are…

Systems and Control · Computer Science 2018-11-28 Nir Shlezinger , Koby Todros

Distributed multi-task adaptive strategies are useful to estimate multiple parameter vectors simultaneously in a collaborative manner. The existed distributed multi-task strategies use diffusion mode of cooperation in which during…

Systems and Control · Computer Science 2015-10-01 Vinay Chakravarthi Gogineni , Mrityunjoy Chakraborty

We investigate the theoretical performances of the Partial Least Square (PLS) algorithm in a high dimensional context. We provide upper bounds on the risk in prediction for the statistical linear model when considering the PLS estimator.…

Statistics Theory · Mathematics 2024-10-15 Luca Castelli , Irène Gannaz , Clément Marteau

The aim of this paper is to propose diffusion strategies for distributed estimation over adaptive networks, assuming the presence of spatially correlated measurements distributed according to a Gaussian Markov random field (GMRF) model. The…

Systems and Control · Computer Science 2015-06-22 Paolo Di Lorenzo