English
Related papers

Related papers: Bayesian Lower Bounds for Dense or Sparse (Outlier…

200 papers

Transfer learning (TL) has emerged as a powerful tool to supplement data collected for a target task with data collected for a related source task. The Bayesian framework is natural for TL because information from the source data can be…

Methodology · Statistics 2024-06-06 Mohamed A. Abba , Jonathan P. Williams , Brian J. Reich

In this article, a study of the mean-square error (MSE) performance of linear echo-state neural networks is performed, both for training and testing tasks. Considering the realistic setting of noise present at the network nodes, we derive…

Machine Learning · Computer Science 2016-03-28 Romain Couillet , Gilles Wainrib , Harry Sevi , Hafiz Tiomoko Ali

We consider distributed estimation of a random source in a hierarchical power constrained wireless sensor network. Sensors within each cluster send their measurements to a cluster head (CH). CHs optimally fuse the received signals and…

Signal Processing · Electrical Eng. & Systems 2020-05-01 Mojtaba Shirazi , Azadeh Vosoughi

We derive unified lower bounds on the mean squared error (MSE) of distributed quantum sensor fusion under Byzantine faults and decoherence. Building on the classical Brooks-Iyengar overlap function and its vector extension, the predictive…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-20 Vasanth Iyer , S. S. Iyengar

This paper proposes a new family of lower and upper bounds on the minimum mean squared error (MMSE). The key idea is to minimize/maximize the MMSE subject to the constraint that the joint distribution of the input-output statistics lies in…

Information Theory · Computer Science 2020-06-09 Michael Fauß , Alex Dysto , H. Vincent Poor

This note studies a method for the efficient estimation of a finite number of unknown parameters from linear equations, which are perturbed by Gaussian noise. In case the unknown parameters have only few nonzero entries, the proposed…

Systems and Control · Computer Science 2014-05-27 Liang Dai , Kristiaan Pelckmans

In this paper, we consider signals with a low-rank covariance matrix which reside in a low-dimensional subspace and can be written in terms of a finite (small) number of parameters. Although such signals do not necessarily have a sparse…

Statistics Theory · Mathematics 2023-07-19 Mahdi Shaghaghi , Sergiy A. Vorobyov

Linear regression models contaminated by Gaussian noise (inlier) and possibly unbounded sparse outliers are common in many signal processing applications. Sparse recovery inspired robust regression (SRIRR) techniques are shown to deliver…

Machine Learning · Statistics 2018-12-26 Sreejith Kallummil , Sheetal Kalyani

Usually, hearing impaired people use hearing aids which are implemented with speech enhancement algorithms. Estimation of speech and estimation of nose are the components in single channel speech enhancement system. The main objective of…

Sound · Computer Science 2014-11-10 M. Ravichandra Kumar , B. Ravi Teja

In tracking of time-varying low-rank models of time-varying matrices, we present a method robust to both uniformly-distributed measurement noise and arbitrarily-distributed ``sparse'' noise. In theory, we bound the tracking error. In…

Optimization and Control · Mathematics 2020-02-05 Albert Akhriev , Jakub Marecek , Andrea Simonetto

The Gauss Markov theorem states that the weighted least squares estimator is a linear minimum variance unbiased estimation (MVUE) in linear models. In this paper, we take a first step towards extending this result to non linear settings via…

Machine Learning · Computer Science 2023-11-30 Tzvi Diskin , Yonina C. Eldar , Ami Wiesel

We propose a generative model for robust tensor factorization in the presence of both missing data and outliers. The objective is to explicitly infer the underlying low-CP-rank tensor capturing the global information and a sparse tensor…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Qibin Zhao , Guoxu Zhou , Liqing Zhang , Andrzej Cichocki , Shun-ichi Amari

This letter proposes a low-computational Bayesian algorithm for noisy sparse recovery in the context of one bit compressed sensing with sensing matrix perturbation. The proposed algorithm which is called BHT-MLE comprises a sparse support…

Machine Learning · Statistics 2015-11-19 H. Zayyani , M. Korki , F. Marvasti

We address the problem of signal denoising via transform-domain shrinkage based on a novel $\textit{risk}$ criterion called the minimum probability of error (MPE), which measures the probability that the estimated parameter lies outside an…

Applications · Statistics 2020-02-19 Jishnu Sadasivan , Subhadip Mukherjee , Chandra Sekhar Seelamantula

A popular approach within the signal processing and machine learning communities consists in modelling signals as sparse linear combinations of atoms selected from a learned dictionary. While this paradigm has led to numerous empirical…

Machine Learning · Computer Science 2015-08-25 Rémi Gribonval , Rodolphe Jenatton , Francis Bach

This paper addresses the estimation of signals with sublinear sparsity sent over the additive white Gaussian noise channel. This fundamental problem arises in designing denoisers used in message-passing algorithms for sublinear sparsity.…

Information Theory · Computer Science 2026-04-28 Keigo Takeuchi

We consider the problem of sequentially learning to estimate, in the mean squared error (MSE) sense, a Gaussian $K$-vector of unknown covariance by observing only $m < K$ of its entries in each round. We propose two MSE estimators, and…

Machine Learning · Computer Science 2025-05-05 Ayon Ghosh , L. A. Prashanth , Dipayan Sen , Aditya Gopalan

In a standard classification framework a set of trustworthy learning data are employed to build a decision rule, with the final aim of classifying unlabelled units belonging to the test set. Therefore, unreliable labelled observations,…

Applications · Statistics 2019-11-20 Andrea Cappozzo , Francesca Greselin , Thomas Brendan Murphy

Analysis of non-asymptotic estimation error and structured statistical recovery based on norm regularized regression, such as Lasso, needs to consider four aspects: the norm, the loss function, the design matrix, and the noise model. This…

Machine Learning · Statistics 2015-12-01 Arindam Banerjee , Sheng Chen , Farideh Fazayeli , Vidyashankar Sivakumar

In modern large-scale observational studies, data collection constraints often result in partially labeled datasets, posing challenges for reliable causal inference, especially due to potential labeling bias and relatively small size of the…

Methodology · Statistics 2025-04-22 Yuqian Zhang , Abhishek Chakrabortty , Jelena Bradic