English
Related papers

Related papers: Sharp Information-Theoretic Thresholds for Shuffle…

200 papers

We study a class of real robust phase retrieval problems under a Gaussian assumption on the coding matrix when the received signal is sparsely corrupted by noise. The goal is to establish conditions on the sparsity under which the input…

Information Theory · Computer Science 2019-05-27 Aleksandr Aravkin , James Burke , Daiwei He

The recovery of sparsest overcomplete representation has recently attracted intensive research activities owe to its important potential in the many applied fields such as signal processing, medical imaging, communication, and so on. This…

Information Theory · Computer Science 2011-09-29 Lianlin Li

A noisy training set usually leads to the degradation of the generalization and robustness of neural networks. In this paper, we propose a novel theoretically guaranteed clean sample selection framework for learning with noisy labels.…

Machine Learning · Computer Science 2023-11-30 Yikai Wang , Yanwei Fu , Xinwei Sun

We consider the problem of recovering an unknown signal $\pmb{x}_0\in \mathbb{R}^{n}$ from phaseless measurements. In this paper, we study the convex phase retrieval problem via PhaseLift from linear Gaussian measurements perturbed by…

Information Theory · Computer Science 2023-11-23 Gao Huang , Song Li , Hang Xu

We investigate non-negative least squares (NNLS) for the recovery of sparse non-negative vectors from noisy linear and biased measurements. We build upon recent results from [1] showing that for matrices whose row-span intersects the…

Information Theory · Computer Science 2019-12-30 Yonatan Shadmi , Peter Jung , Giuseppe Caire

Policy-gradient methods are widely used in reinforcement learning, yet training often becomes unstable or slows down as learning progresses. We study this phenomenon through the noise-to-signal ratio (NSR) of a policy-gradient estimator,…

Optimization and Control · Mathematics 2026-02-10 Haoyu Han , Heng Yang

We consider the linearly transformed spiked model, where observations $Y_i$ are noisy linear transforms of unobserved signals of interest $X_i$: \begin{align*} Y_i = A_i X_i + \varepsilon_i, \end{align*} for $i=1,\ldots,n$. The transform…

Statistics Theory · Mathematics 2018-07-13 Edgar Dobriban , William Leeb , Amit Singer

High signal to noise ratio (SNR) consistency of model selection criteria in linear regression models has attracted a lot of attention recently. However, most of the existing literature on high SNR consistency deals with model order…

Machine Learning · Statistics 2017-03-13 Sreejith Kallummil , Sheetal Kalyani

Robust regression techniques rely on least-squares optimization, which works well for Gaussian noise but fails in the presence of asymmetric structured noise. We propose a hybrid neural-symbolic architecture where a transformer encoder…

Machine Learning · Computer Science 2025-08-06 Roman Gutierrez , Tony Kai Tang , Isabel Gutierrez

We consider statistical models of estimation of a rank-one matrix (the spike) corrupted by an additive gaussian noise matrix in the sparse limit. In this limit the underlying hidden vector (that constructs the rank-one matrix) has a number…

Information Theory · Computer Science 2019-11-13 Jean Barbier , Nicolas Macris

Motivated by cutting-edge applications like cryo-electron microscopy (cryo-EM), the Multi-Reference Alignment (MRA) model entails the learning of an unknown signal from repeated measurements of its images under the latent action of a group…

Statistics Theory · Mathematics 2022-03-11 Subhro Ghosh , Philippe Rigollet

Sparse linear regression is one of the classic problems in the field of statistics, which has deep connections and high intersections with optimization, computation, and machine learning. To address the effective handling of…

Methodology · Statistics 2025-08-04 Peili Li , Zhuomei Li , Yunhai Xiao , Chao Ying , Zhou Yu

We consider the problem of clustering a graph $G$ into two communities by observing a subset of the vertex correlations. Specifically, we consider the inverse problem with observed variables $Y=B_G x \oplus Z$, where $B_G$ is the incidence…

Information Theory · Computer Science 2014-11-06 Emmanuel Abbe , Afonso S. Bandeira , Annina Bracher , Amit Singer

We consider testing for presence of a signal in Gaussian white noise with intensity 1/sqrt(n), when the alternatives are given by smoothness ellipsoids with an L2-ball of (squared) radius rho removed. It is known that, for a fixed Sobolev…

Statistics Theory · Mathematics 2020-08-11 Pengsheng Ji , Michael Nussbaum

This paper considers the linear inverse problem where we wish to estimate a structured signal $x$ from its corrupted observations. When the problem is ill-posed, it is natural to make use of a convex function $f(\cdot)$ that exploits the…

Information Theory · Computer Science 2013-12-06 Samet Oymak , Christos Thrampoulidis , Babak Hassibi

Linear thresholding models postulate that the conditional distribution of a response variable in terms of covariates differs on the two sides of a (typically unknown) hyperplane in the covariate space. A key goal in such models is to learn…

Statistics Theory · Mathematics 2021-10-01 Debarghya Mukherjee , Moulinath Banerjee , Debasri Mukherjee , Ya'acov Ritov

We consider the problem of sparse normal means estimation in a distributed setting with communication constraints. We assume there are $M$ machines, each holding $d$-dimensional observations of a $K$-sparse vector $\mu$ corrupted by…

Machine Learning · Statistics 2022-02-15 Chen Amiraz , Robert Krauthgamer , Boaz Nadler

Signal to Noise Ratio (SNR) is an important index for wireless communications. In CDMA systems, spreading sequences are utilized. This series of papers show the method to derive spreading sequences as the solutions of the non-linear…

Information Theory · Computer Science 2016-12-28 Hirofumi Tsuda , Ken Umeno

We consider the estimation of a signal from the knowledge of its noisy linear random Gaussian projections. A few examples where this problem is relevant are compressed sensing, sparse superposition codes, and code division multiple access.…

Information Theory · Computer Science 2020-08-31 Jean Barbier , Nicolas Macris , Mohamad Dia , Florent Krzakala

We present a sparse representation of model uncertainty for Deep Neural Networks (DNNs) where the parameter posterior is approximated with an inverse formulation of the Multivariate Normal Distribution (MND), also known as the information…

Machine Learning · Computer Science 2020-06-23 Jongseok Lee , Matthias Humt , Jianxiang Feng , Rudolph Triebel