English
Related papers

Related papers: Sharp bounds for population recovery

200 papers

Flat regions of the neural network loss landscape have long been hypothesized to correlate with better generalization properties. A closely related but distinct problem is training models that are robust to internal perturbations to their…

Machine Learning · Computer Science 2026-02-10 Philip Jacobson , Ben Feinberg , Suhas Kumar , Sapan Agarwal , T. Patrick Xiao , Christopher Bennett

Greedy algorithm are in widespread use for sparse recovery because of its efficiency. But some evident flaws exists in most popular greedy algorithms, such as CoSaMP, which includes unreasonable demands on prior knowledge of target signal…

Information Theory · Computer Science 2009-08-18 Hao Zhang , Gang Li , Huadong Meng

In noisy evolutionary optimization, sampling is a common strategy to deal with noise. By the sampling strategy, the fitness of a solution is evaluated multiple times (called \emph{sample size}) independently, and its true fitness is then…

Neural and Evolutionary Computing · Computer Science 2022-11-29 Chao Qian , Chao Bian , Yang Yu , Ke Tang , Xin Yao

Recently, there was a substantial progress in the problem of sampling recovery on function classes with mixed smoothness. Mostly, it has been done by proving new and sometimes optimal upper bounds for both linear sampling recovery and for…

Numerical Analysis · Mathematics 2025-05-29 A. Gasnikov , V. Temlyakov

Motivated by the learned iterative soft thresholding algorithm (LISTA), we introduce a general class of neural networks suitable for sparse reconstruction from few linear measurements. By allowing a wide range of degrees of weight-sharing…

Machine Learning · Computer Science 2022-01-19 Ekkehard Schnoor , Arash Behboodi , Holger Rauhut

Sorting is the task of ordering $n$ elements using pairwise comparisons. It is well known that $m=\Theta(n\log n)$ comparisons are both necessary and sufficient when the outcomes of the comparisons are observed with no noise. In this paper,…

Information Theory · Computer Science 2024-07-09 Ziao Wang , Nadim Ghaddar , Banghua Zhu , Lele Wang

We consider in this paper the problem of estimating a parameter matrix from observations which are affected by two types of noise components: (i) a sparse noise sequence which, whenever nonzero can have arbitrarily large amplitude (ii) and…

Systems and Control · Computer Science 2017-11-07 Laurent Bako

We study efficient PAC learning of homogeneous halfspaces in $\mathbb{R}^d$ in the presence of malicious noise of Valiant (1985). This is a challenging noise model and only until recently has near-optimal noise tolerance bound been…

Machine Learning · Computer Science 2021-10-06 Jie Shen

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a small number of noisy linear measurements is an important problem in compressed sensing. In this paper, the high-dimensional setting is considered. It is shown…

Information Theory · Computer Science 2013-02-06 Galen Reeves , Michael Gastpar

Supervised training of deep neural networks on pairs of clean image and noisy measurement achieves state-of-the-art performance for many image reconstruction tasks, but such training pairs are difficult to collect. Self-supervised methods…

Image and Video Processing · Electrical Eng. & Systems 2023-10-30 Tobit Klug , Dogukan Atik , Reinhard Heckel

In Gaussian graphical model selection, noise-corrupted samples present significant challenges. It is known that even minimal amounts of noise can obscure the underlying structure, leading to fundamental identifiability issues. A recent line…

Machine Learning · Statistics 2024-05-09 Abrar Zahin , Rajasekhar Anguluri , Lalitha Sankar , Oliver Kosut , Gautam Dasarathy

This dissertation shows that careful injection of noise into sample data can substantially speed up Expectation-Maximization algorithms. Expectation-Maximization algorithms are a class of iterative algorithms for extracting maximum…

Machine Learning · Statistics 2014-11-26 Osonde Adekorede Osoba

The problem of recovering the sparsity pattern of a fixed but unknown vector $\beta^* \in \real^p based on a set of $n$ noisy observations arises in a variety of settings, including subset selection in regression, graphical model selection,…

Statistics Theory · Mathematics 2007-07-13 Martin J. Wainwright

A fundamental problem in statistics and machine learning is to estimate a function $f$ from possibly noisy observations of its point samples. The goal is to design a numerical algorithm to construct an approximation $\hat f$ to $f$ in a…

Statistics Theory · Mathematics 2025-05-30 Ronald DeVore , Robert D. Nowak , Rahul Parhi , Guergana Petrova , Jonathan W. Siegel

The generalized phase retrieval problem over compact groups aims to recover a set of matrices -- representing an unknown signal -- from their associated Gram matrices. This framework generalizes the classical phase retrieval problem, which…

Signal Processing · Electrical Eng. & Systems 2025-11-20 Tal Amir , Tamir Bendory , Nadav Dym , Dan Edidin

The performance of estimating the common support for jointly sparse signals based on their projections onto lower-dimensional space is analyzed. Support recovery is formulated as a multiple-hypothesis testing problem. Both upper and lower…

Information Theory · Computer Science 2009-11-05 Gongguo Tang , Arye Nehorai

Many models for sparse regression typically assume that the covariates are known completely, and without noise. Particularly in high-dimensional applications, this is often not the case. This paper develops efficient OMP-like algorithms to…

Statistics Theory · Mathematics 2015-03-31 Yudong Chen , Constantine Caramanis

In this work we address the problem of recovering sparse solutions to non linear inverse problems. We look at two variants of the basic problem, the synthesis prior problem when the solution is sparse and the analysis prior problem where…

Information Theory · Computer Science 2015-12-25 Kavya Gupta , Ankita Raj , Angshul Majumdar

In this paper, we expand the theory of depth-unbiased source localization to unbiased parameter estimation and signal reconstruction of an arbitrary number of non-zero parameters to be recovered. The topic touches on the concept of exact…

Information Theory · Computer Science 2026-05-08 Joonas Lahtinen

Noisy PN learning is the problem of binary classification when training examples may be mislabeled (flipped) uniformly with noise rate rho1 for positive examples and rho0 for negative examples. We propose Rank Pruning (RP) to solve noisy PN…

Machine Learning · Statistics 2017-08-11 Curtis G. Northcutt , Tailin Wu , Isaac L. Chuang
‹ Prev 1 3 4 5 6 7 10 Next ›