English
Related papers

Related papers: Retrieving Data Permutations from Noisy Observatio…

200 papers

Maximizing high-dimensional, non-convex functions through noisy observations is a notoriously hard problem, but one that arises in many applications. In this paper, we tackle this challenge by modeling the unknown function as a sample from…

Machine Learning · Computer Science 2012-07-03 Bo Chen , Rui Castro , Andreas Krause

An extension and generalization of a recently presented approach for the analysis of Langevin-type stochastic processes in the presence of strong measurement noise is presented. For a stochastic process in N dimensions which is superimposed…

Data Analysis, Statistics and Probability · Physics 2012-10-23 B. Lehle

We study the problem of estimating low-rank matrices from linear measurements (a.k.a., matrix sensing) through nonconvex optimization. We propose an efficient stochastic variance reduced gradient descent algorithm to solve a nonconvex…

Machine Learning · Statistics 2017-01-17 Xiao Zhang , Lingxiao Wang , Quanquan Gu

This paper studies the recovery of a superposition of point sources from noisy bandlimited data. In the fewest possible words, we only have information about the spectrum of an object in a low-frequency band bounded by a certain cut-off…

Information Theory · Computer Science 2013-07-11 Emmanuel Candes , Carlos Fernandez-Granda

High-probability analysis of stochastic first-order optimization methods under mild assumptions on the noise has been gaining a lot of attention in recent years. Typically, gradient clipping is one of the key algorithmic ingredients to…

An additive noise channel is considered, in which the distribution of the noise is nonparametric and unknown. The problem of learning encoders and decoders based on noise samples is considered. For uncoded communication systems, the problem…

Information Theory · Computer Science 2021-11-17 Nir Weinberger

We consider an evolution operator for a discrete Langevin equation with a strongly hyperbolic classical dynamics and noise with finite moments. Using a perturbative expansion of the evolution operator we calculate high order corrections to…

chao-dyn · Physics 2015-06-24 Niels Sondergaard , Gabor Vattay , Gergely Palla , Andre Voros

Higher-order tensors can represent scores in a rating system, frames in a video, and images of the same subject. In practice, the measurements are often highly quantized due to the sampling strategies or the quality of devices. Existing…

Machine Learning · Computer Science 2020-10-28 Ren Wang , Meng Wang , Jinjun Xiong

Stochastic inverse problems considered in this article consist of estimating the probability distributions of intrinsically random inputs of computer models. These estimations are based on observable outputs affected by model noise, and…

Statistics Theory · Mathematics 2025-03-17 Nicolas Bousquet , Mélanie Blazère , Thomas Cerbelaud

We introduce a new technique for reducing the dimension of the ambient space of low-degree polynomials in the Gaussian space while preserving their relative correlation structure, analogous to the Johnson-Lindenstrauss lemma. As…

Computational Complexity · Computer Science 2017-08-15 Badih Ghazi , Pritish Kamath , Prasad Raghavendra

This note formulates a deterministic recovery result for vectors $x$ from quadratic measurements of the form $(Ax)_i \overline{(Ax)_j}$ for some left-invertible $A$. Recovery is exact, or stable in the noisy case, when the couples $(i,j)$…

Numerical Analysis · Mathematics 2018-01-16 Laurent Demanet , Vincent Jugnon

Distribution estimation for noisy data via density deconvolution is a notoriously difficult problem for typical noise distributions like Gaussian. We develop a density deconvolution estimator based on quadratic programming (QP) that can…

Methodology · Statistics 2018-12-06 Ran Yang , Daniel Apley , Jeremy Staum , David Ruppert

The paper considers the phase retrieval problem in N-dimensional complex vector spaces. It provides two sets of deterministic measurement vectors which guarantee signal recovery for all signals, excluding only a specific subspace and a…

Information Theory · Computer Science 2014-07-21 Volker Pohl , Fanny Yang , Holger Boche

We consider the problem of recovering elements of a low-dimensional model from linear measurements. From signal and image processing to inverse problems in data science, this question has been at the center of many applications. Lately,…

Signal Processing · Electrical Eng. & Systems 2025-05-15 Yann Traonmilin , Jean François Aujol , Antoine Guennec

We consider the phase retrieval problem of reconstructing a $n$-dimensional real or complex signal $\mathbf{X}^{\star}$ from $m$ (possibly noisy) observations $Y_\mu = | \sum_{i=1}^n \Phi_{\mu i} X^{\star}_i/\sqrt{n}|$, for a large class of…

Statistics Theory · Mathematics 2021-02-18 Antoine Maillard , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

We propose robust sparse reduced rank regression for analyzing large and complex high-dimensional data with heavy-tailed random noise. The proposed method is based on a convex relaxation of a rank- and sparsity-constrained non-convex…

Machine Learning · Statistics 2019-04-16 Kean Ming Tan , Qiang Sun , Daniela Witten

The problem of phase retrieval has many applications in the field of optical imaging. Motivated by imaging experiments with biological specimens, we primarily consider the setting of low-dose illumination where Poisson noise plays the…

Numerical Analysis · Mathematics 2024-03-28 Benedikt Diederichs , Frank Filbir , Patricia Römer

Machine unlearning seeks to efficiently remove the influence of selected data while preserving generalization. Significant progress has been made in low dimensions $(p \ll n)$, but high dimensions pose serious theoretical challenges as…

Machine Learning · Statistics 2025-10-16 Aaradhya Pandey , Arnab Auddy , Haolin Zou , Arian Maleki , Sanjeev Kulkarni

In "Unlabeled Sensing", one observes a set of linear measurements of an underlying signal with incomplete or missing information about their ordering, which can be modeled in terms of an unknown permutation. Previous work on the case of a…

Information Theory · Computer Science 2020-07-14 Hang Zhang , Martin Slawski , Ping Li

We compute exact asymptotic results for the probability of the occurrence of large deviations of the largest (smallest) eigenvalue of random matrices belonging to the Gaussian orthogonal, unitary and symplectic ensembles. In particular, we…

Statistical Mechanics · Physics 2009-11-13 David S. Dean , Satya N. Majumdar