English
Related papers

Related papers: Denoising Linear Models with Permuted Data

200 papers

Image noise can often be accurately fitted to a Poisson-Gaussian distribution. However, estimating the distribution parameters from a noisy image only is a challenging task. Here, we study the case when paired noisy and noise-free samples…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Nicolas Bähler , Majed El Helou , Étienne Objois , Kaan Okumuş , Sabine Süsstrunk

We study the problem of estimating low-rank matrices from linear measurements (a.k.a., matrix sensing) through nonconvex optimization. We propose an efficient stochastic variance reduced gradient descent algorithm to solve a nonconvex…

Machine Learning · Statistics 2017-01-17 Xiao Zhang , Lingxiao Wang , Quanquan Gu

There has been a recent surge of interest in studying permutation-based models for ranking from pairwise comparison data. Despite being structurally richer and more robust than parametric ranking models, permutation-based models are less…

Machine Learning · Statistics 2017-10-31 Cheng Mao , Jonathan Weed , Philippe Rigollet

Analytical understanding of how low-dimensional latent features reveal themselves in large-dimensional data is still lacking. We study this by defining a linear latent feature model with additive noise constructed from probabilistic…

Disordered Systems and Neural Networks · Physics 2022-07-20 Philipp Fleig , Ilya Nemenman

The autoregressive time series model is a popular second-order stationary process, modeling a wide range of real phenomena. However, in applications, autoregressive signals are often corrupted by additive noise. Further, the autoregressive…

Methodology · Statistics 2025-12-09 Sayantan Banerjee , Agnieszka Wylomanska , Sundar S

A continuing mystery in understanding the empirical success of deep neural networks is their ability to achieve zero training error and generalize well, even when the training data is noisy and there are more parameters than data points. We…

Machine Learning · Computer Science 2019-09-10 Vidya Muthukumar , Kailas Vodrahalli , Vignesh Subramanian , Anant Sahai

We want to reconstruct a signal based on inhomogeneous data (the amount of data can vary strongly), using the model of regression with a random design. Our aim is to understand the consequences of inhomogeneity on the accuracy of estimation…

Statistics Theory · Mathematics 2016-08-16 Stéphane Gaiffas

Prior probability models are a fundamental component of many image processing problems, but density estimation is notoriously difficult for high-dimensional signals such as photographic images. Deep neural networks have provided…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Zahra Kadkhodaie , Eero P. Simoncelli

The problem of Poisson denoising appears in various imaging applications, such as low-light photography, medical imaging and microscopy. In cases of high SNR, several transformations exist so as to convert the Poisson noise into an additive…

Computer Vision and Pattern Recognition · Computer Science 2015-06-17 Raja Giryes , Michael Elad

The paper deals with the nonparametric estimation problem at a given fixed point for an autoregressive model with unknown distributed noise. Kernel estimate modifications are proposed. Asymptotic minimax and efficiency properties for…

Statistics Theory · Mathematics 2008-06-19 Ouerdia Arkoun , Serguei Pergamenchtchikov

Image denoising is a well-known and well studied problem, commonly targeting a minimization of the mean squared error (MSE) between the outcome and the original image. Unfortunately, especially for severe noise levels, such Minimum MSE…

Image and Video Processing · Electrical Eng. & Systems 2021-09-01 Bahjat Kawar , Gregory Vaksman , Michael Elad

This dissertation shows that careful injection of noise into sample data can substantially speed up Expectation-Maximization algorithms. Expectation-Maximization algorithms are a class of iterative algorithms for extracting maximum…

Machine Learning · Statistics 2014-11-26 Osonde Adekorede Osoba

We study the problem of estimation and testing in logistic regression with class-conditional noise in the observed labels, which has an important implication in the Positive-Unlabeled (PU) learning setting. With the key observation that the…

Methodology · Statistics 2020-08-14 Hyebin Song , Ran Dai , Garvesh Raskutti , Rina Foygel Barber

In this work we introduce a novel stochastic algorithm dubbed SNIPS, which draws samples from the posterior distribution of any linear inverse problem, where the observation is assumed to be contaminated by additive white Gaussian noise.…

Image and Video Processing · Electrical Eng. & Systems 2021-11-11 Bahjat Kawar , Gregory Vaksman , Michael Elad

We consider the problem of inference in a linear regression model in which the relative ordering of the input features and output labels is not known. Such datasets naturally arise from experiments in which the samples are shuffled or…

Machine Learning · Statistics 2018-04-04 Abubakar Abid , James Zou

We compare a recently proposed multivariate spline based on mixed partial derivatives with two other standard splines for the scattered data smoothing problem. The splines are defined as the minimiser of a penalised least squares…

Numerical Analysis · Mathematics 2020-03-04 Elizabeth Harris , Bishnu Lamichhane , Quoc Thong Le Gia

Using a Bayesian approach, we consider the problem of recovering sparse signals under additive sparse and dense noise. Typically, sparse noise models outliers, impulse bursts or data loss. To handle sparse noise, existing methods…

Machine Learning · Statistics 2015-01-13 Martin Sundin , Saikat Chatterjee , Magnus Jansson

Second-order information -- such as curvature or data covariance -- is critical for optimisation, diagnostics, and robustness. However, in many modern settings, only the gradients are observable. We show that the gradients alone can reveal…

Machine Learning · Computer Science 2026-04-08 Arash Jamshidi , Katsiaryna Haitsiukevich , Kai Puolamäki

This paper discusses the problem of estimating a stochastic signal from nonlinear uncertain observations with time-correlated additive noise described by a first-order Markov process. Random deception attacks are assumed to be launched by…

Signal Processing · Electrical Eng. & Systems 2024-05-09 R. Caballero-Águila , J. Hu , J. Linares-Pérez

Shuffled linear regression (SLR) seeks to estimate latent features through a linear transformation, complicated by unknown permutations in the measurement dimensions. This problem extends traditional least-squares (LS) and Least Absolute…

Statistics Theory · Mathematics 2025-04-17 Hang Liu , Anna Scaglione
‹ Prev 1 4 5 6 7 8 10 Next ›