中文
相关论文

相关论文: Adapting to Unknown Noise Distribution in Matrix D…

200 篇论文

We address the problem of estimating a high-dimensional matrix from linear measurements, with a focus on designing optimal rank-adaptive algorithms. These algorithms infer the matrix by estimating its singular values and the corresponding…

信息论 · 计算机科学 2026-05-12 Frédéric Zheng , Yassir Jedra , Alexandre Proutiere

We construct minimax optimal non-asymptotic confidence sets for low rank matrix recovery algorithms such as the Matrix Lasso or Dantzig selector. These are employed to devise adaptive sequential sampling procedures that guarantee recovery…

统计理论 · 数学 2019-12-10 Alexandra Carpentier , Jens Eisert , David Gross , Richard Nickl

Empirical risk minimization (ERM) is not robust to changes in the distribution of data. When the distribution of test data is different from that of training data, the problem is known as out-of-distribution generalization. Recently, two…

计算机视觉与模式识别 · 计算机科学 2025-01-16 Shijian Xu

Factorization of matrices where the rank of the two factors diverges linearly with their sizes has many applications in diverse areas such as unsupervised representation learning, dictionary learning or sparse coding. We consider a setting…

无序系统与神经网络 · 物理学 2022-08-11 Antoine Maillard , Florent Krzakala , Marc Mézard , Lenka Zdeborová

In this paper we study the matrix completion problem: Suppose $X \in {\mathbb R}^{n_r \times n_c}$ is unknown except for a known upper bound $r$ on its rank. By measuring a small number $m \ll n_r n_c$ of elements of $X$, is it possible to…

机器学习 · 统计学 2020-05-22 Shantanu Prasad Burnwal , Mathukumalli Vidyasagar

This paper considers the problem of recovering the permutation of an n-dimensional random vector X observed in Gaussian noise. First, a general expression for the probability of error is derived when a linear decoder (i.e., linear estimator…

信息论 · 计算机科学 2021-05-10 Minoh Jeong , Alex Dytso , Martina Cardone

We consider the least-squares regression problem with unknown noise variance, where the observed data points are allowed to be corrupted by outliers. Building on the median-of-means (MOM) method introduced by Lecue and Lerasle…

统计理论 · 数学 2021-03-19 G. Finocchio , A. Derumigny , K. Proksch

We propose a method for estimating the entries of a large noisy matrix when the variance of the noise, $\sigma^2$, is unknown without putting any assumption on the rank of the matrix. We consider the estimator for $\sigma$ introduced by…

统计理论 · 数学 2019-10-30 Mona Azadkia

Computing accurate low rank approximations of large matrices is a fundamental data mining task. In many applications however the matrix contains sensitive information about individuals. In such case we would like to release a low rank…

数据结构与算法 · 计算机科学 2012-11-06 Moritz Hardt , Aaron Roth

We study the matrix completion problem when the observation pattern is deterministic and possibly non-uniform. We propose a simple and efficient debiased projection scheme for recovery from noisy observations and analyze the error under a…

信息论 · 计算机科学 2019-10-31 Simon Foucart , Deanna Needell , Reese Pathak , Yaniv Plan , Mary Wootters

We are motivated by problems that arise in a number of applications such as Online Marketing and Explosives detection, where the observations are usually modeled using Poisson statistics. We model each observation as a Poisson random…

机器学习 · 统计学 2016-06-29 Mohammad H. Rohban , Delaram Motamedvaziri , Venkatesh Saligrama

We study least-squares trace regression when the parameter is the sum of a $r$-low-rank matrix and a $s$-sparse matrix and a fraction $\epsilon$ of the labels is corrupted. For subgaussian distributions and feature-dependent noise, we…

统计理论 · 数学 2024-01-08 Philip Thompson

We consider a high dimensional linear regression problem where the goal is to efficiently recover an unknown vector $\beta^*$ from $n$ noisy linear observations $Y=X\beta^*+W \in \mathbb{R}^n$, for known $X \in \mathbb{R}^{n \times p}$ and…

统计理论 · 数学 2018-11-12 David Gamarnik , Ilias Zadik

In the present paper, we consider the problem of matrix completion with noise. Unlike previous works, we consider quite general sampling distribution and we do not need to know or to estimate the variance of the noise. Two new nuclear-norm…

统计理论 · 数学 2014-02-06 Olga Klopp

An approximate sparse recovery system consists of parameters $k,N$, an $m$-by-$N$ measurement matrix, $\Phi$, and a decoding algorithm, $\mathcal{D}$. Given a vector, $x$, the system approximates $x$ by $\widehat x =\mathcal{D}(\Phi x)$,…

数据结构与算法 · 计算机科学 2014-02-10 Anna C. Gilbert , Yi Li , Ely Porat , Martin J. Strauss

The goal of a denoising algorithm is to reconstruct a signal from its noise-corrupted observations. Perfect reconstruction is seldom possible and performance is measured under a given fidelity criterion. In a recent work, the authors…

信息论 · 计算机科学 2009-11-11 George Gemelos , Styrmir Sigurjonsson , Tsachy Weissman

In this work, we study a variant of nonnegative matrix factorization where we wish to find a symmetric factorization of a given input matrix into a sparse, Boolean matrix. Formally speaking, given $\mathbf{M}\in\mathbb{Z}^{m\times m}$, we…

机器学习 · 计算机科学 2022-01-14 Sitan Chen , Zhao Song , Runzhou Tao , Ruizhe Zhang

Nonnegative Matrix Factorization (NMF) is a versatile and powerful tool for discovering latent structures in data matrices, with many variations proposed in the literature. Recently, Leplat et al.\@ (2019) introduced a minimum-volume NMF…

机器学习 · 统计学 2023-09-26 Duc Toan Nguyen , Eric C. Chi

A method of determining the optimum number of levels of decomposition in soft-thresholding wavelet denoising using Stationary Wavelet Transform is presented here. The method calculates the risk at each level of decomposition using Steins…

计算物理 · 物理学 2017-01-25 Mohd Rozni Md Yusof , Ahmad Kamal bin Ariffin

Suppose we wish to recover an n-dimensional real-valued vector x_0 (e.g. a digital signal or image) from incomplete and contaminated observations y = A x_0 + e; A is a n by m matrix with far fewer rows than columns (n << m) and e is an…

数值分析 · 数学 2007-05-23 Emmanuel Candes , Justin Romberg , Terence Tao