中文
相关论文

相关论文: An Improved Gap-Dependency Analysis of the Noisy P…

200 篇论文

Spectral estimators are fundamental in lowrank matrix models and arise throughout machine learning and statistics, with applications including network analysis, matrix completion and PCA. These estimators aim to recover the leading…

统计理论 · 数学 2025-02-17 Hao Yan , Keith Levin

We study the high-dimensional inference of a rank-one signal corrupted by sparse noise. The noise is modelled as the adjacency matrix of a weighted undirected graph with finite average connectivity in the large size limit. Using the replica…

机器学习 · 统计学 2025-11-18 Urte Adomaityte , Gabriele Sicuro , Pierpaolo Vivo

A central challenge in machine learning is to understand how noise or measurement errors affect low-rank approximations, particularly in the spectral norm. This question is especially important in differentially private low-rank…

机器学习 · 计算机科学 2025-10-30 Phuc Tran , Nisheeth K. Vishnoi , Van H. Vu

Recently years, the attempts on distilling mobile data into useful knowledge has been led to the deployment of machine learning algorithms at the network edge. Principal component analysis (PCA) is a classic technique for extracting the…

信息论 · 计算机科学 2022-04-04 Zezhong Zhang , Guangxu Zhu , Rui Wang , Vincent K. N. Lau , Kaibin Huang

Principal component analysis (PCA) aims at estimating the direction of maximal variability of a high-dimensional dataset. A natural question is: does this task become easier, and estimation more accurate, when we exploit additional…

信息论 · 计算机科学 2014-06-19 Andrea Montanari , Emile Richard

We consider the Principal Component Analysis problem for large tensors of arbitrary order $k$ under a single-spike (or rank-one plus noise) model. On the one hand, we use information theory, and recent results in probability theory, to…

机器学习 · 计算机科学 2014-11-06 Andrea Montanari , Emile Richard

The learning with privileged information setting has recently attracted a lot of attention within the machine learning community, as it allows the integration of additional knowledge into the training process of a classifier, even when this…

Constructing an efficient parameterization of a large, noisy data set of points lying close to a smooth manifold in high dimension remains a fundamental problem. One approach consists in recovering a local parameterization using the local…

数据分析、统计与概率 · 物理学 2013-12-09 Daniel N. Kaslovsky , Francois G. Meyer

Deep learning technology has been widely applied to speech enhancement. While testing the effectiveness of various network structures, researchers are also exploring the improvement of the loss function used in network training. Although…

音频与语音处理 · 电气工程与系统科学 2023-04-25 Tianrui Wang , Weibin Zhu

We study the problem of PAC learning $\gamma$-margin halfspaces with Random Classification Noise. We establish an information-computation tradeoff suggesting an inherent gap between the sample complexity of the problem and the sample…

机器学习 · 计算机科学 2023-06-29 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis

The performance of Neyman-Pearson detection of correlated stochastic signals using noisy observations is investigated via the error exponent for the miss probability with a fixed level. Using the state-space structure of the signal and…

信息论 · 计算机科学 2016-11-17 Youngchul Sung , Lang Tong , H. Vincent Poor

We consider the problem of estimating a rank-one matrix in Gaussian noise under a probabilistic model for the left and right factors of the matrix. The probabilistic model can impose constraints on the factors including sparsity and…

信息论 · 计算机科学 2015-09-16 Alyson K. Fletcher , Sundeep Rangan

Principal component analysis (PCA) is one of the most fundamental tools in machine learning with broad use as a dimensionality reduction and denoising tool. In the later setting, while PCA is known to be effective at subspace recovery and…

机器学习 · 计算机科学 2024-04-23 Chandra Sekhar Mukherjee , Nikhil Doerkar , Jiapeng Zhang

Non-Gaussian component analysis (NGCA) is a problem in multidimensional data analysis which, since its formulation in 2006, has attracted considerable attention in statistics and machine learning. In this problem, we have a random variable…

机器学习 · 计算机科学 2019-07-25 Navin Goyal , Abhishek Shetty

For enhancement of noisy speech, a method of threshold determination based on modeling of Teager energy (TE) operated perceptual wavelet packet (PWP) coefficients of the noisy speech by exponential distribution is presented. A custom…

音频与语音处理 · 电气工程与系统科学 2018-02-19 Md Tauhidul Islam , Celia Shahnaz , Wei-Ping Zhu , M. Omair Ahmad

We study Principal Component Analysis (PCA) in a setting where a part of the corrupting noise is data-dependent and, as a result, the noise and the true data are correlated. Under a bounded-ness assumption on the true data and the noise,…

信息论 · 计算机科学 2017-11-01 Namrata Vaswani , Praneeth Narayanamurthy

It has recently been shown that many of the existing quasi-Newton algorithms can be formulated as learning algorithms, capable of learning local models of the cost functions. Importantly, this understanding allows us to safely start…

机器学习 · 统计学 2017-04-06 Adrian G. Wills , Thomas B. Schön

We present a simple noise-robust margin-based active learning algorithm to find homogeneous (passing the origin) linear separators and analyze its error convergence when labels are corrupted by noise. We show that when the imposed noise…

机器学习 · 统计学 2015-11-25 Yining Wang , Aarti Singh

Many industrial applications use Metric Learning as a way to circumvent scalability issues when designing systems with a high number of classes. Because of this, this field of research is attracting a lot of interest from the academic and…

计算机视觉与模式识别 · 计算机科学 2020-06-11 Carlos Roig , David Varas , Issey Masuda , Juan Carlos Riveiro , Elisenda Bou-Balust

We study the problem of learning general (i.e., not necessarily homogeneous) halfspaces with Random Classification Noise under the Gaussian distribution. We establish nearly-matching algorithmic and Statistical Query (SQ) lower bound…

机器学习 · 计算机科学 2023-07-18 Ilias Diakonikolas , Jelena Diakonikolas , Daniel M. Kane , Puqian Wang , Nikos Zarifis