English
Related papers

Related papers: Consistently recovering the signal from noisy func…

200 papers

We propose a new framework for modeling high-dimensional matrix-variate time series by a two-way transformation, where the transformed data consist of a matrix-variate factor process, which is dynamically dependent, and three other blocks…

Econometrics · Economics 2021-08-19 Zhaoxing Gao , Ruey S. Tsay

Tensor decomposition is a powerful tool for extracting physically meaningful latent factors from multi-dimensional nonnegative data, and has been an increasing interest in a variety of fields such as image processing, machine learning, and…

Machine Learning · Computer Science 2024-12-03 Xiongjun Zhang , Michael K. Ng

We analyze a practical algorithm for sparse PCA on incomplete and noisy data under a general non-random sampling scheme. The algorithm is based on a semidefinite relaxation of the $\ell_1$-regularized PCA problem. We provide theoretical…

Machine Learning · Statistics 2023-02-06 Hanbyul Lee , Qifan Song , Jean Honorio

In datasets where the number of parameters is fixed and the number of samples is large, principal component analysis (PCA) is a powerful dimension reduction tool. However, in many contemporary datasets, when the number of parameters is…

Probability · Mathematics 2019-02-14 Enrico Au-Yeung , Greg Zanotti

High-dimensional data often exhibit dependencies among variables that violate the isotropic-noise assumption under which principal component analysis (PCA) is optimal. For cases where the noise is not independent and identically distributed…

Machine Learning · Computer Science 2026-01-16 Antonio Briola , Marwin Schmidt , Fabio Caccioli , Carlos Ros Perez , James Singleton , Christian Michler , Tomaso Aste

Recovering linear subspaces from data is a fundamental and important task in statistics and machine learning. Motivated by heterogeneity in Federated Learning settings, we study a basic formulation of this problem: the principal component…

Machine Learning · Computer Science 2022-10-26 John Duchi , Vitaly Feldman , Lunjia Hu , Kunal Talwar

We study data-driven stabilization of continuous-time systems in autoregressive form when only noisy input-output data are available. First, we provide an operator-based characterization of the set of systems consistent with the data. Next,…

Optimization and Control · Mathematics 2026-02-04 Masashi Wakaiki

Principal components analysis (PCA) is a classical method for the reduction of dimensionality of data in the form of n observations (or cases) of a vector with p variables. For a simple model of factor analysis type, it is proved that…

Statistics Theory · Mathematics 2009-01-29 Iain M Johnstone , Arthur Yu Lu

A host of problems involve the recovery of structured signals from a dimensionality reduced representation such as a random projection; examples include sparse signals (compressive sensing) and low-rank matrices (matrix completion). Given…

Information Theory · Computer Science 2012-05-22 Shirin Jalali , Arian Maleki , Richard Baraniuk

Common problem in signal processing is reconstruction of the missing signal samples. Missing samples can occur by intentionally omitting signal coefficients to reduce memory requirements, or to speed up the transmission process. Also, noisy…

Information Theory · Computer Science 2015-03-02 Slavoljub Jokić , Ljindita Niković , Jelena Kadović

Analyzing dynamical data often requires information of the temporal labels, but such information is unavailable in many applications. Recovery of these temporal labels, closely related to the seriation or sequencing problem, becomes crucial…

Methodology · Statistics 2024-06-21 Yuehaw Khoo , Xin T. Tong , Wanjie Wang , Yuguan Wang

A new algorithm is developed to jointly recover a temporal sequence of images from noisy and under-sampled Fourier data. Specifically, we consider the case where each data set is missing vital information that prevents its (individual)…

Numerical Analysis · Mathematics 2022-05-13 Yao Xiao , Jan Glaubitz , Anne Gelb , Guohui Song

High-dimensional, higher-order tensor data are gaining prominence in a variety of fields, including but not limited to computer vision and network analysis. Tensor factor models, induced from noisy versions of tensor decompositions or…

Methodology · Statistics 2024-12-16 Xu Zhang , Guodong Li , Catherine C. Liu , Jianhua Guo

In signal processing, several applications involve the recovery of a function given noisy modulo samples. The setting considered in this paper is that the samples corrupted by an additive Gaussian noise are wrapped due to the modulo…

Statistics Theory · Mathematics 2021-12-06 Michaël Fanuel , Hemant Tyagi

Separating signals from an additive mixture may be an unnecessarily hard problem when one is only interested in specific properties of a given signal. In this work, we tackle simpler "statistical component separation" problems that focus on…

Machine Learning · Statistics 2024-03-01 Bruno Régaldo-Saint Blancard , Michael Eickenberg

We consider the problem of learning a linear factor model. We propose a regularized form of principal component analysis (PCA) and demonstrate through experiments with synthetic and real data the superiority of resulting estimates to those…

Machine Learning · Computer Science 2013-05-31 Yi-Hao Kao , Benjamin Van Roy

We study the classical problem of recovering a multidimensional source signal from observations of nonlinear mixtures of this signal. We show that this recovery is possible (up to a permutation and monotone scaling of the source's original…

Machine Learning · Statistics 2023-01-18 Alexander Schell , Harald Oberhauser

Regression models usually tend to recover a noisy signal in the form of a combination of regressors, also called features in machine learning, themselves being the result of a learning process.The alignment of the prior covariance feature…

Statistical Mechanics · Physics 2023-01-25 Cyril Furtlehner

In this paper, we tackle the compressive phase retrieval problem in the presence of noise. The noisy compressive phase retrieval problem is to recover a $K$-sparse complex signal $s \in \mathbb{C}^n$, from a set of $m$ noisy quadratic…

Information Theory · Computer Science 2016-06-03 Dong Yin , Kangwook Lee , Ramtin Pedarsani , Kannan Ramchandran

Cellular Automata are discrete dynamical systems that evolve following simple and local rules. Despite of its local simplicity, knowledge discovery in CA is a NP problem. This is the main motivation for using data mining techniques for CA…

Discrete Mathematics · Computer Science 2007-05-23 Gilson A. Giraldi , Antonio A. F. Oliveira , Leonardo Carvalho