English
Related papers

Related papers: Making Tensor Factorizations Robust to Non-Gaussia…

200 papers

We consider the Principal Component Analysis problem for large tensors of arbitrary order $k$ under a single-spike (or rank-one plus noise) model. On the one hand, we use information theory, and recent results in probability theory, to…

Machine Learning · Computer Science 2014-11-06 Andrea Montanari , Emile Richard

We revisit the Bayesian online inference problems for the linear dynamic systems (LDS) under non- Gaussian environment. The noises can naturally be non-Gaussian (skewed and/or heavy tailed) or to accommodate spurious observations, noises…

Computation · Statistics 2015-04-23 Saikat Saha

We propose a nonparametric density estimator based on the Gaussian process (GP) and derive three novel closed form learning algorithms based on Fisher divergence (FD) score matching. The density estimator is formed by multiplying a base…

Machine Learning · Computer Science 2025-11-17 John Paisley , Wei Zhang , Brian Barr

Tensor decompositions play a crucial role in numerous applications related to multi-way data analysis. By employing a Bayesian framework with sparsity-inducing priors, Bayesian Tensor Ring (BTR) factorization offers probabilistic estimates…

Machine Learning · Computer Science 2024-12-05 Zerui Tao , Toshihisa Tanaka , Qibin Zhao

Probabilistic encoding introduces Gaussian noise into neural networks, enabling a smooth transition from deterministic to uncertain states and enhancing generalization ability. However, the randomness of Gaussian noise distorts point-based…

Machine Learning · Computer Science 2025-07-24 Pengjiu Xia , Yidian Huang , Wenchao Wei , Yuwen Tan

Multitask Gaussian processes (MTGP) are the Gaussian process (GP) framework's solution for multioutput regression problems in which the $T$ elements of the regressors cannot be considered conditionally independent given the observations.…

Machine Learning · Computer Science 2022-08-26 Óscar García-Hinde , Vanessa Gómez-Verdejo , Manel Martínez-Ramón

The CP tensor decomposition is used in applications such as machine learning and signal processing to discover latent low-rank structure in multidimensional data. Computing a CP decomposition via an alternating least squares (ALS) method…

Numerical Analysis · Mathematics 2021-12-22 Rachel Minster , Irina Viviano , Xiaotian Liu , Grey Ballard

Factor analysis (FA) or principal component analysis (PCA) models the covariance matrix of the observed data as R = SS' + {\Sigma}, where SS' is the low-rank covariance matrix of the factors (aka latent variables) and {\Sigma} is the…

Methodology · Statistics 2023-05-31 Petre Stoica , Prabhu Babu

We study estimation and testing in the Poisson regression model with noisy high dimensional covariates, which has wide applications in analyzing noisy big data. Correcting for the estimation bias due to the covariate noise leads to a…

Statistics Theory · Mathematics 2023-01-03 Fei Jiang , Yeqing Zhou , Jianxuan Liu , Yanyuan Ma

One popular way to compute the CANDECOMP/PARAFAC (CP) decomposition of a tensor is to transform the problem into a sequence of overdetermined least squares subproblems with Khatri-Rao product (KRP) structure involving factor matrices. In…

Numerical Analysis · Mathematics 2023-01-25 Yajie Yu , Hanyu Li

In this paper, we propose a new algorithm for point cloud denoising based on the tensor Tucker decomposition. We first represent the local surface patches of a noisy point cloud to be matrices by their distances to a reference point, and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Jianze Li , Xiao-Ping Zhang , Tuan Tran

In this manuscript we consider denoising of large rectangular matrices: given a noisy observation of a signal matrix, what is the best way of recovering the signal matrix itself? For Gaussian noise and rotationally-invariant signal priors,…

Disordered Systems and Neural Networks · Physics 2022-10-03 Emanuele Troiani , Vittorio Erba , Florent Krzakala , Antoine Maillard , Lenka Zdeborová

Signal processing in non-Gaussian noise environment is addressed in this paper. For many real-life situations, the additive noise process present in the system is found to be dominantly non-Gaussian. The problem of detection and estimation…

Statistics Theory · Mathematics 2014-01-23 Jugalkishore K. Banoth , Pradip Sircar

The noisy-or and its generalization noisy-max have been utilized to reduce the complexity of knowledge acquisition. In this paper, we present a new representation of noisy-max that allows for efficient inference in general Bayesian…

Artificial Intelligence · Computer Science 2013-01-30 Masami Takikawa , Bruce D'Ambrosio

This paper provides performance bounds for compressed sensing in the presence of Poisson noise using expander graphs. The Poisson noise model is appropriate for a variety of applications, including low-light imaging and digital streaming,…

Information Theory · Computer Science 2009-11-25 Sina Jafarpour , Rebecca Willett , Maxim Raginsky , Robert Calderbank

Causal discovery methods are intrinsically constrained by the set of assumptions needed to ensure structure identifiability. Moreover additional restrictions are often imposed in order to simplify the inference task: this is the case for…

Machine Learning · Computer Science 2023-04-07 Francesco Montagna , Nicoletta Noceti , Lorenzo Rosasco , Kun Zhang , Francesco Locatello

Gravitational wave detectors will need optimal signal-processing algorithms to extract weak signals from the detector noise. Most algorithms designed to date are based on the unrealistic assumption that the detector noise may be modeled as…

General Relativity and Quantum Cosmology · Physics 2009-11-07 Bruce Allen , Jolien D. E. Creighton , Eanna E. Flanagan , Joseph D. Romano

In numerous settings, it is increasingly common to deal with longitudinal data organized as high-dimensional multi-dimensional arrays, also known as tensors. Within this framework, the time-continuous property of longitudinal data often…

Methodology · Statistics 2026-01-28 Lucas Sort , Laurent Le Brusquet , Arthur Tenenhaus

We consider the problem of estimating a low-rank matrix from a noisy observed matrix. Previous work has shown that the optimal method depends crucially on the choice of loss function. In this paper, we use a family of weighted loss…

Statistics Theory · Mathematics 2021-04-08 William Leeb

Tensor decomposition plays a key role in identifying common features across a collection of matrices in many areas of science. A fundamental need in big data research is to process data tabulated as large-scale matrices using eigenvectors.…

Computational Engineering, Finance, and Science · Computer Science 2016-05-24 HyungSeon Oh