English
Related papers

Related papers: Making Tensor Factorizations Robust to Non-Gaussia…

200 papers

The Canonical Polyadic decomposition (CPD) is a convenient and intuitive tool for tensor factorization; however, for higher-order tensors, it often exhibits high computational cost and permutation of tensor entries, these undesirable…

Numerical Analysis · Computer Science 2018-09-05 Anh-Huy Phan , Andrzej Cichocki , Ivan Oseledets , Salman Ahmadi Asl , Giuseppe Calvi , Danilo Mandic

Tucker tensor decomposition offers a more effective representation for multiway data compared to the widely used PARAFAC model. However, its flexibility brings the challenge of selecting the appropriate latent multi-rank. To overcome the…

Methodology · Statistics 2025-05-19 Federica Stolf , Antonio Canale

Inference for GP models with non-Gaussian noises is computationally expensive when dealing with large datasets. Many recent inference methods approximate the posterior distribution with a simpler distribution defined on a small number of…

Machine Learning · Computer Science 2018-09-11 Linfeng Liu , Liping Liu

In CANDECOMP/PARAFAC tensor decomposition, degeneracy often occurs in some difficult scenarios, e.g., when the rank exceeds the tensor dimension, or when the loading components are highly collinear in several or all modes, or when CPD does…

Numerical Analysis · Computer Science 2017-09-26 Anh-Huy Phan , Petr Tichavský , Andrzej Cichocki

Fourier PCA is Principal Component Analysis of a matrix obtained from higher order derivatives of the logarithm of the Fourier transform of a distribution.We make this method algorithmic by developing a tensor decomposition method for a…

Machine Learning · Computer Science 2014-07-01 Navin Goyal , Santosh Vempala , Ying Xiao

In this article, a Probability Mass Function (PMF) estimation method which tames the curse of dimensionality is proposed. This method, called Partial Coupled Tensor Factorization of 3D marginals or PCTF3D, has for principle to partially…

Signal Processing · Electrical Eng. & Systems 2025-09-08 Philippe Flores , Konstantin Usevich , David Brie

This paper studies the numerical solution of strictly convex unconstrained optimization problems by linesearch Newton-CG methods. We focus on methods employing inexact evaluations of the objective function and inexact and possibly random…

Optimization and Control · Mathematics 2022-05-16 Stefania Bellavia , Eugenio Fabrizi , Benedetta Morini

Acoustic monitoring for machine fault detection is a recent and expanding research path that has already provided promising results for industries. However, it is impossible to collect enough data to learn all types of faults from a…

Machine Learning · Statistics 2022-06-14 Gaetan Frusque , Gabriel Michau , Olga Fink

In this work, we present a new approach for the distributed computation of the PARAFAC decomposition of a third-order tensor across a network of collaborating nodes. We are interested in the case where the overall data gathered across the…

Numerical Analysis · Computer Science 2014-06-09 Alain Y. Kibangou , André L. F. de Almeida

We consider estimation of a deterministic unknown parameter vector in a linear model with non-Gaussian noise. In the Gaussian case, dimensionality reduction via a linear matched filter provides a simple low dimensional sufficient statistic…

Applications · Statistics 2013-11-05 Jakob Vovnoboy , Ami Wiesel

In biomedical research and other fields, it is now common to generate high content data that are both multi-source and multi-way. Multi-source data are collected from different high-throughput technologies while multi-way data are collected…

Machine Learning · Statistics 2025-02-28 Zhiyu Kang , Raghavendra B. Rao , Eric F. Lock

In this paper, we consider diffusion index forecasting with both tensor and non-tensor predictors, where the tensor structure is preserved with a Canonical Polyadic (CP) tensor factor model. When the number of non-tensor predictors is…

Methodology · Statistics 2026-02-05 Bin Chen , Yuefeng Han , Qiyang Yu

We study the Gaussian Process regression model in the context of training data with noise in both input and output. The presence of two sources of noise makes the task of learning accurate predictive models extremely challenging. However,…

Machine Learning · Statistics 2015-07-03 Cuong Tran , Vladimir Pavlovic , Robert Kopp

In this paper, we aim to design robust estimation techniques based on the compound-Gaussian (CG) process and adapted for calibration of radio interferometers. The motivation beyond this is due to the presence of outliers leading to an…

Applications · Statistics 2018-07-31 Virginie Ollier , Mohammed Nabil El Korso , André Ferrari , Rémy Boyer , Pascal Larzabal

Dimensionality reduction for high-order tensors is a challenging problem. In conventional approaches, higher order tensors are `vectorized` via Tucker decomposition to obtain lower order tensors. This will destroy the inherent high-order…

Computer Vision and Pattern Recognition · Computer Science 2017-07-04 Fujiao Ju , Yanfeng Sun , Junbin Gao , Yongli Hu , Baocai Yin

We introduce a new tensor norm, the average spectrum norm, to study sample complexity of tensor completion problems based on the canonical polyadic decomposition (CPD). Properties of the average spectrum norm and its dual norm are…

Information Theory · Computer Science 2024-06-19 Oscar López , Richard Lehoucq , Carlos Llosa-Vite , Arvind Prasadan , Daniel M. Dunlavy

Many machine learning applications use latent variable models to explain structure in data, whereby visible variables (= coordinates of the given datapoint) are explained as a probabilistic function of some hidden variables. Finding…

Machine Learning · Computer Science 2016-12-30 Sanjeev Arora , Rong Ge , Tengyu Ma , Andrej Risteski

We consider the estimation of some parameter $\mathbf{x}$ living in a cone from the nonlinear observations of the form $\{y_i=f_i(\langle\mathbf{a}_i,\mathbf{x}\rangle)\}_{i=1}^m$. We develop a unified approach that first constructs a…

Statistics Theory · Mathematics 2025-10-21 Junren Chen , Lijun Ding , Dong Xia , Ming Yuan

Tensor rank learning for canonical polyadic decomposition (CPD) has long been deemed as an essential yet challenging problem. In particular, since the tensor rank controls the complexity of the CPD model, its inaccurate learning would cause…

Machine Learning · Computer Science 2022-03-30 Lei Cheng , Zhongtao Chen , Qingjiang Shi , Yik-Chung Wu , Sergios Theodoridis

In this letter, we present a novel Gaussian Process Learning-based Probabilistic Optimal Power Flow (GP-POPF) for solving POPF under renewable and load uncertainties of arbitrary distribution. The proposed method relies on a non-parametric…

Systems and Control · Electrical Eng. & Systems 2020-04-17 Parikshit Pareek , Hung D. Nguyen