English
Related papers

Related papers: Dimension-free Bounds for Covariance Estimation wi…

200 papers

Deep neural networks (DNNs) have enabled impressive breakthroughs in various artificial intelligence (AI) applications recently due to its capability of learning high-level features from big data. However, the current demand of DNNs for…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Bijiao Wu , Dingheng Wang , Guangshe Zhao , Lei Deng , Guoqi Li

Although the operator (spectral) norm is one of the most widely used metrics for covariance estimation, comparatively little is known about the fluctuations of error in this norm. To be specific, let $\hat\Sigma$ denote the sample…

Statistics Theory · Mathematics 2019-09-16 Miles E. Lopes , N. Benjamin Erichson , Michael W. Mahoney

We establish a dimension-free improvement of Talagrand's Gaussian transport-entropy inequality, under the assumption that the measures satisfy a Poincar\'e inequality. We also study stability of the inequality, in terms of relative entropy,…

Probability · Mathematics 2021-04-27 Dan Mikulincer

Multiway data analysis aims to uncover patterns in data structured as multi-indexed arrays, with multiway covariance playing a crucial role in many applications. However, the high dimensionality of multiway covariance presents significant…

Statistics Theory · Mathematics 2026-03-19 Dogyoon Song , Alfred O. Hero

Existing models for high-dimensional time series are overwhelmingly developed within the finite-order vector autoregressive (VAR) framework. However, the more flexible vector autoregressive moving averages (VARMA) have been much less…

Methodology · Statistics 2025-05-01 Feiqing Huang , Kexin Lu , Yao Zheng

We consider the problem of jointly modeling and clustering populations of tensors by introducing a high-dimensional tensor mixture model with heterogeneous covariances. To effectively tackle the high dimensionality of tensor objects, we…

Methodology · Statistics 2024-11-21 Biao Cai , Jingfei Zhang , Will Wei Sun

The design and application of regression-free tensor network representations for integration is presented. Tensor network methods are demonstrated to outperform Monte Carlo for test problems, and exponential convergence is shown to be…

Numerical Analysis · Mathematics 2022-02-22 Sebastian Cassel

Suppose we are given an $n$-dimensional order-3 symmetric tensor $T \in (\mathbb{R}^n)^{\otimes 3}$ that is the sum of $r$ random rank-1 terms. The problem of recovering the rank-1 components is possible in principle when $r \lesssim n^2$…

Computational Complexity · Computer Science 2023-03-28 Alexander S. Wein

This article develops a new algorithm named TTRISK to solve high-dimensional risk-averse optimization problems governed by differential equations (ODEs and/or PDEs) under uncertainty. As an example, we focus on the so-called Conditional…

Numerical Analysis · Mathematics 2022-12-02 Harbir Antil , Sergey Dolgov , Akwum Onwunta

We study extensions of compressive sensing and low rank matrix recovery (matrix completion) to the recovery of low rank tensors of higher order from a small number of linear measurements. While the theoretical understanding of low rank…

Information Theory · Computer Science 2016-02-18 Holger Rauhut , Reinhold Schneider , Zeljka Stojanac

Tensor factorization is a powerful tool to analyse multi-way data. Compared with traditional multi-linear methods, nonlinear tensor factorization models are capable of capturing more complex relationships in the data. However, they are…

Machine Learning · Computer Science 2016-05-24 Shandian Zhe , Kai Zhang , Pengyuan Wang , Kuang-chih Lee , Zenglin Xu , Yuan Qi , Zoubin Ghahramani

We present a novel offline-online method to mitigate the computational burden of the characterization of posterior random variables in statistical learning. In the offline phase, the proposed method learns the joint law of the parameter…

Machine Learning · Statistics 2023-03-07 Tiangang Cui , Sergey Dolgov , Olivier Zahm

Tensor Factor Models (TFM) are appealing dimension reduction tools for high-order large-dimensional tensor time series, and have wide applications in economics, finance and medical imaging. In this paper, we propose a projection estimator…

Methodology · Statistics 2025-03-03 Matteo Barigozzi , Yong He , Lingxiao Li , Lorenzo Trapani

We propose a (3+1)D linear set of covariant vector equations, which unify the spin 0 ``new Dirac equation'' with its spin 1/2 counterpart, proposed by Staunton. Our equations describe a spin (0,1/2) supermultiplet with different numbers of…

High Energy Physics - Theory · Physics 2008-11-26 Peter A. Horvathy , Mikhail S. Plyushchay , Mauricio Valenzuela

Accurately evaluating configurational integrals for dense solids remains a central and difficult challenge in the statistical mechanics of condensed systems. Here, we present a novel tensor network approach that reformulates the…

This paper is concerned with convergence estimates for fully discrete tree tensor network approximations of high-dimensional functions from several model classes. For functions having standard or mixed Sobolev regularity, new estimates…

Numerical Analysis · Mathematics 2021-12-03 Markus Bachmayr , Anthony Nouy , Reinhold Schneider

We provide guarantees for learning latent variable models emphasizing on the overcomplete regime, where the dimensionality of the latent space can exceed the observed dimensionality. In particular, we consider multiview mixtures, spherical…

Machine Learning · Computer Science 2014-12-18 Animashree Anandkumar , Rong Ge , Majid Janzamin

We investigate the problem of statistical inference for logistic regression with high-dimensional covariates in settings where dependence among individuals is induced by an underlying Markov random field. Going beyond the pairwise…

Statistics Theory · Mathematics 2026-03-23 Josh Miles , Sohom Bhattacharya

The dependency structure of multivariate data can be analyzed using the covariance matrix $\Sigma$. In many fields the precision matrix $\Sigma^{-1}$ is even more informative. As the sample covariance estimator is singular in…

Methodology · Statistics 2015-06-04 Viktoria Öllerer , Christophe Croux

Recent advances in IoT and biometric sensing technologies have led to the generation of massive and high-dimensional tensor data, yet achieving accurate and efficient low-rank approximation remains a major challenge. Most existing tensor…

Machine Learning · Computer Science 2025-11-03 Hiroki Hasegawa , Yukihiko Okada