English
Related papers

Related papers: Mutual information for low-rank even-order symmetr…

200 papers

We present an efficient computational framework to quantify the impact of individual observations in four dimensional variational data assimilation. The proposed methodology uses first and second order adjoint sensitivity analysis, together…

Computational Engineering, Finance, and Science · Computer Science 2013-07-22 Alexandru Cioaca , Adrian Sandu

Data used for analytics and machine learning often take the form of tables with categorical entries. We introduce a family of lossless compression algorithms for such data that proceed in four steps: $(i)$ Estimate latent variables…

Information Theory · Computer Science 2023-02-21 Andrea Montanari , Eric Weiner

A symmetric tensor is a higher order generalization of a symmetric matrix. In this paper, we study various properties of symmetric tensors in relation to a decomposition into a sum of symmetric outer product of vectors. A rank-1 order-k…

Numerical Analysis · Mathematics 2008-09-02 Pierre Comon , Gene Golub , Lek-Heng Lim , Bernard Mourrain

In this paper we focus on the estimation of mutual information from finite samples $(\mathcal{X}\times\mathcal{Y})$. The main concern with estimations of mutual information is their robustness under the class of transformations for which it…

Data Analysis, Statistics and Probability · Physics 2020-02-04 Nicholas Carrara , Jesse Ernst

Tensor decompositions are promising tools for big data analytics as they bring multiple modes and aspects of data to a unified framework, which allows us to discover complex internal structures and correlations of data. Unfortunately most…

Numerical Analysis · Computer Science 2014-12-30 Guoxu Zhou , Andrzej Cichocki , Shengli Xie

The concept of tensor rank, introduced in the twenties, has been popularized at the beginning of the seventies. This has allowed to carry out Factor Analysis on arrays with more than two indices. The generic rank may be seen as an upper…

Other Computer Science · Computer Science 2008-02-19 P. Comon , J. ten Berge

Bottom-Up Hidden Tree Markov Model is a highly expressive model for tree-structured data. Unfortunately, it cannot be used in practice due to the intractable size of its state-transition matrix. We propose a new approximation which lies on…

Machine Learning · Computer Science 2019-06-03 Daniele Castellana , Davide Bacciu

We construct a soft thresholding operation for rank reduction of hierarchical tensors and subsequently consider its use in iterative thresholding methods, in particular for the solution of discretized high-dimensional elliptic problems. The…

Numerical Analysis · Mathematics 2015-02-02 Markus Bachmayr , Reinhold Schneider

The performance of most the clustering methods hinges on the used pairwise affinity, which is usually denoted by a similarity matrix. However, the pairwise similarity is notoriously known for its vulnerability of noise contamination or the…

Machine Learning · Computer Science 2020-06-29 Hong Peng , Yu Hu , Jiazhou Chen , Haiyan Wang , Yang Li , Hongmin Cai

Consider the task of estimating a 3-order $n \times n \times n$ tensor from noisy observations of randomly chosen entries in the sparse regime. We introduce a similarity based collaborative filtering algorithm for estimating a tensor from…

Machine Learning · Computer Science 2023-01-18 Devavrat Shah , Christina Lee Yu

We introduce tensor Interpolative Decomposition (tensor ID) for the reduction of the separation rank of Canonical Tensor Decompositions (CTDs). Tensor ID selects, for a user-defined accuracy \epsilon, a near optimal subset of terms of a CTD…

Numerical Analysis · Mathematics 2013-12-18 David J. Biagioni , Daniel Beylkin , Gregory Beylkin

We propose a flexible and theoretically supported framework for scalable nonnegative matrix factorization. The goal is to find nonnegative low-rank components directly from compressed measurements, accessing the original data only once or…

Optimization and Control · Mathematics 2026-02-17 Abraar Chaudhry , Elizaveta Rebrova

This paper develops a general methodology to connect propositional and first-order interpolation. In fact, the existence of suitable skolemizations and of Herbrand expansions together with a propositional interpolant suffice to construct a…

Logic · Mathematics 2020-02-14 Matthias Baaz , Anela Lolic

The raking-ratio method is a statistical and computational method which adjusts the empirical measure to match the true probability of sets of a finite partition. We study the asymptotic behavior of the raking-ratio empirical process…

Statistics Theory · Mathematics 2019-05-07 Mickael Albertus

In this paper, we study the problem of low-rank tensor learning, where only a few of training samples are observed and the underlying tensor has a low-rank structure. The existing methods are based on the sum of nuclear norms of unfolding…

Machine Learning · Computer Science 2024-10-25 Sijia Xia , Michael K. Ng , Xiongjun Zhang

Polynomial regression is widely used and can help to express nonlinear patterns. However, considering very high polynomial orders may lead to overfitting and poor extrapolation ability for unseen data. The paper presents a method for…

Machine Learning · Computer Science 2023-08-01 Andrei Ivanov , Stefan Maria Ailuro

Predicting unobserved entries of a partially observed matrix has found wide applicability in several areas, such as recommender systems, computational biology, and computer vision. Many scalable methods with rigorous theoretical guarantees…

Machine Learning · Statistics 2018-02-15 Vatsal Shah , Nikhil Rao , Weicong Ding

The low-tubal-rank tensor model has been recently proposed for real-world multidimensional data. In this paper, we study the low-tubal-rank tensor completion problem, i.e., to recover a third-order tensor by observing a subset of its…

Machine Learning · Computer Science 2016-10-12 Xiao-Yang Liu , Shuchin Aeron , Vaneet Aggarwal , Xiaodong Wang

The existing randomized algorithms need an initial estimation of the tubal rank to compute a tensor singular value decomposition. This paper proposes a new randomized fixedprecision algorithm which for a given third-order tensor and a…

Numerical Analysis · Mathematics 2024-04-09 Salman Ahmadi-Asl

Low-rank tensor sensing is a fundamental problem with broad applications in signal processing and machine learning. Among various tensor models, low-Tucker-rank tensors are particularly attractive for capturing multi-mode subspace…

Machine Learning · Computer Science 2026-01-21 Shuang Li