English
Related papers

Related papers: The Layered Structure of Tensor Estimation and its…

200 papers

Based on tensor neural network, we propose an interpolation method for high dimensional non-tensor-product-type functions. This interpolation scheme is designed by using the tensor neural network based machine learning method. This means…

Numerical Analysis · Mathematics 2024-04-12 Yongxin Li , Zhongshuo Lin , Yifan Wang , Hehu Xie

Linear information and rank inequalities as, for instance, Ingleton inequality, are useful tools in information theory and matroid theory. Even though many such inequalities have been found, it seems that most of them remain undiscovered.…

Combinatorics · Mathematics 2022-03-31 Michael Bamiloshin , Aner Ben-Efraim , Oriol Farràs , Carles Padró

Tensor factorization arises in many machine learning applications, such knowledge base modeling and parameter estimation in latent variable models. However, numerical methods for tensor factorization have not reached the level of maturity…

Machine Learning · Computer Science 2015-05-20 Volodymyr Kuleshov , Arun Tejasvi Chaganty , Percy Liang

A new connection between two different necessary conditions for a polymatroid to be linearly representable is presented. Specifically, we prove that the existence of a tensor product with the uniform matroid of rank two on three elements…

Combinatorics · Mathematics 2025-02-20 Carles Padró

Tensor decomposition is a mathematically supported technique for data compression. It consists of applying some kind of a Low Rank Decomposition technique on the tensors or matrices in order to reduce the redundancy of the data. However, it…

Machine Learning · Computer Science 2025-05-27 Habib Hajimolahoseini , Walid Ahmed , Austin Wen , Yang Liu

We introduce Bayesian multi-tensor factorization, a model that is the first Bayesian formulation for joint factorization of multiple matrices and tensors. The research problem generalizes the joint matrix-tensor factorization problem to…

Machine Learning · Statistics 2016-10-13 Suleiman A. Khan , Eemeli Leppäaho , Samuel Kaski

Recommender systems have been widely adopted by electronic commerce and entertainment industries for individualized prediction and recommendation, which benefit consumers and improve business intelligence. In this article, we propose an…

Machine Learning · Statistics 2017-11-07 Xuan Bi , Annie Qu , Xiaotong Shen

Spectral clustering and co-clustering are well-known techniques in data analysis, and recent work has extended spectral clustering to square, symmetric tensors and hypermatrices derived from a network. We develop a new tensor spectral…

Social and Information Networks · Computer Science 2016-03-02 Tao Wu , Austin R. Benson , David F. Gleich

We consider the problem of learning low-rank tensors from partial observations with structural constraints, and propose a novel factorization of such tensors, which leads to a simpler optimization problem. The resulting problem is an…

Machine Learning · Computer Science 2023-05-16 Jayadev Naram , Tanmay Kumar Sinha , Pawan Kumar

These lecture notes are intended as an introduction to several notions of tensor rank and their connections to the asymptotic complexity of matrix multiplication. The latter is studied with the exponent of matrix multiplication, which will…

Algebraic Geometry · Mathematics 2022-08-01 Giorgio Ottaviani , Philipp Reichenbach

In this paper, we present an approach to enhance interpolation and approximation error estimates. Based on a previously derived first-order Taylor-like formula, we demonstrate its applicability in improving the $P_1$-interpolation error…

Numerical Analysis · Mathematics 2023-10-31 Joel Chaskalovic , Franck Assous

We consider rank-one symmetric tensor estimation when the tensor is corrupted by Gaussian noise and the spike forming the tensor is a structured signal coming from a generalized linear model. The latter is a mathematically tractable model…

Information Theory · Computer Science 2020-06-29 Clément Luneau , Nicolas Macris

Feature selection methods are usually evaluated by wrapping specific classifiers and datasets in the evaluation process, resulting very often in unfair comparisons between methods. In this work, we develop a theoretical framework that…

Machine Learning · Statistics 2016-10-11 Cláudia Pascoal , M. Rosário Oliveira , António Pacheco , Rui Valadas

We consider the problem of estimating a rank-one nonsymmetric matrix under additive white Gaussian noise. The matrix to estimate can be written as the outer product of two vectors and we look at the special case in which both vectors are…

Probability · Mathematics 2020-10-12 Clément Luneau , Nicolas Macris , Jean Barbier

The power of multivariate functions is their ability to model a wide variety of phenomena, but have the disadvantages that they lack an intuitive or interpretable representation, and often require a (very) large number of parameters. We…

Numerical Analysis · Computer Science 2018-05-23 Philippe Dreesen , Jeroen De Geeter , Mariya Ishteva

This paper proposes a tensor-based parameter estimation algorithm for sensing in an intelligent reflecting surface-assisted system. We present a higher-order singular value decomposition-based solution that exploits the tensor structure of…

Signal Processing · Electrical Eng. & Systems 2026-05-29 Kenneth B. A. Benício , Bruno Sokal , André L. F. de Almeida , Fazal-E-Asim , Behrooz Makki , Gábor Fodor

We address the practical problems of estimating the information relations that characterize large networks. Building on methods developed for analysis of the neural code, we show that reliable estimates of mutual information can be obtained…

Information Theory · Computer Science 2007-07-13 Noam Slonim , Gurinder S. Atwal , Gasper Tkacik , William Bialek

This work considers a computationally and statistically efficient parameter estimation method for a wide class of latent variable models---including Gaussian mixture models, hidden Markov models, and latent Dirichlet allocation---which…

Machine Learning · Computer Science 2014-11-17 Anima Anandkumar , Rong Ge , Daniel Hsu , Sham M. Kakade , Matus Telgarsky

Mutual information is used as a purely geometrical regularization of entanglement entropy applicable to any QFT. A coefficient in the mutual information between concentric circular entangling surfaces gives a precise universal prescription…

High Energy Physics - Theory · Physics 2015-06-23 Horacio Casini , Marina Huerta , Robert C. Myers , Alexandre Yale

In data processing and machine learning, an important challenge is to recover and exploit models that can represent accurately the data. We consider the problem of recovering Gaussian mixture models from datasets. We investigate symmetric…

Algebraic Geometry · Mathematics 2022-06-22 Rima Khouja , Pierre-Alexandre Mattei , Bernard Mourrain