English
Related papers

Related papers: The M-Tensor Format: Optimality in High Dimensiona…

200 papers

Statistical inference for tensors has emerged as a critical challenge in analyzing high-dimensional data in modern data science. This paper introduces a unified framework for inferring general and low-Tucker-rank linear functionals of…

Statistics Theory · Mathematics 2025-01-28 Ke Xu , Elynn Chen , Yuefeng Han

There has been a great effort to transfer linear discriminant techniques that operate on vector data to high-order data, generally referred to as Multilinear Discriminant Analysis (MDA) techniques. Many existing works focus on maximizing…

Computer Vision and Pattern Recognition · Computer Science 2018-07-06 Dat Thanh Tran , Moncef Gabbouj , Alexandros Iosifidis

Multitask learning (MTL) can utilize the relatedness between multiple tasks for performance improvement. The advent of multimodal data allows tasks to be referenced by multiple indices. High-order tensors are capable of providing efficient…

Machine Learning · Computer Science 2023-08-23 Jiani Liu , Qinghua Tao , Ce Zhu , Yipeng Liu , Johan A. K. Suykens

The automated construction of coarse-grained models represents a pivotal component in computer simulation of physical systems and is a key enabler in various analysis and design tasks related to uncertainty quantification. Pertinent methods…

Machine Learning · Statistics 2019-09-11 Constantin Grigo , Phaedon-Stelios Koutsourelakis

The effectiveness of non-parametric, kernel-based methods for function estimation comes at the price of high computational complexity, which hinders their applicability in adaptive, model-based control. Motivated by approximation techniques…

Statistics Theory · Mathematics 2023-03-17 Anna Scampicchio , Elena Arcari , Melanie N. Zeilinger

Accurate and concise governing equations are crucial for understanding system dynamics. Recently, data-driven methods such as sparse regression have been employed to automatically uncover governing equations from data, representing a…

Machine Learning · Computer Science 2025-08-05 Boqian Zhang , Juanmian Lei , Guoyou Sun , Shuaibing Ding , Jian Guo

In this work we perform some mathematical analysis on non-negative matrix factorizations (NMF) and apply NMF to some imaging and inverse problems. We will propose a sparse low-rank approximation of big positive data and images in terms of…

Optimization and Control · Mathematics 2015-04-24 Yat Tin Chow , Kazufumi Ito , Jun Zou

This work proposes a low complexity nonlinearity model and develops adaptive algorithms over it. The model is based on the decomposable---or rank-one, in tensor language---Volterra kernels. It may also be described as a product of FIR…

Systems and Control · Computer Science 2016-10-25 Felipe C. Pinheiro , Cassio G. Lopes

High-dimensional partial differential equations (PDEs) are ubiquitous in economics, science and engineering. However, their numerical treatment poses formidable challenges since traditional grid-based methods tend to be frustrated by the…

Machine Learning · Statistics 2021-07-20 Lorenz Richter , Leon Sallandt , Nikolas Nüsken

Tensor decomposition methods are popular tools for learning latent variables given only lower-order moments of the data. However, the standard assumption is that we have sufficient data to estimate these moments to high accuracy. In this…

Machine Learning · Statistics 2019-03-13 Omer Gottesman , Weiwei Pan , Finale Doshi-Velez

We study the tensor-on-tensor regression, where the goal is to connect tensor responses to tensor covariates with a low Tucker rank parameter tensor/matrix without the prior knowledge of its intrinsic rank. We propose the Riemannian…

Statistics Theory · Mathematics 2024-01-17 Yuetian Luo , Anru R. Zhang

This work studies the problem of high-dimensional data (referred to as tensors) completion from partially observed samplings. We consider that a tensor is a superposition of multiple low-rank components. In particular, each component can be…

Computer Vision and Pattern Recognition · Computer Science 2021-09-22 Chang Nie , Huan Wang , Zhihui Lai

In genetic studies, not only can the number of predictors obtained from microarray measurements be extremely large, there can also be multiple response variables. Motivated by such a situation, we consider semiparametric dimension reduction…

Methodology · Statistics 2013-09-25 Heng Lian , Shujie Ma

For material modeling of microstructured media, an accurate characterization of the underlying microstructure is indispensable. Mathematically speaking, the overall goal of microstructure characterization is to find simple functionals which…

Computational Engineering, Finance, and Science · Computer Science 2020-07-31 Felix Ernesti , Matti Schneider , Steffen Winter , Daniel Hug , Günter Last , Thomas Böhlke

Compressive Learning is an emerging topic that combines signal acquisition via compressive sensing and machine learning to perform inference tasks directly on a small number of measurements. Many data modalities naturally have a…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Dat Thanh Tran , Mehmet Yamac , Aysen Degerli , Moncef Gabbouj , Alexandros Iosifidis

Researchers are increasingly incorporating numeric high-order data, i.e., numeric tensors, within their practice. Just like the matrix/vector (MV) paradigm, the development of multi-purpose, but high-performance, sparse data structures and…

Mathematical Software · Computer Science 2018-02-09 Adam P. Harrison , Dileepan Joseph

Most machine learning models for structured data encode the structural knowledge of a node by leveraging simple aggregation functions (in neural models, typically a weighted sum) of the information in the node's neighbourhood. Nevertheless,…

Machine Learning · Computer Science 2020-06-18 Daniele Castellana , Davide Bacciu

In this work, we develop an optimization framework for problems whose solutions are well-approximated by Hierarchical Tucker (HT) tensors, an efficient structured tensor format based on recursive subspace factorizations. By exploiting the…

Numerical Analysis · Mathematics 2014-05-12 Curt Da Silva , Felix J. Herrmann

Many recent theoretical works on \emph{meta-learning} aim to achieve guarantees in leveraging similar representational structures from related tasks towards simplifying a target task. The main aim of theoretical guarantees on the subject is…

Machine Learning · Statistics 2025-05-21 Dimitri Meunier , Zhu Li , Arthur Gretton , Samory Kpotufe

We propose a tensor neural network ($t$-NN) framework that offers an exciting new paradigm for designing neural networks with multidimensional (tensor) data. Our network architecture is based on the $t$-product (Kilmer and Martin, 2011), an…

Machine Learning · Computer Science 2018-11-19 Elizabeth Newman , Lior Horesh , Haim Avron , Misha Kilmer