English
Related papers

Related papers: Multi-Dictionary Tensor Decomposition

200 papers

This paper introduces matrix product state (MPS) decomposition as a computational tool for extracting features of multidimensional data represented by higher-order tensors. Regardless of tensor order, MPS extracts its relevant features to…

Computer Vision and Pattern Recognition · Computer Science 2016-01-22 Johann A. Bengua , Ho N. Phien , Hoang D. Tuan , Minh N. Do

To ensure interpretability of extracted sources in tensor decomposition, we introduce in this paper a dictionary-based tensor canonical polyadic decomposition which enforces one factor to belong exactly to a known dictionary. A new…

Machine Learning · Statistics 2018-03-13 Jérémy E. Cohen , Nicolas Gillis

Existing tensor completion formulation mostly relies on partial observations from a single tensor. However, tensors extracted from real-world data are often more complex due to: (i) Partial observation: Only a small subset (e.g., 5%) of…

Numerical Analysis · Mathematics 2021-06-22 Chaoqi Yang , Navjot Singh , Cao Xiao , Cheng Qian , Edgar Solomonik , Jimeng Sun

Recent work has proposed the use of tensor decomposition to model repetitions and to separate tracks in loop-based electronic music. The present work investigates further on the ability of Nonnegative Tucker Decompositon (NTD) to uncover…

Sound · Computer Science 2022-01-31 Axel Marmoret , Jérémy E. Cohen , Nancy Bertin , Frédéric Bimbot

This paper introduces an extended tensor decomposition (XTD) method for model reduction. The proposed method is based on a sparse non-separated enrichment to the conventional tensor decomposition, which is expected to improve the…

Numerical Analysis · Mathematics 2023-11-07 Ye Lu , Satyajit Mojumder , Jiachen Guo , Yangfan Li , Wing Kam Liu

We demonstrate that the integration of the recently developed dynamic mode decomposition (DMD) with a multi-resolution analysis allows for a decomposition method capable of robustly separating complex systems into a hierarchy of…

Dynamical Systems · Mathematics 2015-06-02 J. Nathan Kutz , Xing Fu , Steven L. Brunton

There is a significant expansion in both volume and range of applications along with the concomitant increase in the variety of data sources. These ever-expanding trends have highlighted the necessity for more versatile analysis tools that…

Numerical Analysis · Mathematics 2021-09-09 Ilya Kisil , Giuseppe G. Calvi , Kriton Konstantinidis , Yao Lei Xu , Danilo P. Mandic

Tensor decomposition methods are popular tools for learning latent variables given only lower-order moments of the data. However, the standard assumption is that we have sufficient data to estimate these moments to high accuracy. In this…

Machine Learning · Statistics 2019-03-13 Omer Gottesman , Weiwei Pan , Finale Doshi-Velez

Nonnegative Tucker decomposition (NTD), a tensor decomposition model, has received increased interest in the recent years because of its ability to blindly extract meaningful patterns, in particular in Music Information Retrieval.…

Tensor decompositions are powerful tools for dimensionality reduction and feature interpretation of multidimensional data such as signals. Existing tensor decomposition objectives (e.g., Frobenius norm) are designed for fitting raw data…

Numerical Analysis · Mathematics 2022-09-20 Chaoqi Yang , Cheng Qian , Navjot Singh , Cao Xiao , M Brandon Westover , Edgar Solomonik , Jimeng Sun

A novel method for common and individual feature analysis from exceedingly large-scale data is proposed, in order to ensure the tractability of both the computation and storage and thus mitigate the curse of dimensionality, a major…

Signal Processing · Electrical Eng. & Systems 2017-11-03 Ilia Kisil , Giuseppe G. Calvi , Danilo P. Mandic

Dynamic Mode Decomposition (DMD) is a powerful, data-driven method for diagnosing complex dynamics. Various DMD algorithms allow one to fit data with a low-rank model that decomposes it into a sum of coherent spatiotemporal patterns.…

Dynamical Systems · Mathematics 2025-09-04 Karl Lapo , Samuele Mosso , J. Nathan Kutz

Multi-way data arises in many applications such as electroencephalography (EEG) classification, face recognition, text mining and hyperspectral data analysis. Tensor decomposition has been commonly used to find the hidden factors and elicit…

Optimization and Control · Mathematics 2014-05-07 Yangyang Xu

Increased training parameters have enabled large pre-trained models to excel in various downstream tasks. Nevertheless, the extensive computational requirements associated with these models hinder their widespread adoption within the…

Artificial Intelligence · Computer Science 2024-11-12 Yu-Liang Zhan , Zhong-Yi Lu , Hao Sun , Ze-Feng Gao

Recently, introducing Tensor Decomposition (TD) techniques into unsupervised feature selection (UFS) has been an emerging research topic. A tensor structure is beneficial for mining the relations between different modes and helps relieve…

Machine Learning · Computer Science 2025-07-04 Junjing Zheng , Xinyu Zhang , Weidong Jiang , Xiangfeng Qiu , Mingjian Ren

Coupled tensor decompositions (CTDs) perform data fusion by linking factors from different datasets. Although many CTDs have been already proposed, current works do not address important challenges of data fusion, where: 1) the datasets are…

Machine Learning · Computer Science 2024-12-13 Ricardo Augusto Borsoi , Konstantin Usevich , David Brie , Tülay Adali

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

Machine Learning · Computer Science 2016-06-13 Furong Huang

The paper surveys the topic of tensor decompositions in modern machine learning applications. It focuses on three active research topics of significant relevance for the community. After a brief review of consolidated works on multi-way…

Machine Learning · Computer Science 2020-02-28 Davide Bacciu , Danilo P. Mandic

Numerous complex real-world systems, such as those in biological, ecological, and social networks, exhibit higher-order interactions that are often modeled using polynomial dynamical systems or homogeneous polynomial dynamical systems…

Dynamical Systems · Mathematics 2025-03-25 Xin Mao , Anqi Dong , Ziqin He , Yidan Mei , Shenghan Mei , Can Chen

Tensor methods have emerged as a powerful paradigm for consistent learning of many latent variable models such as topic models, independent component analysis and dictionary learning. Model parameters are estimated via CP decomposition of…

Machine Learning · Computer Science 2015-06-22 Furong Huang , Animashree Anandkumar