English
Related papers

Related papers: Goal-Oriented Low-Rank Tensor Decompositions for N…

200 papers

Tensor decomposition is one of the fundamental technique for model compression of deep convolution neural networks owing to its ability to reveal the latent relations among complex structures. However, most existing methods compress the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Bo-Shiuan Chu , Che-Rung Lee

Learning generative probabilistic models is a core problem in machine learning, which presents significant challenges due to the curse of dimensionality. This paper proposes a joint dimensionality reduction and non-parametric density…

Machine Learning · Statistics 2022-06-22 Magda Amiridi , Nikos Kargas , Nicholas D. Sidiropoulos

Recently, the \textit{Tensor Nuclear Norm~(TNN)} regularization based on t-SVD has been widely used in various low tubal-rank tensor recovery tasks. However, these models usually require smooth change of data along the third dimension to…

Machine Learning · Computer Science 2021-06-16 Hao Kong , Canyi Lu , Zhouchen Lin

A primary interest in dynamic inverse problems is to identify the underlying temporal behaviour of the system from outside measurements. In this work we consider the case, where the target can be represented by a decomposition of spatial…

Numerical Analysis · Mathematics 2020-06-09 Simon Arridge , Pascal Fernsel , Andreas Hauptmann

The groundbreaking performance of deep neural networks (NNs) promoted a surge of interest in providing a mathematical basis to deep learning theory. Low-rank tensor decompositions are specially befitting for this task due to their close…

Machine Learning · Computer Science 2025-12-18 Ricardo Borsoi , Konstantin Usevich , Marianne Clausel

Low-rank modeling plays a pivotal role in signal processing and machine learning, with applications ranging from collaborative filtering, video surveillance, medical imaging, to dimensionality reduction and adaptive filtering. Many modern…

Machine Learning · Statistics 2018-05-04 Yudong Chen , Yuejie Chi

Dimensionality reduction represents the process of generating a low dimensional representation of high dimensional data. Motivated by the formation control of mobile agents, we propose a nonlinear dynamical system for dimensionality…

Machine Learning · Computer Science 2025-01-17 Taeuk Jeong , Yoon Mo Jung , Euntack Lee

Most currently used tensor regression models for high-dimensional data are based on Tucker decomposition, which has good properties but loses its efficiency in compressing tensors very quickly as the order of tensors increases, say greater…

Methodology · Statistics 2024-03-20 Yuefeng Si , Yingying Zhang , Yuxi Cai , Chunling Liu , Guodong Li

Effective non-parametric density estimation is a key challenge in high-dimensional multivariate data analysis. In this paper,we propose a novel approach that builds upon tensor factorization tools. Any multivariate density can be…

Machine Learning · Statistics 2022-10-19 Magda Amiridi , Nikos Kargas , Nicholas D. Sidiropoulos

Dynamic mode decomposition (DMD) is a recently developed tool for the analysis of the behavior of complex dynamical systems. In this paper, we will propose an extension of DMD that exploits low-rank tensor decompositions of potentially…

Numerical Analysis · Mathematics 2019-08-14 Stefan Klus , Patrick Gelß , Sebastian Peitz , Christof Schütte

Machine learning and data mining algorithms are becoming increasingly important in analyzing large volume, multi-relational and multi--modal datasets, which are often conveniently represented as multiway arrays or tensors. It is therefore…

Numerical Analysis · Computer Science 2017-09-12 A. Cichocki , N. Lee , I. V. Oseledets , A. -H. Phan , Q. Zhao , D. Mandic

This work proposes a systematic model reduction approach based on rank adaptive tensor recovery for partial differential equation (PDE) models with high-dimensional random parameters. Since the standard outputs of interest of these models…

Numerical Analysis · Mathematics 2019-02-15 Kejun Tang , Qifeng Liao

Unsupervised learning aims at the discovery of hidden structure that drives the observations in the real world. It is essential for success in modern machine learning. Latent variable models are versatile in unsupervised learning and have…

Machine Learning · Computer Science 2016-06-13 Furong Huang

This paper describes a flexible framework for generalized low-rank tensor estimation problems that includes many important instances arising from applications in computational imaging, genomics, and network analysis. The proposed estimator…

Statistics Theory · Mathematics 2021-02-08 Rungang Han , Rebecca Willett , Anru R. Zhang

With the advances in data acquisition technology, tensor objects are collected in a variety of applications including multimedia, medical and hyperspectral imaging. As the dimensionality of tensor objects is usually very high,…

Image and Video Processing · Electrical Eng. & Systems 2019-11-06 Seyyid Emre Sofuoglu , Selin Aviyente

Since higher-order tensors are naturally suitable for representing multi-dimensional data in real-world, e.g., color images and videos, low-rank tensor representation has become one of the emerging areas in machine learning and computer…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Yisi Luo , Xile Zhao , Zhemin Li , Michael K. Ng , Deyu Meng

Higher-order tensors have received increased attention across science and engineering. While most tensor decomposition methods are developed for a single tensor observation, scientific studies often collect side information, in the form of…

Methodology · Statistics 2021-10-29 Jiaxin Hu , Chanwoo Lee , Miaoyan Wang

Radio-frequency (RF) tomographic imaging is a promising technique for inferring multi-dimensional physical space by processing RF signals traversed across a region of interest. However, conventional RF tomography schemes are generally based…

Information Theory · Computer Science 2017-12-19 Tao Deng , Xiao-Yang Liu , Feng Qian , Anwar Walid

This work presents a low-rank tensor model for multi-dimensional Markov chains. A common approach to simplify the dynamical behavior of a Markov chain is to impose low-rankness on the transition probability matrix. Inspired by the success…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Madeline Navarro , Sergio Rozada , Antonio G. Marques , Santiago Segarra

Modeling of multidimensional signal using tensor is more convincing than representing it as a collection of matrices. The tensor based approaches can explore the abundant spatial and temporal structures of the mutlidimensional signal. The…

Signal Processing · Electrical Eng. & Systems 2019-12-10 Baburaj Madathil , Sameera V Mohd Sagheer , Abdu Rahiman , Anju Jose Tom , Baiju P S , Jobin Francis , Sudhish N. George