English
Related papers

Related papers: A Low-Rank tensor framework for THB-Splines

200 papers

We propose a new framework for the analysis of low-rank tensors which lies at the intersection of spectral graph theory and signal processing. As a first step, we present a new graph based low-rank decomposition which approximates the…

Computer Vision and Pattern Recognition · Computer Science 2016-11-16 Nauman Shahid , Francesco Grassi , Pierre Vandergheynst

The problem of recovering a low $n$-rank tensor is an extension of sparse recovery problem from the low dimensional space (matrix space) to the high dimensional space (tensor space) and has many applications in computer vision and graphics…

Optimization and Control · Mathematics 2014-04-09 Min Zhang , Lei Yang , Zheng-Hai Huang

Recent years have seen rapid advances in the data-driven analysis of dynamical systems based on Koopman operator theory and related approaches. On the other hand, low-rank tensor product approximations -- in particular the tensor train (TT)…

Numerical Analysis · Mathematics 2021-08-11 Feliks Nüske , Patrick Gelß , Stefan Klus , Cecilia Clementi

Quantitative magnetic resonance (MR) T1\r{ho} mapping is a promising approach for characterizing intrinsic tissue-dependent information. However, long scan time significantly hinders its widespread applications. Recently, low-rank tensor…

Image and Video Processing · Electrical Eng. & Systems 2023-01-31 Yuanyuan Liu , Dong Liang , Zhuo-Xu Cui , Yuxin Yang , Chentao Cao , Qingyong Zhu , Jing Cheng , Caiyun Shi , Haifeng Wang , Yanjie Zhu

Let us consider a case where all of the elements in some continuous slices are missing in tensor data. In this case, the nuclear-norm and total variation regularization methods usually fail to recover the missing elements. The key problem…

Computer Vision and Pattern Recognition · Computer Science 2018-04-06 Tatsuya Yokota , Burak Erem , Seyhmus Guler , Simon K. Warfield , Hidekata Hontani

In low-rank tensor completion tasks, due to the underlying multiple large-scale singular value decomposition (SVD) operations and rank selection problem of the traditional methods, they suffer from high computational cost and high…

Numerical Analysis · Computer Science 2018-05-23 Longhao Yuan , Chao Li , Danilo Mandic , Jianting Cao , Qibin Zhao

We study low rank matrix and tensor completion and propose novel algorithms that employ adaptive sampling schemes to obtain strong performance guarantees. Our algorithms exploit adaptivity to identify entries that are highly informative for…

Machine Learning · Statistics 2013-11-12 Akshay Krishnamurthy , Aarti Singh

Tensor network (TN) is a powerful framework in machine learning, but selecting a good TN model, known as TN structure search (TN-SS), is a challenging and computationally intensive task. The recent approach TNLS~\cite{li2022permutation}…

Machine Learning · Computer Science 2023-05-30 Chao Li , Junhua Zeng , Chunmei Li , Cesar Caiafa , Qibin Zhao

The radiative transfer equation (RTE) has been established as a fundamental tool for the description of energy transport, absorption and scattering in many relevant societal applications, and requires numerical approximations. However,…

Numerical Analysis · Mathematics 2025-05-28 Markus Bachmayr , Riccardo Bardin , Matthias Schlottbom

We consider factoring low-rank tensors in the presence of outlying slabs. This problem is important in practice, because data collected in many real-world applications, such as speech, fluorescence, and some social network data, fit this…

Machine Learning · Statistics 2023-07-19 Xiao Fu , Kejun Huang , Wing-Kin Ma , Nicholas D. Sidiropoulos , Rasmus Bro

Isogeometric analysis is a recently developed framework based on finite element analysis, where the simple building blocks in geometry and solution space are replaced by more complex and geometrically-oriented compounds. Box splines are an…

Numerical Analysis · Mathematics 2019-09-26 Tadej Kanduc , Carlotta Giannelli , Francesca Pelosi , Hendrik Speleers

Low-Rank Adaptation (LoRA) is widely used to efficiently adapt Transformers by adding trainable low-rank matrices to attention projections. While effective, these matrices are considered independent for each attention projection (Query,…

Machine Learning · Computer Science 2026-02-06 Axel Marmoret , Reda Bensaid , Jonathan Lys , Vincent Gripon , François Leduc-Primeau

We investigate a generalized framework to estimate a latent low-rank plus sparse tensor, where the low-rank tensor often captures the multi-way principal components and the sparse tensor accounts for potential model mis-specifications or…

Methodology · Statistics 2022-04-15 Jian-Feng Cai , Jingyang Li , Dong Xia

We introduce tensor numerical techniques for solving optimal control problems constrained by elliptic operators in $\mathbb{R}^d$, $d=2,3$, with variable coefficients, which can be represented in a low rank separable form. We construct a…

Numerical Analysis · Mathematics 2021-05-28 Boris N. Khoromskij , Britta Schmitt , Volker Schulz

We consider an adaptive algorithm for finite element methods for the isogeometric analysis (IGAFEM) of elliptic (possibly non-symmetric) second-order partial differential equations. We employ analysis-suitable T-splines of arbitrary odd…

Numerical Analysis · Mathematics 2020-09-07 Gregor Gantner , Dirk Praetorius

Neural networks have achieved tremendous success in a large variety of applications. However, their memory footprint and computational demand can render them impractical in application settings with limited hardware or energy resources. In…

Machine Learning · Computer Science 2022-10-19 Steffen Schotthöfer , Emanuele Zangrando , Jonas Kusch , Gianluca Ceruti , Francesco Tudisco

Tensor Robust Principal Component Analysis (TRPCA), which aims to recover a low-rank tensor corrupted by sparse noise, has attracted much attention in many real applications. This paper develops a new Global Weighted TRPCA method (GWTRPCA),…

Machine Learning · Computer Science 2023-01-06 Libin Wang , Yulong Wang , Shiyuan Wang , Youheng Liu , Yutao Hu , Longlong Chen , Hong Chen

Recovery of low-rank matrices from a small number of linear measurements is now well-known to be possible under various model assumptions on the measurements. Such results demonstrate robustness and are backed with provable theoretical…

Numerical Analysis · Mathematics 2019-08-23 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

The paper addresses the problem of low-rank trace norm minimization. We propose an algorithm that alternates between fixed-rank optimization and rank-one updates. The fixed-rank optimization is characterized by an efficient factorization…

Optimization and Control · Mathematics 2013-06-04 B. Mishra , G. Meyer , F. Bach , R. Sepulchre

To efficiently express tensor data using the Tucker format, a critical task is to minimize the multilinear rank such that the model would not be over-flexible and lead to overfitting. Due to the lack of rank minimization tools in tensor,…

Signal Processing · Electrical Eng. & Systems 2024-09-11 Xueke Tong , Hancheng Zhu , Lei Cheng , Yik-Chung Wu