English
Related papers

Related papers: OTLRM: Orthogonal Learning-based Low-Rank Metric f…

200 papers

The instability of embedding spaces across model retraining cycles presents significant challenges to downstream applications using user or item embeddings derived from recommendation systems as input features. This paper introduces a novel…

Information Retrieval · Computer Science 2025-08-12 Kevin Zielnicki , Ko-Jen Hsiao

Tensor train (TT) decomposition is a powerful representation for high-order tensors, which has been successfully applied to various machine learning tasks in recent years. However, since the tensor product is not commutative, permutation of…

Numerical Analysis · Computer Science 2017-05-31 Qibin Zhao , Masashi Sugiyama , Andrzej Cichocki

The Large Margin Distribution Machine (LMDM) is a recent advancement in classifier design that optimizes not just the minimum margin (as in SVM) but the entire margin distribution, thereby improving generalization. However, existing LMDM…

Machine Learning · Computer Science 2025-09-19 Yang Xu , Junpeng Li , Changchun Hua , Yana Yang

This work presents a comprehensive understanding of the estimation of a planted low-rank signal from a general spiked tensor model near the computational threshold. Relying on standard tools from the theory of large random matrices, we…

Machine Learning · Statistics 2025-01-15 Hugo Lebeau , Florent Chatelain , Romain Couillet

Tensors, which provide a powerful and flexible model for representing multi-attribute data and multi-way interactions, play an indispensable role in modern data science across various fields in science and engineering. A fundamental task is…

Machine Learning · Computer Science 2022-06-23 Tian Tong , Cong Ma , Ashley Prater-Bennette , Erin Tripp , Yuejie Chi

Quantum-inspired singular value decomposition (SVD) is a technique to perform SVD in logarithmic time with respect to the dimension of a matrix, given access to the matrix embedded in a segment-tree data structure. The speedup is possible…

Quantum Physics · Physics 2022-09-27 Iori Takeda , Souichi Takahira , Kosuke Mitarai , Keisuke Fujii

Tensor completion can estimate missing values of a high-order data from its partially observed entries. Recent works show that low rank tensor ring approximation is one of the most powerful tools to solve tensor completion problem. However,…

Numerical Analysis · Mathematics 2021-01-03 Abdul Ahad , Zhen Long , Ce Zhu , Yipeng Liu

This paper proposes a novel approach to tensor completion, which recovers missing entries of data represented by tensors. The approach is based on the tensor train (TT) rank, which is able to capture hidden information from tensors thanks…

Numerical Analysis · Computer Science 2017-04-26 Johann A. Bengua , Ho N. Phien , Hoang D. Tuan , Minh N. Do

Low rank tensor representation (LRTR) methods are very useful for hyperspectral anomaly detection (HAD). To overcome the limitations that they often overlook spectral anomaly and rely on large-scale matrix singular value decomposition, we…

Computer Vision and Pattern Recognition · Computer Science 2025-03-10 Quan Yu , Yu-Hong Dai , Minru Bai

Singular Value Decomposition (SVD) is the basic body of many statistical algorithms and few users question whether SVD is properly handling its job. SVD aims at evaluating the decomposition that best approximates a data matrix, given some…

Applications · Statistics 2007-09-06 William Rey

Due to the explosive growth of large-scale data sets, tensors have been a vital tool to analyze and process high-dimensional data. Different from the matrix case, tensor decomposition has been defined in various formats, which can be…

Optimization and Control · Mathematics 2023-12-27 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

The deep learning methods have achieved attractive performance in dynamic MR cine imaging. However, all of these methods are only driven by the sparse prior of MR images, while the important low-rank (LR) prior of dynamic MR cine images is…

Image and Video Processing · Electrical Eng. & Systems 2020-07-29 Ziwen Ke , Wenqi Huang , Jing Cheng , Zhuoxu Cui , Sen Jia , Haifeng Wang , Xin Liu , Hairong Zheng , Leslie Ying , Yanjie Zhu , Dong Liang

Recently, a quaternion tensor product named Qt-product was proposed, and then the singular value decomposition and the rank of a third-order quaternion tensor were given. From a more applicable perspective, we extend the Qt-product and…

Optimization and Control · Mathematics 2024-03-26 Zhenzhi Qin , Zhenyu Ming , Defeng Sun , Liping Zhang

The randomized singular value decomposition (SVD) has become a popular approach to computing cheap, yet accurate, low-rank approximations to matrices due to its efficiency and strong theoretical guarantees. Recent work by Boull\'e and…

Numerical Analysis · Mathematics 2024-12-10 David Persson , Nicolas Boullé , Daniel Kressner

With the advances in data acquisition technology, tensor objects are collected in a variety of applications including multimedia, medical and hyperspectral imaging. As the dimensionality of tensor objects is usually very high,…

Image and Video Processing · Electrical Eng. & Systems 2019-11-06 Seyyid Emre Sofuoglu , Selin Aviyente

Low-rank decomposition (LRD) is a state-of-the-art method for visual data reconstruction and modelling. However, it is a very challenging problem when the image data contains significant occlusion, noise, illumination variation, and…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Chen Chen , Baochang Zhang , Alessio Del Bue , Vittorio Murino

The soft SVD is a robust matrix decomposition algorithm and a key component of matrix completion methods. However, computing the soft SVD for large sparse matrices is often impractical using conventional numerical methods for the SVD due to…

Numerical Analysis · Mathematics 2021-04-06 Mahendra Panagoda , Tyrus Berry , Harbir Antil

This paper studies a general framework for high-order tensor SVD. We propose a new computationally efficient algorithm, tensor-train orthogonal iteration (TTOI), that aims to estimate the low tensor-train rank structure from the noisy…

Statistics Theory · Mathematics 2022-01-26 Yuchen Zhou , Anru R. Zhang , Lili Zheng , Yazhen Wang

Low-rank tensor recovery problems have been widely studied in many applications of signal processing and machine learning. Tucker decomposition is known as one of the most popular decompositions in the tensor framework. In recent years,…

Numerical Analysis · Mathematics 2020-07-17 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

We consider several classes of highly important semidefinite optimization problems that involve both a convex objective function (smooth or nonsmooth) and additional linear or nonlinear smooth and convex constraints, which are ubiquitous in…

Optimization and Control · Mathematics 2025-04-08 Dan Garber , Atara Kaplan