English
Related papers

Related papers: An Efficient Algorithm for Tensor Learning

200 papers

In this paper we propose a tensor-based nonlinear model for high-order data classification. The advantages of the proposed scheme are that (i) it significantly reduces the number of weight parameters, and hence of required training samples,…

The theory and computation of tensors with different tensor products play increasingly important roles in scientific computing and machine learning. Different products aim to preserve different algebraic properties from the matrix algebra,…

The advancement of sensing technology has driven the widespread application of high-dimensional data. However, issues such as missing entries during acquisition and transmission negatively impact the accuracy of subsequent tasks. Tensor…

Image and Video Processing · Electrical Eng. & Systems 2025-04-09 Jie Yang , Chang Su , Yuhan Zhang , Jianjun Zhu , Jianli Wang

This work studies the problem of maximizing a higher degree real homogeneous multivariate polynomial over the unit sphere. This problem is equivalent to finding the leading eigenvalue of the associated symmetric tensor of higher order,…

Optimization and Control · Mathematics 2019-10-02 Yuning Yang , Guoyin Li

In this paper, we study multi-dimensional image recovery. Recently, transform-based tensor nuclear norm minimization methods are considered to capture low-rank tensor structures to recover third-order tensors in multi-dimensional image…

Image and Video Processing · Electrical Eng. & Systems 2022-06-15 Yi-Si Luo , Xi-Le Zhao , Tai-Xiang Jiang , Yi Chang , Michael K. Ng , Chao Li

A tensor network is a diagram that specifies a way to "multiply" a collection of tensors together to produce another tensor (or matrix). Many existing algorithms for tensor problems (such as tensor decomposition and tensor PCA), although…

Data Structures and Algorithms · Computer Science 2018-11-05 Ankur Moitra , Alexander S. Wein

In pattern classification, polynomial classifiers are well-studied methods as they are capable of generating complex decision surfaces. Unfortunately, the use of multivariate polynomials is limited to kernels as in support vector machines,…

Machine Learning · Computer Science 2017-11-07 Zhongming Chen , Kim Batselier , Johan A. K. Suykens , Ngai Wong

The development of efficient machine learning models for molecular systems representation is becoming crucial in scientific research. We introduce TensorNet, an innovative O(3)-equivariant message-passing neural network architecture that…

Machine Learning · Computer Science 2023-10-31 Guillem Simeon , Gianni de Fabritiis

While multilinear algebra appears natural for studying the multiway interactions modeled by hypergraphs, tensor methods for general hypergraphs have been stymied by theoretical and practical barriers. A recently proposed adjacency tensor is…

Numerical Analysis · Mathematics 2024-04-05 Sinan G. Aksoy , Ilya Amburg , Stephen J. Young

Low rank tensor learning, such as tensor completion and multilinear multitask learning, has received much attention in recent years. In this paper, we propose higher order matching pursuit for low rank tensor learning problems with a convex…

Machine Learning · Statistics 2015-03-10 Yuning Yang , Siamak Mehrkanoon , Johan A. K. Suykens

Low-rank tensor completion problem aims to recover a tensor from limited observations, which has many real-world applications. Due to the easy optimization, the convex overlapping nuclear norm has been popularly used for tensor completion.…

Machine Learning · Computer Science 2019-01-24 Quanming Yao , James T Kwok , Bo Han

The real-world effectiveness of deep neural networks often depends on their latency, thereby necessitating optimization techniques that can reduce a model's inference time while preserving its performance. One popular approach is to…

Machine Learning · Computer Science 2024-10-10 Jakob Hartmann , Guoliang He , Eiko Yoneki

The rotation of multi-dimensional arrays, or tensors, is a fundamental operation in computer science with applications ranging from data processing to scientific computing. While various methods exist, achieving this rotation in-place…

Data Structures and Algorithms · Computer Science 2025-12-02 Dexin Chen

The order in which the trajectory is executed is a powerful source of information for recognizers. However, there is still no general approach for recovering the trajectory of complex and long handwriting from static images. Complex…

Computer Vision and Pattern Recognition · Computer Science 2024-06-06 Moises Diaz , Gioele Crispo , Antonio Parziale , Angelo Marcelli , Miguel A. Ferrer

Variational tensor network optimization has become a powerful tool for studying classical statistical models in two dimensions. However, its application to three-dimensional systems remains limited, primarily due to the high computational…

Statistical Mechanics · Physics 2025-10-14 Xia-Ze Xu , Tong-Yu Lin , Guang-Ming Zhang

In this paper, we present and analyze a new set of low-rank recovery algorithms for linear inverse problems within the class of hard thresholding methods. We provide strategies on how to set up these algorithms via basic ingredients for…

Numerical Analysis · Computer Science 2013-01-15 Anastasios Kyrillidis , Volkan Cevher

We propose and study a class of novel algorithms that aim at solving bilinear and quadratic inverse problems. Using a convex relaxation based on tensorial lifting, and applying first-order proximal algorithms, these problems could be solved…

Optimization and Control · Mathematics 2021-03-19 Robert Beinert , Kristian Bredies

Back-propagation with gradient method is the most popular learning algorithm for feed-forward neural networks. However, it is critical to determine a proper fixed learning rate for the algorithm. In this paper, an optimized recursive…

Neural and Evolutionary Computing · Computer Science 2011-08-10 Daohang Sha , Vladimir B. Bajic

We study tensor completion in the agnostic setting. In the classical tensor completion problem, we receive $n$ entries of an unknown rank-$r$ tensor and wish to exactly complete the remaining entries. In agnostic tensor completion, we make…

Machine Learning · Computer Science 2019-06-03 Dylan J. Foster , Andrej Risteski

Robust tensor recovery plays an instrumental role in robustifying tensor decompositions for multilinear data analysis against outliers, gross corruptions and missing values and has a diverse array of applications. In this paper, we study…

Machine Learning · Statistics 2014-08-26 Donald Goldfarb , Zhiwei Qin