English
Related papers

Related papers: Trace maximization algorithm for the approximate t…

200 papers

In this paper, we study the equality constrained nonlinear least squares problem, where the Jacobian matrices of the objective function and constraints are unavailable or expensive to compute. We approximate the Jacobian matrices via…

Optimization and Control · Mathematics 2025-07-09 Xi Chen , Jinyan Fan

The paper is concerned with methods for computing the best low multilinear rank approximation of large and sparse tensors. Krylov-type methods have been used for this problem; here block versions are introduced. For the computation of…

Numerical Analysis · Mathematics 2020-12-17 L. Eldén , M. Dehghan

In this paper, we solve a maximization problem where the objective function is quadratic and convex or concave and the constraints set is the reachable value set of a convergent discrete-time affine system. Moreover, we assume that the…

Optimization and Control · Mathematics 2020-06-18 Assalé Adjé

Tensor ring (TR) decomposition is an efficient approach to discover the hidden low-rank patterns for higher-order tensors, and streaming tensors are becoming highly prevalent in real-world applications. In this paper, we investigate how to…

Numerical Analysis · Mathematics 2023-07-04 Yajie Yu , Hanyu Li

We study symmetric tensor decompositions, i.e. decompositions of the input symmetric tensor T of order 3 as sum of r 3rd-order tensor powers of u_i where u_i are vectors in \C^n. In order to obtain efficient decomposition algorithms, it is…

Data Structures and Algorithms · Computer Science 2025-03-12 Pascal Koiran , Subhayan Saha

This work aims to numerically construct exactly commuting matrices close to given almost commuting ones, which is equivalent to the joint approximate diagonalization problem. We first prove that almost commuting matrices generically have…

Numerical Analysis · Mathematics 2023-10-13 Bowen Li , Jianfeng Lu , Ziang Yu

We give reconstruction algorithms for subclasses of depth-3 arithmetic circuits. In particular, we obtain the first efficient algorithm for finding tensor rank, and an optimal tensor decomposition as a sum of rank-one tensors, when given…

Computational Complexity · Computer Science 2022-09-12 Shir Peleg , Amir Shpilka , Ben Lee Volk

We give a detailed description of a polynomial optimization method allowing to solve a problem in continuum mechanics: the determination of the elasticity or the piezoelectricity tensor of a specific isotropy stratum the closest to a given…

Algebraic Geometry · Mathematics 2023-11-22 Perla Azzi , Rodrigue Desmorat , Boris Kolev , Fabien Priziac

Tucker decomposition is a popular technique for many data analysis and machine learning applications. Finding a Tucker decomposition is a nonconvex optimization problem. As the scale of the problems increases, local search algorithms such…

Machine Learning · Computer Science 2020-07-01 Abraham Frandsen , Rong Ge

We present an improved form of the algorithm for constructing Jacobi rotations. This is simultaneously a more accurate code for finding the eigenvalues and eigenvectors of a real symmetric 2x2 matrix.

Numerical Analysis · Computer Science 2018-06-22 Carlos F. Borges

Tensor Networks (TN) offer a powerful framework to efficiently represent very high-dimensional objects. TN have recently shown their potential for machine learning applications and offer a unifying view of common tensor decomposition models…

Machine Learning · Computer Science 2021-06-24 Meraj Hashemizadeh , Michelle Liu , Jacob Miller , Guillaume Rabusseau

We introduce a tensor renormalization group scheme for coarse-graining a two-dimensional tensor network that can be successfully applied to both classical and quantum systems on and off criticality. The key innovation in our scheme is to…

Strongly Correlated Electrons · Physics 2017-03-17 Shuo Yang , Zheng-Cheng Gu , Xiao-Gang Wen

We propose a set of convex low rank inducing norms for a coupled matrices and tensors (hereafter coupled tensors), which shares information between matrices and tensors through common modes. More specifically, we propose a mixture of the…

Machine Learning · Statistics 2018-06-15 Kishan Wimalawarne , Makoto Yamada , Hiroshi Mamitsuka

Tensor completion recovers a multi-dimensional array from a limited number of measurements. Using the recently proposed tensor ring (TR) decomposition, in this paper we show that a d-order tensor of dimensional size n and TR rank r can be…

Machine Learning · Computer Science 2020-03-17 Huyan Huang , Yipeng Liu , Ce Zhu

We propose an algorithm for solution of high-dimensional evolutionary equations (ODEs and discretized time-dependent PDEs) in the Tensor Train (TT) decomposition, assuming that the solution and the right-hand side of the ODE admit such a…

Numerical Analysis · Mathematics 2017-10-05 Sergey V. Dolgov

Joint space trajectory optimization under end-effector task constraints leads to a challenging non-convex problem. Thus, a real-time adaptation of prior computed trajectories to perturbation in task constraints often becomes intractable.…

Three algorithms of Gram-Schmidt type are given that produce an orthogonal decomposition of finite $d$-dimensional symmetric, alternating, or Hermitian forms over division rings. The first uses $d^3/3+O(d^2)$ ring operations with very…

Numerical Analysis · Mathematics 2020-11-23 James B. Wilson

Tensors, especially higher-order tensors, are typically represented in low-rank formats to preserve the main information of the high-dimensional data while saving memory space. In practice, only a small fraction elements in high-dimensional…

Numerical Analysis · Mathematics 2025-11-12 Chuanfu Xiao , Jiaxin Zeng

Low rank tensor learning, such as tensor completion and multilinear multitask learning, has received much attention in recent years. In this paper, we propose higher order matching pursuit for low rank tensor learning problems with a convex…

Machine Learning · Statistics 2015-03-10 Yuning Yang , Siamak Mehrkanoon , Johan A. K. Suykens

This paper considers the decentralized consensus optimization problem defined over a network where each node holds a second-order differentiable local objective function. Our goal is to minimize the summation of local objective functions…

Optimization and Control · Mathematics 2020-08-25 Jiaojiao Zhang , Qing Ling , Anthony Man-Cho So