English
Related papers

Related papers: Sketch-and-project methods for tensor linear syste…

200 papers

This paper describes a new algorithm for computing a low-Tucker-rank approximation of a tensor. The method applies a randomized linear map to the tensor to obtain a sketch that captures the important directions within each mode, as well as…

Numerical Analysis · Mathematics 2021-05-04 Yiming Sun , Yang Guo , Charlene Luo , Joel Tropp , Madeleine Udell

Randomized sketches of a tensor product of $p$ vectors follow a tradeoff between statistical efficiency and computational acceleration. Commonly used approaches avoid computing the high-dimensional tensor product explicitly, resulting in a…

Machine Learning · Statistics 2023-05-02 Jonas Wacker , Ruben Ohana , Maurizio Filippone

A substantial progress in development of new and efficient tensor factorization techniques has led to an extensive research of their applicability in recommender systems field. Tensor-based recommender models push the boundaries of…

Machine Learning · Computer Science 2018-02-20 Evgeny Frolov , Ivan Oseledets

We proposed the tensor-input tree (TT) method for scalar-on-tensor and tensor-on-tensor regression problems. We first address scalar-on-tensor problem by proposing scalar-output regression tree models whose input variable are tensors (i.e.,…

Machine Learning · Computer Science 2025-07-10 Hengrui Luo , Akira Horiguchi , Li Ma

A adapted tensor-structured GMRES method for the TT format is proposed and investigated. The Tensor Train (TT) approximation is a robust approach to high-dimensional problems. One class of problems is solution of a linear system. In this…

Numerical Analysis · Mathematics 2012-06-26 Sergey V. Dolgov

In this paper, we mainly develop the well-known vector and matrix polynomial extrapolation methods in tensor framework. To this end, some new products between tensors are defined and the concept of positive definitiveness is extended for…

Numerical Analysis · Mathematics 2020-04-14 F. P. A. Beik , A. El Ichi , K. Jbilou , R. Sadaka

We theoretically and experimentally investigate tensor-based regression and classification. Our focus is regularization with various tensor norms, including the overlapped trace norm, the latent trace norm, and the scaled latent trace norm.…

Machine Learning · Computer Science 2015-09-08 Kishan Wimalawarne , Ryota Tomioka , Masashi Sugiyama

We are interested in finding a solution to the tensor complementarity problem with a strong M-tensor, which we call the M-tensor complementarity problem. We propose a lower dimensional linear equation approach to solve that problem. At each…

Optimization and Control · Mathematics 2020-07-28 Dong-Hui Li , Cui-Dan Chen , Hong-Bo Guan

In this paper, we propose a general framework for sparse and low-rank tensor estimation from cubic sketchings. A two-stage non-convex implementation is developed based on sparse tensor decomposition and thresholded gradient descent, which…

Statistics Theory · Mathematics 2020-03-17 Botao Hao , Anru Zhang , Guang Cheng

A version of the projection method for solving the scattering problem for acoustic and electromagnetic waves is proposed and shown to be more efficient numerically than the earlier ones because the corresponding matrix is not…

Mathematical Physics · Physics 2007-05-23 A. G. Ramm

Tensor factorization arises in many machine learning applications, such knowledge base modeling and parameter estimation in latent variable models. However, numerical methods for tensor factorization have not reached the level of maturity…

Machine Learning · Computer Science 2015-05-20 Volodymyr Kuleshov , Arun Tejasvi Chaganty , Percy Liang

Randomized iterative algorithms, such as the randomized Kaczmarz method and the randomized Gauss-Seidel method, have gained considerable popularity due to their efficacy in solving matrix-vector and matrix-matrix regression problems. Our…

This paper presents iterative methods for solving tensor equations involving the T-product. The proposed approaches apply tensor computations without matrix construction. For each initial tensor, these algorithms solve related problems in a…

Numerical Analysis · Mathematics 2025-04-28 Malihe Nobakht Kooshkghazi , Salman Ahmadi-Asl , Hamidreza Afshin

We introduce a family of numerical algorithms for the solution of linear system in higher dimensions with the matrix and right hand side given and the solution sought in the tensor train format. The proposed methods are rank--adaptive and…

Numerical Analysis · Mathematics 2014-10-07 Sergey V. Dolgov , Dmitry V. Savostyanov

This paper presents a method to build explicit tensor-train (TT) representations. We show that a wide class of tensors can be explicitly represented with sparse TT-cores, obtaining, in many cases, optimal TT-ranks. Numerical experiments…

Numerical Analysis · Mathematics 2022-06-16 Gleb Ryzhakov , Ivan Oseledets

In sketched clustering, a dataset of $T$ samples is first sketched down to a vector of modest size, from which the centroids are subsequently extracted. Advantages include i) reduced storage complexity and ii) centroid extraction complexity…

Information Theory · Computer Science 2019-05-21 Evan Byrne , Antoine Chatalic , Remi Gribonval , Philip Schniter

While Spectral Methods have long been used for Principal Component Analysis, this survey focusses on work over the last 15 years with three salient features: (i) Spectral methods are useful not only for numerical problems, but also discrete…

Data Structures and Algorithms · Computer Science 2010-04-09 Ravindran Kannan

Random projections offer an appealing and flexible approach to a wide range of large-scale statistical problems. They are particularly useful in high-dimensional settings, where we have many covariates recorded for each observation. In…

Methodology · Statistics 2019-11-26 Timothy I. Cannings

Tensors are a fundamental data structure for many scientific contexts, such as time series analysis, materials science, and physics, among many others. Improving our ability to produce and handle tensors is essential to efficiently address…

Machine Learning · Statistics 2026-02-12 Wilson G. Gregory , Josué Tonelli-Cueto , Nicholas F. Marshall , Andrew S. Lee , Soledad Villar

Tensor Networks (TN) offer a powerful framework to efficiently represent very high-dimensional objects. TN have recently shown their potential for machine learning applications and offer a unifying view of common tensor decomposition models…

Machine Learning · Computer Science 2021-06-24 Meraj Hashemizadeh , Michelle Liu , Jacob Miller , Guillaume Rabusseau