English
Related papers

Related papers: Preconditioned low-rank Riemannian optimization fo…

200 papers

In tensor completion tasks, the traditional low-rank tensor decomposition models suffer from the laborious model selection problem due to their high model sensitivity. In particular, for tensor ring (TR) decomposition, the number of model…

Machine Learning · Computer Science 2018-12-03 Longhao Yuan , Chao Li , Danilo Mandic , Jianting Cao , Qibin Zhao

The goal of tensor completion is to fill in missing entries of a partially known tensor (possibly including some noise) under a low-rank constraint. This may be formulated as a least-squares problem. The set of tensors of a given…

Numerical Analysis · Mathematics 2018-12-03 Gennadij Heidel , Volker Schulz

The numerical solution of algebraic tensor equations is a largely open and challenging task. Assuming that the operator is symmetric and positive definite, we propose two new gradient-descent type methods for tensor equations that…

Numerical Analysis · Mathematics 2026-02-26 Martina Iannacito , Lorenzo Piccinini , Valeria Simoncini

High-dimensional partial differential equations (PDEs) are ubiquitous in economics, science and engineering. However, their numerical treatment poses formidable challenges since traditional grid-based methods tend to be frustrated by the…

Machine Learning · Statistics 2021-07-20 Lorenz Richter , Leon Sallandt , Nikolas Nüsken

We introduce the tensor numerical method for solution of the $d$-dimensional optimal control problems with fractional Laplacian type operators in constraints discretized on large $n^{\otimes d}$ tensor-product Cartesian grids. The approach…

Numerical Analysis · Mathematics 2020-05-27 Gennadij Heidel , Venera Khoromskaia , Boris N. Khoromskij , Volker Schulz

This paper is concerned with the approximation of tensors using tree-based tensor formats, which are tensor networks whose graphs are dimension partition trees. We consider Hilbert tensor spaces of multivariate functions defined on a…

Numerical Analysis · Mathematics 2019-09-11 Anthony Nouy

We propose a new algorithm to solve optimization problems of the form $\min f(X)$ for a smooth function $f$ under the constraints that $X$ is positive semidefinite and the diagonal blocks of $X$ are small identity matrices. Such problems…

Optimization and Control · Mathematics 2016-01-07 Nicolas Boumal

The low-rank matrix recovery problem often arises in various fields, including signal processing, machine learning, and imaging science. The Riemannian gradient descent (RGD) algorithm has proven to be an efficient algorithm for solving…

Optimization and Control · Mathematics 2023-05-05 Fengmiao Bian , Jian-Feng Cai , Rui Zhang

Several tensor networks are built of isometric tensors, i.e. tensors satisfying $W^\dagger W = \mathrm{I}$. Prominent examples include matrix product states (MPS) in canonical form, the multiscale entanglement renormalization ansatz (MERA),…

Quantum Physics · Physics 2021-02-24 Markus Hauru , Maarten Van Damme , Jutho Haegeman

This work presents a low-rank tensor model for multi-dimensional Markov chains. A common approach to simplify the dynamical behavior of a Markov chain is to impose low-rankness on the transition probability matrix. Inspired by the success…

Systems and Control · Electrical Eng. & Systems 2024-11-05 Madeline Navarro , Sergio Rozada , Antonio G. Marques , Santiago Segarra

The numerical solution of kinetic equations is challenging due to the high dimensionality of the underlying phase space. In this paper, we develop a dynamical low-rank method based on the projector-splitting integrator in tensor-train (TT)…

Numerical Analysis · Mathematics 2026-03-31 Geshuo Wang , Jingwei Hu

In this paper, we propose an efficient method for solving multi-dimensional Riesz space fractional diffusion equations with variable coefficients. The Crank-Nicolson (CN) method is used for temporal discretization, while the fourth-order…

Numerical Analysis · Mathematics 2025-08-01 Yuan-Yuan Huang , Wei Qu , Sean Y. Hon , Siu-Long Lei

This article is concerned with the question of constructing effcient multigrid preconditioners for the linear systems arising when applying semismooth Newton methods to large-scale linear-quadratic optimization problems constrained by…

Numerical Analysis · Mathematics 2013-11-08 Andrei Draganescu

A novel fourth-order finite difference formula coupling the Crank-Nicolson explicit linearized method is proposed to solve Riesz space fractional nonlinear reaction-diffusion equations in two dimensions. Theoretically, under the Lipschitz…

Numerical Analysis · Mathematics 2024-05-07 Wei Qu , Yuan-Yuan Huang , Sean Hon , Siu-Long Lei

The radiative transfer equation (RTE) has been established as a fundamental tool for the description of energy transport, absorption and scattering in many relevant societal applications, and requires numerical approximations. However,…

Numerical Analysis · Mathematics 2025-05-28 Markus Bachmayr , Riccardo Bardin , Matthias Schlottbom

Designing quantum circuits for ground state preparation is a fundamental task in quantum information science. However, standard Variational Quantum Algorithms (VQAs) are often constrained by limited ansatz expressivity and difficult…

Quantum Physics · Physics 2026-02-25 Zhijian Lai , Hantao Nie , Jiayuan Wu , Dong An

Many applications in data science and scientific computing involve large-scale datasets that are expensive to store and compute with, but can be efficiently compressed and stored in an appropriate tensor format. In recent years, randomized…

Numerical Analysis · Mathematics 2019-05-20 Rachel Minster , Arvind K. Saibaba , Misha E. Kilmer

Randomized methods are becoming increasingly popular in numerical linear algebra. However, few attempts have been made to use them in developing preconditioners. Our interest lies in solving large-scale sparse symmetric positive definite…

Numerical Analysis · Mathematics 2021-11-16 Hussam Al Daas , Tyrone Rees , Jennifer Scott

Tensor train (TT) decomposition provides a space-efficient representation for higher-order tensors. Despite its advantage, we face two crucial limitations when we apply the TT decomposition to machine learning problems: the lack of…

Machine Learning · Statistics 2017-08-03 Masaaki Imaizumi , Takanori Maehara , Kohei Hayashi

Low-rank tensors appear to be prosperous in many applications. However, the sets of bounded-rank tensors are non-smooth and non-convex algebraic varieties, rendering the low-rank optimization problems to be challenging. To this end, we…

Optimization and Control · Mathematics 2024-11-22 Bin Gao , Renfeng Peng , Ya-xiang Yuan