English
Related papers

Related papers: The low-rank tensor-train finite difference method…

200 papers

While post-training model compression can greatly reduce the inference cost of a deep neural network, uncompressed training still consumes a huge amount of hardware resources, run-time and energy. It is highly desirable to directly train a…

Machine Learning · Computer Science 2021-10-05 Cole Hawkins , Xing Liu , Zheng Zhang

We consider a model initial- and Dirichlet boundary- value problem for a fourth-order linear stochastic parabolic equation, in one space dimension, forced by an additive space-time white noise. First, we approximate its solution by the…

Numerical Analysis · Mathematics 2016-07-19 Georgios E. Zouraris

The Tensor-Train (TT) format is a highly compact low-rank representation for high-dimensional tensors. TT is particularly useful when representing approximations to the solutions of certain types of parametrized partial differential…

We introduce the tensor numerical method for solution of the $d$-dimensional optimal control problems with fractional Laplacian type operators in constraints discretized on large $n^{\otimes d}$ tensor-product Cartesian grids. The approach…

Numerical Analysis · Mathematics 2020-05-27 Gennadij Heidel , Venera Khoromskaia , Boris N. Khoromskij , Volker Schulz

Many problems in computational science and engineering are simultaneously characterized by the following challenging issues: uncertainty, nonlinearity, nonstationarity and high dimensionality. Existing numerical techniques for such models…

Numerical Analysis · Mathematics 2017-03-20 Peter Benner , Sergey Dolgov , Akwum Onwunta , Martin Stoll

The goal of tensor completion is to fill in missing entries of a partially known tensor under a low-rank constraint. In this paper, we mainly study low rank third-order tensor completion problems by using Riemannian optimization methods on…

Optimization and Control · Mathematics 2020-11-24 Guang-Jing Song , Xue-Zhong Wang , Michael K. Ng

In this paper, we propose a low rank approximation method for efficiently solving stochastic partial differential equations. Specifically, our method utilizes a novel low rank approximation of the stiffness matrices, which can significantly…

Numerical Analysis · Mathematics 2023-10-20 Yujun Zhu , Ju Ming , Jie Zhu , Zhongming Wang

Computing low-rank approximations of kernel matrices is an important problem with many applications in scientific computing and data science. We propose methods to efficiently approximate and store low-rank approximations to kernel matrices…

Numerical Analysis · Mathematics 2025-03-14 Abraham Khan , Arvind K. Saibaba

We propose a numerical method to obtain an adequate value for the upper bound on the rank for the tensor completion problem on the variety of third-order tensors of bounded tensor-train rank. The method is inspired by the parametrization of…

Optimization and Control · Mathematics 2024-09-10 Charlotte Vermeylen , Guillaume Olikier , P. -A. Absil , Marc Van Barel

This paper lies in the intersection of several fields: number theory, lattice theory, multilinear algebra, and scientific computing. We adapt existing solution algorithms for tensor eigenvalue problems to the tensor-train framework. As an…

Numerical Analysis · Mathematics 2017-10-05 Harri Hakula , Pauliina Ilmonen , Vesa Kaarnioja

The low-tubal-rank tensor model has been recently proposed for real-world multidimensional data. In this paper, we study the low-tubal-rank tensor completion problem, i.e., to recover a third-order tensor by observing a subset of its…

Machine Learning · Computer Science 2016-10-12 Xiao-Yang Liu , Shuchin Aeron , Vaneet Aggarwal , Xiaodong Wang

The linear transform-based tensor nuclear norm (TNN) methods have recently obtained promising results for tensor completion. The main idea of this type of methods is exploiting the low-rank structure of frontal slices of the targeted tensor…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Ben-Zheng Li , Xi-Le Zhao , Teng-Yu Ji , Xiong-Jun Zhang , Ting-Zhu Huang

Tensor networks are a class of algorithms aimed at reducing the computational complexity of high-dimensional problems. They are used in an increasing number of applications, from quantum simulations to machine learning. Exploiting data…

Numerical Analysis · Mathematics 2024-10-25 Melven Röhrig-Zöllner , Manuel Joey Becklas , Jonas Thies , Achim Basermann

The goals of this work are two-fold: firstly, to propose a new theoretical framework for representing random fields on a large class of multidimensional geometrical domain in the tensor train format; secondly, to develop a new algorithm…

Numerical Analysis · Mathematics 2020-05-26 Ling-Ze Bu , Wei Zhao , Wei Wang

Time-dependent kinetic models are ubiquitous in computational science and engineering. The underlying integro-differential equations in these models are high-dimensional, comprised of a six--dimensional phase space, making simulations of…

Numerical Analysis · Mathematics 2025-06-23 Lukas Einkemmer , Katharina Kormann , Jonas Kusch , Ryan G. McClarren , Jing-Mei Qiu

Using the matrix product state (MPS) representation of the recently proposed tensor ring decompositions, in this paper we propose a tensor completion algorithm, which is an alternating minimization algorithm that alternates over the factors…

Machine Learning · Computer Science 2017-07-27 Wenqi Wang , Vaneet Aggarwal , Shuchin Aeron

Low-rank approximation is a technique to approximate a tensor or a matrix with a reduced rank to reduce the memory required and computational cost for simulation. Its broad applications include dimension reduction, signal processing,…

Computational Physics · Physics 2019-06-25 Zhuogang Peng , Ryan G. McClarren , Martin Frank

Selecting the latent dimensions (ranks) in tensor factorization is a central challenge that often relies on heuristic methods. This paper introduces a rigorous approach to determine rank identifiability in probabilistic tensor models, based…

Machine Learning · Computer Science 2026-04-03 Eliezer da Silva , Arto Klami , Diego Mesquita , Iñigo Urteaga

Parameter-dependent models arise in many contexts such as uncertainty quantification, sensitivity analysis, inverse problems or optimization. Parametric or uncertainty analyses usually require the evaluation of an output of a model for many…

Numerical Analysis · Mathematics 2018-10-22 Anthony Nouy

This paper proposes a novel approach to tensor completion, which recovers missing entries of data represented by tensors. The approach is based on the tensor train (TT) rank, which is able to capture hidden information from tensors thanks…

Numerical Analysis · Computer Science 2017-04-26 Johann A. Bengua , Ho N. Phien , Hoang D. Tuan , Minh N. Do