English
Related papers

Related papers: Permutation of Tensor-Train Cores for Computing Mo…

200 papers

This paper lies in the intersection of several fields: number theory, lattice theory, multilinear algebra, and scientific computing. We adapt existing solution algorithms for tensor eigenvalue problems to the tensor-train framework. As an…

Numerical Analysis · Mathematics 2017-10-05 Harri Hakula , Pauliina Ilmonen , Vesa Kaarnioja

Efficient modelling of feature interactions underpins supervised learning for non-sequential tasks, characterized by a lack of inherent ordering of features (variables). The brute force approach of learning a parameter for each interaction…

Machine Learning · Computer Science 2021-03-31 Alexandros Haliassos , Kriton Konstantinidis , Danilo P. Mandic

This paper presents a method to build explicit tensor-train (TT) representations. We show that a wide class of tensors can be explicitly represented with sparse TT-cores, obtaining, in many cases, optimal TT-ranks. Numerical experiments…

Numerical Analysis · Mathematics 2022-06-16 Gleb Ryzhakov , Ivan Oseledets

We present a brief survey on the modern tensor numerical methods for multidimensional stationary and time-dependent partial differential equations (PDEs). The guiding principle of the tensor approach is the rank-structured separable…

Numerical Analysis · Mathematics 2014-08-19 Boris N. Khoromskij

The choice of how to retain information about past gradients dramatically affects the convergence properties of state-of-the-art stochastic optimization methods, such as Heavy-ball, Nesterov's momentum, RMSprop and Adam. Building on this…

Machine Learning · Computer Science 2020-03-13 Antonio Orvieto , Jonas Kohler , Aurelien Lucchi

First-order stochastic methods are the state-of-the-art in large-scale machine learning optimization owing to efficient per-iteration complexity. Second-order methods, while able to provide faster convergence, have been much less explored…

Machine Learning · Statistics 2017-12-01 Naman Agarwal , Brian Bullins , Elad Hazan

Recent research on temporal networks has highlighted the limitations of a static network perspective for our understanding of complex systems with dynamic topologies. In particular, recent works have shown that i) the specific order in…

Physics and Society · Physics 2017-11-20 Ingo Scholtes , Nicolas Wider , Antonios Garas

The concept of effective order is a popular methodology in the deterministic literature for the construction of efficient and accurate integrators for differential equations over long times. The idea is to enhance the accuracy of a…

Numerical Analysis · Mathematics 2016-08-18 Gilles Vilmart

We derive rank bounds on the quantized tensor train (QTT) compressed approximation of singularly perturbed reaction diffusion partial differential equations (PDEs) in one dimension. Specifically, we show that, independently of the scale of…

Numerical Analysis · Mathematics 2020-10-15 Carlo Marcati , Maxim Rakhuba , Johan E. M. Ulander

Tensor trains (TTs), also known as matrix product states (MPS), are compressed representations of high-dimensional data that can be efficiently manipulated to perform calculations on the data. In many applications, such as TT-based solvers…

Numerical Analysis · Mathematics 2026-04-27 Marc K. Ritter

In this work, we introduce an interior-point method that employs tensor decompositions to efficiently represent and manipulate the variables and constraints of semidefinite programs, targeting problems where the solutions may not be…

Optimization and Control · Mathematics 2025-09-16 Frederik Kelbel , Sergey Dolgov , Dante Kalise , Alessandra Russo

Recent advances in stochastic differential equations (SDEs) have enabled robust modeling of real-world dynamical processes across diverse domains, such as finance, health, and systems biology. However, parameter estimation for SDEs…

Machine Learning · Computer Science 2026-01-29 Long Van Tran , Truyen Tran , Phuoc Nguyen

Tensor networks provide compact and scalable representations of high-dimensional data, enabling efficient computation in fields such as quantum physics, numerical partial differential equations (PDEs), and machine learning. This paper…

Numerical Analysis · Mathematics 2025-08-28 Julia Wei , Alec Dektor , Chungen Shen , Zaiwen Wen , Chao Yang

In this paper, we aim at the problem of tensor data completion. Tensor-train decomposition is adopted because of its powerful representation ability and linear scalability to tensor order. We propose an algorithm named Sparse Tensor-train…

Numerical Analysis · Computer Science 2018-03-23 Longhao Yuan , Qibin Zhao , Jianting Cao

Data encoding remains a fundamental bottleneck in quantum machine learning, where amplitude encoding of high-dimensional classical vectors into quantum states incurs exponential cost. In this work, we propose a pre-trained tensor-train (TT)…

Quantum Physics · Physics 2026-02-11 Jun Qi , Chao-Han Huck Yang , Pin-Yu Chen , Min-Hsiu Hsieh

Discrete tensor train decomposition is widely employed to mitigate the curse of dimensionality in solving high-dimensional PDEs through traditional methods. However, the direct application of the tensor train method typically requires…

Numerical Analysis · Mathematics 2025-10-16 Yani Feng , Michael K. Ng , Kejun Tang , Zhiwen Zhang

We investigate the application of tensor-train (TT) algorithms to multigroup thermal radiation transport (i.e., photon radiation transport). The TT framework enables simulations at discretizations that might otherwise be computationally…

Instrumentation and Methods for Astrophysics · Physics 2026-04-10 Aditya S. Deshpande , Patrick D. Mullen , Alex A. Gorodetsky , Joshua C. Dolence , Chad D. Meyer , Jonah M. Miller , Luke F. Roberts

Time series analysis has gained significant attention due to its critical applications in diverse fields such as healthcare, finance, and sensor networks. The complexity and non-stationarity of time series make it challenging to capture the…

Machine Learning · Computer Science 2024-10-31 Guancen Lin , Cong Shen , Aijing Lin

Stochastic Hybrid Systems (SHS) constitute an important class of mathematical models that integrate discrete stochastic events with continuous dynamics. The time evolution of statistical moments is generally not closed for SHS, in the sense…

Dynamical Systems · Mathematics 2016-03-17 Mohammad Soltani , Abhyudai Singh

Tensors are a natural way to express correlations among many physical variables, but storing tensors in a computer naively requires memory which scales exponentially in the rank of the tensor. This is not optimal, as the required memory is…

Computational Physics · Physics 2018-12-03 Adam S. Jermyn