English
Related papers

Related papers: Interpolatory Dynamical Low-Rank Approximation: Th…

200 papers

To approximate solutions of a linear differential equation, we project, via trigonometric interpolation, its solution space onto a finite-dimensional space of trigonometric polynomials and construct a matrix representation of the…

Numerical Analysis · Mathematics 2011-08-30 Oksana Bihun , Austin Bren , Michael Dyrud , Kristin Heysse

Linear discriminant analysis (LDA) is a classical method for dimensionality reduction, where discriminant vectors are sought to project data to a lower dimensional space for optimal separability of classes. Several recent papers have…

Computation · Statistics 2022-03-04 Summer Atkins , Gudmundur Einarsson , Brendan Ames , Line Clemmensen

Multi-view data have been routinely collected in various fields of science and engineering. A general problem is to study the predictive association between multivariate responses and multi-view predictor sets, all of which can be of high…

Methodology · Statistics 2018-07-30 Gen Li , Xiaokang Liu , Kun Chen

The discrete-dipole approximation (DDA) is a flexible technique for computing scattering and absorption by targets of arbitrary geometry. In this paper we perform systematic study of various non-stationary iterative (conjugate gradient)…

Atmospheric and Oceanic Physics · Physics 2007-05-23 Piotr J. Flatau

Numerical simulations of kinetic problems can become prohibitively expensive due to their large memory requirements and computational costs. A method that has proven to successfully reduce these costs is the dynamical low-rank approximation…

Numerical Analysis · Mathematics 2025-06-17 Lukas Einkemmer , Jonas Kusch , Steffen Schotthöfer

In the present paper we consider a 2-D shallow-water equations (SWE) model on a $\beta$-plane solved using an alternating direction fully implicit (ADI) finite-difference scheme on a rectangular domain. The scheme was shown to be…

Computational Physics · Physics 2015-06-12 Razvan Stefanescu , Ionel Michael Navon

Projection-based model reduction has become a popular approach to reduce the cost associated with integrating large-scale dynamical systems so they can be used in many-query settings such as optimization and uncertainty quantification. For…

Numerical Analysis · Mathematics 2020-08-26 Han Gao , Jian-Xun Wang , Matthew J. Zahr

Linear discriminant analysis (LDA) is a widely used algorithm in machine learning to extract a low-dimensional representation of high-dimensional data, it features to find the orthogonal discriminant projection subspace by using the Fisher…

Machine Learning · Computer Science 2021-07-21 Wanguang Yin , Zhengming Ma , Quanying Liu

Recent technical advances in collecting spatial data have been increasing the demand for methods to analyze large spatial datasets. The statistical analysis for these types of datasets can provide useful knowledge in various fields.…

Methodology · Statistics 2021-06-16 Toshihiro Hirano

Large language model (LLM) training is often bottlenecked by memory constraints and stochastic gradient noise in extremely high-dimensional parameter spaces. Motivated by empirical evidence that many LLM gradient matrices are effectively…

Machine Learning · Computer Science 2026-03-24 Zehao Li , Tao Ren , Zishi Zhang , Xi Chen , Yijie Peng

We consider the problem of computing tractable approximations of time-dependent d x d large positive semi-definite (PSD) matrices defined as solutions of a matrix differential equation. We propose to use "low-rank plus diagonal" PSD…

Numerical Analysis · Mathematics 2024-07-08 Silvère Bonnabel , Marc Lambert , Francis Bach

The iterative rational Krylov algorithm (\textsf{IRKA}) is a popular approach for producing locally optimal reduced-order $\mathcal{H}_2$-approximations to linear time-invariant (LTI) dynamical systems. Overall, \textsf{IRKA} has seen…

Numerical Analysis · Mathematics 2019-11-15 C. Beattie , Z. Drmac , S. Gugercin

Random Projection (RP) technique has been widely applied in many scenarios because it can reduce high-dimensional features into low-dimensional space within short time and meet the need of real-time analysis of massive data. There is an…

Machine Learning · Computer Science 2017-06-20 Haozhe Xie , Jie Li , Qiaosheng Zhang , Yadong Wang

The numerical solution of implicit and stiff differential equations by implicit numerical integrators has been largely investigated and there exist many excellent efficient codes available in the scientific community, as Radau5 (based on a…

Numerical Analysis · Mathematics 2025-06-27 Nicola Guglielmi , Ernst Hairer

We present a novel tensor interpolation algorithm for the time integration of nonlinear tensor differential equations (TDEs) on the tensor train and Tucker tensor low-rank manifolds, which are the building blocks of many tensor network…

Numerical Analysis · Mathematics 2024-06-12 Behzad Ghahremani , Hessam Babaee

Digital image inpainting is an interpolation problem, inferring the content in the missing (unknown) region to agree with the known region data such that the interpolated result fulfills some prior knowledge. Low-rank and nonlocal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-23 Shenghai Liao , Xuya Liu , Ruyi Han , Shujun Fu , Yuanfeng Zhou , Yuliang Li

Computing reduced-order models using non-intrusive methods is particularly attractive for systems that are simulated using black-box solvers. However, obtaining accurate data-driven models can be challenging, especially if the underlying…

Mathematical Physics · Physics 2024-01-03 Alberto Padovan , Blaine Vollmer , Daniel J. Bodony

Constrained tensor and matrix factorization models allow to extract interpretable patterns from multiway data. Therefore identifiability properties and efficient algorithms for constrained low-rank approximations are nowadays important…

Machine Learning · Computer Science 2022-01-24 Jeremy E. Cohen

Low-rank structure have been profoundly studied in data mining and machine learning. In this paper, we show a dense matrix $X$'s low-rank approximation can be rapidly built from its left and right random projections $Y_1=XA_1$ and…

Machine Learning · Statistics 2011-12-23 Tianyi Zhou , Dacheng Tao

Dynamic Low Rank (DLR) methods are a promising way to reduce the computational cost and memory footprint of the high-dimensional thermal radiative transfer (TRT) equations. The TRT equations are a system of nonlinear PDEs that model the…

Numerical Analysis · Mathematics 2026-01-27 Terry Haut , John Loffeld , Lukas Einkemmer , Pierson Guthrey , Stefan Brunner , William Schill