English
Related papers

Related papers: Collocation methods for nonlinear differential equ…

200 papers

In this paper we explore acceleration techniques for large scale nonconvex optimization problems with special focuses on deep neural networks. The extrapolation scheme is a classical approach for accelerating stochastic gradient descent for…

Machine Learning · Statistics 2018-05-18 Guangzeng Xie , Yitan Wang , Shuchang Zhou , Zhihua Zhang

The dynamical low-rank (DLR) approximation is an efficient technique to approximate the solution to matrix differential equations. Recently, the DLR method was applied to radiation transport calculations to reduce memory requirements and…

Computational Physics · Physics 2022-11-23 Zhuogang Peng , Ryan G. McClarren

This paper presents a simplified implementation of the arc-length method for computing the equilibrium paths of nonlinear structural mechanics problems using the finite element method. In the proposed technique, the predictor is computed by…

Computational Engineering, Finance, and Science · Computer Science 2020-12-21 Chennakesava Kadapa

This paper studies a tensor-structured linear regression model with a scalar response variable and tensor-structured predictors, such that the regression parameters form a tensor of order $d$ (i.e., a $d$-fold multiway array) in…

Machine Learning · Computer Science 2020-11-26 Talal Ahmed , Haroon Raja , Waheed U. Bajwa

Tensor classification has become increasingly crucial in statistics and machine learning, with applications spanning neuroimaging, computer vision, and recommendation systems. However, the high dimensionality of tensors presents significant…

Methodology · Statistics 2024-09-24 Elynn Chen , Yuefeng Han , Jiayu Li

Projected gradient descent and its Riemannian variant belong to a typical class of methods for low-rank matrix estimation. This paper proposes a new Nesterov's Accelerated Riemannian Gradient algorithm by efficient orthographic retraction…

Optimization and Control · Mathematics 2023-06-05 Hongyi Li , Zhen Peng , Chengwei Pan , Di Zhao

In the present work, we study how to develop an efficient solver for the fast resolution of large and sparse linear systems that occur while discretizing elliptic partial differential equations using isogeometric analysis. Our new approach…

Numerical Analysis · Mathematics 2024-12-31 Abdellatif Mouhssine , Ahmed Ratnani , Hassane Sadok

Motivated by applications arising from sensor networks and machine learning, we consider the problem of minimizing a finite sum of nondifferentiable convex functions where each component function is associated with an agent and a…

Optimization and Control · Mathematics 2021-03-22 Harshal D. Kaushik , Farzad Yousefian

In this study we propose a-posteriori error estimation results to approximate the precision loss in quantities of interests computed using reduced order models. To generate the surrogate models we employ Proper Orthogonal Decomposition and…

Numerical Analysis · Mathematics 2024-12-20 R. Stefanescu , A. Sandu

This paper studies the model order reduction of second-order index-1 descriptor systems using a tangential interpolation projection method based on the Iterative Rational Krylov Algorithm (IRKA). Our primary focus is to reduce the system…

Optimization and Control · Mathematics 2020-11-16 Md. Motlubar Rahman , M. Monir Uddin , L. S. Andallah , Mahtab Uddin

Bayesian statistical inverse problems are often solved with Markov chain Monte Carlo (MCMC)-type schemes. When the problems are governed by large-scale discrete nonlinear partial differential equations (PDEs), they are computationally…

Numerical Analysis · Mathematics 2019-09-06 Howard C. Elman , Akwum Onwunta

The paper considers function-valued tensors, viewed as multidimensional arrays with entries in an abstract Hilbert space. Despite the absence of the algebraic structure of a field, the geometric inner-product structure suffices to introduce…

Numerical Analysis · Mathematics 2025-12-01 Stanislav Budzinskiy , Vladimir Kazeev , Maxim Olshanskii

We propose a multilevel tensor-train (TT) framework for solving nonlinear partial differential equations (PDEs) in a global space-time formulation. While space-time TT solvers have demonstrated significant potential for compressed…

Numerical Analysis · Mathematics 2026-02-10 N. R. Rapaka , R. Peddinti , E. Tiunov , N. J. Faraj , A. N. Alkhooori , L. Aolita , Y. Addad , M. K. Riahi

We address the challenge of correlated predictors in high-dimensional GLMs, where regression coefficients range from sparse to dense, by proposing a data-driven random projection method. This is particularly relevant for applications where…

Methodology · Statistics 2025-12-30 Roman Parzer , Peter Filzmoser , Laura Vana-Gür

Tensor time series, which is a time series consisting of tensorial observations, has become ubiquitous. It typically exhibits high dimensionality. One approach for dimension reduction is to use a factor model structure, in a form similar to…

Methodology · Statistics 2024-07-19 Yuefeng Han , Rong Chen , Dan Yang , Cun-Hui Zhang

We propose a new methodology for parametric domain decomposition using iterative principal component analysis. Starting with iterative principle component analysis, the high dimension manifold is reduced to the lower dimension manifold.…

Machine Learning · Computer Science 2025-05-14 Chetra Mang , Axel TahmasebiMoradi , Mouadh Yagoubi

This paper, broadly speaking, covers the use of randomness in two main areas: low-rank approximation and kernel methods. Low-rank approximation is very important in numerical linear algebra. Many applications depend on matrix decomposition…

Numerical Analysis · Mathematics 2020-08-12 Rishi Advani , Madison Crim , Sean O'Hagan

We propose two implicit numerical schemes for the low-rank time integration of stiff nonlinear partial differential equations. Our approach uses the preconditioned Riemannian trust-region method of Absil, Baker, and Gallivan, 2007. We…

Numerical Analysis · Mathematics 2023-05-22 Marco Sutti , Bart Vandereycken

Recently developed reduced-order modeling techniques aim to approximate nonlinear dynamical systems on low-dimensional manifolds learned from data. This is an effective approach for modeling dynamics in a post-transient regime where the…

Dynamical Systems · Mathematics 2023-09-27 Samuel E. Otto , Gregory R. Macchio , Clarence W. Rowley

An interpolation method for discretising continuous-time Linear Time Invariant (LTI) models is proposed in this paper. It consists first in using the Loewner interpolation framework on a specific set of frequency data and secondly to…

Systems and Control · Electrical Eng. & Systems 2019-07-26 Pierre Vuillemin , Charles Poussot-Vassal