English
Related papers

Related papers: Jacobian-free implicit MDRK methods for stiff syst…

200 papers

We study gradient-based optimization methods obtained by directly discretizing a second-order ordinary differential equation (ODE) related to the continuous limit of Nesterov's accelerated gradient method. When the function is smooth…

Optimization and Control · Mathematics 2018-11-29 Jingzhao Zhang , Aryan Mokhtari , Suvrit Sra , Ali Jadbabaie

Dynamical low-rank approximation in the Tucker tensor format of given large time-dependent tensors and of tensor differential equations is the subject of this paper. In particular, a discrete time integration method for rank-constrained…

Numerical Analysis · Mathematics 2017-09-11 Christian Lubich , Bart Vandereycken , Hanna Walach

An algorithm for a family of self-starting high-order implicit time integration schemes with controllable numerical dissipation is proposed for both linear and nonlinear transient problems. This work builds on the previous works of the…

Numerical Analysis · Mathematics 2024-09-23 Daniel O'Shea , Xiaoran Zhang , Shayan Mohammadian , Chongmin Song

In this paper we develop a higher-order method for solving composite (non)convex minimization problems with smooth (non)convex functional constraints. At each iteration our method approximates the smooth part of the objective function and…

Optimization and Control · Mathematics 2025-03-04 Yassine Nabou , Ion Necoara

Stiff ordinary differential equations (ODEs) are common in many science and engineering fields, but standard neural ODE approaches struggle to accurately learn these stiff systems, posing a significant barrier to widespread adoption of…

Numerical Analysis · Mathematics 2024-12-03 Colby Fronk , Linda Petzold

In this paper, we introduce a fourth-order accurate finite element method for incompressible variable density flow. The method is implicit in time and constructed with the Taylor series technique, and uses standard high-order Lagrange basis…

Numerical Analysis · Mathematics 2022-09-21 Lukas Lundgren , Murtazo Nazarov

Currently, nearly all positivity preserving discontinuous Galerkin (DG) discretizations of partial differential equations are coupled with explicit time integration methods. Unfortunately, for many problems this can result in severe…

Numerical Analysis · Mathematics 2019-06-03 J. J. W. van der Vegt , Yinhua Xia , Yan Xu

We propose an arbitrarily higher (even) order implicit leapfrog scheme for time discretization of a three-field formulation of Maxwell's equations. We use this in conjunction with an arbitrarily higher-order and compatible discretization…

Numerical Analysis · Mathematics 2026-02-09 Archana Arya , Kaushik Kalyanaraman

Many time-dependent partial differential equations (PDEs) can be transformed into an ordinary differential equations (ODEs) containing moderately stiff and non-stiff terms after spatial semi-discretization. In the present paper, we…

Numerical Analysis · Mathematics 2025-09-23 Xiao Tang , Junwei Huang

Time integration methods for solving initial value problems are an important component of many scientific and engineering simulations. Implicit time integrators are desirable for their stability properties, significantly relaxing…

Numerical Analysis · Mathematics 2020-11-24 Ross Glandon , Mahesh Narayanamurthi , Adrian Sandu

For time integration of transient eddy current problems commonly implicit time integration methods are used, where in every time step one or several nonlinear systems of equations have to be linearized with the Newton-Raphson method due to…

Computational Engineering, Finance, and Science · Computer Science 2017-09-26 Jennifer Dutiné , Markus Clemens , Sebastian Schöps , Georg Wimmer

The multiplicative Newton-like method developed by the author et al. is extended to the situation where the dynamics is restricted to the orthogonal group. A general framework is constructed without specifying the cost function. Though the…

Machine Learning · Computer Science 2007-05-23 Toshinao Akuzawa

We propose a numerical integrator for determining low-rank approximations to solutions of large-scale matrix differential equations. The considered differential equations are semilinear and stiff. Our method consists of first splitting the…

Numerical Analysis · Mathematics 2019-06-03 Alexander Ostermann , Chiara Piazzola , Hanna Walach

Linear programming relaxations are central to {\sc map} inference in discrete Markov Random Fields. The ability to properly solve the Lagrangian dual is a critical component of such methods. In this paper, we study the benefit of using…

Computer Vision and Pattern Recognition · Computer Science 2017-09-06 Hariprasad Kannan , Nikos Komodakis , Nikos Paragios

In this paper, we study the equality constrained nonlinear least squares problem, where the Jacobian matrices of the objective function and constraints are unavailable or expensive to compute. We approximate the Jacobian matrices via…

Optimization and Control · Mathematics 2025-07-09 Xi Chen , Jinyan Fan

Exponential Runge--Kutta methods have shown to be competitive for the time integration of stiff semilinear parabolic PDEs. The current construction of stiffly accurate exponential Runge--Kutta methods, however, relies on a convergence…

Numerical Analysis · Mathematics 2020-09-29 Vu Thai Luan

Considered herein is a modified Newton method for the numerical solution of nonlinear equations where the Jacobian is approximated using a complex-step derivative approximation. We show that this method converges for sufficiently small…

Numerical Analysis · Mathematics 2024-10-03 Dimitrios Mitsotakis

In this paper, two new families of fourth-order explicit exponential Runge--Kutta (ERK) methods with four stages are studied for solving first-order differential systems $y'(t)+My(t)=f(y(t))$. By comparing the Taylor series of the exact…

Numerical Analysis · Mathematics 2024-06-19 Xianfa Hu , Yonglei Fang , Bin Wang

We consider the construction of semi-implicit linear multistep methods which can be applied to time dependent PDEs where the separation of scales in additive form, typically used in implicit-explicit (IMEX) methods, is not possible. As…

Numerical Analysis · Mathematics 2020-01-14 Giacomo Albi , Lorenzo Pareschi

A single-step high-order implicit time integration scheme for the solution of transient and wave propagation problems is presented. It is constructed from the Pad\'e expansions of the matrix exponential solution of a system of first-order…

Numerical Analysis · Mathematics 2022-06-10 Chongmin Song , Sascha Eisenträger