English
Related papers

Related papers: Sub-ODEs Simplify Taylor Series Algorithms for Ord…

200 papers

In this paper, we propose a third-order Newton's method which in each iteration solves a semidefinite program as a subproblem. Our approach is based on moving to the local minimum of the third-order Taylor expansion at each iteration,…

Optimization and Control · Mathematics 2023-06-08 Olha Silina , Jeffrey Zhang

This paper investigates the semi-discrete optimal transport (OT) problem with entropic regularization. We characterize the solution using a governing, well-posed ordinary differential equation (ODE). This naturally yields an algorithm to…

Numerical Analysis · Mathematics 2025-04-07 Luca Nenna , Daniyar Omarov , Brendan Pass

A common machine learning task is to discriminate between normal and anomalous data points. In practice, it is not always sufficient to reach high accuracy at this task, one also would like to understand why a given data point has been…

Machine Learning · Statistics 2020-01-23 Jacob Kauffmann , Klaus-Robert Müller , Grégoire Montavon

This paper discusses the upwinded local discontinuous Galerkin methods for the one-term/multi-term fractional ordinary differential equations (FODEs). The natural upwind choice of the numerical fluxes for the initial value problem for FODEs…

Numerical Analysis · Mathematics 2015-12-18 Weihua Deng , Jan S. Hesthaven

Classical convergence theory of Runge-Kutta methods assumes that the time step is small relative to the Lipschitz constant of the ordinary differential equation (ODE). For stiff problems, that assumption is often violated, and a problematic…

Numerical Analysis · Mathematics 2026-05-05 Steven B. Roberts , David Shirokoff , Abhijit Biswas , Benjamin Seibold

To combine a feedforward neural network (FNN) and Lie group (symmetry) theory of differential equations (DEs), an alternative artificial NN approach is proposed to solve the initial value problems (IVPs) of ordinary DEs (ODEs). Introducing…

Numerical Analysis · Mathematics 2022-05-04 Ying Wen , Temuer Chaolu , Xiangsheng Wang

Natural laws are often described through differential equations yet finding a differential equation that describes the governing law underlying observed data is a challenging and still mostly manual task. In this paper we make a step…

Machine Learning · Computer Science 2022-11-08 Sören Becker , Michal Klein , Alexander Neitz , Giambattista Parascandolo , Niki Kilbertus

This paper proposes and analyzes a new operator splitting method for stochastic Maxwell equations driven by additive noise, which not only decomposes the original multi-dimensional system into some local one-dimensional subsystems, but also…

Numerical Analysis · Mathematics 2021-02-23 Chuchu Chen , Jialin Hong , Lihai Ji

The derivation of second-order ordinary differential equations (ODEs) as continuous-time limits of optimization algorithms has been shown to be an effective tool for the analysis of these algorithms. Additionally, discretizing…

Optimization and Control · Mathematics 2019-08-29 Rachel Walker , Emily Zhang

A seventh order ordinary differential equation (ODE) arising by reduction of the Drinfeld-Sokolov hierarchyis shown to be identical to a similarity reduction of an equationin the hierarchy of Sawada-Kotera.We also exhibit its link with a…

Exactly Solvable and Integrable Systems · Physics 2024-05-22 R. Conte

Viewing optimization methods as numerical integrators for ordinary differential equations (ODEs) provides a thought-provoking modern framework for studying accelerated first-order optimizers. In this literature, acceleration is often…

Optimization and Control · Mathematics 2021-02-24 Peiyuan Zhang , Antonio Orvieto , Hadi Daneshmand , Thomas Hofmann , Roy Smith

The class of functions from the integers to the integers computable in polynomial time has been characterized recently using discrete ordinary differential equations (ODE), also known as finite differences. In the framework of ordinary…

Computational Complexity · Computer Science 2022-11-17 Manon Blanc , Olivier Bournez

The paper presents a general strategy to solve ordinary differential equations (ODE), where some coefficient depend on the spatial variable and on additional random variables. The approach is based on the application of a recently developed…

Numerical Analysis · Mathematics 2019-07-17 Maximilian Bochmann , Lutz Kämmerer , Daniel Potts

The article presents a matrix differential operator and a pseudoinverse matrix differential operator for finding a particular solution to nonhomogeneous linear ordinary differential equations (ODE) with constant coefficients with special…

General Mathematics · Mathematics 2021-01-07 Jozef Fecenko

Differential equations parameterized by neural networks become expensive to solve numerically as training progresses. We propose a remedy that encourages learned dynamics to be easier to solve. Specifically, we introduce a differentiable…

Machine Learning · Computer Science 2020-10-26 Jacob Kelly , Jesse Bettencourt , Matthew James Johnson , David Duvenaud

We define a class of discrete operators acting on infinite, finite or periodic sequences mimicking the standard properties of pseudo-differential operators. In particular we can define the notion of order and regularity, and we recover the…

Analysis of PDEs · Mathematics 2021-10-01 Erwan Faou , Benoît Grébert

We propose a fast proximal Newton-type algorithm for minimizing regularized finite sums that returns an $\epsilon$-suboptimal point in $\tilde{\mathcal{O}}(d(n + \sqrt{\kappa d})\log(\frac{1}{\epsilon}))$ FLOPS, where $n$ is number of…

Machine Learning · Computer Science 2017-08-30 Xuanqing Liu , Cho-Jui Hsieh , Jason D. Lee , Yuekai Sun

It is well known that the Euler method for a random ordinary differential equation $\mathrm{d}X_t/\mathrm{d}t = f(t, X_t, Y_t)$ driven by a stochastic process $\{Y_t\}_t$ with $\theta$-H\"older sample paths is estimated to be of strong…

Probability · Mathematics 2025-10-21 Peter E. Kloeden , Ricardo M. S. Rosa

The Butcher theory provides a powerful tool for analyzing order conditions of Runge-Kutta schemes for ordinary differential equations (ODEs); however, such a theory has not yet been well established for backward stochastic differential…

Numerical Analysis · Mathematics 2026-05-26 Shuixin Fang , Yue Qiu , Weidong Zhao

Quantum algorithms offer an exponential advantage with respect to the number of dependent variables for solving certain nonlinear ordinary differential equations (ODEs). These algorithms typically begin by transforming the original…

Quantum Physics · Physics 2025-12-09 Judd Katz , Gopikrishnan Muraleedharan , Abhijeet Alase