English
Related papers

Related papers: Implicit Probabilistic Integrators for ODEs

200 papers

We show that symplectic and linearly-implicit integrators proposed by [Zhang and Skeel, 1997] are variational linearizations of Newmark methods. When used in conjunction with penalty methods (i.e., methods that replace constraints by stiff…

Numerical Analysis · Mathematics 2014-12-08 Molei Tao , Houman Owhadi

Linear programming (LP) is an extremely useful tool which has been successfully applied to solve various problems in a wide range of areas, including operations research, engineering, economics, or even more abstract mathematical areas such…

Data Structures and Algorithms · Computer Science 2022-09-26 Agniva Chowdhury , Gregory Dexter , Palma London , Haim Avron , Petros Drineas

Prompt learning methods have significantly extended the transferability of pre-trained Vision-Language Models (VLMs) like CLIP for various downstream tasks. These methods adopt handcraft templates or learnable vectors to provide text or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Jiahui Wang , Qin Xu , Bo Jiang , Bin Luo

We present a multiscale integrator for Hamiltonian systems with slowly varying quadratic stiff potentials that uses coarse timesteps (analogous to what the impulse method uses for constant quadratic stiff potentials). This method is based…

Numerical Analysis · Mathematics 2011-04-14 Molei Tao , Houman Owhadi , Jerrold E. Marsden

Stiff ordinary differential equations (ODEs) are common in many science and engineering fields, but standard neural ODE approaches struggle to accurately learn these stiff systems, posing a significant barrier to widespread adoption of…

Numerical Analysis · Mathematics 2024-12-03 Colby Fronk , Linda Petzold

Symplectic integration algorithms have become popular in recent years in long-term orbital integrations because these algorithms enforce certain conservation laws that are intrinsic to Hamiltonian systems. For problems with large variations…

Astrophysics · Physics 2007-05-23 Man Hoi Lee , Martin J. Duncan , Harold F. Levison

Inference metaprogramming enables effective probabilistic programming by supporting the decomposition of executions of probabilistic programs into subproblems and the deployment of hybrid probabilistic inference algorithms that apply…

Programming Languages · Computer Science 2019-07-16 Shivam Handa , Vikash Mansinghka , Martin Rinard

Viewing optimization methods as numerical integrators for ordinary differential equations (ODEs) provides a thought-provoking modern framework for studying accelerated first-order optimizers. In this literature, acceleration is often…

Optimization and Control · Mathematics 2021-02-24 Peiyuan Zhang , Antonio Orvieto , Hadi Daneshmand , Thomas Hofmann , Roy Smith

We propose two new classes of time integrators for stiff DEs: the implicit-explicit exponential (IMEXP) and the hybrid exponential methods. In contrast to the existing exponential schemes, the new methods offer significant computational…

Numerical Analysis · Mathematics 2016-05-11 Vu Thai Luan , Mayya Tokman , Greg Rainwater

Stiff systems of ordinary differential equations (ODEs) arise in a wide range of scientific and engineering disciplines and are traditionally solved using implicit integration methods due to their stability and efficiency. However, these…

Numerical Analysis · Mathematics 2024-12-02 Colby Fronk , Linda Petzold

With the immense computing power at our disposal, the numerical solution of partial differential equations (PDEs) is becoming a day-to-day task for modern computational scientists. However, the complexity of real-life problems is such that…

Numerical Analysis · Mathematics 2022-04-05 Mitja Jančič , Filip Strniša , Gregor Kosec

In this paper we use a Variational Quantum Algorithm to solve Initial Value Problems with the Implicit Crank-Nicolson and the Method of Lines (MoL) evolution schemes. The unknown functions use a spectral decomposition with the Fourier…

Quantum Physics · Physics 2024-10-17 Francisco Guzman-Cajica , Francisco S. Guzman

In order to solve an initial value problem by the variational iteration method, a sequence of functions is produced which converges to the solution under some suitable conditions. In the nonlinear case, after a few iterations the terms of…

Numerical Analysis · Mathematics 2016-06-23 Davod Khojasteh Salkuyeh , Ali Tavakoli

In simulation-based inferences for partially observed Markov process models (POMP), the by-product of the Monte Carlo filtering is an approximation of the log likelihood function. Recently, iterated filtering [14, 13] has originally been…

Methodology · Statistics 2018-02-26 Dao Nguyen

Incremental methods are widely utilized for solving finite-sum optimization problems in machine learning and signal processing. In this paper, we study a family of incremental methods -- including incremental subgradient, incremental…

Optimization and Control · Mathematics 2022-12-26 Xiao Li , Zhihui Zhu , Anthony Man-Cho So , Jason D Lee

We construct integrators to be used in Hamiltonian (or Hybrid) Monte Carlo sampling. The new integrators are easily implementable and, for a given computational budget, may deliver five times as many accepted proposals as standard…

Numerical Analysis · Mathematics 2021-06-25 S. Blanes , M. P. Calvo , F. Casas , J. M. Sanz-Serna

Additive regression models have a long history in multivariate nonparametric regression. They provide a model in which each regression function depends only on a single explanatory variable allowing to obtain estimators at the optimal…

Methodology · Statistics 2015-09-16 Graciela Boente , Alejandra Martinez

This article considers Hamiltonian mechanical systems with potential functions admitting jump discontinuities. The focus is on accurate and efficient numerical approximations of their solutions, which will be defined via the laws of…

Numerical Analysis · Mathematics 2022-01-05 Molei Tao , Shi Jin

In this article we introduce a low order implicit symplectic integrator designed to follow the Hamiltonian flow as close as possible. This integrator is obtained by the method of Liouvillian forms and does not require particular hypotheses…

Symplectic Geometry · Mathematics 2020-11-04 Hugo Jiménez-Pérez

Fast and accurate solution of time-dependent partial differential equations (PDEs) is of key interest in many research fields including physics, engineering, and biology. Generally, implicit schemes are preferred over the explicit ones for…

Numerical Analysis · Mathematics 2019-11-28 Suprosanna Shit , Abinav Ravi Venkatakrishnan , Ivan Ezhov , Jana Lipkova , Marie Piraud , Bjoern Menze