English
Related papers

Related papers: Implicit Probabilistic Integrators for ODEs

200 papers

Likelihood-free (a.k.a. simulation-based) inference problems are inverse problems with expensive, or intractable, forward models. ODE inverse problems are commonly treated as likelihood-free, as their forward map has to be numerically…

Machine Learning · Statistics 2020-07-01 Hans Kersting , Nicholas Krämer , Martin Schiegg , Christian Daniel , Michael Tiemann , Philipp Hennig

Iterative regularization exploits the implicit bias of an optimization algorithm to regularize ill-posed problems. Constructing algorithms with such built-in regularization mechanisms is a classic challenge in inverse problems but also in…

Optimization and Control · Mathematics 2022-02-02 Cesare Molinari , Mathurin Massias , Lorenzo Rosasco , Silvia Villa

The optimization problems associated with training generative adversarial neural networks can be largely reduced to certain {\em non-monotone} variational inequality problems (VIPs), whereas existing convergence results are mostly based on…

Optimization and Control · Mathematics 2021-03-09 Chaobing Song , Zhengyuan Zhou , Yichao Zhou , Yong Jiang , Yi Ma

The work of Wachter and Biegler suggests that infeasible-start interior point methods (IPMs) developed for linear programming cannot be adapted to nonlinear optimization without significant modification, i.e., using a two-phase or penalty…

Optimization and Control · Mathematics 2018-01-12 Oliver Hinder , Yinyu Ye

We propose new primal-dual decomposition algorithms for solving systems of inclusions involving sums of linearly composed maximally monotone operators. The principal innovation in these algorithms is that they are block-iterative in the…

Optimization and Control · Mathematics 2015-11-30 Patrick L. Combettes , Jonathan Eckstein

We propose and analyse a numerical integrator that computes a low-rank approximation to large time-dependent matrices that are either given explicitly via their increments or are the unknown solution to a matrix differential equation.…

Numerical Analysis · Mathematics 2020-10-06 Gianluca Ceruti , Christian Lubich

Inferring the parameters of ordinary differential equations (ODEs) from noisy observations is an important problem in many scientific fields. Currently, most parameter estimation methods that bypass numerical integration tend to rely on…

Methodology · Statistics 2023-10-25 Mingwei Xu , Samuel W. K. Wong , Peijun Sang

Monotone inclusions have a wide range of applications, including minimization, saddle-point, and equilibria problems. We introduce new stochastic algorithms, with or without variance reduction, to estimate a root of the expectation of…

Optimization and Control · Mathematics 2024-05-24 Abdurakhmon Sadiev , Laurent Condat , Peter Richtárik

In this paper, we develop a new type of accelerated algorithms to solve some classes of maximally monotone equations as well as monotone inclusions. Instead of using Nesterov's accelerating approach, our methods rely on a so-called…

Optimization and Control · Mathematics 2021-12-08 Quoc Tran-Dinh , Yang Luo

The light damping hypothesis is usually assumed in structural dynamics since dissipative forces are in general weak with respect to inertial and elastic forces. In this paper a novel numerical method of time integration based on the…

Numerical Analysis · Mathematics 2025-04-01 Mario Lázaro

Walley's Imprecise Dirichlet Model (IDM) for categorical i.i.d. data extends the classical Dirichlet model to a set of priors. It overcomes several fundamental problems which other approaches to uncertainty suffer from. Yet, to be useful in…

Statistics Theory · Mathematics 2009-12-30 Marcus Hutter

Variational integrators are derived for structure-preserving simulation of stochastic Hamiltonian systems with a certain type of multiplicative noise arising in geometric mechanics. The derivation is based on a stochastic discrete…

Numerical Analysis · Mathematics 2019-07-31 Darryl D. Holm , Tomasz M. Tyranowski

Estimating the parameters of ordinary differential equations (ODEs) is of fundamental importance in many scientific applications. While ODEs are typically approximated with deterministic algorithms, new research on probabilistic solvers…

Machine Learning · Statistics 2023-12-08 Mohan Wu , Martin Lysy

Inverse problems arise in situations where data is available, but the underlying model is not. It can therefore be necessary to infer the parameters of the latter starting from the former. Statistical mechanics offers a toolbox of…

Statistical Mechanics · Physics 2025-07-04 Stefano Bae , Dario Bocchi , Luca Maria Del Bono , Luca Leuzzi

Splitting methods are widely used for solving initial value problems (IVPs) due to their ability to simplify complicated evolutions into more manageable subproblems which can be solved efficiently and accurately. Traditionally, these…

Numerical Analysis · Mathematics 2024-11-15 L. M. Kreusser , H. E. Lockyer , E. H. Müller , P. Singh

We consider the problem of parameter estimation from a generalized linear model with a random design matrix that is orthogonally invariant in law. Such a model allows the design have an arbitrary distribution of singular values and only…

Statistics Theory · Mathematics 2026-02-11 Yihan Zhang , Hong Chang Ji , Ramji Venkataramanan , Marco Mondelli

The Asymptotic Iteration Method (AIM) is a technique for solving analytically and approximately the linear second-order differential equation, especially the eigenvalue problems that frequently appear in theoretical and mathematical…

Mathematical Physics · Physics 2020-03-17 Mourad E. H. Ismail , Nasser Saad

We propose a simple interpolation-based method for the efficient approximation of gradients in neural ODE models. We compare it with the reverse dynamic method (known in the literature as "adjoint method") to train neural ODEs on…

Neural and Evolutionary Computing · Computer Science 2020-11-03 Talgat Daulbaev , Alexandr Katrutsa , Larisa Markeeva , Julia Gusak , Andrzej Cichocki , Ivan Oseledets

We consider an inertial primal-dual fixed point algorithm (IPDFP) to compute the minimizations of the following Problem (1.1). This is a full splitting approach, in the sense that the nonsmooth functions are processed individually via their…

Optimization and Control · Mathematics 2016-04-20 Meng Wen , Yu-Chao Tang , Jigen Peng

In many applications, one needs to learn a dynamical system from its solutions sampled at a finite number of time points. The learning problem is often formulated as an optimization problem over a chosen function class. However, in the…

Numerical Analysis · Mathematics 2026-04-24 Bing-Ze Lu , Richard Tsai