English
Related papers

Related papers: Fast derivatives of likelihood functionals for ODE…

200 papers

Computation methods for solving entropy-regularized reward optimization -- a class of problems widely used for fine-tuning generative models -- have advanced rapidly. Among those, Adjoint Matching (AM, Domingo-Enrich et al., 2025) has…

Machine Learning · Statistics 2026-02-17 Oswin So , Brian Karrer , Chuchu Fan , Ricky T. Q. Chen , Guan-Horng Liu

Ordinary differential equations (ODEs) are widely used to model biological, (bio-)chemical and technical processes. The parameters of these ODEs are often estimated from experimental data using ODE-constrained optimisation. This article…

Optimization and Control · Mathematics 2015-11-06 Anna Fiedler , Fabian J. Theis , Jan Hasenauer

This paper proposes new ANOVA-based approximations of functions and emulators of high-dimensional models using either available derivatives or local stochastic evaluations of such models. Our approach makes use of sensitivity indices to…

Statistics Theory · Mathematics 2025-03-18 Matieyendou Lamboni

Latent stochastic differential equation (SDE) models are important tools for the unsupervised discovery of dynamical systems from data, with applications ranging from engineering to neuroscience. In these complex domains, exact posterior…

Machine Learning · Computer Science 2025-11-25 Amber Hu , Henry Smith , Scott Linderman

We establish that nonconvex definable parametric optimization problems with possibly nonsmooth objectives, inequality constraints, conic constraint systems, and non-unique primal and dual solutions admit an adjoint state formula under a…

Optimization and Control · Mathematics 2026-04-23 Jérôme Bolte , Edouard Pauwels , Cheik Traoré

Neuroscientists fit morphologically and biophysically detailed neuron simulations to physiological data, often using evolutionary algorithms. However, such gradient-free approaches are computationally expensive, making convergence slow when…

Neurons and Cognition · Quantitative Biology 2024-07-23 Ilenna Simone Jones , Konrad Paul Kording

We consider the problem of making nonparametric inference in a class of multi-dimensional diffusions in divergence form, from low-frequency data. Statistical analysis in this setting is notoriously challenging due to the intractability of…

Methodology · Statistics 2025-01-23 Matteo Giordano , Sven Wang

This paper concerns the numerical procedure for solving hybrid optimal control problems with sliding modes. The proposed procedure has several features which distinguishes it from the other procedures for the problem. First of all a sliding…

Optimization and Control · Mathematics 2021-01-18 Radoslaw Pytlak , Damian Suski

Stochastic differential equation mixed-effects models (SDEMEMs) are flexible hierarchical models that are able to account for random variability inherent in the underlying time-dynamics, as well as the variability between experimental units…

Computation · Statistics 2021-01-22 Samuel Wiqvist , Andrew Golightly , Ashleigh T. McLean , Umberto Picchini

One of the popular measures of central tendency that provides better representation and interesting insights of the data compared to the other measures like mean and median is the metric mode. If the analytical form of the density function…

Machine Learning · Computer Science 2019-06-04 Chandramouli Kamanchi , Raghuram Bharadwaj Diddigi , Prabuchandran K. J. , Shalabh Bhatnagar

Debiased machine learning estimators for smooth functionals in nonparametric models can exhibit substantial variability and instability, often leading practitioners to instead rely on parametric or semiparametric working models. Such…

Methodology · Statistics 2026-03-20 Lars van der Laan , Marco Carone , Alex Luedtke , Mark van der Laan

Neural differential equations may be trained by backpropagating gradients via the adjoint method, which is another differential equation typically solved using an adaptive-step-size numerical differential equation solver. A proposed step is…

Machine Learning · Computer Science 2021-05-11 Patrick Kidger , Ricky T. Q. Chen , Terry Lyons

Many real-world dynamical systems can be described as State-Space Models (SSMs). In this formulation, each observation is emitted by a latent state, which follows first-order Markovian dynamics. A Probabilistic Deep SSM (ProDSSM)…

Machine Learning · Computer Science 2023-09-18 Andreas Look , Melih Kandemir , Barbara Rakitsch , Jan Peters

This work analyzes the sensitivities of the solution of a system of ordinary differential equations (ODEs) and a corresponding quantity of interest (QoI) to perturbations in a state-dependent component function that appears in the governing…

Optimization and Control · Mathematics 2025-10-13 Jonathan R. Cangelosi , Matthias Heinkenschloss

In this paper, we propose a flexible model for survival analysis using neural networks along with scalable optimization algorithms. One key technical challenge for directly applying maximum likelihood estimation (MLE) to censored data is…

Machine Learning · Statistics 2021-12-07 Weijing Tang , Jiaqi Ma , Qiaozhu Mei , Ji Zhu

Inverse problem or parameter estimation of ordinary differential equations (ODEs), the iterative process of minimizing the mismatch between model-predicted and experimental states by tuning the parameter values within an optimization…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Siddharth Prabhu , Srinivas Rangarajan , Mayuresh Kothare

When the nonconvex problem is complicated by stochasticity, the sample complexity of stochastic first-order methods may depend linearly on the problem dimension, which is undesirable for large-scale problems. In this work, we propose…

Optimization and Control · Mathematics 2024-10-01 Yue Xie , Jiawen Bi , Hongcheng Liu

Data-driven modeling of dynamical systems is a crucial area of machine learning. In many scenarios, a thorough understanding of the model's behavior becomes essential for practical applications. For instance, understanding the behavior of a…

Machine Learning · Computer Science 2025-04-14 Krzysztof Kacprzyk , Mihaela van der Schaar

Effectively modeling phenomena present in highly nonlinear dynamical systems whilst also accurately quantifying uncertainty is a challenging task, which often requires problem-specific techniques. We present a novel, domain-agnostic…

Machine Learning · Statistics 2021-10-26 Thomas M. McDonald , Mauricio A. Álvarez

In sparse estimation, such as fused lasso and convex clustering, we apply either the proximal gradient method or the alternating direction method of multipliers (ADMM) to solve the problem. It takes time to include matrix division in the…

Optimization and Control · Mathematics 2022-03-29 Ryosuke Shimmura , Joe Suzuki